Jun 10 16:44:40.351917 ip-10-0-143-240 systemd[1]: Starting Kubernetes Kubelet... Jun 10 16:44:40.776827 ip-10-0-143-240 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 16:44:40.776827 ip-10-0-143-240 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 10 16:44:40.776827 ip-10-0-143-240 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 16:44:40.776827 ip-10-0-143-240 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 10 16:44:40.776827 ip-10-0-143-240 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 16:44:40.777815 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.777734 2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 10 16:44:40.783772 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783756 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 16:44:40.783772 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783771 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 16:44:40.783838 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783775 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 16:44:40.783838 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783778 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 16:44:40.783838 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783781 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 16:44:40.783838 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783784 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 16:44:40.783838 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783787 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 16:44:40.783838 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783789 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 16:44:40.783838 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783794 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 16:44:40.783838 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783798 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 16:44:40.783838 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783801 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 16:44:40.783838 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783803 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 16:44:40.783838 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783806 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 16:44:40.783838 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783809 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 16:44:40.783838 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783811 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 16:44:40.783838 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783814 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 16:44:40.783838 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783817 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 16:44:40.783838 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783819 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 16:44:40.783838 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783823 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 16:44:40.783838 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783826 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 16:44:40.783838 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783828 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 16:44:40.784332 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783830 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 16:44:40.784332 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783833 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 16:44:40.784332 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783835 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 16:44:40.784332 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783837 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 16:44:40.784332 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783840 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 16:44:40.784332 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783843 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 16:44:40.784332 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783846 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 16:44:40.784332 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783848 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 16:44:40.784332 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783851 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 16:44:40.784332 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783854 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 16:44:40.784332 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783856 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 16:44:40.784332 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783859 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 16:44:40.784332 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783861 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 16:44:40.784332 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783863 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 16:44:40.784332 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783866 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 16:44:40.784332 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783868 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 16:44:40.784332 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783871 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 16:44:40.784332 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783873 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 16:44:40.784332 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783875 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 16:44:40.784332 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783878 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 16:44:40.784841 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783880 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 16:44:40.784841 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783882 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 16:44:40.784841 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783885 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 16:44:40.784841 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783889 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 16:44:40.784841 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783892 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 16:44:40.784841 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783895 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 16:44:40.784841 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783898 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 16:44:40.784841 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783901 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 16:44:40.784841 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783904 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 16:44:40.784841 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783906 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 16:44:40.784841 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783909 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 16:44:40.784841 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783912 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 16:44:40.784841 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783914 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 16:44:40.784841 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783918 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 16:44:40.784841 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783920 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 16:44:40.784841 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783923 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 16:44:40.784841 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783926 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 16:44:40.784841 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783928 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 16:44:40.784841 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783930 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 16:44:40.784841 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783933 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 16:44:40.785404 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783935 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 16:44:40.785404 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783938 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 16:44:40.785404 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783941 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 16:44:40.785404 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783943 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 16:44:40.785404 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783946 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 16:44:40.785404 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783948 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 16:44:40.785404 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783950 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 16:44:40.785404 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783953 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 16:44:40.785404 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783955 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 16:44:40.785404 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783959 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 16:44:40.785404 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783962 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 16:44:40.785404 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783965 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 16:44:40.785404 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783968 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 16:44:40.785404 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783971 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 16:44:40.785404 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783974 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 16:44:40.785404 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783976 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 16:44:40.785404 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783979 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 16:44:40.785404 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783981 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 16:44:40.785404 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783983 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 16:44:40.786210 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783986 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 16:44:40.786210 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783989 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 16:44:40.786210 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783991 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 16:44:40.786210 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783993 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 16:44:40.786210 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.783997 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 16:44:40.786210 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784000 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 16:44:40.786210 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784004 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 16:44:40.786210 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784007 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 16:44:40.786210 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784010 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 16:44:40.786210 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784013 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 16:44:40.786210 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784015 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 16:44:40.786210 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784017 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 16:44:40.786210 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784020 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 16:44:40.786210 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784022 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 16:44:40.786210 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784025 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 16:44:40.786210 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784027 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 10 16:44:40.786210 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784030 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 16:44:40.786210 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784032 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 16:44:40.786210 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784035 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 16:44:40.786210 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784783 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 16:44:40.786906 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784791 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 16:44:40.786906 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784794 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 16:44:40.786906 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784797 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 16:44:40.786906 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784800 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 16:44:40.786906 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784802 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 16:44:40.786906 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784805 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 16:44:40.786906 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784808 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 16:44:40.786906 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784811 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 16:44:40.786906 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784813 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 16:44:40.786906 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784816 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 16:44:40.786906 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784818 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 16:44:40.786906 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784821 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 16:44:40.786906 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784823 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 16:44:40.786906 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784826 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 16:44:40.786906 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784828 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 16:44:40.786906 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784831 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 16:44:40.786906 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784833 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 16:44:40.786906 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784841 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 16:44:40.786906 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784845 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 16:44:40.786906 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784847 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 16:44:40.787526 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784851 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 16:44:40.787526 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784854 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 16:44:40.787526 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784856 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 16:44:40.787526 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784859 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 16:44:40.787526 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784861 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 16:44:40.787526 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784864 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 16:44:40.787526 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784866 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 16:44:40.787526 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784869 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 16:44:40.787526 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784871 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 16:44:40.787526 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784874 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 16:44:40.787526 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784876 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 16:44:40.787526 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784878 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 16:44:40.787526 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784881 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 16:44:40.787526 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784883 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 16:44:40.787526 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784886 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 16:44:40.787526 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784888 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 16:44:40.787526 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784891 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 16:44:40.787526 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784893 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 16:44:40.787526 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784896 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 16:44:40.787526 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784898 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 16:44:40.788038 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784900 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 16:44:40.788038 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784914 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 16:44:40.788038 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784917 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 16:44:40.788038 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784920 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 16:44:40.788038 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784923 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 16:44:40.788038 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784925 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 16:44:40.788038 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784928 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 16:44:40.788038 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784931 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 16:44:40.788038 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784933 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 16:44:40.788038 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784936 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 16:44:40.788038 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784940 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 16:44:40.788038 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784943 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 16:44:40.788038 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784946 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 16:44:40.788038 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784949 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 16:44:40.788038 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784952 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 16:44:40.788038 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784954 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 16:44:40.788038 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784956 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 16:44:40.788038 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784959 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 16:44:40.788038 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784961 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 16:44:40.788038 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784964 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 16:44:40.788535 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784966 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 16:44:40.788535 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784969 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 16:44:40.788535 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784971 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 16:44:40.788535 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784974 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 16:44:40.788535 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784976 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 16:44:40.788535 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784979 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 16:44:40.788535 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784981 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 16:44:40.788535 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784983 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 16:44:40.788535 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784986 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 16:44:40.788535 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784990 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 16:44:40.788535 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784993 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 16:44:40.788535 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.784998 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 16:44:40.788535 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.785001 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 16:44:40.788535 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.785004 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 16:44:40.788535 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.785007 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 16:44:40.788535 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.785009 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 16:44:40.788535 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.785013 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 16:44:40.788535 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.785016 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 16:44:40.789004 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.785019 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 16:44:40.789004 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.785022 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 16:44:40.789004 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.785025 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 16:44:40.789004 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.785028 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 16:44:40.789004 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.785031 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 16:44:40.789004 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.785034 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 16:44:40.789004 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.785036 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 16:44:40.789004 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.785039 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 16:44:40.789004 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.785042 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 10 16:44:40.789004 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.785044 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 16:44:40.789004 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.785046 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 16:44:40.789004 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.785049 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 16:44:40.789004 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.785051 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 16:44:40.789004 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.785054 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 16:44:40.789004 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.785056 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 16:44:40.789004 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.785059 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 16:44:40.789004 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.785061 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 16:44:40.789004 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.785064 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 16:44:40.789004 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.785066 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 16:44:40.789004 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.785069 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 16:44:40.789475 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.786748 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 16:44:40.789475 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.786767 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 16:44:40.789475 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.786771 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 16:44:40.789475 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.786774 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 16:44:40.789475 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.786779 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 16:44:40.789475 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.786787 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 16:44:40.789475 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.786790 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 16:44:40.789475 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.786793 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 16:44:40.789475 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.786818 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 16:44:40.789475 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.786821 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 16:44:40.789475 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.786838 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 16:44:40.789475 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.786841 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 16:44:40.789475 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.786967 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 16:44:40.789475 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.786973 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 16:44:40.789475 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.786976 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 16:44:40.789475 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.786979 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 16:44:40.789475 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.786982 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 16:44:40.789475 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.786986 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 16:44:40.789475 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.786988 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 16:44:40.789974 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.786991 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 16:44:40.789974 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.786994 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 16:44:40.789974 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.786997 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 16:44:40.789974 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.786999 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 16:44:40.789974 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787002 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 10 16:44:40.789974 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787004 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 16:44:40.789974 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787007 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 16:44:40.789974 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787010 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 16:44:40.789974 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787013 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 16:44:40.789974 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787015 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 16:44:40.789974 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787018 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 16:44:40.789974 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787020 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 16:44:40.789974 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787023 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 16:44:40.789974 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787026 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 16:44:40.789974 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787029 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 16:44:40.789974 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787032 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 16:44:40.789974 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787037 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 16:44:40.789974 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787042 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 16:44:40.789974 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787045 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 16:44:40.789974 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787049 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 16:44:40.790502 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787052 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 16:44:40.790502 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787055 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 16:44:40.790502 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787058 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 16:44:40.790502 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787065 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 16:44:40.790502 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787068 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 16:44:40.790502 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787070 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 16:44:40.790502 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787073 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 16:44:40.790502 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787075 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 16:44:40.790502 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787078 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 16:44:40.790502 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787081 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 16:44:40.790502 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787083 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 16:44:40.790502 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787086 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 16:44:40.790502 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787088 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 16:44:40.790502 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787091 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 16:44:40.790502 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787093 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 16:44:40.790502 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787096 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 16:44:40.790502 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787099 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 16:44:40.790502 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787101 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 16:44:40.790502 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787104 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 16:44:40.790502 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787108 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 16:44:40.791000 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787110 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 16:44:40.791000 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787113 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 16:44:40.791000 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787115 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 16:44:40.791000 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787118 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 16:44:40.791000 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787121 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 16:44:40.791000 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787124 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 16:44:40.791000 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787127 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 16:44:40.791000 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787129 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 16:44:40.791000 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787132 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 16:44:40.791000 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787137 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 16:44:40.791000 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787141 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 16:44:40.791000 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787144 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 16:44:40.791000 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787147 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 16:44:40.791000 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787150 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 16:44:40.791000 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787152 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 16:44:40.791000 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787155 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 16:44:40.791000 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787157 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 16:44:40.791000 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787160 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 16:44:40.791000 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787162 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 16:44:40.791000 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787165 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 16:44:40.791480 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787168 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 16:44:40.791480 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787170 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 16:44:40.791480 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787173 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 16:44:40.791480 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787175 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 16:44:40.791480 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787178 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 16:44:40.791480 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787181 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 16:44:40.791480 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787183 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 16:44:40.791480 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787186 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 16:44:40.791480 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787188 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 16:44:40.791480 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787191 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 16:44:40.791480 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787193 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 16:44:40.791480 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787196 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 16:44:40.791480 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787199 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 16:44:40.791480 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787201 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 16:44:40.791480 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787204 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 16:44:40.791480 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787206 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 16:44:40.791480 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787209 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 16:44:40.791480 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787212 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 16:44:40.791480 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787214 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 16:44:40.791480 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787217 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 16:44:40.791978 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787288 2562 flags.go:64] FLAG: --address="0.0.0.0" Jun 10 16:44:40.791978 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787295 2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 10 16:44:40.791978 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787302 2562 flags.go:64] FLAG: --anonymous-auth="true" Jun 10 16:44:40.791978 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787306 2562 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 10 16:44:40.791978 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787310 2562 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 10 16:44:40.791978 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787314 2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 10 16:44:40.791978 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787321 2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 10 16:44:40.791978 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787326 2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 10 16:44:40.791978 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787329 2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 10 16:44:40.791978 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787332 2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 10 16:44:40.791978 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787335 2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 10 16:44:40.791978 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787339 2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 10 16:44:40.791978 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787342 2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 10 16:44:40.791978 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787345 2562 flags.go:64] FLAG: --cgroup-root="" Jun 10 16:44:40.791978 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787348 2562 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 10 16:44:40.791978 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787351 2562 flags.go:64] FLAG: --client-ca-file="" Jun 10 16:44:40.791978 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787354 2562 flags.go:64] FLAG: --cloud-provider="external" Jun 10 16:44:40.791978 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787357 2562 flags.go:64] FLAG: --cluster-dns="[]" Jun 10 16:44:40.791978 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787362 2562 flags.go:64] FLAG: --cluster-domain="" Jun 10 16:44:40.791978 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787365 2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 10 16:44:40.791978 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787368 2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 10 16:44:40.791978 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787371 2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 10 16:44:40.791978 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787374 2562 flags.go:64] FLAG: --container-log-max-files="5" Jun 10 16:44:40.791978 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787379 2562 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 10 16:44:40.792555 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787381 2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 10 16:44:40.792555 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787384 2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 10 16:44:40.792555 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787388 2562 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 10 16:44:40.792555 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787391 2562 flags.go:64] FLAG: --contention-profiling="false" Jun 10 16:44:40.792555 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787394 2562 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 10 16:44:40.792555 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787397 2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 10 16:44:40.792555 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787400 2562 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 10 16:44:40.792555 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787402 2562 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 10 16:44:40.792555 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787407 2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 10 16:44:40.792555 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787410 2562 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 10 16:44:40.792555 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787413 2562 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 10 16:44:40.792555 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787416 2562 flags.go:64] FLAG: --enable-load-reader="false" Jun 10 16:44:40.792555 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787418 2562 flags.go:64] FLAG: --enable-server="true" Jun 10 16:44:40.792555 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787421 2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 10 16:44:40.792555 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787427 2562 flags.go:64] FLAG: --event-burst="100" Jun 10 16:44:40.792555 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787430 2562 flags.go:64] FLAG: --event-qps="50" Jun 10 16:44:40.792555 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787433 2562 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 10 16:44:40.792555 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787436 2562 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 10 16:44:40.792555 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787439 2562 flags.go:64] FLAG: --eviction-hard="" Jun 10 16:44:40.792555 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787443 2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 10 16:44:40.792555 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787445 2562 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 10 16:44:40.792555 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787448 2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 10 16:44:40.792555 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787451 2562 flags.go:64] FLAG: --eviction-soft="" Jun 10 16:44:40.792555 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787454 2562 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 10 16:44:40.792555 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787457 2562 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 10 16:44:40.793197 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787460 2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 10 16:44:40.793197 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787463 2562 flags.go:64] FLAG: --experimental-mounter-path="" Jun 10 16:44:40.793197 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787466 2562 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 10 16:44:40.793197 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787469 2562 flags.go:64] FLAG: --fail-swap-on="true" Jun 10 16:44:40.793197 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787472 2562 flags.go:64] FLAG: --feature-gates="" Jun 10 16:44:40.793197 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787476 2562 flags.go:64] FLAG: --file-check-frequency="20s" Jun 10 16:44:40.793197 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787479 2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 10 16:44:40.793197 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787481 2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 10 16:44:40.793197 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787484 2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 10 16:44:40.793197 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787487 2562 flags.go:64] FLAG: --healthz-port="10248" Jun 10 16:44:40.793197 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787490 2562 flags.go:64] FLAG: --help="false" Jun 10 16:44:40.793197 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787493 2562 flags.go:64] FLAG: --hostname-override="ip-10-0-143-240.ec2.internal" Jun 10 16:44:40.793197 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787496 2562 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 10 16:44:40.793197 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787499 2562 flags.go:64] FLAG: --http-check-frequency="20s" Jun 10 16:44:40.793197 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787502 2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 10 16:44:40.793197 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787506 2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 10 16:44:40.793197 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787509 2562 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 10 16:44:40.793197 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787512 2562 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 10 16:44:40.793197 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787514 2562 flags.go:64] FLAG: --image-service-endpoint="" Jun 10 16:44:40.793197 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787517 2562 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 10 16:44:40.793197 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787520 2562 flags.go:64] FLAG: --kube-api-burst="100" Jun 10 16:44:40.793197 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787523 2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 10 16:44:40.793197 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787525 2562 flags.go:64] FLAG: --kube-api-qps="50" Jun 10 16:44:40.793197 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787528 2562 flags.go:64] FLAG: --kube-reserved="" Jun 10 16:44:40.793841 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787531 2562 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 10 16:44:40.793841 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787534 2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 10 16:44:40.793841 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787537 2562 flags.go:64] FLAG: --kubelet-cgroups="" Jun 10 16:44:40.793841 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787540 2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 10 16:44:40.793841 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787543 2562 flags.go:64] FLAG: --lock-file="" Jun 10 16:44:40.793841 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787545 2562 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 10 16:44:40.793841 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787552 2562 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 10 16:44:40.793841 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787555 2562 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 10 16:44:40.793841 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787560 2562 flags.go:64] FLAG: --log-json-split-stream="false" Jun 10 16:44:40.793841 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787563 2562 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 10 16:44:40.793841 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787566 2562 flags.go:64] FLAG: --log-text-split-stream="false" Jun 10 16:44:40.793841 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787569 2562 flags.go:64] FLAG: --logging-format="text" Jun 10 16:44:40.793841 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787572 2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 10 16:44:40.793841 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787576 2562 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 10 16:44:40.793841 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787579 2562 flags.go:64] FLAG: --manifest-url="" Jun 10 16:44:40.793841 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787581 2562 flags.go:64] FLAG: --manifest-url-header="" Jun 10 16:44:40.793841 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787591 2562 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 10 16:44:40.793841 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787594 2562 flags.go:64] FLAG: --max-open-files="1000000" Jun 10 16:44:40.793841 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787598 2562 flags.go:64] FLAG: --max-pods="110" Jun 10 16:44:40.793841 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787600 2562 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 10 16:44:40.793841 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787604 2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 10 16:44:40.793841 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787606 2562 flags.go:64] FLAG: --memory-manager-policy="None" Jun 10 16:44:40.793841 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787609 2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 10 16:44:40.793841 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787612 2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 10 16:44:40.793841 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787615 2562 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 10 16:44:40.794968 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787618 2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 10 16:44:40.794968 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787639 2562 flags.go:64] FLAG: --node-status-max-images="50" Jun 10 16:44:40.794968 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787642 2562 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 10 16:44:40.794968 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787645 2562 flags.go:64] FLAG: --oom-score-adj="-999" Jun 10 16:44:40.794968 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787648 2562 flags.go:64] FLAG: --pod-cidr="" Jun 10 16:44:40.794968 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787651 2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 10 16:44:40.794968 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787656 2562 flags.go:64] FLAG: --pod-manifest-path="" Jun 10 16:44:40.794968 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787659 2562 flags.go:64] FLAG: --pod-max-pids="-1" Jun 10 16:44:40.794968 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787662 2562 flags.go:64] FLAG: --pods-per-core="0" Jun 10 16:44:40.794968 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787664 2562 flags.go:64] FLAG: --port="10250" Jun 10 16:44:40.794968 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787667 2562 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 10 16:44:40.794968 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787670 2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0cca7405c5c77d820" Jun 10 16:44:40.794968 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787673 2562 flags.go:64] FLAG: --qos-reserved="" Jun 10 16:44:40.794968 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787678 2562 flags.go:64] FLAG: --read-only-port="10255" Jun 10 16:44:40.794968 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787680 2562 flags.go:64] FLAG: --register-node="true" Jun 10 16:44:40.794968 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787683 2562 flags.go:64] FLAG: --register-with-taints="" Jun 10 16:44:40.794968 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787687 2562 flags.go:64] FLAG: --registry-burst="10" Jun 10 16:44:40.794968 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787690 2562 flags.go:64] FLAG: --registry-qps="5" Jun 10 16:44:40.794968 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787693 2562 flags.go:64] FLAG: --reserved-cpus="" Jun 10 16:44:40.794968 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787695 2562 flags.go:64] FLAG: --reserved-memory="" Jun 10 16:44:40.794968 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787699 2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 10 16:44:40.794968 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787702 2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 10 16:44:40.794968 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787707 2562 flags.go:64] FLAG: --rotate-certificates="false" Jun 10 16:44:40.794968 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787710 2562 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 10 16:44:40.794968 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787713 2562 flags.go:64] FLAG: --runonce="false" Jun 10 16:44:40.796090 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787716 2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 10 16:44:40.796090 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787719 2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 10 16:44:40.796090 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787722 2562 flags.go:64] FLAG: --seccomp-default="false" Jun 10 16:44:40.796090 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787724 2562 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 10 16:44:40.796090 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787727 2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 10 16:44:40.796090 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787730 2562 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 10 16:44:40.796090 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787733 2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 10 16:44:40.796090 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787736 2562 flags.go:64] FLAG: --storage-driver-password="root" Jun 10 16:44:40.796090 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787739 2562 flags.go:64] FLAG: --storage-driver-secure="false" Jun 10 16:44:40.796090 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787742 2562 flags.go:64] FLAG: --storage-driver-table="stats" Jun 10 16:44:40.796090 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787745 2562 flags.go:64] FLAG: --storage-driver-user="root" Jun 10 16:44:40.796090 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787748 2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 10 16:44:40.796090 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787751 2562 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 10 16:44:40.796090 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787753 2562 flags.go:64] FLAG: --system-cgroups="" Jun 10 16:44:40.796090 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787756 2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 10 16:44:40.796090 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787762 2562 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 10 16:44:40.796090 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787765 2562 flags.go:64] FLAG: --tls-cert-file="" Jun 10 16:44:40.796090 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787767 2562 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 10 16:44:40.796090 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787771 2562 flags.go:64] FLAG: --tls-min-version="" Jun 10 16:44:40.796090 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787774 2562 flags.go:64] FLAG: --tls-private-key-file="" Jun 10 16:44:40.796090 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787778 2562 flags.go:64] FLAG: --topology-manager-policy="none" Jun 10 16:44:40.796090 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787780 2562 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 10 16:44:40.796090 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787783 2562 flags.go:64] FLAG: --topology-manager-scope="container" Jun 10 16:44:40.796090 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787786 2562 flags.go:64] FLAG: --v="2" Jun 10 16:44:40.796090 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787790 2562 flags.go:64] FLAG: --version="false" Jun 10 16:44:40.797161 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787794 2562 flags.go:64] FLAG: --vmodule="" Jun 10 16:44:40.797161 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787798 2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 10 16:44:40.797161 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.787801 2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 10 16:44:40.797161 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787923 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 16:44:40.797161 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787927 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 16:44:40.797161 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787930 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 16:44:40.797161 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787933 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 16:44:40.797161 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787936 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 16:44:40.797161 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787940 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 16:44:40.797161 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787943 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 16:44:40.797161 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787951 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 16:44:40.797161 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787954 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 16:44:40.797161 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787956 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 16:44:40.797161 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787959 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 16:44:40.797161 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787962 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 16:44:40.797161 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787964 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 16:44:40.797161 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787967 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 16:44:40.797161 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787969 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 16:44:40.797161 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787972 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 16:44:40.797161 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787975 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 16:44:40.797932 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787977 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 16:44:40.797932 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787979 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 16:44:40.797932 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787982 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 16:44:40.797932 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787985 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 16:44:40.797932 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787987 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 16:44:40.797932 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787990 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 16:44:40.797932 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787992 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 16:44:40.797932 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.787999 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 16:44:40.797932 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.788002 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 16:44:40.797932 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.788004 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 16:44:40.797932 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.788007 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 16:44:40.797932 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.788010 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 16:44:40.797932 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.788012 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 16:44:40.797932 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.788015 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 16:44:40.797932 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.788018 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 16:44:40.797932 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.788021 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 16:44:40.797932 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.788024 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 16:44:40.797932 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.788026 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 16:44:40.797932 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.788031 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 16:44:40.797932 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.788034 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 16:44:40.798553 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.788037 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 16:44:40.798553 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.788040 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 16:44:40.798553 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.788043 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 16:44:40.798553 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.788046 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 16:44:40.798553 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.788049 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 16:44:40.798553 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.788051 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 16:44:40.798553 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.788054 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 16:44:40.798553 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.788057 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 16:44:40.798553 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.788059 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 16:44:40.798553 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.788062 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 16:44:40.798553 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.788065 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 16:44:40.798553 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.788067 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 16:44:40.798553 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.788070 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 16:44:40.798553 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.788072 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 16:44:40.798553 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.788074 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 16:44:40.798553 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.788077 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 16:44:40.798553 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.788080 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 16:44:40.798553 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.788082 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 16:44:40.798553 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.788085 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 16:44:40.799251 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.788089 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 16:44:40.799251 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.788091 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 16:44:40.799251 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.788094 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 16:44:40.799251 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.788096 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 16:44:40.799251 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.788099 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 10 16:44:40.799251 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.788101 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 16:44:40.799251 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.788104 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 16:44:40.799251 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.788106 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 16:44:40.799251 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.788109 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 16:44:40.799251 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.788113 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 16:44:40.799251 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.788115 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 16:44:40.799251 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.788117 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 16:44:40.799251 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.788120 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 16:44:40.799251 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.788122 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 16:44:40.799251 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.788125 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 16:44:40.799251 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.788127 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 16:44:40.799251 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.788129 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 16:44:40.799251 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.788131 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 16:44:40.799251 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.788134 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 16:44:40.799251 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.788136 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 16:44:40.799864 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.788139 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 16:44:40.799864 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.788141 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 16:44:40.799864 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.788143 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 16:44:40.799864 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.788146 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 16:44:40.799864 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.788148 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 16:44:40.799864 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.788151 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 16:44:40.799864 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.788153 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 16:44:40.799864 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.788157 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 16:44:40.799864 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.788160 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 16:44:40.799864 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.788162 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 16:44:40.799864 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.788165 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 16:44:40.799864 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.788167 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 16:44:40.799864 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.788171 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 16:44:40.799864 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.788174 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 16:44:40.799864 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.788177 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 16:44:40.799864 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.788179 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 16:44:40.799864 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.788182 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 16:44:40.799864 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.788184 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 16:44:40.799864 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.788187 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 16:44:40.800666 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.788189 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 16:44:40.800666 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.788192 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 16:44:40.800666 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.788195 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 16:44:40.800666 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.788197 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 16:44:40.800666 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.788903 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 16:44:40.800666 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.796253 2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 10 16:44:40.800666 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.796271 2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 10 16:44:40.800666 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.796297 2562 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 10 16:44:40.800666 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.796307 2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 10 16:44:40.800666 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796384 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 16:44:40.800666 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796391 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 10 16:44:40.800666 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796396 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 16:44:40.800666 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796402 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 16:44:40.800666 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796406 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 16:44:40.800666 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796411 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 16:44:40.801080 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796416 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 16:44:40.801080 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796420 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 16:44:40.801080 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796425 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 16:44:40.801080 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796430 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 16:44:40.801080 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796434 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 16:44:40.801080 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796439 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 16:44:40.801080 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796444 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 16:44:40.801080 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796448 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 16:44:40.801080 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796452 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 16:44:40.801080 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796457 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 16:44:40.801080 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796461 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 16:44:40.801080 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796465 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 16:44:40.801080 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796470 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 16:44:40.801080 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796474 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 16:44:40.801080 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796478 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 16:44:40.801080 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796482 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 16:44:40.801080 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796486 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 16:44:40.801080 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796491 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 16:44:40.801080 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796495 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 16:44:40.801080 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796499 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 16:44:40.801561 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796503 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 16:44:40.801561 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796510 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 16:44:40.801561 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796515 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 16:44:40.801561 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796530 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 16:44:40.801561 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796535 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 16:44:40.801561 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796541 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 16:44:40.801561 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796546 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 16:44:40.801561 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796550 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 16:44:40.801561 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796555 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 16:44:40.801561 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796559 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 16:44:40.801561 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796563 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 16:44:40.801561 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796567 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 16:44:40.801561 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796571 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 16:44:40.801561 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796576 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 16:44:40.801561 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796580 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 16:44:40.801561 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796586 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 16:44:40.801561 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796592 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 16:44:40.801561 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796596 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 16:44:40.801561 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796603 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 16:44:40.802207 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796608 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 16:44:40.802207 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796613 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 16:44:40.802207 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796618 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 16:44:40.802207 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796622 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 16:44:40.802207 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796651 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 16:44:40.802207 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796655 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 16:44:40.802207 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796659 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 16:44:40.802207 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796663 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 16:44:40.802207 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796668 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 16:44:40.802207 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796672 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 16:44:40.802207 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796677 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 16:44:40.802207 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796681 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 16:44:40.802207 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796685 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 16:44:40.802207 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796689 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 16:44:40.802207 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796693 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 16:44:40.802207 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796698 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 16:44:40.802207 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796702 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 16:44:40.802207 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796708 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 16:44:40.802207 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796712 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 16:44:40.802207 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796716 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 16:44:40.802766 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796720 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 16:44:40.802766 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796725 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 16:44:40.802766 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796729 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 16:44:40.802766 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796733 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 16:44:40.802766 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796737 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 16:44:40.802766 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796742 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 16:44:40.802766 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796746 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 16:44:40.802766 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796750 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 16:44:40.802766 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796754 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 16:44:40.802766 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796758 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 16:44:40.802766 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796763 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 16:44:40.802766 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796767 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 16:44:40.802766 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796771 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 16:44:40.802766 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796775 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 16:44:40.802766 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796779 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 16:44:40.802766 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796783 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 16:44:40.802766 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796788 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 16:44:40.802766 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796792 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 16:44:40.802766 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796796 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 16:44:40.803215 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796801 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 16:44:40.803215 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796805 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 16:44:40.803215 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796809 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 16:44:40.803215 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796813 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 16:44:40.803215 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796817 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 16:44:40.803215 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796822 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 16:44:40.803215 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796826 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 16:44:40.803215 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796830 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 16:44:40.803215 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796834 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 16:44:40.803215 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796839 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 16:44:40.803215 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796843 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 16:44:40.803215 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796848 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 16:44:40.803215 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796852 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 16:44:40.803215 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796856 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 16:44:40.803215 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.796861 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 16:44:40.803647 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.796869 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 16:44:40.803647 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797043 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 16:44:40.803647 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797051 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 16:44:40.803647 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797058 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 16:44:40.803647 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797063 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 16:44:40.803647 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797068 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 16:44:40.803647 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797072 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 16:44:40.803647 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797077 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 16:44:40.803647 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797082 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 16:44:40.803647 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797087 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 16:44:40.803647 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797092 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 16:44:40.803647 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797097 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 16:44:40.803647 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797101 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 16:44:40.803647 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797105 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 16:44:40.803993 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797110 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 16:44:40.803993 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797114 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 16:44:40.803993 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797118 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 16:44:40.803993 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797123 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 16:44:40.803993 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797127 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 16:44:40.803993 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797132 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 16:44:40.803993 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797136 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 16:44:40.803993 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797140 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 16:44:40.803993 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797144 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 16:44:40.803993 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797149 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 16:44:40.803993 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797153 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 16:44:40.803993 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797157 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 16:44:40.803993 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797161 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 16:44:40.803993 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797165 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 16:44:40.803993 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797169 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 16:44:40.803993 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797174 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 16:44:40.803993 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797178 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 16:44:40.803993 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797182 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 16:44:40.803993 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797186 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 16:44:40.803993 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797190 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 16:44:40.804506 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797194 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 16:44:40.804506 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797199 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 16:44:40.804506 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797203 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 16:44:40.804506 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797207 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 16:44:40.804506 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797211 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 16:44:40.804506 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797215 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 16:44:40.804506 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797219 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 16:44:40.804506 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797224 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 16:44:40.804506 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797228 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 16:44:40.804506 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797232 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 16:44:40.804506 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797236 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 16:44:40.804506 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797240 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 16:44:40.804506 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797244 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 16:44:40.804506 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797248 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 10 16:44:40.804506 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797253 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 16:44:40.804506 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797257 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 16:44:40.804506 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797261 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 16:44:40.804506 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797265 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 16:44:40.804506 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797272 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 16:44:40.804985 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797277 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 16:44:40.804985 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797282 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 16:44:40.804985 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797287 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 16:44:40.804985 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797292 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 16:44:40.804985 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797296 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 16:44:40.804985 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797300 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 16:44:40.804985 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797305 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 16:44:40.804985 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797309 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 16:44:40.804985 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797313 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 16:44:40.804985 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797317 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 16:44:40.804985 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797322 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 16:44:40.804985 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797326 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 16:44:40.804985 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797330 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 16:44:40.804985 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797334 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 16:44:40.804985 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797338 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 16:44:40.804985 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797343 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 16:44:40.804985 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797347 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 16:44:40.804985 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797351 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 16:44:40.804985 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797355 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 16:44:40.804985 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797359 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 16:44:40.805472 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797363 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 16:44:40.805472 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797367 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 16:44:40.805472 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797371 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 16:44:40.805472 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797376 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 16:44:40.805472 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797380 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 16:44:40.805472 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797384 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 16:44:40.805472 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797388 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 16:44:40.805472 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797392 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 16:44:40.805472 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797396 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 16:44:40.805472 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797400 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 16:44:40.805472 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797404 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 16:44:40.805472 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797408 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 16:44:40.805472 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797412 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 16:44:40.805472 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797416 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 16:44:40.805472 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797423 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 16:44:40.805472 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797428 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 16:44:40.805472 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797433 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 16:44:40.805472 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797437 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 16:44:40.805472 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797441 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 16:44:40.805472 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797445 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 16:44:40.805964 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797450 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 16:44:40.805964 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797454 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 16:44:40.805964 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797459 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 16:44:40.805964 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797463 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 16:44:40.805964 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797467 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 16:44:40.805964 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797471 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 16:44:40.805964 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:40.797475 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 16:44:40.805964 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.797483 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 16:44:40.805964 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.797648 2562 server.go:962] "Client rotation is on, will bootstrap in background" Jun 10 16:44:40.805964 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.801938 2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 10 16:44:40.805964 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.803317 2562 server.go:1019] "Starting client certificate rotation" Jun 10 16:44:40.805964 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.803433 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 16:44:40.805964 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.803465 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 16:44:40.807027 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.807012 2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 16:44:40.814644 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.808195 2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 16:44:40.824425 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.824407 2562 log.go:25] "Validated CRI v1 runtime API" Jun 10 16:44:40.826844 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.826823 2562 log.go:25] "Validated CRI v1 image API" Jun 10 16:44:40.827701 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.827681 2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 10 16:44:40.830814 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.830794 2562 fs.go:135] Filesystem UUIDs: map[6f2e776c-7f88-49e2-b4de-294ade0c5567:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 92821ef3-8df5-425f-ad1e-ea104a4f1ea8:/dev/nvme0n1p3] Jun 10 16:44:40.830888 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.830812 2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 10 16:44:40.831537 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.831515 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 16:44:40.835967 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.835854 2562 manager.go:216] Machine: {Timestamp:2026-06-10 16:44:40.834456295 +0000 UTC m=+0.358669355 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099904 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec260de6eee362a2bfd5ed171be3436a SystemUUID:ec260de6-eee3-62a2-bfd5-ed171be3436a BootID:8d2559ad-c802-4215-9d57-a39f0657fc31 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:76:3b:e5:11:53 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:76:3b:e5:11:53 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fe:38:7a:23:2b:81 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 10 16:44:40.835967 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.835963 2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 10 16:44:40.836083 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.836046 2562 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 10 16:44:40.839688 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.839665 2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 10 16:44:40.839822 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.839691 2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-240.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 10 16:44:40.840418 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.840408 2562 topology_manager.go:138] "Creating topology manager with none policy" Jun 10 16:44:40.840449 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.840420 2562 container_manager_linux.go:309] "Creating device plugin manager" Jun 10 16:44:40.840449 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.840428 2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 16:44:40.841152 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.841141 2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 16:44:40.843256 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.843246 2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 10 16:44:40.845680 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.845669 2562 state_mem.go:36] "Initialized new in-memory state store" Jun 10 16:44:40.845817 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.845807 2562 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 10 16:44:40.845860 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.845837 2562 kubelet.go:486] "Attempting to sync node with API server" Jun 10 16:44:40.845860 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.845847 2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 10 16:44:40.845860 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.845857 2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 10 16:44:40.845970 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.845866 2562 kubelet.go:398] "Adding apiserver pod source" Jun 10 16:44:40.845970 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.845882 2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 10 16:44:40.846303 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.846290 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 16:44:40.846375 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.846318 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 16:44:40.851608 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.851588 2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 10 16:44:40.852950 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.852928 2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 10 16:44:40.853017 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.852976 2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 10 16:44:40.853959 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.853947 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 10 16:44:40.854019 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.853964 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 10 16:44:40.854019 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.853971 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 10 16:44:40.854019 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.853977 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 10 16:44:40.854019 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.853987 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 10 16:44:40.854019 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.853996 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 10 16:44:40.854019 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.854006 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 10 16:44:40.854019 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.854011 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 10 16:44:40.854019 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.854018 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 10 16:44:40.854216 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.854024 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 10 16:44:40.854216 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.854032 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 10 16:44:40.854216 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.854037 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 10 16:44:40.855822 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.855809 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 10 16:44:40.855822 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.855823 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 10 16:44:40.856312 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:40.856279 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-240.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 10 16:44:40.856312 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:40.856287 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 10 16:44:40.859059 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.859044 2562 server.go:1268] "Started kubelet" Jun 10 16:44:40.859173 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.859117 2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 10 16:44:40.859235 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.859126 2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 10 16:44:40.859235 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.859194 2562 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 10 16:44:40.859471 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.859433 2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-240.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 10 16:44:40.859975 ip-10-0-143-240 systemd[1]: Started Kubernetes Kubelet. Jun 10 16:44:40.860692 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.860579 2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 10 16:44:40.868022 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.868001 2562 server.go:310] "Adding debug handlers to kubelet server" Jun 10 16:44:40.869024 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:40.869001 2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 10 16:44:40.871534 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.871503 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 10 16:44:40.871616 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.871506 2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 10 16:44:40.871696 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:40.871662 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-240.ec2.internal\" not found" Jun 10 16:44:40.872445 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.872140 2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 10 16:44:40.872445 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.872171 2562 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 10 16:44:40.872445 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.872194 2562 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 10 16:44:40.872445 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.872358 2562 reconstruct.go:97] "Volume reconstruction finished" Jun 10 16:44:40.872445 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.872366 2562 reconciler.go:29] "Reconciler: start to sync state" Jun 10 16:44:40.872445 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.872423 2562 factory.go:55] Registering systemd factory Jun 10 16:44:40.872445 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.872440 2562 factory.go:223] Registration of the systemd container factory successfully Jun 10 16:44:40.872820 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.872800 2562 factory.go:153] Registering CRI-O factory Jun 10 16:44:40.872820 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.872820 2562 factory.go:223] Registration of the crio container factory successfully Jun 10 16:44:40.872923 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.872880 2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 10 16:44:40.872923 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.872902 2562 factory.go:103] Registering Raw factory Jun 10 16:44:40.872992 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.872986 2562 manager.go:1196] Started watching for new ooms in manager Jun 10 16:44:40.873519 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.873482 2562 manager.go:349] Starting recovery of all containers Jun 10 16:44:40.873883 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:40.872661 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-240.ec2.internal.18b7c5fffa8a308b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-240.ec2.internal,UID:ip-10-0-143-240.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-240.ec2.internal,},FirstTimestamp:2026-06-10 16:44:40.859013259 +0000 UTC m=+0.383226321,LastTimestamp:2026-06-10 16:44:40.859013259 +0000 UTC m=+0.383226321,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-240.ec2.internal,}" Jun 10 16:44:40.877905 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:40.877726 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 10 16:44:40.877905 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:40.877732 2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-240.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 10 16:44:40.884956 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.884939 2562 manager.go:354] Recovery completed Jun 10 16:44:40.885221 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.885192 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ldh4z" Jun 10 16:44:40.889808 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.889795 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 16:44:40.891703 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.891687 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-240.ec2.internal" event="NodeHasSufficientMemory" Jun 10 16:44:40.891792 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.891722 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-240.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 16:44:40.891792 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.891739 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-240.ec2.internal" event="NodeHasSufficientPID" Jun 10 16:44:40.892269 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.892256 2562 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 10 16:44:40.892269 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.892268 2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 10 16:44:40.892350 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.892283 2562 state_mem.go:36] "Initialized new in-memory state store" Jun 10 16:44:40.892350 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.892284 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 16:44:40.892596 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.892580 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ldh4z" Jun 10 16:44:40.893113 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.893099 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-240.ec2.internal" event="NodeHasSufficientMemory" Jun 10 16:44:40.893200 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.893123 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-240.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 16:44:40.893200 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.893132 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-240.ec2.internal" event="NodeHasSufficientPID" Jun 10 16:44:40.893327 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.893315 2562 policy_none.go:49] "None policy: Start" Jun 10 16:44:40.893372 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.893343 2562 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 10 16:44:40.893372 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.893362 2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 10 16:44:40.893668 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:40.893550 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-240.ec2.internal.18b7c5fffc7d0660 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-240.ec2.internal,UID:ip-10-0-143-240.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-240.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-240.ec2.internal,},FirstTimestamp:2026-06-10 16:44:40.891704928 +0000 UTC m=+0.415917995,LastTimestamp:2026-06-10 16:44:40.891704928 +0000 UTC m=+0.415917995,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-240.ec2.internal,}" Jun 10 16:44:40.894331 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.894312 2562 policy_none.go:47] "Start" Jun 10 16:44:40.933223 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.933206 2562 manager.go:337] "Starting Device Plugin manager" Jun 10 16:44:40.939524 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:40.933238 2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 10 16:44:40.939524 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.933248 2562 server.go:87] "Starting device plugin registration server" Jun 10 16:44:40.939524 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.933498 2562 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 10 16:44:40.939524 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.933508 2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 10 16:44:40.939524 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.933603 2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 10 16:44:40.939524 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.933712 2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 10 16:44:40.939524 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.933720 2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 10 16:44:40.939524 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:40.934237 2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 10 16:44:40.939524 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:40.934289 2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-240.ec2.internal\" not found" Jun 10 16:44:40.940588 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.940568 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 10 16:44:40.941909 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.941893 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 10 16:44:40.942003 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.941936 2562 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 10 16:44:40.942003 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.941959 2562 kubelet.go:2448] "Starting kubelet main sync loop" Jun 10 16:44:40.942095 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:40.942001 2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 10 16:44:40.943702 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:40.943686 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 16:44:41.033825 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:41.033753 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 16:44:41.035145 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:41.035127 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-240.ec2.internal" event="NodeHasSufficientMemory" Jun 10 16:44:41.035239 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:41.035160 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-240.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 16:44:41.035239 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:41.035176 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-240.ec2.internal" event="NodeHasSufficientPID" Jun 10 16:44:41.035239 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:41.035207 2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-240.ec2.internal" Jun 10 16:44:41.042876 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:41.042851 2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-143-240.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-240.ec2.internal"] Jun 10 16:44:41.042968 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:41.042911 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 16:44:41.044401 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:41.044385 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-240.ec2.internal" event="NodeHasSufficientMemory" Jun 10 16:44:41.044467 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:41.044414 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-240.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 16:44:41.044467 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:41.044429 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-240.ec2.internal" event="NodeHasSufficientPID" Jun 10 16:44:41.044467 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:41.044461 2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-240.ec2.internal" Jun 10 16:44:41.044554 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:41.044480 2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-240.ec2.internal\": node \"ip-10-0-143-240.ec2.internal\" not found" Jun 10 16:44:41.045732 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:41.045720 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 16:44:41.045849 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:41.045835 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-240.ec2.internal" Jun 10 16:44:41.045883 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:41.045866 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 16:44:41.046508 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:41.046492 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-240.ec2.internal" event="NodeHasSufficientMemory" Jun 10 16:44:41.046568 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:41.046518 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-240.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 16:44:41.046568 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:41.046529 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-240.ec2.internal" event="NodeHasSufficientPID" Jun 10 16:44:41.046649 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:41.046498 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-240.ec2.internal" event="NodeHasSufficientMemory" Jun 10 16:44:41.046649 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:41.046600 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-240.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 16:44:41.046649 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:41.046611 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-240.ec2.internal" event="NodeHasSufficientPID" Jun 10 16:44:41.047784 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:41.047768 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-240.ec2.internal" Jun 10 16:44:41.047877 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:41.047796 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 16:44:41.048489 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:41.048476 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-240.ec2.internal" event="NodeHasSufficientMemory" Jun 10 16:44:41.048563 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:41.048500 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-240.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 16:44:41.048563 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:41.048510 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-240.ec2.internal" event="NodeHasSufficientPID" Jun 10 16:44:41.063143 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:41.063124 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-240.ec2.internal\" not found" node="ip-10-0-143-240.ec2.internal" Jun 10 16:44:41.066791 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:41.066777 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-240.ec2.internal\" not found" node="ip-10-0-143-240.ec2.internal" Jun 10 16:44:41.067296 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:41.067280 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-240.ec2.internal\" not found" Jun 10 16:44:41.167671 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:41.167622 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-240.ec2.internal\" not found" Jun 10 16:44:41.172876 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:41.172857 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6d4dfeae904d1951cf9e800fc852a4d5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-240.ec2.internal\" (UID: \"6d4dfeae904d1951cf9e800fc852a4d5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-240.ec2.internal" Jun 10 16:44:41.172951 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:41.172884 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6d4dfeae904d1951cf9e800fc852a4d5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-240.ec2.internal\" (UID: \"6d4dfeae904d1951cf9e800fc852a4d5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-240.ec2.internal" Jun 10 16:44:41.172951 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:41.172902 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9b7ffcb998d117f623e995855278ca37-config\") pod \"kube-apiserver-proxy-ip-10-0-143-240.ec2.internal\" (UID: \"9b7ffcb998d117f623e995855278ca37\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-240.ec2.internal" Jun 10 16:44:41.268059 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:41.268016 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-240.ec2.internal\" not found" Jun 10 16:44:41.273288 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:41.273271 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6d4dfeae904d1951cf9e800fc852a4d5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-240.ec2.internal\" (UID: \"6d4dfeae904d1951cf9e800fc852a4d5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-240.ec2.internal" Jun 10 16:44:41.273348 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:41.273296 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6d4dfeae904d1951cf9e800fc852a4d5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-240.ec2.internal\" (UID: \"6d4dfeae904d1951cf9e800fc852a4d5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-240.ec2.internal" Jun 10 16:44:41.273348 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:41.273317 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9b7ffcb998d117f623e995855278ca37-config\") pod \"kube-apiserver-proxy-ip-10-0-143-240.ec2.internal\" (UID: \"9b7ffcb998d117f623e995855278ca37\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-240.ec2.internal" Jun 10 16:44:41.273466 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:41.273356 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9b7ffcb998d117f623e995855278ca37-config\") pod \"kube-apiserver-proxy-ip-10-0-143-240.ec2.internal\" (UID: \"9b7ffcb998d117f623e995855278ca37\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-240.ec2.internal" Jun 10 16:44:41.273466 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:41.273391 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6d4dfeae904d1951cf9e800fc852a4d5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-240.ec2.internal\" (UID: \"6d4dfeae904d1951cf9e800fc852a4d5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-240.ec2.internal" Jun 10 16:44:41.273466 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:41.273394 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6d4dfeae904d1951cf9e800fc852a4d5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-240.ec2.internal\" (UID: \"6d4dfeae904d1951cf9e800fc852a4d5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-240.ec2.internal" Jun 10 16:44:41.366805 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:41.366741 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-240.ec2.internal" Jun 10 16:44:41.368534 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:41.368510 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-240.ec2.internal\" not found" Jun 10 16:44:41.371195 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:41.371179 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-240.ec2.internal" Jun 10 16:44:41.469646 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:41.469599 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-240.ec2.internal\" not found" Jun 10 16:44:41.570121 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:41.570086 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-240.ec2.internal\" not found" Jun 10 16:44:41.670617 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:41.670560 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-240.ec2.internal\" not found" Jun 10 16:44:41.771080 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:41.771048 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-240.ec2.internal\" not found" Jun 10 16:44:41.802514 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:41.802486 2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 10 16:44:41.803128 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:41.802673 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 10 16:44:41.871398 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:41.871374 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-240.ec2.internal\" not found" Jun 10 16:44:41.873874 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:41.873843 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d4dfeae904d1951cf9e800fc852a4d5.slice/crio-f89e9ad3835813e777853d263acbd70b13e6d31b9ec0d554bda763df529224b4 WatchSource:0}: Error finding container f89e9ad3835813e777853d263acbd70b13e6d31b9ec0d554bda763df529224b4: Status 404 returned error can't find the container with id f89e9ad3835813e777853d263acbd70b13e6d31b9ec0d554bda763df529224b4 Jun 10 16:44:41.874113 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:41.874085 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b7ffcb998d117f623e995855278ca37.slice/crio-26a2a2beb8a0c52173ad264a92ff6531bbe8e54397e57f40cd69d6037e6761b4 WatchSource:0}: Error finding container 26a2a2beb8a0c52173ad264a92ff6531bbe8e54397e57f40cd69d6037e6761b4: Status 404 returned error can't find the container with id 26a2a2beb8a0c52173ad264a92ff6531bbe8e54397e57f40cd69d6037e6761b4 Jun 10 16:44:41.879488 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:41.879475 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 16:44:41.894809 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:41.894767 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-09 16:39:40 +0000 UTC" deadline="2027-12-28 10:37:35.589764603 +0000 UTC" Jun 10 16:44:41.894891 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:41.894808 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13577h52m53.694962165s" Jun 10 16:44:41.945202 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:41.945123 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-240.ec2.internal" event={"ID":"9b7ffcb998d117f623e995855278ca37","Type":"ContainerStarted","Data":"26a2a2beb8a0c52173ad264a92ff6531bbe8e54397e57f40cd69d6037e6761b4"} Jun 10 16:44:41.946179 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:41.946159 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-240.ec2.internal" event={"ID":"6d4dfeae904d1951cf9e800fc852a4d5","Type":"ContainerStarted","Data":"f89e9ad3835813e777853d263acbd70b13e6d31b9ec0d554bda763df529224b4"} Jun 10 16:44:41.970361 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:41.970339 2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 16:44:41.971587 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:41.971569 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-240.ec2.internal\" not found" Jun 10 16:44:42.072489 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:42.072442 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-240.ec2.internal\" not found" Jun 10 16:44:42.172891 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:42.172855 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-240.ec2.internal\" not found" Jun 10 16:44:42.187276 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.187244 2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 16:44:42.232970 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.232880 2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 16:44:42.272595 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.272562 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-240.ec2.internal" Jun 10 16:44:42.281441 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.281417 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 16:44:42.282526 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.282504 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-240.ec2.internal" Jun 10 16:44:42.294183 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.294159 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 16:44:42.617991 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.617913 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 16:44:42.847800 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.847768 2562 apiserver.go:52] "Watching apiserver" Jun 10 16:44:42.858719 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.858691 2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 10 16:44:42.860195 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.860159 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-7qdxg","openshift-ovn-kubernetes/ovnkube-node-p96z8","kube-system/global-pull-secret-syncer-5jkcf","kube-system/konnectivity-agent-ghpgs","kube-system/kube-apiserver-proxy-ip-10-0-143-240.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d5k7w","openshift-dns/node-resolver-65mjb","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-240.ec2.internal","openshift-cluster-node-tuning-operator/tuned-z8b5l","openshift-image-registry/node-ca-7s4lf","openshift-multus/multus-additional-cni-plugins-mfkbh","openshift-multus/multus-km7gt","openshift-multus/network-metrics-daemon-frvb8","openshift-network-diagnostics/network-check-target-jwscc"] Jun 10 16:44:42.861620 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.861597 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-65mjb" Jun 10 16:44:42.862568 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.862549 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mfkbh" Jun 10 16:44:42.863583 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.863561 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5jkcf" Jun 10 16:44:42.863701 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:42.863652 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5jkcf" podUID="745cd6f9-646a-4143-b3e5-9c84f4c0869a" Jun 10 16:44:42.864346 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.864325 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 10 16:44:42.864430 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.864331 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ktsxs\"" Jun 10 16:44:42.864665 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.864645 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 10 16:44:42.864824 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.864810 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 10 16:44:42.865027 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.865008 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 10 16:44:42.865111 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.865008 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 10 16:44:42.865111 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.865096 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-bvjv2\"" Jun 10 16:44:42.865212 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.865110 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 10 16:44:42.865325 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.865311 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 10 16:44:42.865899 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.865879 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ghpgs" Jun 10 16:44:42.867021 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.867002 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwscc" Jun 10 16:44:42.867110 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:42.867086 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jwscc" podUID="139ad3f2-9413-4f80-a1a7-b86ae8edb649" Jun 10 16:44:42.867664 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.867622 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 10 16:44:42.867664 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.867660 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 10 16:44:42.868281 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.868235 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d5k7w" Jun 10 16:44:42.868831 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.868682 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-b9tsm\"" Jun 10 16:44:42.869346 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.869328 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-z8b5l" Jun 10 16:44:42.869906 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.869889 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 10 16:44:42.870155 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.870136 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 10 16:44:42.870249 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.870183 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 10 16:44:42.870522 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.870505 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frvb8" Jun 10 16:44:42.870522 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.870516 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-n2ntb\"" Jun 10 16:44:42.870734 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:42.870566 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frvb8" podUID="1955ad17-c126-4e00-b082-09ca6f6bba61" Jun 10 16:44:42.871705 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.871684 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" Jun 10 16:44:42.872012 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.871994 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4fjd7\"" Jun 10 16:44:42.872229 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.872204 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 10 16:44:42.872415 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.872208 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 10 16:44:42.872780 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.872764 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 10 16:44:42.873504 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.873489 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7s4lf" Jun 10 16:44:42.874387 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.874369 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7qdxg" Jun 10 16:44:42.875568 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.875543 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-km7gt" Jun 10 16:44:42.875756 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.875731 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 10 16:44:42.876216 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.876195 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 10 16:44:42.876485 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.876464 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 10 16:44:42.876564 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.876467 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 10 16:44:42.876602 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.876467 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 10 16:44:42.876906 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.876886 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 10 16:44:42.876999 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.876931 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 10 16:44:42.877062 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.876935 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 10 16:44:42.877062 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.877047 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 10 16:44:42.877161 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.877103 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 10 16:44:42.877212 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.877201 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 10 16:44:42.877212 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.877202 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 10 16:44:42.877363 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.877228 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-762t9\"" Jun 10 16:44:42.877363 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.877240 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-kzbsn\"" Jun 10 16:44:42.877575 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.877559 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-q566h\"" Jun 10 16:44:42.877900 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.877779 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-7zt86\"" Jun 10 16:44:42.877900 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.877822 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 10 16:44:42.881873 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.881847 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bedb86e4-97c5-49a2-bbbc-4f13bf6c0426-cnibin\") pod \"multus-additional-cni-plugins-mfkbh\" (UID: \"bedb86e4-97c5-49a2-bbbc-4f13bf6c0426\") " pod="openshift-multus/multus-additional-cni-plugins-mfkbh" Jun 10 16:44:42.881975 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.881898 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7965261b-bc5b-4d9c-b69e-5af087ee998e-tmp\") pod \"tuned-z8b5l\" (UID: \"7965261b-bc5b-4d9c-b69e-5af087ee998e\") " pod="openshift-cluster-node-tuning-operator/tuned-z8b5l" Jun 10 16:44:42.881975 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.881925 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ppbm\" (UniqueName: \"kubernetes.io/projected/1955ad17-c126-4e00-b082-09ca6f6bba61-kube-api-access-9ppbm\") pod \"network-metrics-daemon-frvb8\" (UID: \"1955ad17-c126-4e00-b082-09ca6f6bba61\") " pod="openshift-multus/network-metrics-daemon-frvb8" Jun 10 16:44:42.881975 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.881950 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqzmt\" (UniqueName: \"kubernetes.io/projected/51c9f98e-ff02-48f2-b3e7-340543a646a6-kube-api-access-tqzmt\") pod \"node-ca-7s4lf\" (UID: \"51c9f98e-ff02-48f2-b3e7-340543a646a6\") " pod="openshift-image-registry/node-ca-7s4lf" Jun 10 16:44:42.881975 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.881972 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/65c6da66-78d8-4637-b28a-fb347d794e81-registration-dir\") pod \"aws-ebs-csi-driver-node-d5k7w\" (UID: \"65c6da66-78d8-4637-b28a-fb347d794e81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d5k7w" Jun 10 16:44:42.882175 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.881996 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/65c6da66-78d8-4637-b28a-fb347d794e81-etc-selinux\") pod \"aws-ebs-csi-driver-node-d5k7w\" (UID: \"65c6da66-78d8-4637-b28a-fb347d794e81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d5k7w" Jun 10 16:44:42.882175 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.882026 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bedb86e4-97c5-49a2-bbbc-4f13bf6c0426-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mfkbh\" (UID: \"bedb86e4-97c5-49a2-bbbc-4f13bf6c0426\") " pod="openshift-multus/multus-additional-cni-plugins-mfkbh" Jun 10 16:44:42.882175 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.882049 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7965261b-bc5b-4d9c-b69e-5af087ee998e-etc-sysctl-d\") pod \"tuned-z8b5l\" (UID: \"7965261b-bc5b-4d9c-b69e-5af087ee998e\") " pod="openshift-cluster-node-tuning-operator/tuned-z8b5l" Jun 10 16:44:42.882175 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.882073 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7965261b-bc5b-4d9c-b69e-5af087ee998e-var-lib-kubelet\") pod \"tuned-z8b5l\" (UID: \"7965261b-bc5b-4d9c-b69e-5af087ee998e\") " pod="openshift-cluster-node-tuning-operator/tuned-z8b5l" Jun 10 16:44:42.882175 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.882094 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/51c9f98e-ff02-48f2-b3e7-340543a646a6-host\") pod \"node-ca-7s4lf\" (UID: \"51c9f98e-ff02-48f2-b3e7-340543a646a6\") " pod="openshift-image-registry/node-ca-7s4lf" Jun 10 16:44:42.882175 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.882122 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a9624b92-752b-4888-99da-f864e807a6f0-host-kubelet\") pod \"ovnkube-node-p96z8\" (UID: \"a9624b92-752b-4888-99da-f864e807a6f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" Jun 10 16:44:42.882175 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.882145 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a9624b92-752b-4888-99da-f864e807a6f0-host-cni-bin\") pod \"ovnkube-node-p96z8\" (UID: \"a9624b92-752b-4888-99da-f864e807a6f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" Jun 10 16:44:42.882175 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.882168 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a9624b92-752b-4888-99da-f864e807a6f0-env-overrides\") pod \"ovnkube-node-p96z8\" (UID: \"a9624b92-752b-4888-99da-f864e807a6f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" Jun 10 16:44:42.882559 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.882227 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bedb86e4-97c5-49a2-bbbc-4f13bf6c0426-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mfkbh\" (UID: \"bedb86e4-97c5-49a2-bbbc-4f13bf6c0426\") " pod="openshift-multus/multus-additional-cni-plugins-mfkbh" Jun 10 16:44:42.882559 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.882266 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bedb86e4-97c5-49a2-bbbc-4f13bf6c0426-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mfkbh\" (UID: \"bedb86e4-97c5-49a2-bbbc-4f13bf6c0426\") " pod="openshift-multus/multus-additional-cni-plugins-mfkbh" Jun 10 16:44:42.882559 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.882290 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7965261b-bc5b-4d9c-b69e-5af087ee998e-run\") pod \"tuned-z8b5l\" (UID: \"7965261b-bc5b-4d9c-b69e-5af087ee998e\") " pod="openshift-cluster-node-tuning-operator/tuned-z8b5l" Jun 10 16:44:42.882559 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.882318 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1955ad17-c126-4e00-b082-09ca6f6bba61-metrics-certs\") pod \"network-metrics-daemon-frvb8\" (UID: \"1955ad17-c126-4e00-b082-09ca6f6bba61\") " pod="openshift-multus/network-metrics-daemon-frvb8" Jun 10 16:44:42.882559 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.882336 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2bff1d3f-6fe7-41ae-9084-5bc3ea7e4185-iptables-alerter-script\") pod \"iptables-alerter-7qdxg\" (UID: \"2bff1d3f-6fe7-41ae-9084-5bc3ea7e4185\") " pod="openshift-network-operator/iptables-alerter-7qdxg" Jun 10 16:44:42.882559 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.882351 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a9624b92-752b-4888-99da-f864e807a6f0-host-cni-netd\") pod \"ovnkube-node-p96z8\" (UID: \"a9624b92-752b-4888-99da-f864e807a6f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" Jun 10 16:44:42.882559 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.882370 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a9624b92-752b-4888-99da-f864e807a6f0-ovn-node-metrics-cert\") pod \"ovnkube-node-p96z8\" (UID: \"a9624b92-752b-4888-99da-f864e807a6f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" Jun 10 16:44:42.882559 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.882391 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a9624b92-752b-4888-99da-f864e807a6f0-ovnkube-script-lib\") pod \"ovnkube-node-p96z8\" (UID: \"a9624b92-752b-4888-99da-f864e807a6f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" Jun 10 16:44:42.882559 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.882470 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bedb86e4-97c5-49a2-bbbc-4f13bf6c0426-cni-binary-copy\") pod \"multus-additional-cni-plugins-mfkbh\" (UID: \"bedb86e4-97c5-49a2-bbbc-4f13bf6c0426\") " pod="openshift-multus/multus-additional-cni-plugins-mfkbh" Jun 10 16:44:42.882559 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.882506 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7965261b-bc5b-4d9c-b69e-5af087ee998e-etc-sysconfig\") pod \"tuned-z8b5l\" (UID: \"7965261b-bc5b-4d9c-b69e-5af087ee998e\") " pod="openshift-cluster-node-tuning-operator/tuned-z8b5l" Jun 10 16:44:42.882559 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.882532 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/745cd6f9-646a-4143-b3e5-9c84f4c0869a-kubelet-config\") pod \"global-pull-secret-syncer-5jkcf\" (UID: \"745cd6f9-646a-4143-b3e5-9c84f4c0869a\") " pod="kube-system/global-pull-secret-syncer-5jkcf" Jun 10 16:44:42.882559 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.882555 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a9624b92-752b-4888-99da-f864e807a6f0-host-slash\") pod \"ovnkube-node-p96z8\" (UID: \"a9624b92-752b-4888-99da-f864e807a6f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" Jun 10 16:44:42.883129 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.882595 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a9624b92-752b-4888-99da-f864e807a6f0-host-run-netns\") pod \"ovnkube-node-p96z8\" (UID: \"a9624b92-752b-4888-99da-f864e807a6f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" Jun 10 16:44:42.883129 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.882646 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7965261b-bc5b-4d9c-b69e-5af087ee998e-etc-modprobe-d\") pod \"tuned-z8b5l\" (UID: \"7965261b-bc5b-4d9c-b69e-5af087ee998e\") " pod="openshift-cluster-node-tuning-operator/tuned-z8b5l" Jun 10 16:44:42.883129 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.882671 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7965261b-bc5b-4d9c-b69e-5af087ee998e-etc-systemd\") pod \"tuned-z8b5l\" (UID: \"7965261b-bc5b-4d9c-b69e-5af087ee998e\") " pod="openshift-cluster-node-tuning-operator/tuned-z8b5l" Jun 10 16:44:42.883129 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.882694 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/224e07b4-de73-42d9-a0b2-300dd5944e96-tmp-dir\") pod \"node-resolver-65mjb\" (UID: \"224e07b4-de73-42d9-a0b2-300dd5944e96\") " pod="openshift-dns/node-resolver-65mjb" Jun 10 16:44:42.883129 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.882716 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zr7c\" (UniqueName: \"kubernetes.io/projected/65c6da66-78d8-4637-b28a-fb347d794e81-kube-api-access-9zr7c\") pod \"aws-ebs-csi-driver-node-d5k7w\" (UID: \"65c6da66-78d8-4637-b28a-fb347d794e81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d5k7w" Jun 10 16:44:42.883129 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.882758 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a9624b92-752b-4888-99da-f864e807a6f0-systemd-units\") pod \"ovnkube-node-p96z8\" (UID: \"a9624b92-752b-4888-99da-f864e807a6f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" Jun 10 16:44:42.883129 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.882781 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a9624b92-752b-4888-99da-f864e807a6f0-run-systemd\") pod \"ovnkube-node-p96z8\" (UID: \"a9624b92-752b-4888-99da-f864e807a6f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" Jun 10 16:44:42.883129 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.882803 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a9624b92-752b-4888-99da-f864e807a6f0-ovnkube-config\") pod \"ovnkube-node-p96z8\" (UID: \"a9624b92-752b-4888-99da-f864e807a6f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" Jun 10 16:44:42.883129 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.882843 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7965261b-bc5b-4d9c-b69e-5af087ee998e-etc-sysctl-conf\") pod \"tuned-z8b5l\" (UID: \"7965261b-bc5b-4d9c-b69e-5af087ee998e\") " pod="openshift-cluster-node-tuning-operator/tuned-z8b5l" Jun 10 16:44:42.883129 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.882887 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9z2c\" (UniqueName: \"kubernetes.io/projected/7965261b-bc5b-4d9c-b69e-5af087ee998e-kube-api-access-g9z2c\") pod \"tuned-z8b5l\" (UID: \"7965261b-bc5b-4d9c-b69e-5af087ee998e\") " pod="openshift-cluster-node-tuning-operator/tuned-z8b5l" Jun 10 16:44:42.883129 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.882928 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgq97\" (UniqueName: \"kubernetes.io/projected/a9624b92-752b-4888-99da-f864e807a6f0-kube-api-access-jgq97\") pod \"ovnkube-node-p96z8\" (UID: \"a9624b92-752b-4888-99da-f864e807a6f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" Jun 10 16:44:42.883129 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.882956 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7965261b-bc5b-4d9c-b69e-5af087ee998e-host\") pod \"tuned-z8b5l\" (UID: \"7965261b-bc5b-4d9c-b69e-5af087ee998e\") " pod="openshift-cluster-node-tuning-operator/tuned-z8b5l" Jun 10 16:44:42.883129 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.882979 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9624b92-752b-4888-99da-f864e807a6f0-var-lib-openvswitch\") pod \"ovnkube-node-p96z8\" (UID: \"a9624b92-752b-4888-99da-f864e807a6f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" Jun 10 16:44:42.883129 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.883002 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a9624b92-752b-4888-99da-f864e807a6f0-node-log\") pod \"ovnkube-node-p96z8\" (UID: \"a9624b92-752b-4888-99da-f864e807a6f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" Jun 10 16:44:42.883129 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.883027 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7965261b-bc5b-4d9c-b69e-5af087ee998e-sys\") pod \"tuned-z8b5l\" (UID: \"7965261b-bc5b-4d9c-b69e-5af087ee998e\") " pod="openshift-cluster-node-tuning-operator/tuned-z8b5l" Jun 10 16:44:42.883129 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.883049 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/65c6da66-78d8-4637-b28a-fb347d794e81-sys-fs\") pod \"aws-ebs-csi-driver-node-d5k7w\" (UID: \"65c6da66-78d8-4637-b28a-fb347d794e81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d5k7w" Jun 10 16:44:42.883748 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.883072 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/745cd6f9-646a-4143-b3e5-9c84f4c0869a-dbus\") pod \"global-pull-secret-syncer-5jkcf\" (UID: \"745cd6f9-646a-4143-b3e5-9c84f4c0869a\") " pod="kube-system/global-pull-secret-syncer-5jkcf" Jun 10 16:44:42.883748 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.883094 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bedb86e4-97c5-49a2-bbbc-4f13bf6c0426-os-release\") pod \"multus-additional-cni-plugins-mfkbh\" (UID: \"bedb86e4-97c5-49a2-bbbc-4f13bf6c0426\") " pod="openshift-multus/multus-additional-cni-plugins-mfkbh" Jun 10 16:44:42.883748 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.883119 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prpcx\" (UniqueName: \"kubernetes.io/projected/bedb86e4-97c5-49a2-bbbc-4f13bf6c0426-kube-api-access-prpcx\") pod \"multus-additional-cni-plugins-mfkbh\" (UID: \"bedb86e4-97c5-49a2-bbbc-4f13bf6c0426\") " pod="openshift-multus/multus-additional-cni-plugins-mfkbh" Jun 10 16:44:42.883748 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.883141 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27qqr\" (UniqueName: \"kubernetes.io/projected/139ad3f2-9413-4f80-a1a7-b86ae8edb649-kube-api-access-27qqr\") pod \"network-check-target-jwscc\" (UID: \"139ad3f2-9413-4f80-a1a7-b86ae8edb649\") " pod="openshift-network-diagnostics/network-check-target-jwscc" Jun 10 16:44:42.883748 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.883162 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/51c9f98e-ff02-48f2-b3e7-340543a646a6-serviceca\") pod \"node-ca-7s4lf\" (UID: \"51c9f98e-ff02-48f2-b3e7-340543a646a6\") " pod="openshift-image-registry/node-ca-7s4lf" Jun 10 16:44:42.883748 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.883184 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csggg\" (UniqueName: \"kubernetes.io/projected/2bff1d3f-6fe7-41ae-9084-5bc3ea7e4185-kube-api-access-csggg\") pod \"iptables-alerter-7qdxg\" (UID: \"2bff1d3f-6fe7-41ae-9084-5bc3ea7e4185\") " pod="openshift-network-operator/iptables-alerter-7qdxg" Jun 10 16:44:42.883748 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.883207 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/745cd6f9-646a-4143-b3e5-9c84f4c0869a-original-pull-secret\") pod \"global-pull-secret-syncer-5jkcf\" (UID: \"745cd6f9-646a-4143-b3e5-9c84f4c0869a\") " pod="kube-system/global-pull-secret-syncer-5jkcf" Jun 10 16:44:42.883748 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.883239 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9624b92-752b-4888-99da-f864e807a6f0-host-run-ovn-kubernetes\") pod \"ovnkube-node-p96z8\" (UID: \"a9624b92-752b-4888-99da-f864e807a6f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" Jun 10 16:44:42.883748 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.883265 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9624b92-752b-4888-99da-f864e807a6f0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-p96z8\" (UID: \"a9624b92-752b-4888-99da-f864e807a6f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" Jun 10 16:44:42.883748 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.883288 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/224e07b4-de73-42d9-a0b2-300dd5944e96-hosts-file\") pod \"node-resolver-65mjb\" (UID: \"224e07b4-de73-42d9-a0b2-300dd5944e96\") " pod="openshift-dns/node-resolver-65mjb" Jun 10 16:44:42.883748 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.883310 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtw9t\" (UniqueName: \"kubernetes.io/projected/224e07b4-de73-42d9-a0b2-300dd5944e96-kube-api-access-qtw9t\") pod \"node-resolver-65mjb\" (UID: \"224e07b4-de73-42d9-a0b2-300dd5944e96\") " pod="openshift-dns/node-resolver-65mjb" Jun 10 16:44:42.883748 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.883334 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/65c6da66-78d8-4637-b28a-fb347d794e81-kubelet-dir\") pod \"aws-ebs-csi-driver-node-d5k7w\" (UID: \"65c6da66-78d8-4637-b28a-fb347d794e81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d5k7w" Jun 10 16:44:42.883748 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.883357 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bedb86e4-97c5-49a2-bbbc-4f13bf6c0426-system-cni-dir\") pod \"multus-additional-cni-plugins-mfkbh\" (UID: \"bedb86e4-97c5-49a2-bbbc-4f13bf6c0426\") " pod="openshift-multus/multus-additional-cni-plugins-mfkbh" Jun 10 16:44:42.883748 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.883379 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7965261b-bc5b-4d9c-b69e-5af087ee998e-lib-modules\") pod \"tuned-z8b5l\" (UID: \"7965261b-bc5b-4d9c-b69e-5af087ee998e\") " pod="openshift-cluster-node-tuning-operator/tuned-z8b5l" Jun 10 16:44:42.883748 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.883423 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2bff1d3f-6fe7-41ae-9084-5bc3ea7e4185-host-slash\") pod \"iptables-alerter-7qdxg\" (UID: \"2bff1d3f-6fe7-41ae-9084-5bc3ea7e4185\") " pod="openshift-network-operator/iptables-alerter-7qdxg" Jun 10 16:44:42.883748 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.883463 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/65c6da66-78d8-4637-b28a-fb347d794e81-socket-dir\") pod \"aws-ebs-csi-driver-node-d5k7w\" (UID: \"65c6da66-78d8-4637-b28a-fb347d794e81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d5k7w" Jun 10 16:44:42.884283 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.883489 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/65c6da66-78d8-4637-b28a-fb347d794e81-device-dir\") pod \"aws-ebs-csi-driver-node-d5k7w\" (UID: \"65c6da66-78d8-4637-b28a-fb347d794e81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d5k7w" Jun 10 16:44:42.884283 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.883537 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a9624b92-752b-4888-99da-f864e807a6f0-run-ovn\") pod \"ovnkube-node-p96z8\" (UID: \"a9624b92-752b-4888-99da-f864e807a6f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" Jun 10 16:44:42.884283 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.883577 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7965261b-bc5b-4d9c-b69e-5af087ee998e-etc-tuned\") pod \"tuned-z8b5l\" (UID: \"7965261b-bc5b-4d9c-b69e-5af087ee998e\") " pod="openshift-cluster-node-tuning-operator/tuned-z8b5l" Jun 10 16:44:42.884283 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.883620 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a8c96b8d-5704-4cf6-86b8-633cb01726a6-agent-certs\") pod \"konnectivity-agent-ghpgs\" (UID: \"a8c96b8d-5704-4cf6-86b8-633cb01726a6\") " pod="kube-system/konnectivity-agent-ghpgs" Jun 10 16:44:42.884283 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.883658 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9624b92-752b-4888-99da-f864e807a6f0-etc-openvswitch\") pod \"ovnkube-node-p96z8\" (UID: \"a9624b92-752b-4888-99da-f864e807a6f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" Jun 10 16:44:42.884283 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.883688 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a9624b92-752b-4888-99da-f864e807a6f0-log-socket\") pod \"ovnkube-node-p96z8\" (UID: \"a9624b92-752b-4888-99da-f864e807a6f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" Jun 10 16:44:42.884283 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.883721 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7965261b-bc5b-4d9c-b69e-5af087ee998e-etc-kubernetes\") pod \"tuned-z8b5l\" (UID: \"7965261b-bc5b-4d9c-b69e-5af087ee998e\") " pod="openshift-cluster-node-tuning-operator/tuned-z8b5l" Jun 10 16:44:42.884283 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.883748 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a8c96b8d-5704-4cf6-86b8-633cb01726a6-konnectivity-ca\") pod \"konnectivity-agent-ghpgs\" (UID: \"a8c96b8d-5704-4cf6-86b8-633cb01726a6\") " pod="kube-system/konnectivity-agent-ghpgs" Jun 10 16:44:42.884283 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.883767 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9624b92-752b-4888-99da-f864e807a6f0-run-openvswitch\") pod \"ovnkube-node-p96z8\" (UID: \"a9624b92-752b-4888-99da-f864e807a6f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" Jun 10 16:44:42.884883 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.884494 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 16:44:42.916562 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.916541 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-8m2gw" Jun 10 16:44:42.925480 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.925455 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-8m2gw" Jun 10 16:44:42.972956 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.972925 2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 10 16:44:42.984434 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.984403 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7965261b-bc5b-4d9c-b69e-5af087ee998e-etc-kubernetes\") pod \"tuned-z8b5l\" (UID: \"7965261b-bc5b-4d9c-b69e-5af087ee998e\") " pod="openshift-cluster-node-tuning-operator/tuned-z8b5l" Jun 10 16:44:42.984595 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.984445 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a8c96b8d-5704-4cf6-86b8-633cb01726a6-konnectivity-ca\") pod \"konnectivity-agent-ghpgs\" (UID: \"a8c96b8d-5704-4cf6-86b8-633cb01726a6\") " pod="kube-system/konnectivity-agent-ghpgs" Jun 10 16:44:42.984595 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.984467 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9624b92-752b-4888-99da-f864e807a6f0-run-openvswitch\") pod \"ovnkube-node-p96z8\" (UID: \"a9624b92-752b-4888-99da-f864e807a6f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" Jun 10 16:44:42.984595 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.984484 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7965261b-bc5b-4d9c-b69e-5af087ee998e-etc-kubernetes\") pod \"tuned-z8b5l\" (UID: \"7965261b-bc5b-4d9c-b69e-5af087ee998e\") " pod="openshift-cluster-node-tuning-operator/tuned-z8b5l" Jun 10 16:44:42.984595 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.984493 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bedb86e4-97c5-49a2-bbbc-4f13bf6c0426-cnibin\") pod \"multus-additional-cni-plugins-mfkbh\" (UID: \"bedb86e4-97c5-49a2-bbbc-4f13bf6c0426\") " pod="openshift-multus/multus-additional-cni-plugins-mfkbh" Jun 10 16:44:42.984595 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.984543 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bedb86e4-97c5-49a2-bbbc-4f13bf6c0426-cnibin\") pod \"multus-additional-cni-plugins-mfkbh\" (UID: \"bedb86e4-97c5-49a2-bbbc-4f13bf6c0426\") " pod="openshift-multus/multus-additional-cni-plugins-mfkbh" Jun 10 16:44:42.984595 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.984543 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9624b92-752b-4888-99da-f864e807a6f0-run-openvswitch\") pod \"ovnkube-node-p96z8\" (UID: \"a9624b92-752b-4888-99da-f864e807a6f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" Jun 10 16:44:42.984595 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.984590 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7965261b-bc5b-4d9c-b69e-5af087ee998e-tmp\") pod \"tuned-z8b5l\" (UID: \"7965261b-bc5b-4d9c-b69e-5af087ee998e\") " pod="openshift-cluster-node-tuning-operator/tuned-z8b5l" Jun 10 16:44:42.984966 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.984642 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ppbm\" (UniqueName: \"kubernetes.io/projected/1955ad17-c126-4e00-b082-09ca6f6bba61-kube-api-access-9ppbm\") pod \"network-metrics-daemon-frvb8\" (UID: \"1955ad17-c126-4e00-b082-09ca6f6bba61\") " pod="openshift-multus/network-metrics-daemon-frvb8" Jun 10 16:44:42.984966 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.984676 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqzmt\" (UniqueName: \"kubernetes.io/projected/51c9f98e-ff02-48f2-b3e7-340543a646a6-kube-api-access-tqzmt\") pod \"node-ca-7s4lf\" (UID: \"51c9f98e-ff02-48f2-b3e7-340543a646a6\") " pod="openshift-image-registry/node-ca-7s4lf" Jun 10 16:44:42.984966 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.984705 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/65c6da66-78d8-4637-b28a-fb347d794e81-registration-dir\") pod \"aws-ebs-csi-driver-node-d5k7w\" (UID: \"65c6da66-78d8-4637-b28a-fb347d794e81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d5k7w" Jun 10 16:44:42.984966 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.984926 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/65c6da66-78d8-4637-b28a-fb347d794e81-etc-selinux\") pod \"aws-ebs-csi-driver-node-d5k7w\" (UID: \"65c6da66-78d8-4637-b28a-fb347d794e81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d5k7w" Jun 10 16:44:42.984966 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.984956 2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 10 16:44:42.985193 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.984983 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bedb86e4-97c5-49a2-bbbc-4f13bf6c0426-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mfkbh\" (UID: \"bedb86e4-97c5-49a2-bbbc-4f13bf6c0426\") " pod="openshift-multus/multus-additional-cni-plugins-mfkbh" Jun 10 16:44:42.985193 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.984996 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/65c6da66-78d8-4637-b28a-fb347d794e81-registration-dir\") pod \"aws-ebs-csi-driver-node-d5k7w\" (UID: \"65c6da66-78d8-4637-b28a-fb347d794e81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d5k7w" Jun 10 16:44:42.985193 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.985008 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7965261b-bc5b-4d9c-b69e-5af087ee998e-etc-sysctl-d\") pod \"tuned-z8b5l\" (UID: \"7965261b-bc5b-4d9c-b69e-5af087ee998e\") " pod="openshift-cluster-node-tuning-operator/tuned-z8b5l" Jun 10 16:44:42.985193 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.985050 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7965261b-bc5b-4d9c-b69e-5af087ee998e-var-lib-kubelet\") pod \"tuned-z8b5l\" (UID: \"7965261b-bc5b-4d9c-b69e-5af087ee998e\") " pod="openshift-cluster-node-tuning-operator/tuned-z8b5l" Jun 10 16:44:42.985193 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.985074 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/65c6da66-78d8-4637-b28a-fb347d794e81-etc-selinux\") pod \"aws-ebs-csi-driver-node-d5k7w\" (UID: \"65c6da66-78d8-4637-b28a-fb347d794e81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d5k7w" Jun 10 16:44:42.985193 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.985078 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/51c9f98e-ff02-48f2-b3e7-340543a646a6-host\") pod \"node-ca-7s4lf\" (UID: \"51c9f98e-ff02-48f2-b3e7-340543a646a6\") " pod="openshift-image-registry/node-ca-7s4lf" Jun 10 16:44:42.985193 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.985102 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a9624b92-752b-4888-99da-f864e807a6f0-host-kubelet\") pod \"ovnkube-node-p96z8\" (UID: \"a9624b92-752b-4888-99da-f864e807a6f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" Jun 10 16:44:42.985193 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.985119 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a8c96b8d-5704-4cf6-86b8-633cb01726a6-konnectivity-ca\") pod \"konnectivity-agent-ghpgs\" (UID: \"a8c96b8d-5704-4cf6-86b8-633cb01726a6\") " pod="kube-system/konnectivity-agent-ghpgs" Jun 10 16:44:42.985193 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.985125 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a9624b92-752b-4888-99da-f864e807a6f0-host-cni-bin\") pod \"ovnkube-node-p96z8\" (UID: \"a9624b92-752b-4888-99da-f864e807a6f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" Jun 10 16:44:42.985193 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.985147 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a9624b92-752b-4888-99da-f864e807a6f0-env-overrides\") pod \"ovnkube-node-p96z8\" (UID: \"a9624b92-752b-4888-99da-f864e807a6f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" Jun 10 16:44:42.985193 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.985187 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/04d3d006-a5bb-45bc-9aee-25b04c2b7560-host-run-netns\") pod \"multus-km7gt\" (UID: \"04d3d006-a5bb-45bc-9aee-25b04c2b7560\") " pod="openshift-multus/multus-km7gt" Jun 10 16:44:42.985193 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.985194 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7965261b-bc5b-4d9c-b69e-5af087ee998e-var-lib-kubelet\") pod \"tuned-z8b5l\" (UID: \"7965261b-bc5b-4d9c-b69e-5af087ee998e\") " pod="openshift-cluster-node-tuning-operator/tuned-z8b5l" Jun 10 16:44:42.985800 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.985214 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bedb86e4-97c5-49a2-bbbc-4f13bf6c0426-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mfkbh\" (UID: \"bedb86e4-97c5-49a2-bbbc-4f13bf6c0426\") " pod="openshift-multus/multus-additional-cni-plugins-mfkbh" Jun 10 16:44:42.985800 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.985222 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a9624b92-752b-4888-99da-f864e807a6f0-host-cni-bin\") pod \"ovnkube-node-p96z8\" (UID: \"a9624b92-752b-4888-99da-f864e807a6f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" Jun 10 16:44:42.985800 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.985145 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7965261b-bc5b-4d9c-b69e-5af087ee998e-etc-sysctl-d\") pod \"tuned-z8b5l\" (UID: \"7965261b-bc5b-4d9c-b69e-5af087ee998e\") " pod="openshift-cluster-node-tuning-operator/tuned-z8b5l" Jun 10 16:44:42.985800 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.985241 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bedb86e4-97c5-49a2-bbbc-4f13bf6c0426-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mfkbh\" (UID: \"bedb86e4-97c5-49a2-bbbc-4f13bf6c0426\") " pod="openshift-multus/multus-additional-cni-plugins-mfkbh" Jun 10 16:44:42.985800 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.985266 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7965261b-bc5b-4d9c-b69e-5af087ee998e-run\") pod \"tuned-z8b5l\" (UID: \"7965261b-bc5b-4d9c-b69e-5af087ee998e\") " pod="openshift-cluster-node-tuning-operator/tuned-z8b5l" Jun 10 16:44:42.985800 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.985270 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a9624b92-752b-4888-99da-f864e807a6f0-host-kubelet\") pod \"ovnkube-node-p96z8\" (UID: \"a9624b92-752b-4888-99da-f864e807a6f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" Jun 10 16:44:42.985800 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.985283 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bedb86e4-97c5-49a2-bbbc-4f13bf6c0426-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mfkbh\" (UID: \"bedb86e4-97c5-49a2-bbbc-4f13bf6c0426\") " pod="openshift-multus/multus-additional-cni-plugins-mfkbh" Jun 10 16:44:42.985800 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.985294 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1955ad17-c126-4e00-b082-09ca6f6bba61-metrics-certs\") pod \"network-metrics-daemon-frvb8\" (UID: \"1955ad17-c126-4e00-b082-09ca6f6bba61\") " pod="openshift-multus/network-metrics-daemon-frvb8" Jun 10 16:44:42.985800 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.985321 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2bff1d3f-6fe7-41ae-9084-5bc3ea7e4185-iptables-alerter-script\") pod \"iptables-alerter-7qdxg\" (UID: \"2bff1d3f-6fe7-41ae-9084-5bc3ea7e4185\") " pod="openshift-network-operator/iptables-alerter-7qdxg" Jun 10 16:44:42.985800 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.985323 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/51c9f98e-ff02-48f2-b3e7-340543a646a6-host\") pod \"node-ca-7s4lf\" (UID: \"51c9f98e-ff02-48f2-b3e7-340543a646a6\") " pod="openshift-image-registry/node-ca-7s4lf" Jun 10 16:44:42.985800 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.985337 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7965261b-bc5b-4d9c-b69e-5af087ee998e-run\") pod \"tuned-z8b5l\" (UID: \"7965261b-bc5b-4d9c-b69e-5af087ee998e\") " pod="openshift-cluster-node-tuning-operator/tuned-z8b5l" Jun 10 16:44:42.985800 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.985351 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a9624b92-752b-4888-99da-f864e807a6f0-host-cni-netd\") pod \"ovnkube-node-p96z8\" (UID: \"a9624b92-752b-4888-99da-f864e807a6f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" Jun 10 16:44:42.985800 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.985375 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a9624b92-752b-4888-99da-f864e807a6f0-ovn-node-metrics-cert\") pod \"ovnkube-node-p96z8\" (UID: \"a9624b92-752b-4888-99da-f864e807a6f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" Jun 10 16:44:42.985800 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:42.985415 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 16:44:42.985800 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.985423 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a9624b92-752b-4888-99da-f864e807a6f0-ovnkube-script-lib\") pod \"ovnkube-node-p96z8\" (UID: \"a9624b92-752b-4888-99da-f864e807a6f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" Jun 10 16:44:42.985800 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.985446 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/04d3d006-a5bb-45bc-9aee-25b04c2b7560-os-release\") pod \"multus-km7gt\" (UID: \"04d3d006-a5bb-45bc-9aee-25b04c2b7560\") " pod="openshift-multus/multus-km7gt" Jun 10 16:44:42.985800 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:42.985494 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1955ad17-c126-4e00-b082-09ca6f6bba61-metrics-certs podName:1955ad17-c126-4e00-b082-09ca6f6bba61 nodeName:}" failed. No retries permitted until 2026-06-10 16:44:43.485453661 +0000 UTC m=+3.009666726 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1955ad17-c126-4e00-b082-09ca6f6bba61-metrics-certs") pod "network-metrics-daemon-frvb8" (UID: "1955ad17-c126-4e00-b082-09ca6f6bba61") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 16:44:42.986689 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.985692 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bedb86e4-97c5-49a2-bbbc-4f13bf6c0426-cni-binary-copy\") pod \"multus-additional-cni-plugins-mfkbh\" (UID: \"bedb86e4-97c5-49a2-bbbc-4f13bf6c0426\") " pod="openshift-multus/multus-additional-cni-plugins-mfkbh" Jun 10 16:44:42.986689 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.985720 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7965261b-bc5b-4d9c-b69e-5af087ee998e-etc-sysconfig\") pod \"tuned-z8b5l\" (UID: \"7965261b-bc5b-4d9c-b69e-5af087ee998e\") " pod="openshift-cluster-node-tuning-operator/tuned-z8b5l" Jun 10 16:44:42.986689 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.985727 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a9624b92-752b-4888-99da-f864e807a6f0-env-overrides\") pod \"ovnkube-node-p96z8\" (UID: \"a9624b92-752b-4888-99da-f864e807a6f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" Jun 10 16:44:42.986689 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.985746 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/745cd6f9-646a-4143-b3e5-9c84f4c0869a-kubelet-config\") pod \"global-pull-secret-syncer-5jkcf\" (UID: \"745cd6f9-646a-4143-b3e5-9c84f4c0869a\") " pod="kube-system/global-pull-secret-syncer-5jkcf" Jun 10 16:44:42.986689 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.985772 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a9624b92-752b-4888-99da-f864e807a6f0-host-slash\") pod \"ovnkube-node-p96z8\" (UID: \"a9624b92-752b-4888-99da-f864e807a6f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" Jun 10 16:44:42.986689 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.985797 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a9624b92-752b-4888-99da-f864e807a6f0-host-run-netns\") pod \"ovnkube-node-p96z8\" (UID: \"a9624b92-752b-4888-99da-f864e807a6f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" Jun 10 16:44:42.986689 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.985803 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a9624b92-752b-4888-99da-f864e807a6f0-host-cni-netd\") pod \"ovnkube-node-p96z8\" (UID: \"a9624b92-752b-4888-99da-f864e807a6f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" Jun 10 16:44:42.986689 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.985822 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/04d3d006-a5bb-45bc-9aee-25b04c2b7560-system-cni-dir\") pod \"multus-km7gt\" (UID: \"04d3d006-a5bb-45bc-9aee-25b04c2b7560\") " pod="openshift-multus/multus-km7gt" Jun 10 16:44:42.986689 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.985848 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/04d3d006-a5bb-45bc-9aee-25b04c2b7560-host-run-multus-certs\") pod \"multus-km7gt\" (UID: \"04d3d006-a5bb-45bc-9aee-25b04c2b7560\") " pod="openshift-multus/multus-km7gt" Jun 10 16:44:42.986689 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.985873 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7965261b-bc5b-4d9c-b69e-5af087ee998e-etc-modprobe-d\") pod \"tuned-z8b5l\" (UID: \"7965261b-bc5b-4d9c-b69e-5af087ee998e\") " pod="openshift-cluster-node-tuning-operator/tuned-z8b5l" Jun 10 16:44:42.986689 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.985899 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7965261b-bc5b-4d9c-b69e-5af087ee998e-etc-systemd\") pod \"tuned-z8b5l\" (UID: \"7965261b-bc5b-4d9c-b69e-5af087ee998e\") " pod="openshift-cluster-node-tuning-operator/tuned-z8b5l" Jun 10 16:44:42.986689 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.985902 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bedb86e4-97c5-49a2-bbbc-4f13bf6c0426-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mfkbh\" (UID: \"bedb86e4-97c5-49a2-bbbc-4f13bf6c0426\") " pod="openshift-multus/multus-additional-cni-plugins-mfkbh" Jun 10 16:44:42.986689 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.985922 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/224e07b4-de73-42d9-a0b2-300dd5944e96-tmp-dir\") pod \"node-resolver-65mjb\" (UID: \"224e07b4-de73-42d9-a0b2-300dd5944e96\") " pod="openshift-dns/node-resolver-65mjb" Jun 10 16:44:42.986689 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.985958 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zr7c\" (UniqueName: \"kubernetes.io/projected/65c6da66-78d8-4637-b28a-fb347d794e81-kube-api-access-9zr7c\") pod \"aws-ebs-csi-driver-node-d5k7w\" (UID: \"65c6da66-78d8-4637-b28a-fb347d794e81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d5k7w" Jun 10 16:44:42.986689 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.985969 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a9624b92-752b-4888-99da-f864e807a6f0-host-run-netns\") pod \"ovnkube-node-p96z8\" (UID: \"a9624b92-752b-4888-99da-f864e807a6f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" Jun 10 16:44:42.986689 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.985984 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a9624b92-752b-4888-99da-f864e807a6f0-systemd-units\") pod \"ovnkube-node-p96z8\" (UID: \"a9624b92-752b-4888-99da-f864e807a6f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" Jun 10 16:44:42.986689 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.986009 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a9624b92-752b-4888-99da-f864e807a6f0-run-systemd\") pod \"ovnkube-node-p96z8\" (UID: \"a9624b92-752b-4888-99da-f864e807a6f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" Jun 10 16:44:42.987700 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.986010 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a9624b92-752b-4888-99da-f864e807a6f0-ovnkube-script-lib\") pod \"ovnkube-node-p96z8\" (UID: \"a9624b92-752b-4888-99da-f864e807a6f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" Jun 10 16:44:42.987700 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.986032 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a9624b92-752b-4888-99da-f864e807a6f0-ovnkube-config\") pod \"ovnkube-node-p96z8\" (UID: \"a9624b92-752b-4888-99da-f864e807a6f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" Jun 10 16:44:42.987700 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.986060 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/04d3d006-a5bb-45bc-9aee-25b04c2b7560-cni-binary-copy\") pod \"multus-km7gt\" (UID: \"04d3d006-a5bb-45bc-9aee-25b04c2b7560\") " pod="openshift-multus/multus-km7gt" Jun 10 16:44:42.987700 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.986084 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7965261b-bc5b-4d9c-b69e-5af087ee998e-etc-sysctl-conf\") pod \"tuned-z8b5l\" (UID: \"7965261b-bc5b-4d9c-b69e-5af087ee998e\") " pod="openshift-cluster-node-tuning-operator/tuned-z8b5l" Jun 10 16:44:42.987700 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.986087 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7965261b-bc5b-4d9c-b69e-5af087ee998e-etc-modprobe-d\") pod \"tuned-z8b5l\" (UID: \"7965261b-bc5b-4d9c-b69e-5af087ee998e\") " pod="openshift-cluster-node-tuning-operator/tuned-z8b5l" Jun 10 16:44:42.987700 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.986108 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9z2c\" (UniqueName: \"kubernetes.io/projected/7965261b-bc5b-4d9c-b69e-5af087ee998e-kube-api-access-g9z2c\") pod \"tuned-z8b5l\" (UID: \"7965261b-bc5b-4d9c-b69e-5af087ee998e\") " pod="openshift-cluster-node-tuning-operator/tuned-z8b5l" Jun 10 16:44:42.987700 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.986135 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgq97\" (UniqueName: \"kubernetes.io/projected/a9624b92-752b-4888-99da-f864e807a6f0-kube-api-access-jgq97\") pod \"ovnkube-node-p96z8\" (UID: \"a9624b92-752b-4888-99da-f864e807a6f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" Jun 10 16:44:42.987700 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.986144 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7965261b-bc5b-4d9c-b69e-5af087ee998e-etc-sysconfig\") pod \"tuned-z8b5l\" (UID: \"7965261b-bc5b-4d9c-b69e-5af087ee998e\") " pod="openshift-cluster-node-tuning-operator/tuned-z8b5l" Jun 10 16:44:42.987700 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.986161 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/04d3d006-a5bb-45bc-9aee-25b04c2b7560-multus-socket-dir-parent\") pod \"multus-km7gt\" (UID: \"04d3d006-a5bb-45bc-9aee-25b04c2b7560\") " pod="openshift-multus/multus-km7gt" Jun 10 16:44:42.987700 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.986186 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/04d3d006-a5bb-45bc-9aee-25b04c2b7560-host-var-lib-cni-bin\") pod \"multus-km7gt\" (UID: \"04d3d006-a5bb-45bc-9aee-25b04c2b7560\") " pod="openshift-multus/multus-km7gt" Jun 10 16:44:42.987700 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.986193 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a9624b92-752b-4888-99da-f864e807a6f0-run-systemd\") pod \"ovnkube-node-p96z8\" (UID: \"a9624b92-752b-4888-99da-f864e807a6f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" Jun 10 16:44:42.987700 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.986210 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/04d3d006-a5bb-45bc-9aee-25b04c2b7560-multus-daemon-config\") pod \"multus-km7gt\" (UID: \"04d3d006-a5bb-45bc-9aee-25b04c2b7560\") " pod="openshift-multus/multus-km7gt" Jun 10 16:44:42.987700 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.986060 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a9624b92-752b-4888-99da-f864e807a6f0-systemd-units\") pod \"ovnkube-node-p96z8\" (UID: \"a9624b92-752b-4888-99da-f864e807a6f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" Jun 10 16:44:42.987700 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.986236 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04d3d006-a5bb-45bc-9aee-25b04c2b7560-etc-kubernetes\") pod \"multus-km7gt\" (UID: \"04d3d006-a5bb-45bc-9aee-25b04c2b7560\") " pod="openshift-multus/multus-km7gt" Jun 10 16:44:42.987700 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.986273 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7965261b-bc5b-4d9c-b69e-5af087ee998e-host\") pod \"tuned-z8b5l\" (UID: \"7965261b-bc5b-4d9c-b69e-5af087ee998e\") " pod="openshift-cluster-node-tuning-operator/tuned-z8b5l" Jun 10 16:44:42.987700 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.986299 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/224e07b4-de73-42d9-a0b2-300dd5944e96-tmp-dir\") pod \"node-resolver-65mjb\" (UID: \"224e07b4-de73-42d9-a0b2-300dd5944e96\") " pod="openshift-dns/node-resolver-65mjb" Jun 10 16:44:42.987700 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.986319 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9624b92-752b-4888-99da-f864e807a6f0-var-lib-openvswitch\") pod \"ovnkube-node-p96z8\" (UID: \"a9624b92-752b-4888-99da-f864e807a6f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" Jun 10 16:44:42.988468 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.986346 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a9624b92-752b-4888-99da-f864e807a6f0-node-log\") pod \"ovnkube-node-p96z8\" (UID: \"a9624b92-752b-4888-99da-f864e807a6f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" Jun 10 16:44:42.988468 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.986358 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7965261b-bc5b-4d9c-b69e-5af087ee998e-etc-sysctl-conf\") pod \"tuned-z8b5l\" (UID: \"7965261b-bc5b-4d9c-b69e-5af087ee998e\") " pod="openshift-cluster-node-tuning-operator/tuned-z8b5l" Jun 10 16:44:42.988468 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.986379 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7965261b-bc5b-4d9c-b69e-5af087ee998e-sys\") pod \"tuned-z8b5l\" (UID: \"7965261b-bc5b-4d9c-b69e-5af087ee998e\") " pod="openshift-cluster-node-tuning-operator/tuned-z8b5l" Jun 10 16:44:42.988468 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.986415 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/65c6da66-78d8-4637-b28a-fb347d794e81-sys-fs\") pod \"aws-ebs-csi-driver-node-d5k7w\" (UID: \"65c6da66-78d8-4637-b28a-fb347d794e81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d5k7w" Jun 10 16:44:42.988468 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.986438 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/04d3d006-a5bb-45bc-9aee-25b04c2b7560-multus-cni-dir\") pod \"multus-km7gt\" (UID: \"04d3d006-a5bb-45bc-9aee-25b04c2b7560\") " pod="openshift-multus/multus-km7gt" Jun 10 16:44:42.988468 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.986462 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/04d3d006-a5bb-45bc-9aee-25b04c2b7560-host-run-k8s-cni-cncf-io\") pod \"multus-km7gt\" (UID: \"04d3d006-a5bb-45bc-9aee-25b04c2b7560\") " pod="openshift-multus/multus-km7gt" Jun 10 16:44:42.988468 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.986503 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/04d3d006-a5bb-45bc-9aee-25b04c2b7560-host-var-lib-kubelet\") pod \"multus-km7gt\" (UID: \"04d3d006-a5bb-45bc-9aee-25b04c2b7560\") " pod="openshift-multus/multus-km7gt" Jun 10 16:44:42.988468 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.986527 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/745cd6f9-646a-4143-b3e5-9c84f4c0869a-dbus\") pod \"global-pull-secret-syncer-5jkcf\" (UID: \"745cd6f9-646a-4143-b3e5-9c84f4c0869a\") " pod="kube-system/global-pull-secret-syncer-5jkcf" Jun 10 16:44:42.988468 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.986033 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7965261b-bc5b-4d9c-b69e-5af087ee998e-etc-systemd\") pod \"tuned-z8b5l\" (UID: \"7965261b-bc5b-4d9c-b69e-5af087ee998e\") " pod="openshift-cluster-node-tuning-operator/tuned-z8b5l" Jun 10 16:44:42.988468 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.986552 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/04d3d006-a5bb-45bc-9aee-25b04c2b7560-host-var-lib-cni-multus\") pod \"multus-km7gt\" (UID: \"04d3d006-a5bb-45bc-9aee-25b04c2b7560\") " pod="openshift-multus/multus-km7gt" Jun 10 16:44:42.988468 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.986581 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bedb86e4-97c5-49a2-bbbc-4f13bf6c0426-os-release\") pod \"multus-additional-cni-plugins-mfkbh\" (UID: \"bedb86e4-97c5-49a2-bbbc-4f13bf6c0426\") " pod="openshift-multus/multus-additional-cni-plugins-mfkbh" Jun 10 16:44:42.988468 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.986599 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9624b92-752b-4888-99da-f864e807a6f0-var-lib-openvswitch\") pod \"ovnkube-node-p96z8\" (UID: \"a9624b92-752b-4888-99da-f864e807a6f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" Jun 10 16:44:42.988468 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.986606 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prpcx\" (UniqueName: \"kubernetes.io/projected/bedb86e4-97c5-49a2-bbbc-4f13bf6c0426-kube-api-access-prpcx\") pod \"multus-additional-cni-plugins-mfkbh\" (UID: \"bedb86e4-97c5-49a2-bbbc-4f13bf6c0426\") " pod="openshift-multus/multus-additional-cni-plugins-mfkbh" Jun 10 16:44:42.988468 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.986688 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a9624b92-752b-4888-99da-f864e807a6f0-ovnkube-config\") pod \"ovnkube-node-p96z8\" (UID: \"a9624b92-752b-4888-99da-f864e807a6f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" Jun 10 16:44:42.988468 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.986728 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bedb86e4-97c5-49a2-bbbc-4f13bf6c0426-cni-binary-copy\") pod \"multus-additional-cni-plugins-mfkbh\" (UID: \"bedb86e4-97c5-49a2-bbbc-4f13bf6c0426\") " pod="openshift-multus/multus-additional-cni-plugins-mfkbh" Jun 10 16:44:42.988468 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.986738 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bedb86e4-97c5-49a2-bbbc-4f13bf6c0426-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mfkbh\" (UID: \"bedb86e4-97c5-49a2-bbbc-4f13bf6c0426\") " pod="openshift-multus/multus-additional-cni-plugins-mfkbh" Jun 10 16:44:42.988468 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.986791 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/745cd6f9-646a-4143-b3e5-9c84f4c0869a-kubelet-config\") pod \"global-pull-secret-syncer-5jkcf\" (UID: \"745cd6f9-646a-4143-b3e5-9c84f4c0869a\") " pod="kube-system/global-pull-secret-syncer-5jkcf" Jun 10 16:44:42.989519 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.986794 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7965261b-bc5b-4d9c-b69e-5af087ee998e-host\") pod \"tuned-z8b5l\" (UID: \"7965261b-bc5b-4d9c-b69e-5af087ee998e\") " pod="openshift-cluster-node-tuning-operator/tuned-z8b5l" Jun 10 16:44:42.989519 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.986811 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27qqr\" (UniqueName: \"kubernetes.io/projected/139ad3f2-9413-4f80-a1a7-b86ae8edb649-kube-api-access-27qqr\") pod \"network-check-target-jwscc\" (UID: \"139ad3f2-9413-4f80-a1a7-b86ae8edb649\") " pod="openshift-network-diagnostics/network-check-target-jwscc" Jun 10 16:44:42.989519 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.986815 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a9624b92-752b-4888-99da-f864e807a6f0-node-log\") pod \"ovnkube-node-p96z8\" (UID: \"a9624b92-752b-4888-99da-f864e807a6f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" Jun 10 16:44:42.989519 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.986842 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/65c6da66-78d8-4637-b28a-fb347d794e81-sys-fs\") pod \"aws-ebs-csi-driver-node-d5k7w\" (UID: \"65c6da66-78d8-4637-b28a-fb347d794e81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d5k7w" Jun 10 16:44:42.989519 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.986838 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/51c9f98e-ff02-48f2-b3e7-340543a646a6-serviceca\") pod \"node-ca-7s4lf\" (UID: \"51c9f98e-ff02-48f2-b3e7-340543a646a6\") " pod="openshift-image-registry/node-ca-7s4lf" Jun 10 16:44:42.989519 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.985983 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2bff1d3f-6fe7-41ae-9084-5bc3ea7e4185-iptables-alerter-script\") pod \"iptables-alerter-7qdxg\" (UID: \"2bff1d3f-6fe7-41ae-9084-5bc3ea7e4185\") " pod="openshift-network-operator/iptables-alerter-7qdxg" Jun 10 16:44:42.989519 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.986883 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bedb86e4-97c5-49a2-bbbc-4f13bf6c0426-os-release\") pod \"multus-additional-cni-plugins-mfkbh\" (UID: \"bedb86e4-97c5-49a2-bbbc-4f13bf6c0426\") " pod="openshift-multus/multus-additional-cni-plugins-mfkbh" Jun 10 16:44:42.989519 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.986380 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a9624b92-752b-4888-99da-f864e807a6f0-host-slash\") pod \"ovnkube-node-p96z8\" (UID: \"a9624b92-752b-4888-99da-f864e807a6f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" Jun 10 16:44:42.989519 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.986886 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csggg\" (UniqueName: \"kubernetes.io/projected/2bff1d3f-6fe7-41ae-9084-5bc3ea7e4185-kube-api-access-csggg\") pod \"iptables-alerter-7qdxg\" (UID: \"2bff1d3f-6fe7-41ae-9084-5bc3ea7e4185\") " pod="openshift-network-operator/iptables-alerter-7qdxg" Jun 10 16:44:42.989519 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.986896 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7965261b-bc5b-4d9c-b69e-5af087ee998e-sys\") pod \"tuned-z8b5l\" (UID: \"7965261b-bc5b-4d9c-b69e-5af087ee998e\") " pod="openshift-cluster-node-tuning-operator/tuned-z8b5l" Jun 10 16:44:42.989519 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.986925 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/745cd6f9-646a-4143-b3e5-9c84f4c0869a-dbus\") pod \"global-pull-secret-syncer-5jkcf\" (UID: \"745cd6f9-646a-4143-b3e5-9c84f4c0869a\") " pod="kube-system/global-pull-secret-syncer-5jkcf" Jun 10 16:44:42.989519 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.986931 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/745cd6f9-646a-4143-b3e5-9c84f4c0869a-original-pull-secret\") pod \"global-pull-secret-syncer-5jkcf\" (UID: \"745cd6f9-646a-4143-b3e5-9c84f4c0869a\") " pod="kube-system/global-pull-secret-syncer-5jkcf" Jun 10 16:44:42.989519 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.986961 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9624b92-752b-4888-99da-f864e807a6f0-host-run-ovn-kubernetes\") pod \"ovnkube-node-p96z8\" (UID: \"a9624b92-752b-4888-99da-f864e807a6f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" Jun 10 16:44:42.989519 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.986989 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9624b92-752b-4888-99da-f864e807a6f0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-p96z8\" (UID: \"a9624b92-752b-4888-99da-f864e807a6f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" Jun 10 16:44:42.989519 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.987016 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/224e07b4-de73-42d9-a0b2-300dd5944e96-hosts-file\") pod \"node-resolver-65mjb\" (UID: \"224e07b4-de73-42d9-a0b2-300dd5944e96\") " pod="openshift-dns/node-resolver-65mjb" Jun 10 16:44:42.989519 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.987022 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9624b92-752b-4888-99da-f864e807a6f0-host-run-ovn-kubernetes\") pod \"ovnkube-node-p96z8\" (UID: \"a9624b92-752b-4888-99da-f864e807a6f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" Jun 10 16:44:42.989519 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:42.986992 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 16:44:42.990514 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:42.987079 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/745cd6f9-646a-4143-b3e5-9c84f4c0869a-original-pull-secret podName:745cd6f9-646a-4143-b3e5-9c84f4c0869a nodeName:}" failed. No retries permitted until 2026-06-10 16:44:43.487064141 +0000 UTC m=+3.011277202 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/745cd6f9-646a-4143-b3e5-9c84f4c0869a-original-pull-secret") pod "global-pull-secret-syncer-5jkcf" (UID: "745cd6f9-646a-4143-b3e5-9c84f4c0869a") : object "kube-system"/"original-pull-secret" not registered Jun 10 16:44:42.990514 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.987134 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9624b92-752b-4888-99da-f864e807a6f0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-p96z8\" (UID: \"a9624b92-752b-4888-99da-f864e807a6f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" Jun 10 16:44:42.990514 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.987179 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/224e07b4-de73-42d9-a0b2-300dd5944e96-hosts-file\") pod \"node-resolver-65mjb\" (UID: \"224e07b4-de73-42d9-a0b2-300dd5944e96\") " pod="openshift-dns/node-resolver-65mjb" Jun 10 16:44:42.990514 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.987207 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtw9t\" (UniqueName: \"kubernetes.io/projected/224e07b4-de73-42d9-a0b2-300dd5944e96-kube-api-access-qtw9t\") pod \"node-resolver-65mjb\" (UID: \"224e07b4-de73-42d9-a0b2-300dd5944e96\") " pod="openshift-dns/node-resolver-65mjb" Jun 10 16:44:42.990514 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.987233 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/65c6da66-78d8-4637-b28a-fb347d794e81-kubelet-dir\") pod \"aws-ebs-csi-driver-node-d5k7w\" (UID: \"65c6da66-78d8-4637-b28a-fb347d794e81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d5k7w" Jun 10 16:44:42.990514 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.987266 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/04d3d006-a5bb-45bc-9aee-25b04c2b7560-hostroot\") pod \"multus-km7gt\" (UID: \"04d3d006-a5bb-45bc-9aee-25b04c2b7560\") " pod="openshift-multus/multus-km7gt" Jun 10 16:44:42.990514 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.987288 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bedb86e4-97c5-49a2-bbbc-4f13bf6c0426-system-cni-dir\") pod \"multus-additional-cni-plugins-mfkbh\" (UID: \"bedb86e4-97c5-49a2-bbbc-4f13bf6c0426\") " pod="openshift-multus/multus-additional-cni-plugins-mfkbh" Jun 10 16:44:42.990514 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.987312 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7965261b-bc5b-4d9c-b69e-5af087ee998e-lib-modules\") pod \"tuned-z8b5l\" (UID: \"7965261b-bc5b-4d9c-b69e-5af087ee998e\") " pod="openshift-cluster-node-tuning-operator/tuned-z8b5l" Jun 10 16:44:42.990514 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.987334 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2bff1d3f-6fe7-41ae-9084-5bc3ea7e4185-host-slash\") pod \"iptables-alerter-7qdxg\" (UID: \"2bff1d3f-6fe7-41ae-9084-5bc3ea7e4185\") " pod="openshift-network-operator/iptables-alerter-7qdxg" Jun 10 16:44:42.990514 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.987362 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/65c6da66-78d8-4637-b28a-fb347d794e81-socket-dir\") pod \"aws-ebs-csi-driver-node-d5k7w\" (UID: \"65c6da66-78d8-4637-b28a-fb347d794e81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d5k7w" Jun 10 16:44:42.990514 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.987367 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bedb86e4-97c5-49a2-bbbc-4f13bf6c0426-system-cni-dir\") pod \"multus-additional-cni-plugins-mfkbh\" (UID: \"bedb86e4-97c5-49a2-bbbc-4f13bf6c0426\") " pod="openshift-multus/multus-additional-cni-plugins-mfkbh" Jun 10 16:44:42.990514 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.987392 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/51c9f98e-ff02-48f2-b3e7-340543a646a6-serviceca\") pod \"node-ca-7s4lf\" (UID: \"51c9f98e-ff02-48f2-b3e7-340543a646a6\") " pod="openshift-image-registry/node-ca-7s4lf" Jun 10 16:44:42.990514 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.987406 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2bff1d3f-6fe7-41ae-9084-5bc3ea7e4185-host-slash\") pod \"iptables-alerter-7qdxg\" (UID: \"2bff1d3f-6fe7-41ae-9084-5bc3ea7e4185\") " pod="openshift-network-operator/iptables-alerter-7qdxg" Jun 10 16:44:42.990514 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.987446 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/65c6da66-78d8-4637-b28a-fb347d794e81-device-dir\") pod \"aws-ebs-csi-driver-node-d5k7w\" (UID: \"65c6da66-78d8-4637-b28a-fb347d794e81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d5k7w" Jun 10 16:44:42.990514 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.987482 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7965261b-bc5b-4d9c-b69e-5af087ee998e-lib-modules\") pod \"tuned-z8b5l\" (UID: \"7965261b-bc5b-4d9c-b69e-5af087ee998e\") " pod="openshift-cluster-node-tuning-operator/tuned-z8b5l" Jun 10 16:44:42.990514 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.987499 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/65c6da66-78d8-4637-b28a-fb347d794e81-kubelet-dir\") pod \"aws-ebs-csi-driver-node-d5k7w\" (UID: \"65c6da66-78d8-4637-b28a-fb347d794e81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d5k7w" Jun 10 16:44:42.991239 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.987518 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/65c6da66-78d8-4637-b28a-fb347d794e81-socket-dir\") pod \"aws-ebs-csi-driver-node-d5k7w\" (UID: \"65c6da66-78d8-4637-b28a-fb347d794e81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d5k7w" Jun 10 16:44:42.991239 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.987543 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a9624b92-752b-4888-99da-f864e807a6f0-run-ovn\") pod \"ovnkube-node-p96z8\" (UID: \"a9624b92-752b-4888-99da-f864e807a6f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" Jun 10 16:44:42.991239 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.987560 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/65c6da66-78d8-4637-b28a-fb347d794e81-device-dir\") pod \"aws-ebs-csi-driver-node-d5k7w\" (UID: \"65c6da66-78d8-4637-b28a-fb347d794e81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d5k7w" Jun 10 16:44:42.991239 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.987609 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/04d3d006-a5bb-45bc-9aee-25b04c2b7560-cnibin\") pod \"multus-km7gt\" (UID: \"04d3d006-a5bb-45bc-9aee-25b04c2b7560\") " pod="openshift-multus/multus-km7gt" Jun 10 16:44:42.991239 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.987651 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/04d3d006-a5bb-45bc-9aee-25b04c2b7560-multus-conf-dir\") pod \"multus-km7gt\" (UID: \"04d3d006-a5bb-45bc-9aee-25b04c2b7560\") " pod="openshift-multus/multus-km7gt" Jun 10 16:44:42.991239 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.987698 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a9624b92-752b-4888-99da-f864e807a6f0-run-ovn\") pod \"ovnkube-node-p96z8\" (UID: \"a9624b92-752b-4888-99da-f864e807a6f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" Jun 10 16:44:42.991239 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.987733 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7965261b-bc5b-4d9c-b69e-5af087ee998e-etc-tuned\") pod \"tuned-z8b5l\" (UID: \"7965261b-bc5b-4d9c-b69e-5af087ee998e\") " pod="openshift-cluster-node-tuning-operator/tuned-z8b5l" Jun 10 16:44:42.991239 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.987761 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a8c96b8d-5704-4cf6-86b8-633cb01726a6-agent-certs\") pod \"konnectivity-agent-ghpgs\" (UID: \"a8c96b8d-5704-4cf6-86b8-633cb01726a6\") " pod="kube-system/konnectivity-agent-ghpgs" Jun 10 16:44:42.991239 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.987811 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9624b92-752b-4888-99da-f864e807a6f0-etc-openvswitch\") pod \"ovnkube-node-p96z8\" (UID: \"a9624b92-752b-4888-99da-f864e807a6f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" Jun 10 16:44:42.991239 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.987836 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a9624b92-752b-4888-99da-f864e807a6f0-log-socket\") pod \"ovnkube-node-p96z8\" (UID: \"a9624b92-752b-4888-99da-f864e807a6f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" Jun 10 16:44:42.991239 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.987864 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sd4mp\" (UniqueName: \"kubernetes.io/projected/04d3d006-a5bb-45bc-9aee-25b04c2b7560-kube-api-access-sd4mp\") pod \"multus-km7gt\" (UID: \"04d3d006-a5bb-45bc-9aee-25b04c2b7560\") " pod="openshift-multus/multus-km7gt" Jun 10 16:44:42.991239 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.987982 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a9624b92-752b-4888-99da-f864e807a6f0-log-socket\") pod \"ovnkube-node-p96z8\" (UID: \"a9624b92-752b-4888-99da-f864e807a6f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" Jun 10 16:44:42.991239 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.988309 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9624b92-752b-4888-99da-f864e807a6f0-etc-openvswitch\") pod \"ovnkube-node-p96z8\" (UID: \"a9624b92-752b-4888-99da-f864e807a6f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" Jun 10 16:44:42.991239 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.988738 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7965261b-bc5b-4d9c-b69e-5af087ee998e-tmp\") pod \"tuned-z8b5l\" (UID: \"7965261b-bc5b-4d9c-b69e-5af087ee998e\") " pod="openshift-cluster-node-tuning-operator/tuned-z8b5l" Jun 10 16:44:42.991239 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.988872 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a9624b92-752b-4888-99da-f864e807a6f0-ovn-node-metrics-cert\") pod \"ovnkube-node-p96z8\" (UID: \"a9624b92-752b-4888-99da-f864e807a6f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" Jun 10 16:44:42.991239 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.991209 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a8c96b8d-5704-4cf6-86b8-633cb01726a6-agent-certs\") pod \"konnectivity-agent-ghpgs\" (UID: \"a8c96b8d-5704-4cf6-86b8-633cb01726a6\") " pod="kube-system/konnectivity-agent-ghpgs" Jun 10 16:44:42.994568 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.994544 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7965261b-bc5b-4d9c-b69e-5af087ee998e-etc-tuned\") pod \"tuned-z8b5l\" (UID: \"7965261b-bc5b-4d9c-b69e-5af087ee998e\") " pod="openshift-cluster-node-tuning-operator/tuned-z8b5l" Jun 10 16:44:42.995078 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:42.995053 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 16:44:42.995176 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:42.995092 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 16:44:42.995176 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:42.995110 2562 projected.go:196] Error preparing data for projected volume kube-api-access-27qqr for pod openshift-network-diagnostics/network-check-target-jwscc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 16:44:42.995284 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:42.995176 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/139ad3f2-9413-4f80-a1a7-b86ae8edb649-kube-api-access-27qqr podName:139ad3f2-9413-4f80-a1a7-b86ae8edb649 nodeName:}" failed. No retries permitted until 2026-06-10 16:44:43.495158702 +0000 UTC m=+3.019371802 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-27qqr" (UniqueName: "kubernetes.io/projected/139ad3f2-9413-4f80-a1a7-b86ae8edb649-kube-api-access-27qqr") pod "network-check-target-jwscc" (UID: "139ad3f2-9413-4f80-a1a7-b86ae8edb649") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 16:44:42.996065 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.996044 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ppbm\" (UniqueName: \"kubernetes.io/projected/1955ad17-c126-4e00-b082-09ca6f6bba61-kube-api-access-9ppbm\") pod \"network-metrics-daemon-frvb8\" (UID: \"1955ad17-c126-4e00-b082-09ca6f6bba61\") " pod="openshift-multus/network-metrics-daemon-frvb8" Jun 10 16:44:42.997238 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.997210 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqzmt\" (UniqueName: \"kubernetes.io/projected/51c9f98e-ff02-48f2-b3e7-340543a646a6-kube-api-access-tqzmt\") pod \"node-ca-7s4lf\" (UID: \"51c9f98e-ff02-48f2-b3e7-340543a646a6\") " pod="openshift-image-registry/node-ca-7s4lf" Jun 10 16:44:42.997930 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.997904 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zr7c\" (UniqueName: \"kubernetes.io/projected/65c6da66-78d8-4637-b28a-fb347d794e81-kube-api-access-9zr7c\") pod \"aws-ebs-csi-driver-node-d5k7w\" (UID: \"65c6da66-78d8-4637-b28a-fb347d794e81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d5k7w" Jun 10 16:44:42.998520 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.998499 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9z2c\" (UniqueName: \"kubernetes.io/projected/7965261b-bc5b-4d9c-b69e-5af087ee998e-kube-api-access-g9z2c\") pod \"tuned-z8b5l\" (UID: \"7965261b-bc5b-4d9c-b69e-5af087ee998e\") " pod="openshift-cluster-node-tuning-operator/tuned-z8b5l" Jun 10 16:44:42.998590 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.998499 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-prpcx\" (UniqueName: \"kubernetes.io/projected/bedb86e4-97c5-49a2-bbbc-4f13bf6c0426-kube-api-access-prpcx\") pod \"multus-additional-cni-plugins-mfkbh\" (UID: \"bedb86e4-97c5-49a2-bbbc-4f13bf6c0426\") " pod="openshift-multus/multus-additional-cni-plugins-mfkbh" Jun 10 16:44:42.998938 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:42.998916 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-csggg\" (UniqueName: \"kubernetes.io/projected/2bff1d3f-6fe7-41ae-9084-5bc3ea7e4185-kube-api-access-csggg\") pod \"iptables-alerter-7qdxg\" (UID: \"2bff1d3f-6fe7-41ae-9084-5bc3ea7e4185\") " pod="openshift-network-operator/iptables-alerter-7qdxg" Jun 10 16:44:43.000032 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:43.000011 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgq97\" (UniqueName: \"kubernetes.io/projected/a9624b92-752b-4888-99da-f864e807a6f0-kube-api-access-jgq97\") pod \"ovnkube-node-p96z8\" (UID: \"a9624b92-752b-4888-99da-f864e807a6f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" Jun 10 16:44:43.000398 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:43.000375 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtw9t\" (UniqueName: \"kubernetes.io/projected/224e07b4-de73-42d9-a0b2-300dd5944e96-kube-api-access-qtw9t\") pod \"node-resolver-65mjb\" (UID: \"224e07b4-de73-42d9-a0b2-300dd5944e96\") " pod="openshift-dns/node-resolver-65mjb" Jun 10 16:44:43.088679 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:43.088650 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/04d3d006-a5bb-45bc-9aee-25b04c2b7560-hostroot\") pod \"multus-km7gt\" (UID: \"04d3d006-a5bb-45bc-9aee-25b04c2b7560\") " pod="openshift-multus/multus-km7gt" Jun 10 16:44:43.088856 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:43.088691 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/04d3d006-a5bb-45bc-9aee-25b04c2b7560-cnibin\") pod \"multus-km7gt\" (UID: \"04d3d006-a5bb-45bc-9aee-25b04c2b7560\") " pod="openshift-multus/multus-km7gt" Jun 10 16:44:43.088856 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:43.088714 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/04d3d006-a5bb-45bc-9aee-25b04c2b7560-multus-conf-dir\") pod \"multus-km7gt\" (UID: \"04d3d006-a5bb-45bc-9aee-25b04c2b7560\") " pod="openshift-multus/multus-km7gt" Jun 10 16:44:43.088856 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:43.088739 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sd4mp\" (UniqueName: \"kubernetes.io/projected/04d3d006-a5bb-45bc-9aee-25b04c2b7560-kube-api-access-sd4mp\") pod \"multus-km7gt\" (UID: \"04d3d006-a5bb-45bc-9aee-25b04c2b7560\") " pod="openshift-multus/multus-km7gt" Jun 10 16:44:43.088856 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:43.088776 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/04d3d006-a5bb-45bc-9aee-25b04c2b7560-host-run-netns\") pod \"multus-km7gt\" (UID: \"04d3d006-a5bb-45bc-9aee-25b04c2b7560\") " pod="openshift-multus/multus-km7gt" Jun 10 16:44:43.088856 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:43.088780 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/04d3d006-a5bb-45bc-9aee-25b04c2b7560-hostroot\") pod \"multus-km7gt\" (UID: \"04d3d006-a5bb-45bc-9aee-25b04c2b7560\") " pod="openshift-multus/multus-km7gt" Jun 10 16:44:43.088856 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:43.088804 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/04d3d006-a5bb-45bc-9aee-25b04c2b7560-multus-conf-dir\") pod \"multus-km7gt\" (UID: \"04d3d006-a5bb-45bc-9aee-25b04c2b7560\") " pod="openshift-multus/multus-km7gt" Jun 10 16:44:43.088856 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:43.088808 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/04d3d006-a5bb-45bc-9aee-25b04c2b7560-cnibin\") pod \"multus-km7gt\" (UID: \"04d3d006-a5bb-45bc-9aee-25b04c2b7560\") " pod="openshift-multus/multus-km7gt" Jun 10 16:44:43.088856 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:43.088819 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/04d3d006-a5bb-45bc-9aee-25b04c2b7560-os-release\") pod \"multus-km7gt\" (UID: \"04d3d006-a5bb-45bc-9aee-25b04c2b7560\") " pod="openshift-multus/multus-km7gt" Jun 10 16:44:43.089240 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:43.088864 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/04d3d006-a5bb-45bc-9aee-25b04c2b7560-system-cni-dir\") pod \"multus-km7gt\" (UID: \"04d3d006-a5bb-45bc-9aee-25b04c2b7560\") " pod="openshift-multus/multus-km7gt" Jun 10 16:44:43.089240 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:43.088878 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/04d3d006-a5bb-45bc-9aee-25b04c2b7560-os-release\") pod \"multus-km7gt\" (UID: \"04d3d006-a5bb-45bc-9aee-25b04c2b7560\") " pod="openshift-multus/multus-km7gt" Jun 10 16:44:43.089240 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:43.088892 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/04d3d006-a5bb-45bc-9aee-25b04c2b7560-host-run-multus-certs\") pod \"multus-km7gt\" (UID: \"04d3d006-a5bb-45bc-9aee-25b04c2b7560\") " pod="openshift-multus/multus-km7gt" Jun 10 16:44:43.089240 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:43.088921 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/04d3d006-a5bb-45bc-9aee-25b04c2b7560-cni-binary-copy\") pod \"multus-km7gt\" (UID: \"04d3d006-a5bb-45bc-9aee-25b04c2b7560\") " pod="openshift-multus/multus-km7gt" Jun 10 16:44:43.089240 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:43.088924 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/04d3d006-a5bb-45bc-9aee-25b04c2b7560-host-run-netns\") pod \"multus-km7gt\" (UID: \"04d3d006-a5bb-45bc-9aee-25b04c2b7560\") " pod="openshift-multus/multus-km7gt" Jun 10 16:44:43.089240 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:43.088945 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/04d3d006-a5bb-45bc-9aee-25b04c2b7560-multus-socket-dir-parent\") pod \"multus-km7gt\" (UID: \"04d3d006-a5bb-45bc-9aee-25b04c2b7560\") " pod="openshift-multus/multus-km7gt" Jun 10 16:44:43.089240 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:43.088969 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/04d3d006-a5bb-45bc-9aee-25b04c2b7560-host-var-lib-cni-bin\") pod \"multus-km7gt\" (UID: \"04d3d006-a5bb-45bc-9aee-25b04c2b7560\") " pod="openshift-multus/multus-km7gt" Jun 10 16:44:43.089240 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:43.088979 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/04d3d006-a5bb-45bc-9aee-25b04c2b7560-host-run-multus-certs\") pod \"multus-km7gt\" (UID: \"04d3d006-a5bb-45bc-9aee-25b04c2b7560\") " pod="openshift-multus/multus-km7gt" Jun 10 16:44:43.089240 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:43.088992 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/04d3d006-a5bb-45bc-9aee-25b04c2b7560-multus-daemon-config\") pod \"multus-km7gt\" (UID: \"04d3d006-a5bb-45bc-9aee-25b04c2b7560\") " pod="openshift-multus/multus-km7gt" Jun 10 16:44:43.089240 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:43.089013 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04d3d006-a5bb-45bc-9aee-25b04c2b7560-etc-kubernetes\") pod \"multus-km7gt\" (UID: \"04d3d006-a5bb-45bc-9aee-25b04c2b7560\") " pod="openshift-multus/multus-km7gt" Jun 10 16:44:43.089240 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:43.089026 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/04d3d006-a5bb-45bc-9aee-25b04c2b7560-system-cni-dir\") pod \"multus-km7gt\" (UID: \"04d3d006-a5bb-45bc-9aee-25b04c2b7560\") " pod="openshift-multus/multus-km7gt" Jun 10 16:44:43.089240 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:43.089037 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/04d3d006-a5bb-45bc-9aee-25b04c2b7560-multus-cni-dir\") pod \"multus-km7gt\" (UID: \"04d3d006-a5bb-45bc-9aee-25b04c2b7560\") " pod="openshift-multus/multus-km7gt" Jun 10 16:44:43.089240 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:43.089059 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/04d3d006-a5bb-45bc-9aee-25b04c2b7560-host-run-k8s-cni-cncf-io\") pod \"multus-km7gt\" (UID: \"04d3d006-a5bb-45bc-9aee-25b04c2b7560\") " pod="openshift-multus/multus-km7gt" Jun 10 16:44:43.089240 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:43.089076 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/04d3d006-a5bb-45bc-9aee-25b04c2b7560-host-var-lib-cni-bin\") pod \"multus-km7gt\" (UID: \"04d3d006-a5bb-45bc-9aee-25b04c2b7560\") " pod="openshift-multus/multus-km7gt" Jun 10 16:44:43.089240 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:43.089085 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/04d3d006-a5bb-45bc-9aee-25b04c2b7560-host-var-lib-kubelet\") pod \"multus-km7gt\" (UID: \"04d3d006-a5bb-45bc-9aee-25b04c2b7560\") " pod="openshift-multus/multus-km7gt" Jun 10 16:44:43.089240 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:43.089091 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04d3d006-a5bb-45bc-9aee-25b04c2b7560-etc-kubernetes\") pod \"multus-km7gt\" (UID: \"04d3d006-a5bb-45bc-9aee-25b04c2b7560\") " pod="openshift-multus/multus-km7gt" Jun 10 16:44:43.089240 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:43.089106 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/04d3d006-a5bb-45bc-9aee-25b04c2b7560-multus-socket-dir-parent\") pod \"multus-km7gt\" (UID: \"04d3d006-a5bb-45bc-9aee-25b04c2b7560\") " pod="openshift-multus/multus-km7gt" Jun 10 16:44:43.089240 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:43.089121 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/04d3d006-a5bb-45bc-9aee-25b04c2b7560-host-run-k8s-cni-cncf-io\") pod \"multus-km7gt\" (UID: \"04d3d006-a5bb-45bc-9aee-25b04c2b7560\") " pod="openshift-multus/multus-km7gt" Jun 10 16:44:43.089877 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:43.089132 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/04d3d006-a5bb-45bc-9aee-25b04c2b7560-host-var-lib-kubelet\") pod \"multus-km7gt\" (UID: \"04d3d006-a5bb-45bc-9aee-25b04c2b7560\") " pod="openshift-multus/multus-km7gt" Jun 10 16:44:43.089877 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:43.089144 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/04d3d006-a5bb-45bc-9aee-25b04c2b7560-multus-cni-dir\") pod \"multus-km7gt\" (UID: \"04d3d006-a5bb-45bc-9aee-25b04c2b7560\") " pod="openshift-multus/multus-km7gt" Jun 10 16:44:43.089877 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:43.089149 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/04d3d006-a5bb-45bc-9aee-25b04c2b7560-host-var-lib-cni-multus\") pod \"multus-km7gt\" (UID: \"04d3d006-a5bb-45bc-9aee-25b04c2b7560\") " pod="openshift-multus/multus-km7gt" Jun 10 16:44:43.089877 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:43.089185 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/04d3d006-a5bb-45bc-9aee-25b04c2b7560-host-var-lib-cni-multus\") pod \"multus-km7gt\" (UID: \"04d3d006-a5bb-45bc-9aee-25b04c2b7560\") " pod="openshift-multus/multus-km7gt" Jun 10 16:44:43.089877 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:43.089543 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/04d3d006-a5bb-45bc-9aee-25b04c2b7560-multus-daemon-config\") pod \"multus-km7gt\" (UID: \"04d3d006-a5bb-45bc-9aee-25b04c2b7560\") " pod="openshift-multus/multus-km7gt" Jun 10 16:44:43.089877 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:43.089562 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/04d3d006-a5bb-45bc-9aee-25b04c2b7560-cni-binary-copy\") pod \"multus-km7gt\" (UID: \"04d3d006-a5bb-45bc-9aee-25b04c2b7560\") " pod="openshift-multus/multus-km7gt" Jun 10 16:44:43.096235 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:43.096214 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sd4mp\" (UniqueName: \"kubernetes.io/projected/04d3d006-a5bb-45bc-9aee-25b04c2b7560-kube-api-access-sd4mp\") pod \"multus-km7gt\" (UID: \"04d3d006-a5bb-45bc-9aee-25b04c2b7560\") " pod="openshift-multus/multus-km7gt" Jun 10 16:44:43.174143 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:43.174039 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-65mjb" Jun 10 16:44:43.181962 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:43.181940 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mfkbh" Jun 10 16:44:43.189479 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:43.189454 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ghpgs" Jun 10 16:44:43.195491 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:43.195468 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d5k7w" Jun 10 16:44:43.202023 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:43.202007 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-z8b5l" Jun 10 16:44:43.208422 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:43.208403 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" Jun 10 16:44:43.215945 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:43.215929 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7s4lf" Jun 10 16:44:43.223292 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:43.223275 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7qdxg" Jun 10 16:44:43.228663 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:43.228647 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-km7gt" Jun 10 16:44:43.491508 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:43.491417 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1955ad17-c126-4e00-b082-09ca6f6bba61-metrics-certs\") pod \"network-metrics-daemon-frvb8\" (UID: \"1955ad17-c126-4e00-b082-09ca6f6bba61\") " pod="openshift-multus/network-metrics-daemon-frvb8" Jun 10 16:44:43.491660 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:43.491507 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/745cd6f9-646a-4143-b3e5-9c84f4c0869a-original-pull-secret\") pod \"global-pull-secret-syncer-5jkcf\" (UID: \"745cd6f9-646a-4143-b3e5-9c84f4c0869a\") " pod="kube-system/global-pull-secret-syncer-5jkcf" Jun 10 16:44:43.491660 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:43.491584 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 16:44:43.491660 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:43.491616 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 16:44:43.491802 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:43.491672 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1955ad17-c126-4e00-b082-09ca6f6bba61-metrics-certs podName:1955ad17-c126-4e00-b082-09ca6f6bba61 nodeName:}" failed. No retries permitted until 2026-06-10 16:44:44.491651232 +0000 UTC m=+4.015864302 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1955ad17-c126-4e00-b082-09ca6f6bba61-metrics-certs") pod "network-metrics-daemon-frvb8" (UID: "1955ad17-c126-4e00-b082-09ca6f6bba61") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 16:44:43.491802 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:43.491689 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/745cd6f9-646a-4143-b3e5-9c84f4c0869a-original-pull-secret podName:745cd6f9-646a-4143-b3e5-9c84f4c0869a nodeName:}" failed. No retries permitted until 2026-06-10 16:44:44.491681634 +0000 UTC m=+4.015894682 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/745cd6f9-646a-4143-b3e5-9c84f4c0869a-original-pull-secret") pod "global-pull-secret-syncer-5jkcf" (UID: "745cd6f9-646a-4143-b3e5-9c84f4c0869a") : object "kube-system"/"original-pull-secret" not registered Jun 10 16:44:43.591991 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:43.591951 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27qqr\" (UniqueName: \"kubernetes.io/projected/139ad3f2-9413-4f80-a1a7-b86ae8edb649-kube-api-access-27qqr\") pod \"network-check-target-jwscc\" (UID: \"139ad3f2-9413-4f80-a1a7-b86ae8edb649\") " pod="openshift-network-diagnostics/network-check-target-jwscc" Jun 10 16:44:43.592138 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:43.592102 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 16:44:43.592138 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:43.592121 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 16:44:43.592138 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:43.592131 2562 projected.go:196] Error preparing data for projected volume kube-api-access-27qqr for pod openshift-network-diagnostics/network-check-target-jwscc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 16:44:43.592275 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:43.592186 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/139ad3f2-9413-4f80-a1a7-b86ae8edb649-kube-api-access-27qqr podName:139ad3f2-9413-4f80-a1a7-b86ae8edb649 nodeName:}" failed. No retries permitted until 2026-06-10 16:44:44.59217264 +0000 UTC m=+4.116385688 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-27qqr" (UniqueName: "kubernetes.io/projected/139ad3f2-9413-4f80-a1a7-b86ae8edb649-kube-api-access-27qqr") pod "network-check-target-jwscc" (UID: "139ad3f2-9413-4f80-a1a7-b86ae8edb649") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 16:44:43.705960 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:43.705709 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod224e07b4_de73_42d9_a0b2_300dd5944e96.slice/crio-6dfe4e9caf1197823ea6ea1e3f65ee94da383882169f82c620443f8cd65e43b1 WatchSource:0}: Error finding container 6dfe4e9caf1197823ea6ea1e3f65ee94da383882169f82c620443f8cd65e43b1: Status 404 returned error can't find the container with id 6dfe4e9caf1197823ea6ea1e3f65ee94da383882169f82c620443f8cd65e43b1 Jun 10 16:44:43.707466 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:43.707443 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbedb86e4_97c5_49a2_bbbc_4f13bf6c0426.slice/crio-db8ffcbc9d6ae1b296b025d704d819f06d308862992f624387628b1e4134e9f2 WatchSource:0}: Error finding container db8ffcbc9d6ae1b296b025d704d819f06d308862992f624387628b1e4134e9f2: Status 404 returned error can't find the container with id db8ffcbc9d6ae1b296b025d704d819f06d308862992f624387628b1e4134e9f2 Jun 10 16:44:43.730752 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:43.730730 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7965261b_bc5b_4d9c_b69e_5af087ee998e.slice/crio-8ad19cd874dc5caff86e3ad6106437d8cb6f97400ae272666384c3192d1eded7 WatchSource:0}: Error finding container 8ad19cd874dc5caff86e3ad6106437d8cb6f97400ae272666384c3192d1eded7: Status 404 returned error can't find the container with id 8ad19cd874dc5caff86e3ad6106437d8cb6f97400ae272666384c3192d1eded7 Jun 10 16:44:43.733745 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:43.733718 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bff1d3f_6fe7_41ae_9084_5bc3ea7e4185.slice/crio-7e0e7b054bb13c7e31fddd63d67b16076a8aed1e56ce433d832abd5a10efb345 WatchSource:0}: Error finding container 7e0e7b054bb13c7e31fddd63d67b16076a8aed1e56ce433d832abd5a10efb345: Status 404 returned error can't find the container with id 7e0e7b054bb13c7e31fddd63d67b16076a8aed1e56ce433d832abd5a10efb345 Jun 10 16:44:43.735311 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:43.735287 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8c96b8d_5704_4cf6_86b8_633cb01726a6.slice/crio-d2f528fb0811592b79a8d33f6f046161f0b2125770ba2cf731a1989580d6a0eb WatchSource:0}: Error finding container d2f528fb0811592b79a8d33f6f046161f0b2125770ba2cf731a1989580d6a0eb: Status 404 returned error can't find the container with id d2f528fb0811592b79a8d33f6f046161f0b2125770ba2cf731a1989580d6a0eb Jun 10 16:44:43.736739 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:44:43.736716 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04d3d006_a5bb_45bc_9aee_25b04c2b7560.slice/crio-079e4f0b6c6dc807595c0f4a284916ac3a4ca1259e78db8f7a7c03da7cef5e4d WatchSource:0}: Error finding container 079e4f0b6c6dc807595c0f4a284916ac3a4ca1259e78db8f7a7c03da7cef5e4d: Status 404 returned error can't find the container with id 079e4f0b6c6dc807595c0f4a284916ac3a4ca1259e78db8f7a7c03da7cef5e4d Jun 10 16:44:43.927871 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:43.927831 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 16:39:42 +0000 UTC" deadline="2028-02-04 16:48:21.011717838 +0000 UTC" Jun 10 16:44:43.927871 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:43.927867 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14496h3m37.083854243s" Jun 10 16:44:43.954141 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:43.954092 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-z8b5l" event={"ID":"7965261b-bc5b-4d9c-b69e-5af087ee998e","Type":"ContainerStarted","Data":"8ad19cd874dc5caff86e3ad6106437d8cb6f97400ae272666384c3192d1eded7"} Jun 10 16:44:43.955294 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:43.955261 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mfkbh" event={"ID":"bedb86e4-97c5-49a2-bbbc-4f13bf6c0426","Type":"ContainerStarted","Data":"db8ffcbc9d6ae1b296b025d704d819f06d308862992f624387628b1e4134e9f2"} Jun 10 16:44:43.957317 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:43.957294 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-240.ec2.internal" event={"ID":"9b7ffcb998d117f623e995855278ca37","Type":"ContainerStarted","Data":"c5038da770fd7e7ec8cead2b9e3ee193e960ffb8094b1d0f27106c261da113a1"} Jun 10 16:44:43.958448 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:43.958428 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d5k7w" event={"ID":"65c6da66-78d8-4637-b28a-fb347d794e81","Type":"ContainerStarted","Data":"3b78ebde9bd50b44d24dea0d3393ed48cd9eff8817d624e8d36f607d5c2a4f74"} Jun 10 16:44:43.960887 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:43.960868 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-km7gt" event={"ID":"04d3d006-a5bb-45bc-9aee-25b04c2b7560","Type":"ContainerStarted","Data":"079e4f0b6c6dc807595c0f4a284916ac3a4ca1259e78db8f7a7c03da7cef5e4d"} Jun 10 16:44:43.962883 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:43.962859 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-65mjb" event={"ID":"224e07b4-de73-42d9-a0b2-300dd5944e96","Type":"ContainerStarted","Data":"6dfe4e9caf1197823ea6ea1e3f65ee94da383882169f82c620443f8cd65e43b1"} Jun 10 16:44:43.963915 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:43.963890 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7s4lf" event={"ID":"51c9f98e-ff02-48f2-b3e7-340543a646a6","Type":"ContainerStarted","Data":"ab870c77fb7e834cdf87f306660c9beb61e491e678e313dfcd37b3986a48b66f"} Jun 10 16:44:43.965256 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:43.965236 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" event={"ID":"a9624b92-752b-4888-99da-f864e807a6f0","Type":"ContainerStarted","Data":"90d3fef8b8968314c038363e388a9a96033c57ba62d6f1137136486476c894d4"} Jun 10 16:44:43.966255 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:43.966228 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ghpgs" event={"ID":"a8c96b8d-5704-4cf6-86b8-633cb01726a6","Type":"ContainerStarted","Data":"d2f528fb0811592b79a8d33f6f046161f0b2125770ba2cf731a1989580d6a0eb"} Jun 10 16:44:43.967382 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:43.967361 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7qdxg" event={"ID":"2bff1d3f-6fe7-41ae-9084-5bc3ea7e4185","Type":"ContainerStarted","Data":"7e0e7b054bb13c7e31fddd63d67b16076a8aed1e56ce433d832abd5a10efb345"} Jun 10 16:44:43.972794 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:43.972747 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-240.ec2.internal" podStartSLOduration=1.972734536 podStartE2EDuration="1.972734536s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 16:44:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:44:43.972208982 +0000 UTC m=+3.496422056" watchObservedRunningTime="2026-06-10 16:44:43.972734536 +0000 UTC m=+3.496947605" Jun 10 16:44:44.499521 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:44.498688 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/745cd6f9-646a-4143-b3e5-9c84f4c0869a-original-pull-secret\") pod \"global-pull-secret-syncer-5jkcf\" (UID: \"745cd6f9-646a-4143-b3e5-9c84f4c0869a\") " pod="kube-system/global-pull-secret-syncer-5jkcf" Jun 10 16:44:44.499521 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:44.498767 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1955ad17-c126-4e00-b082-09ca6f6bba61-metrics-certs\") pod \"network-metrics-daemon-frvb8\" (UID: \"1955ad17-c126-4e00-b082-09ca6f6bba61\") " pod="openshift-multus/network-metrics-daemon-frvb8" Jun 10 16:44:44.499521 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:44.498898 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 16:44:44.499521 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:44.498995 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1955ad17-c126-4e00-b082-09ca6f6bba61-metrics-certs podName:1955ad17-c126-4e00-b082-09ca6f6bba61 nodeName:}" failed. No retries permitted until 2026-06-10 16:44:46.498976587 +0000 UTC m=+6.023189652 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1955ad17-c126-4e00-b082-09ca6f6bba61-metrics-certs") pod "network-metrics-daemon-frvb8" (UID: "1955ad17-c126-4e00-b082-09ca6f6bba61") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 16:44:44.499521 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:44.499435 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 16:44:44.499521 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:44.499486 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/745cd6f9-646a-4143-b3e5-9c84f4c0869a-original-pull-secret podName:745cd6f9-646a-4143-b3e5-9c84f4c0869a nodeName:}" failed. No retries permitted until 2026-06-10 16:44:46.499471722 +0000 UTC m=+6.023684771 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/745cd6f9-646a-4143-b3e5-9c84f4c0869a-original-pull-secret") pod "global-pull-secret-syncer-5jkcf" (UID: "745cd6f9-646a-4143-b3e5-9c84f4c0869a") : object "kube-system"/"original-pull-secret" not registered Jun 10 16:44:44.600598 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:44.599957 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27qqr\" (UniqueName: \"kubernetes.io/projected/139ad3f2-9413-4f80-a1a7-b86ae8edb649-kube-api-access-27qqr\") pod \"network-check-target-jwscc\" (UID: \"139ad3f2-9413-4f80-a1a7-b86ae8edb649\") " pod="openshift-network-diagnostics/network-check-target-jwscc" Jun 10 16:44:44.600598 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:44.600141 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 16:44:44.600598 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:44.600163 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 16:44:44.600598 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:44.600176 2562 projected.go:196] Error preparing data for projected volume kube-api-access-27qqr for pod openshift-network-diagnostics/network-check-target-jwscc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 16:44:44.600598 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:44.600236 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/139ad3f2-9413-4f80-a1a7-b86ae8edb649-kube-api-access-27qqr podName:139ad3f2-9413-4f80-a1a7-b86ae8edb649 nodeName:}" failed. No retries permitted until 2026-06-10 16:44:46.600217494 +0000 UTC m=+6.124430555 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-27qqr" (UniqueName: "kubernetes.io/projected/139ad3f2-9413-4f80-a1a7-b86ae8edb649-kube-api-access-27qqr") pod "network-check-target-jwscc" (UID: "139ad3f2-9413-4f80-a1a7-b86ae8edb649") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 16:44:44.928572 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:44.928449 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 16:39:42 +0000 UTC" deadline="2028-01-14 20:22:42.625219964 +0000 UTC" Jun 10 16:44:44.928572 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:44.928513 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13995h37m57.696711734s" Jun 10 16:44:44.943850 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:44.943212 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwscc" Jun 10 16:44:44.943850 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:44.943337 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jwscc" podUID="139ad3f2-9413-4f80-a1a7-b86ae8edb649" Jun 10 16:44:44.943850 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:44.943434 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frvb8" Jun 10 16:44:44.943850 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:44.943531 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frvb8" podUID="1955ad17-c126-4e00-b082-09ca6f6bba61" Jun 10 16:44:44.943850 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:44.943653 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5jkcf" Jun 10 16:44:44.943850 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:44.943731 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5jkcf" podUID="745cd6f9-646a-4143-b3e5-9c84f4c0869a" Jun 10 16:44:44.975051 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:44.975013 2562 generic.go:356] "Generic (PLEG): container finished" podID="6d4dfeae904d1951cf9e800fc852a4d5" containerID="b7c82a5ffff0749c523e75bb793dd7c5ee0f9cfb69ec84ad6fee8fd922467520" exitCode=0 Jun 10 16:44:44.975718 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:44.975689 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-240.ec2.internal" event={"ID":"6d4dfeae904d1951cf9e800fc852a4d5","Type":"ContainerDied","Data":"b7c82a5ffff0749c523e75bb793dd7c5ee0f9cfb69ec84ad6fee8fd922467520"} Jun 10 16:44:45.994847 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:45.994776 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-240.ec2.internal" event={"ID":"6d4dfeae904d1951cf9e800fc852a4d5","Type":"ContainerStarted","Data":"4eb5df2965cc140095e704cc35bdf2ee2b6d81209a5644388a8a7c8f432f81e1"} Jun 10 16:44:46.517923 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:46.517885 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1955ad17-c126-4e00-b082-09ca6f6bba61-metrics-certs\") pod \"network-metrics-daemon-frvb8\" (UID: \"1955ad17-c126-4e00-b082-09ca6f6bba61\") " pod="openshift-multus/network-metrics-daemon-frvb8" Jun 10 16:44:46.518120 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:46.517977 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/745cd6f9-646a-4143-b3e5-9c84f4c0869a-original-pull-secret\") pod \"global-pull-secret-syncer-5jkcf\" (UID: \"745cd6f9-646a-4143-b3e5-9c84f4c0869a\") " pod="kube-system/global-pull-secret-syncer-5jkcf" Jun 10 16:44:46.518191 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:46.518120 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 16:44:46.518191 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:46.518180 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/745cd6f9-646a-4143-b3e5-9c84f4c0869a-original-pull-secret podName:745cd6f9-646a-4143-b3e5-9c84f4c0869a nodeName:}" failed. No retries permitted until 2026-06-10 16:44:50.518163108 +0000 UTC m=+10.042376161 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/745cd6f9-646a-4143-b3e5-9c84f4c0869a-original-pull-secret") pod "global-pull-secret-syncer-5jkcf" (UID: "745cd6f9-646a-4143-b3e5-9c84f4c0869a") : object "kube-system"/"original-pull-secret" not registered Jun 10 16:44:46.518624 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:46.518598 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 16:44:46.518747 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:46.518679 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1955ad17-c126-4e00-b082-09ca6f6bba61-metrics-certs podName:1955ad17-c126-4e00-b082-09ca6f6bba61 nodeName:}" failed. No retries permitted until 2026-06-10 16:44:50.518660151 +0000 UTC m=+10.042873218 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1955ad17-c126-4e00-b082-09ca6f6bba61-metrics-certs") pod "network-metrics-daemon-frvb8" (UID: "1955ad17-c126-4e00-b082-09ca6f6bba61") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 16:44:46.619610 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:46.619310 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27qqr\" (UniqueName: \"kubernetes.io/projected/139ad3f2-9413-4f80-a1a7-b86ae8edb649-kube-api-access-27qqr\") pod \"network-check-target-jwscc\" (UID: \"139ad3f2-9413-4f80-a1a7-b86ae8edb649\") " pod="openshift-network-diagnostics/network-check-target-jwscc" Jun 10 16:44:46.619610 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:46.619527 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 16:44:46.619610 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:46.619549 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 16:44:46.619610 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:46.619563 2562 projected.go:196] Error preparing data for projected volume kube-api-access-27qqr for pod openshift-network-diagnostics/network-check-target-jwscc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 16:44:46.619957 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:46.619622 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/139ad3f2-9413-4f80-a1a7-b86ae8edb649-kube-api-access-27qqr podName:139ad3f2-9413-4f80-a1a7-b86ae8edb649 nodeName:}" failed. No retries permitted until 2026-06-10 16:44:50.619603337 +0000 UTC m=+10.143816402 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-27qqr" (UniqueName: "kubernetes.io/projected/139ad3f2-9413-4f80-a1a7-b86ae8edb649-kube-api-access-27qqr") pod "network-check-target-jwscc" (UID: "139ad3f2-9413-4f80-a1a7-b86ae8edb649") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 16:44:46.942606 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:46.942529 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5jkcf" Jun 10 16:44:46.942794 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:46.942745 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5jkcf" podUID="745cd6f9-646a-4143-b3e5-9c84f4c0869a" Jun 10 16:44:46.942862 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:46.942801 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frvb8" Jun 10 16:44:46.942862 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:46.942843 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwscc" Jun 10 16:44:46.942960 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:46.942930 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frvb8" podUID="1955ad17-c126-4e00-b082-09ca6f6bba61" Jun 10 16:44:46.943014 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:46.942995 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jwscc" podUID="139ad3f2-9413-4f80-a1a7-b86ae8edb649" Jun 10 16:44:48.942977 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:48.942945 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5jkcf" Jun 10 16:44:48.943428 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:48.943070 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5jkcf" podUID="745cd6f9-646a-4143-b3e5-9c84f4c0869a" Jun 10 16:44:48.943489 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:48.943432 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwscc" Jun 10 16:44:48.943547 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:48.943520 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jwscc" podUID="139ad3f2-9413-4f80-a1a7-b86ae8edb649" Jun 10 16:44:48.943604 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:48.943591 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frvb8" Jun 10 16:44:48.943719 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:48.943697 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frvb8" podUID="1955ad17-c126-4e00-b082-09ca6f6bba61" Jun 10 16:44:50.557008 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:50.556971 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1955ad17-c126-4e00-b082-09ca6f6bba61-metrics-certs\") pod \"network-metrics-daemon-frvb8\" (UID: \"1955ad17-c126-4e00-b082-09ca6f6bba61\") " pod="openshift-multus/network-metrics-daemon-frvb8" Jun 10 16:44:50.557422 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:50.557070 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/745cd6f9-646a-4143-b3e5-9c84f4c0869a-original-pull-secret\") pod \"global-pull-secret-syncer-5jkcf\" (UID: \"745cd6f9-646a-4143-b3e5-9c84f4c0869a\") " pod="kube-system/global-pull-secret-syncer-5jkcf" Jun 10 16:44:50.557422 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:50.557134 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 16:44:50.557422 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:50.557151 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 16:44:50.557422 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:50.557202 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/745cd6f9-646a-4143-b3e5-9c84f4c0869a-original-pull-secret podName:745cd6f9-646a-4143-b3e5-9c84f4c0869a nodeName:}" failed. No retries permitted until 2026-06-10 16:44:58.557183363 +0000 UTC m=+18.081396411 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/745cd6f9-646a-4143-b3e5-9c84f4c0869a-original-pull-secret") pod "global-pull-secret-syncer-5jkcf" (UID: "745cd6f9-646a-4143-b3e5-9c84f4c0869a") : object "kube-system"/"original-pull-secret" not registered Jun 10 16:44:50.557422 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:50.557219 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1955ad17-c126-4e00-b082-09ca6f6bba61-metrics-certs podName:1955ad17-c126-4e00-b082-09ca6f6bba61 nodeName:}" failed. No retries permitted until 2026-06-10 16:44:58.557209744 +0000 UTC m=+18.081422792 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1955ad17-c126-4e00-b082-09ca6f6bba61-metrics-certs") pod "network-metrics-daemon-frvb8" (UID: "1955ad17-c126-4e00-b082-09ca6f6bba61") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 16:44:50.657997 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:50.657379 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27qqr\" (UniqueName: \"kubernetes.io/projected/139ad3f2-9413-4f80-a1a7-b86ae8edb649-kube-api-access-27qqr\") pod \"network-check-target-jwscc\" (UID: \"139ad3f2-9413-4f80-a1a7-b86ae8edb649\") " pod="openshift-network-diagnostics/network-check-target-jwscc" Jun 10 16:44:50.657997 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:50.657583 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 16:44:50.657997 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:50.657598 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 16:44:50.657997 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:50.657607 2562 projected.go:196] Error preparing data for projected volume kube-api-access-27qqr for pod openshift-network-diagnostics/network-check-target-jwscc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 16:44:50.657997 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:50.657671 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/139ad3f2-9413-4f80-a1a7-b86ae8edb649-kube-api-access-27qqr podName:139ad3f2-9413-4f80-a1a7-b86ae8edb649 nodeName:}" failed. No retries permitted until 2026-06-10 16:44:58.657654051 +0000 UTC m=+18.181867101 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-27qqr" (UniqueName: "kubernetes.io/projected/139ad3f2-9413-4f80-a1a7-b86ae8edb649-kube-api-access-27qqr") pod "network-check-target-jwscc" (UID: "139ad3f2-9413-4f80-a1a7-b86ae8edb649") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 16:44:50.947437 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:50.947363 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwscc" Jun 10 16:44:50.947585 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:50.947465 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jwscc" podUID="139ad3f2-9413-4f80-a1a7-b86ae8edb649" Jun 10 16:44:50.947891 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:50.947867 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frvb8" Jun 10 16:44:50.948017 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:50.947991 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frvb8" podUID="1955ad17-c126-4e00-b082-09ca6f6bba61" Jun 10 16:44:50.948140 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:50.948124 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5jkcf" Jun 10 16:44:50.948236 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:50.948213 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5jkcf" podUID="745cd6f9-646a-4143-b3e5-9c84f4c0869a" Jun 10 16:44:52.942324 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:52.942282 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5jkcf" Jun 10 16:44:52.942805 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:52.942327 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwscc" Jun 10 16:44:52.942805 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:52.942407 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5jkcf" podUID="745cd6f9-646a-4143-b3e5-9c84f4c0869a" Jun 10 16:44:52.942805 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:52.942510 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jwscc" podUID="139ad3f2-9413-4f80-a1a7-b86ae8edb649" Jun 10 16:44:52.942805 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:52.942554 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frvb8" Jun 10 16:44:52.942805 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:52.942650 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frvb8" podUID="1955ad17-c126-4e00-b082-09ca6f6bba61" Jun 10 16:44:54.943006 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:54.942975 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5jkcf" Jun 10 16:44:54.943006 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:54.943000 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwscc" Jun 10 16:44:54.943514 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:54.943012 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frvb8" Jun 10 16:44:54.943514 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:54.943103 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5jkcf" podUID="745cd6f9-646a-4143-b3e5-9c84f4c0869a" Jun 10 16:44:54.943514 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:54.943241 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jwscc" podUID="139ad3f2-9413-4f80-a1a7-b86ae8edb649" Jun 10 16:44:54.943514 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:54.943335 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frvb8" podUID="1955ad17-c126-4e00-b082-09ca6f6bba61" Jun 10 16:44:56.943777 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:56.942915 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frvb8" Jun 10 16:44:56.943777 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:56.943055 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frvb8" podUID="1955ad17-c126-4e00-b082-09ca6f6bba61" Jun 10 16:44:56.943777 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:56.943456 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5jkcf" Jun 10 16:44:56.943777 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:56.943545 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5jkcf" podUID="745cd6f9-646a-4143-b3e5-9c84f4c0869a" Jun 10 16:44:56.943777 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:56.943603 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwscc" Jun 10 16:44:56.943777 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:56.943699 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jwscc" podUID="139ad3f2-9413-4f80-a1a7-b86ae8edb649" Jun 10 16:44:58.614555 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:58.614520 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/745cd6f9-646a-4143-b3e5-9c84f4c0869a-original-pull-secret\") pod \"global-pull-secret-syncer-5jkcf\" (UID: \"745cd6f9-646a-4143-b3e5-9c84f4c0869a\") " pod="kube-system/global-pull-secret-syncer-5jkcf" Jun 10 16:44:58.615028 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:58.614580 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1955ad17-c126-4e00-b082-09ca6f6bba61-metrics-certs\") pod \"network-metrics-daemon-frvb8\" (UID: \"1955ad17-c126-4e00-b082-09ca6f6bba61\") " pod="openshift-multus/network-metrics-daemon-frvb8" Jun 10 16:44:58.615028 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:58.614682 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 16:44:58.615028 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:58.614695 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 16:44:58.615028 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:58.614751 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1955ad17-c126-4e00-b082-09ca6f6bba61-metrics-certs podName:1955ad17-c126-4e00-b082-09ca6f6bba61 nodeName:}" failed. No retries permitted until 2026-06-10 16:45:14.614728541 +0000 UTC m=+34.138941589 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1955ad17-c126-4e00-b082-09ca6f6bba61-metrics-certs") pod "network-metrics-daemon-frvb8" (UID: "1955ad17-c126-4e00-b082-09ca6f6bba61") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 16:44:58.615028 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:58.614771 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/745cd6f9-646a-4143-b3e5-9c84f4c0869a-original-pull-secret podName:745cd6f9-646a-4143-b3e5-9c84f4c0869a nodeName:}" failed. No retries permitted until 2026-06-10 16:45:14.614760925 +0000 UTC m=+34.138973973 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/745cd6f9-646a-4143-b3e5-9c84f4c0869a-original-pull-secret") pod "global-pull-secret-syncer-5jkcf" (UID: "745cd6f9-646a-4143-b3e5-9c84f4c0869a") : object "kube-system"/"original-pull-secret" not registered Jun 10 16:44:58.715548 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:58.715509 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27qqr\" (UniqueName: \"kubernetes.io/projected/139ad3f2-9413-4f80-a1a7-b86ae8edb649-kube-api-access-27qqr\") pod \"network-check-target-jwscc\" (UID: \"139ad3f2-9413-4f80-a1a7-b86ae8edb649\") " pod="openshift-network-diagnostics/network-check-target-jwscc" Jun 10 16:44:58.715756 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:58.715715 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 16:44:58.715756 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:58.715738 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 16:44:58.715756 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:58.715747 2562 projected.go:196] Error preparing data for projected volume kube-api-access-27qqr for pod openshift-network-diagnostics/network-check-target-jwscc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 16:44:58.715894 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:58.715815 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/139ad3f2-9413-4f80-a1a7-b86ae8edb649-kube-api-access-27qqr podName:139ad3f2-9413-4f80-a1a7-b86ae8edb649 nodeName:}" failed. No retries permitted until 2026-06-10 16:45:14.715793178 +0000 UTC m=+34.240006226 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-27qqr" (UniqueName: "kubernetes.io/projected/139ad3f2-9413-4f80-a1a7-b86ae8edb649-kube-api-access-27qqr") pod "network-check-target-jwscc" (UID: "139ad3f2-9413-4f80-a1a7-b86ae8edb649") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 16:44:58.942561 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:58.942466 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frvb8" Jun 10 16:44:58.942561 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:58.942493 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5jkcf" Jun 10 16:44:58.942790 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:44:58.942466 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwscc" Jun 10 16:44:58.942790 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:58.942650 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frvb8" podUID="1955ad17-c126-4e00-b082-09ca6f6bba61" Jun 10 16:44:58.942790 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:58.942727 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jwscc" podUID="139ad3f2-9413-4f80-a1a7-b86ae8edb649" Jun 10 16:44:58.942937 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:44:58.942795 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5jkcf" podUID="745cd6f9-646a-4143-b3e5-9c84f4c0869a" Jun 10 16:45:00.943504 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:00.943472 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frvb8" Jun 10 16:45:00.944026 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:45:00.943570 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frvb8" podUID="1955ad17-c126-4e00-b082-09ca6f6bba61" Jun 10 16:45:00.944026 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:00.943678 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5jkcf" Jun 10 16:45:00.944026 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:45:00.943773 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5jkcf" podUID="745cd6f9-646a-4143-b3e5-9c84f4c0869a" Jun 10 16:45:00.944026 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:00.943825 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwscc" Jun 10 16:45:00.944026 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:45:00.943921 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jwscc" podUID="139ad3f2-9413-4f80-a1a7-b86ae8edb649" Jun 10 16:45:02.943475 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:02.943258 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwscc" Jun 10 16:45:02.944054 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:45:02.943587 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jwscc" podUID="139ad3f2-9413-4f80-a1a7-b86ae8edb649" Jun 10 16:45:02.944054 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:02.943699 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frvb8" Jun 10 16:45:02.944054 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:45:02.943791 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frvb8" podUID="1955ad17-c126-4e00-b082-09ca6f6bba61" Jun 10 16:45:02.944054 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:02.943920 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5jkcf" Jun 10 16:45:02.944054 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:45:02.943998 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5jkcf" podUID="745cd6f9-646a-4143-b3e5-9c84f4c0869a" Jun 10 16:45:03.028346 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:03.028316 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d5k7w" event={"ID":"65c6da66-78d8-4637-b28a-fb347d794e81","Type":"ContainerStarted","Data":"42cb9161f91c853820b2943a248d320edefcd4bc2ac86a6f3dc3edd484ca5824"} Jun 10 16:45:03.029737 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:03.029713 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-km7gt" event={"ID":"04d3d006-a5bb-45bc-9aee-25b04c2b7560","Type":"ContainerStarted","Data":"81cf77864be76db731ea86435bb25809cf49a88d4837caa8a2e90224418e7b90"} Jun 10 16:45:03.031212 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:03.031185 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-65mjb" event={"ID":"224e07b4-de73-42d9-a0b2-300dd5944e96","Type":"ContainerStarted","Data":"f3adead61680905189e206820186e51e5d76a9887ca17dfdb6820d1694874fa1"} Jun 10 16:45:03.032600 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:03.032573 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7s4lf" event={"ID":"51c9f98e-ff02-48f2-b3e7-340543a646a6","Type":"ContainerStarted","Data":"5d52b7965e7b7a6503f9cbfb5d300c9ec8136550ba6912006cf4d1e1b61b9d2e"} Jun 10 16:45:03.034677 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:03.034658 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" event={"ID":"a9624b92-752b-4888-99da-f864e807a6f0","Type":"ContainerStarted","Data":"0d69e54fcbb571ea9febed85f67fc9d7f0b999053077d826a2515be828b2410a"} Jun 10 16:45:03.036162 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:03.036141 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ghpgs" event={"ID":"a8c96b8d-5704-4cf6-86b8-633cb01726a6","Type":"ContainerStarted","Data":"8ac5ef8928bf5f121ccd2f335fbf7cfd2ecda628cbdf66587c8e95c42bcd551b"} Jun 10 16:45:03.037590 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:03.037573 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-z8b5l" event={"ID":"7965261b-bc5b-4d9c-b69e-5af087ee998e","Type":"ContainerStarted","Data":"8a3d19aa64b25faefe650fe940e8e78c876ff63197ff6a30b2065999cc541163"} Jun 10 16:45:03.038866 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:03.038842 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mfkbh" event={"ID":"bedb86e4-97c5-49a2-bbbc-4f13bf6c0426","Type":"ContainerStarted","Data":"d2cf2b031c1d917878fa9eafe3050c317965b4604e177856932761b2a9a5c2ed"} Jun 10 16:45:03.051004 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:03.050963 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-km7gt" podStartSLOduration=3.067569163 podStartE2EDuration="22.05095069s" totalImagesPullingTime="18.983381527s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 16:44:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:45:03.050735271 +0000 UTC m=+22.574948344" watchObservedRunningTime="2026-06-10 16:45:03.05095069 +0000 UTC m=+22.575163758" Jun 10 16:45:03.051507 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:03.051479 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-240.ec2.internal" podStartSLOduration=21.05146936 podStartE2EDuration="21.05146936s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 16:44:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:44:46.010531171 +0000 UTC m=+5.534744243" watchObservedRunningTime="2026-06-10 16:45:03.05146936 +0000 UTC m=+22.575682430" Jun 10 16:45:03.062842 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:03.062809 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-7s4lf" podStartSLOduration=3.112599688 podStartE2EDuration="22.062799293s" totalImagesPullingTime="18.950199605s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 16:44:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:45:03.062669922 +0000 UTC m=+22.586882993" watchObservedRunningTime="2026-06-10 16:45:03.062799293 +0000 UTC m=+22.587012363" Jun 10 16:45:03.075375 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:03.075329 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-65mjb" podStartSLOduration=3.108663796 podStartE2EDuration="22.075309768s" totalImagesPullingTime="18.966645972s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 16:44:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:45:03.075302002 +0000 UTC m=+22.599515070" watchObservedRunningTime="2026-06-10 16:45:03.075309768 +0000 UTC m=+22.599522839" Jun 10 16:45:03.116607 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:03.116546 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-ghpgs" podStartSLOduration=11.93033674 podStartE2EDuration="22.116523204s" totalImagesPullingTime="10.186186464s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:44:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:45:03.116239416 +0000 UTC m=+22.640452487" watchObservedRunningTime="2026-06-10 16:45:03.116523204 +0000 UTC m=+22.640736276" Jun 10 16:45:03.135007 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:03.134962 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-z8b5l" podStartSLOduration=3.172101259 podStartE2EDuration="22.134945926s" totalImagesPullingTime="18.962844667s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 16:44:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:45:03.134739712 +0000 UTC m=+22.658952785" watchObservedRunningTime="2026-06-10 16:45:03.134945926 +0000 UTC m=+22.659159053" Jun 10 16:45:03.987200 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:03.987053 2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 10 16:45:04.043710 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:04.043689 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p96z8_a9624b92-752b-4888-99da-f864e807a6f0/ovn-acl-logging/0.log" Jun 10 16:45:04.044010 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:04.043991 2562 generic.go:356] "Generic (PLEG): container finished" podID="a9624b92-752b-4888-99da-f864e807a6f0" containerID="29eb2b774500316b11c45f44a984a2c55c76b89fea64b4ef8556d1d4aaac3112" exitCode=1 Jun 10 16:45:04.044098 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:04.044065 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" event={"ID":"a9624b92-752b-4888-99da-f864e807a6f0","Type":"ContainerStarted","Data":"21ed7d59994165f383dfc3ca7f27e3e1737bb2866f11bef7735f35a0e9a67112"} Jun 10 16:45:04.044173 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:04.044153 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" event={"ID":"a9624b92-752b-4888-99da-f864e807a6f0","Type":"ContainerStarted","Data":"af9322838ffca71a8e418fab657a6184c895c35ab31aae50b7fed5cee84f940f"} Jun 10 16:45:04.044277 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:04.044201 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" event={"ID":"a9624b92-752b-4888-99da-f864e807a6f0","Type":"ContainerStarted","Data":"87d158ab8f3a7afaf239a7703abf64a058bbc38cbd8308fdf42581a89ca97a2a"} Jun 10 16:45:04.044277 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:04.044247 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" event={"ID":"a9624b92-752b-4888-99da-f864e807a6f0","Type":"ContainerStarted","Data":"2d4b4bc944c4bcc60f48a001776dd6802db367966c28dc4bffb6ff3a8593aeb0"} Jun 10 16:45:04.044361 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:04.044283 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" event={"ID":"a9624b92-752b-4888-99da-f864e807a6f0","Type":"ContainerDied","Data":"29eb2b774500316b11c45f44a984a2c55c76b89fea64b4ef8556d1d4aaac3112"} Jun 10 16:45:04.045521 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:04.045502 2562 generic.go:356] "Generic (PLEG): container finished" podID="bedb86e4-97c5-49a2-bbbc-4f13bf6c0426" containerID="d2cf2b031c1d917878fa9eafe3050c317965b4604e177856932761b2a9a5c2ed" exitCode=0 Jun 10 16:45:04.045615 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:04.045569 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mfkbh" event={"ID":"bedb86e4-97c5-49a2-bbbc-4f13bf6c0426","Type":"ContainerDied","Data":"d2cf2b031c1d917878fa9eafe3050c317965b4604e177856932761b2a9a5c2ed"} Jun 10 16:45:04.047436 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:04.047409 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d5k7w" event={"ID":"65c6da66-78d8-4637-b28a-fb347d794e81","Type":"ContainerStarted","Data":"80faa294d674ea78328d17ce2784210425e97dffeb1a3aa075c16cadbfaa5184"} Jun 10 16:45:04.942276 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:04.942242 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5jkcf" Jun 10 16:45:04.942276 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:04.942261 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwscc" Jun 10 16:45:04.942520 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:45:04.942381 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5jkcf" podUID="745cd6f9-646a-4143-b3e5-9c84f4c0869a" Jun 10 16:45:04.942520 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:45:04.942473 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jwscc" podUID="139ad3f2-9413-4f80-a1a7-b86ae8edb649" Jun 10 16:45:04.942595 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:04.942535 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frvb8" Jun 10 16:45:04.942651 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:45:04.942597 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frvb8" podUID="1955ad17-c126-4e00-b082-09ca6f6bba61" Jun 10 16:45:04.944467 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:04.944343 2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-10T16:45:03.987195562Z","UUID":"cf984a70-17cc-404f-a68a-4fef1d4865e3","Handler":null,"Name":"","Endpoint":""} Jun 10 16:45:04.946451 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:04.946413 2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 10 16:45:04.946600 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:04.946457 2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 10 16:45:05.051250 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:05.051225 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7qdxg" event={"ID":"2bff1d3f-6fe7-41ae-9084-5bc3ea7e4185","Type":"ContainerStarted","Data":"323360ab7269ca088adf3dac19b0bea67e543461db5a70718f470500e5cff3fc"} Jun 10 16:45:05.109240 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:05.109047 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7qdxg" podStartSLOduration=5.152789774 podStartE2EDuration="24.109030473s" totalImagesPullingTime="18.956240699s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 16:44:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:45:05.10853605 +0000 UTC m=+24.632749119" watchObservedRunningTime="2026-06-10 16:45:05.109030473 +0000 UTC m=+24.633243543" Jun 10 16:45:06.057687 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:06.057655 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p96z8_a9624b92-752b-4888-99da-f864e807a6f0/ovn-acl-logging/0.log" Jun 10 16:45:06.058208 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:06.058072 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" event={"ID":"a9624b92-752b-4888-99da-f864e807a6f0","Type":"ContainerStarted","Data":"70c3c62ba9d8d88447c0daad532d21825b0f86423c45c7e97f9634c8db19fba6"} Jun 10 16:45:06.060546 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:06.060481 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d5k7w" event={"ID":"65c6da66-78d8-4637-b28a-fb347d794e81","Type":"ContainerStarted","Data":"6ed5094ffdbab593d12a6b18b45432f47d972bc0bf50c43762646d3dfddad9a7"} Jun 10 16:45:06.942762 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:06.942725 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwscc" Jun 10 16:45:06.942949 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:06.942738 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5jkcf" Jun 10 16:45:06.942949 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:45:06.942835 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jwscc" podUID="139ad3f2-9413-4f80-a1a7-b86ae8edb649" Jun 10 16:45:06.942949 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:06.942738 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frvb8" Jun 10 16:45:06.942949 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:45:06.942920 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5jkcf" podUID="745cd6f9-646a-4143-b3e5-9c84f4c0869a" Jun 10 16:45:06.943155 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:45:06.943034 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frvb8" podUID="1955ad17-c126-4e00-b082-09ca6f6bba61" Jun 10 16:45:07.367838 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:07.367756 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-ghpgs" Jun 10 16:45:07.368906 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:07.368881 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-ghpgs" Jun 10 16:45:07.382321 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:07.382266 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d5k7w" podStartSLOduration=5.496842335 podStartE2EDuration="26.382252812s" totalImagesPullingTime="20.885410477s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 16:44:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:45:06.076238891 +0000 UTC m=+25.600451957" watchObservedRunningTime="2026-06-10 16:45:07.382252812 +0000 UTC m=+26.906465881" Jun 10 16:45:08.068996 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:08.068845 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p96z8_a9624b92-752b-4888-99da-f864e807a6f0/ovn-acl-logging/0.log" Jun 10 16:45:08.069473 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:08.069443 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" event={"ID":"a9624b92-752b-4888-99da-f864e807a6f0","Type":"ContainerStarted","Data":"ede5a90275267c0721d71442265c56718a529eef8eed7f6e50a919fa9edd5427"} Jun 10 16:45:08.070035 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:08.070016 2562 scope.go:117] "RemoveContainer" containerID="29eb2b774500316b11c45f44a984a2c55c76b89fea64b4ef8556d1d4aaac3112" Jun 10 16:45:08.942740 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:08.942714 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5jkcf" Jun 10 16:45:08.943207 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:08.942815 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwscc" Jun 10 16:45:08.943207 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:08.942850 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frvb8" Jun 10 16:45:08.943207 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:45:08.942818 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5jkcf" podUID="745cd6f9-646a-4143-b3e5-9c84f4c0869a" Jun 10 16:45:08.943207 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:45:08.942909 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jwscc" podUID="139ad3f2-9413-4f80-a1a7-b86ae8edb649" Jun 10 16:45:08.943207 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:45:08.942997 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frvb8" podUID="1955ad17-c126-4e00-b082-09ca6f6bba61" Jun 10 16:45:09.074883 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:09.074856 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p96z8_a9624b92-752b-4888-99da-f864e807a6f0/ovn-acl-logging/0.log" Jun 10 16:45:09.075197 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:09.075173 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" event={"ID":"a9624b92-752b-4888-99da-f864e807a6f0","Type":"ContainerStarted","Data":"14407f95f05f38932cbedaaefb6405610ffa8c109f19695d0a072ea947027d82"} Jun 10 16:45:09.075447 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:09.075421 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" Jun 10 16:45:09.075619 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:09.075602 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" Jun 10 16:45:09.075724 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:09.075703 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" Jun 10 16:45:09.077074 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:09.077047 2562 generic.go:356] "Generic (PLEG): container finished" podID="bedb86e4-97c5-49a2-bbbc-4f13bf6c0426" containerID="692f84b7140f2b0775d9c517ae42893da7967e82a4b0b34f52ea2a7a04ac8229" exitCode=0 Jun 10 16:45:09.077158 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:09.077100 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mfkbh" event={"ID":"bedb86e4-97c5-49a2-bbbc-4f13bf6c0426","Type":"ContainerDied","Data":"692f84b7140f2b0775d9c517ae42893da7967e82a4b0b34f52ea2a7a04ac8229"} Jun 10 16:45:09.092876 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:09.092857 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" Jun 10 16:45:09.092958 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:09.092948 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" Jun 10 16:45:09.104833 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:09.104793 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" podStartSLOduration=9.088549754 podStartE2EDuration="28.104779288s" totalImagesPullingTime="19.016229534s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 16:44:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:45:09.101291987 +0000 UTC m=+28.625505056" watchObservedRunningTime="2026-06-10 16:45:09.104779288 +0000 UTC m=+28.628992357" Jun 10 16:45:09.662982 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:09.662953 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-ghpgs" Jun 10 16:45:09.663141 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:09.663112 2562 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 10 16:45:09.663751 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:09.663723 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-ghpgs" Jun 10 16:45:09.921330 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:09.921242 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jwscc"] Jun 10 16:45:09.921494 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:09.921378 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwscc" Jun 10 16:45:09.921552 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:45:09.921496 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jwscc" podUID="139ad3f2-9413-4f80-a1a7-b86ae8edb649" Jun 10 16:45:09.922929 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:09.922903 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5jkcf"] Jun 10 16:45:09.923038 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:09.922993 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5jkcf" Jun 10 16:45:09.923086 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:45:09.923071 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5jkcf" podUID="745cd6f9-646a-4143-b3e5-9c84f4c0869a" Jun 10 16:45:09.925701 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:09.925675 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-frvb8"] Jun 10 16:45:09.925810 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:09.925770 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frvb8" Jun 10 16:45:09.925887 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:45:09.925864 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frvb8" podUID="1955ad17-c126-4e00-b082-09ca6f6bba61" Jun 10 16:45:10.081330 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:10.081293 2562 generic.go:356] "Generic (PLEG): container finished" podID="bedb86e4-97c5-49a2-bbbc-4f13bf6c0426" containerID="2abb690ac66c2e863cafe5a897e21c58222100776c78ebf137bba37ee35f5f81" exitCode=0 Jun 10 16:45:10.081741 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:10.081343 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mfkbh" event={"ID":"bedb86e4-97c5-49a2-bbbc-4f13bf6c0426","Type":"ContainerDied","Data":"2abb690ac66c2e863cafe5a897e21c58222100776c78ebf137bba37ee35f5f81"} Jun 10 16:45:11.085973 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:11.085800 2562 generic.go:356] "Generic (PLEG): container finished" podID="bedb86e4-97c5-49a2-bbbc-4f13bf6c0426" containerID="5ecd5f16550368b225c0c13ae02f8372961fece56899107df8fd5c5a5d1e2372" exitCode=0 Jun 10 16:45:11.085973 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:11.085878 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mfkbh" event={"ID":"bedb86e4-97c5-49a2-bbbc-4f13bf6c0426","Type":"ContainerDied","Data":"5ecd5f16550368b225c0c13ae02f8372961fece56899107df8fd5c5a5d1e2372"} Jun 10 16:45:11.942509 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:11.942435 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frvb8" Jun 10 16:45:11.942681 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:11.942441 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5jkcf" Jun 10 16:45:11.942681 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:45:11.942582 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frvb8" podUID="1955ad17-c126-4e00-b082-09ca6f6bba61" Jun 10 16:45:11.942681 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:11.942442 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwscc" Jun 10 16:45:11.942819 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:45:11.942674 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5jkcf" podUID="745cd6f9-646a-4143-b3e5-9c84f4c0869a" Jun 10 16:45:11.942819 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:45:11.942739 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jwscc" podUID="139ad3f2-9413-4f80-a1a7-b86ae8edb649" Jun 10 16:45:13.942678 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:13.942648 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5jkcf" Jun 10 16:45:13.943443 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:13.942651 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frvb8" Jun 10 16:45:13.943443 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:45:13.942751 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5jkcf" podUID="745cd6f9-646a-4143-b3e5-9c84f4c0869a" Jun 10 16:45:13.943443 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:13.942659 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwscc" Jun 10 16:45:13.943443 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:45:13.942880 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frvb8" podUID="1955ad17-c126-4e00-b082-09ca6f6bba61" Jun 10 16:45:13.943443 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:45:13.942993 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jwscc" podUID="139ad3f2-9413-4f80-a1a7-b86ae8edb649" Jun 10 16:45:14.638798 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:14.638768 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1955ad17-c126-4e00-b082-09ca6f6bba61-metrics-certs\") pod \"network-metrics-daemon-frvb8\" (UID: \"1955ad17-c126-4e00-b082-09ca6f6bba61\") " pod="openshift-multus/network-metrics-daemon-frvb8" Jun 10 16:45:14.638995 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:14.638825 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/745cd6f9-646a-4143-b3e5-9c84f4c0869a-original-pull-secret\") pod \"global-pull-secret-syncer-5jkcf\" (UID: \"745cd6f9-646a-4143-b3e5-9c84f4c0869a\") " pod="kube-system/global-pull-secret-syncer-5jkcf" Jun 10 16:45:14.638995 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:45:14.638932 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 16:45:14.638995 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:45:14.638968 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 16:45:14.639131 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:45:14.639006 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1955ad17-c126-4e00-b082-09ca6f6bba61-metrics-certs podName:1955ad17-c126-4e00-b082-09ca6f6bba61 nodeName:}" failed. No retries permitted until 2026-06-10 16:45:46.638986292 +0000 UTC m=+66.163199361 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1955ad17-c126-4e00-b082-09ca6f6bba61-metrics-certs") pod "network-metrics-daemon-frvb8" (UID: "1955ad17-c126-4e00-b082-09ca6f6bba61") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 16:45:14.639131 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:45:14.639031 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/745cd6f9-646a-4143-b3e5-9c84f4c0869a-original-pull-secret podName:745cd6f9-646a-4143-b3e5-9c84f4c0869a nodeName:}" failed. No retries permitted until 2026-06-10 16:45:46.639013617 +0000 UTC m=+66.163226679 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/745cd6f9-646a-4143-b3e5-9c84f4c0869a-original-pull-secret") pod "global-pull-secret-syncer-5jkcf" (UID: "745cd6f9-646a-4143-b3e5-9c84f4c0869a") : object "kube-system"/"original-pull-secret" not registered Jun 10 16:45:14.739927 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:14.739890 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27qqr\" (UniqueName: \"kubernetes.io/projected/139ad3f2-9413-4f80-a1a7-b86ae8edb649-kube-api-access-27qqr\") pod \"network-check-target-jwscc\" (UID: \"139ad3f2-9413-4f80-a1a7-b86ae8edb649\") " pod="openshift-network-diagnostics/network-check-target-jwscc" Jun 10 16:45:14.740128 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:45:14.740095 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 16:45:14.740128 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:45:14.740131 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 16:45:14.740301 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:45:14.740146 2562 projected.go:196] Error preparing data for projected volume kube-api-access-27qqr for pod openshift-network-diagnostics/network-check-target-jwscc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 16:45:14.740301 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:45:14.740215 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/139ad3f2-9413-4f80-a1a7-b86ae8edb649-kube-api-access-27qqr podName:139ad3f2-9413-4f80-a1a7-b86ae8edb649 nodeName:}" failed. No retries permitted until 2026-06-10 16:45:46.740194517 +0000 UTC m=+66.264407565 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-27qqr" (UniqueName: "kubernetes.io/projected/139ad3f2-9413-4f80-a1a7-b86ae8edb649-kube-api-access-27qqr") pod "network-check-target-jwscc" (UID: "139ad3f2-9413-4f80-a1a7-b86ae8edb649") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 16:45:15.760679 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:15.760584 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-240.ec2.internal" event="NodeReady" Jun 10 16:45:15.761160 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:15.760756 2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 10 16:45:15.796415 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:15.796387 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6fdf5fbd67-s8c6d"] Jun 10 16:45:15.826500 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:15.826469 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6fdf5fbd67-s8c6d"] Jun 10 16:45:15.826692 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:15.826509 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-sl6mv"] Jun 10 16:45:15.826692 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:15.826584 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6fdf5fbd67-s8c6d" Jun 10 16:45:15.828844 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:15.828818 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 10 16:45:15.829336 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:15.829025 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 10 16:45:15.829336 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:15.829190 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4p9m8\"" Jun 10 16:45:15.830086 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:15.829727 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 10 16:45:15.844568 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:15.844546 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-xlq8r"] Jun 10 16:45:15.844729 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:15.844704 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sl6mv" Jun 10 16:45:15.847047 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:15.847025 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 10 16:45:15.847151 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:15.847100 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xq2hm\"" Jun 10 16:45:15.847265 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:15.847250 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 10 16:45:15.849881 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:15.849859 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 10 16:45:15.862646 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:15.862610 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xlq8r"] Jun 10 16:45:15.862772 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:15.862666 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sl6mv"] Jun 10 16:45:15.862772 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:15.862724 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xlq8r" Jun 10 16:45:15.864853 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:15.864833 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 10 16:45:15.864957 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:15.864854 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 10 16:45:15.864957 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:15.864900 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-6lxlw\"" Jun 10 16:45:15.865103 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:15.865087 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 10 16:45:15.943112 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:15.943061 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5jkcf" Jun 10 16:45:15.943112 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:15.943104 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frvb8" Jun 10 16:45:15.943356 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:15.943104 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwscc" Jun 10 16:45:15.945967 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:15.945945 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 16:45:15.946235 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:15.946216 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zxq5w\"" Jun 10 16:45:15.946369 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:15.946245 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 10 16:45:15.946369 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:15.946269 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 16:45:15.946369 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:15.946222 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 10 16:45:15.946538 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:15.946393 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ldbtp\"" Jun 10 16:45:15.947750 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:15.947729 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6f8001d1-a59a-412b-acb9-b4a5c479b06b-registry-certificates\") pod \"image-registry-6fdf5fbd67-s8c6d\" (UID: \"6f8001d1-a59a-412b-acb9-b4a5c479b06b\") " pod="openshift-image-registry/image-registry-6fdf5fbd67-s8c6d" Jun 10 16:45:15.947847 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:15.947763 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eab6293a-4de8-4ed2-9642-c8053281de99-cert\") pod \"ingress-canary-xlq8r\" (UID: \"eab6293a-4de8-4ed2-9642-c8053281de99\") " pod="openshift-ingress-canary/ingress-canary-xlq8r" Jun 10 16:45:15.947847 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:15.947819 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6f8001d1-a59a-412b-acb9-b4a5c479b06b-installation-pull-secrets\") pod \"image-registry-6fdf5fbd67-s8c6d\" (UID: \"6f8001d1-a59a-412b-acb9-b4a5c479b06b\") " pod="openshift-image-registry/image-registry-6fdf5fbd67-s8c6d" Jun 10 16:45:15.947954 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:15.947872 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6f8001d1-a59a-412b-acb9-b4a5c479b06b-image-registry-private-configuration\") pod \"image-registry-6fdf5fbd67-s8c6d\" (UID: \"6f8001d1-a59a-412b-acb9-b4a5c479b06b\") " pod="openshift-image-registry/image-registry-6fdf5fbd67-s8c6d" Jun 10 16:45:15.947954 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:15.947899 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6f8001d1-a59a-412b-acb9-b4a5c479b06b-ca-trust-extracted\") pod \"image-registry-6fdf5fbd67-s8c6d\" (UID: \"6f8001d1-a59a-412b-acb9-b4a5c479b06b\") " pod="openshift-image-registry/image-registry-6fdf5fbd67-s8c6d" Jun 10 16:45:15.947954 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:15.947922 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6f8001d1-a59a-412b-acb9-b4a5c479b06b-trusted-ca\") pod \"image-registry-6fdf5fbd67-s8c6d\" (UID: \"6f8001d1-a59a-412b-acb9-b4a5c479b06b\") " pod="openshift-image-registry/image-registry-6fdf5fbd67-s8c6d" Jun 10 16:45:15.948089 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:15.947965 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bf8qr\" (UniqueName: \"kubernetes.io/projected/6f8001d1-a59a-412b-acb9-b4a5c479b06b-kube-api-access-bf8qr\") pod \"image-registry-6fdf5fbd67-s8c6d\" (UID: \"6f8001d1-a59a-412b-acb9-b4a5c479b06b\") " pod="openshift-image-registry/image-registry-6fdf5fbd67-s8c6d" Jun 10 16:45:15.948089 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:15.947991 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gxsw\" (UniqueName: \"kubernetes.io/projected/eab6293a-4de8-4ed2-9642-c8053281de99-kube-api-access-9gxsw\") pod \"ingress-canary-xlq8r\" (UID: \"eab6293a-4de8-4ed2-9642-c8053281de99\") " pod="openshift-ingress-canary/ingress-canary-xlq8r" Jun 10 16:45:15.948089 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:15.948032 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d4ee7a98-0681-402a-b223-d8160df30d7a-config-volume\") pod \"dns-default-sl6mv\" (UID: \"d4ee7a98-0681-402a-b223-d8160df30d7a\") " pod="openshift-dns/dns-default-sl6mv" Jun 10 16:45:15.948206 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:15.948100 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6f8001d1-a59a-412b-acb9-b4a5c479b06b-registry-tls\") pod \"image-registry-6fdf5fbd67-s8c6d\" (UID: \"6f8001d1-a59a-412b-acb9-b4a5c479b06b\") " pod="openshift-image-registry/image-registry-6fdf5fbd67-s8c6d" Jun 10 16:45:15.948206 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:15.948126 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6f8001d1-a59a-412b-acb9-b4a5c479b06b-bound-sa-token\") pod \"image-registry-6fdf5fbd67-s8c6d\" (UID: \"6f8001d1-a59a-412b-acb9-b4a5c479b06b\") " pod="openshift-image-registry/image-registry-6fdf5fbd67-s8c6d" Jun 10 16:45:15.948206 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:15.948150 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndf9m\" (UniqueName: \"kubernetes.io/projected/d4ee7a98-0681-402a-b223-d8160df30d7a-kube-api-access-ndf9m\") pod \"dns-default-sl6mv\" (UID: \"d4ee7a98-0681-402a-b223-d8160df30d7a\") " pod="openshift-dns/dns-default-sl6mv" Jun 10 16:45:15.948206 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:15.948175 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4ee7a98-0681-402a-b223-d8160df30d7a-tmp-dir\") pod \"dns-default-sl6mv\" (UID: \"d4ee7a98-0681-402a-b223-d8160df30d7a\") " pod="openshift-dns/dns-default-sl6mv" Jun 10 16:45:15.948356 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:15.948234 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4ee7a98-0681-402a-b223-d8160df30d7a-metrics-tls\") pod \"dns-default-sl6mv\" (UID: \"d4ee7a98-0681-402a-b223-d8160df30d7a\") " pod="openshift-dns/dns-default-sl6mv" Jun 10 16:45:16.049044 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:16.048951 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6f8001d1-a59a-412b-acb9-b4a5c479b06b-registry-tls\") pod \"image-registry-6fdf5fbd67-s8c6d\" (UID: \"6f8001d1-a59a-412b-acb9-b4a5c479b06b\") " pod="openshift-image-registry/image-registry-6fdf5fbd67-s8c6d" Jun 10 16:45:16.049044 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:16.048991 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6f8001d1-a59a-412b-acb9-b4a5c479b06b-bound-sa-token\") pod \"image-registry-6fdf5fbd67-s8c6d\" (UID: \"6f8001d1-a59a-412b-acb9-b4a5c479b06b\") " pod="openshift-image-registry/image-registry-6fdf5fbd67-s8c6d" Jun 10 16:45:16.049044 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:16.049012 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndf9m\" (UniqueName: \"kubernetes.io/projected/d4ee7a98-0681-402a-b223-d8160df30d7a-kube-api-access-ndf9m\") pod \"dns-default-sl6mv\" (UID: \"d4ee7a98-0681-402a-b223-d8160df30d7a\") " pod="openshift-dns/dns-default-sl6mv" Jun 10 16:45:16.049044 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:16.049035 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4ee7a98-0681-402a-b223-d8160df30d7a-tmp-dir\") pod \"dns-default-sl6mv\" (UID: \"d4ee7a98-0681-402a-b223-d8160df30d7a\") " pod="openshift-dns/dns-default-sl6mv" Jun 10 16:45:16.049367 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:45:16.049135 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 16:45:16.049367 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:45:16.049156 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fdf5fbd67-s8c6d: secret "image-registry-tls" not found Jun 10 16:45:16.049367 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:45:16.049216 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6f8001d1-a59a-412b-acb9-b4a5c479b06b-registry-tls podName:6f8001d1-a59a-412b-acb9-b4a5c479b06b nodeName:}" failed. No retries permitted until 2026-06-10 16:45:16.549195909 +0000 UTC m=+36.073408970 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6f8001d1-a59a-412b-acb9-b4a5c479b06b-registry-tls") pod "image-registry-6fdf5fbd67-s8c6d" (UID: "6f8001d1-a59a-412b-acb9-b4a5c479b06b") : secret "image-registry-tls" not found Jun 10 16:45:16.049367 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:45:16.049222 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 16:45:16.049367 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:16.049152 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4ee7a98-0681-402a-b223-d8160df30d7a-metrics-tls\") pod \"dns-default-sl6mv\" (UID: \"d4ee7a98-0681-402a-b223-d8160df30d7a\") " pod="openshift-dns/dns-default-sl6mv" Jun 10 16:45:16.049367 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:45:16.049267 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4ee7a98-0681-402a-b223-d8160df30d7a-metrics-tls podName:d4ee7a98-0681-402a-b223-d8160df30d7a nodeName:}" failed. No retries permitted until 2026-06-10 16:45:16.549253986 +0000 UTC m=+36.073467034 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d4ee7a98-0681-402a-b223-d8160df30d7a-metrics-tls") pod "dns-default-sl6mv" (UID: "d4ee7a98-0681-402a-b223-d8160df30d7a") : secret "dns-default-metrics-tls" not found Jun 10 16:45:16.049367 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:16.049297 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6f8001d1-a59a-412b-acb9-b4a5c479b06b-registry-certificates\") pod \"image-registry-6fdf5fbd67-s8c6d\" (UID: \"6f8001d1-a59a-412b-acb9-b4a5c479b06b\") " pod="openshift-image-registry/image-registry-6fdf5fbd67-s8c6d" Jun 10 16:45:16.049367 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:16.049316 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eab6293a-4de8-4ed2-9642-c8053281de99-cert\") pod \"ingress-canary-xlq8r\" (UID: \"eab6293a-4de8-4ed2-9642-c8053281de99\") " pod="openshift-ingress-canary/ingress-canary-xlq8r" Jun 10 16:45:16.049367 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:16.049358 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6f8001d1-a59a-412b-acb9-b4a5c479b06b-installation-pull-secrets\") pod \"image-registry-6fdf5fbd67-s8c6d\" (UID: \"6f8001d1-a59a-412b-acb9-b4a5c479b06b\") " pod="openshift-image-registry/image-registry-6fdf5fbd67-s8c6d" Jun 10 16:45:16.049367 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:16.049371 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4ee7a98-0681-402a-b223-d8160df30d7a-tmp-dir\") pod \"dns-default-sl6mv\" (UID: \"d4ee7a98-0681-402a-b223-d8160df30d7a\") " pod="openshift-dns/dns-default-sl6mv" Jun 10 16:45:16.049810 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:16.049393 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6f8001d1-a59a-412b-acb9-b4a5c479b06b-image-registry-private-configuration\") pod \"image-registry-6fdf5fbd67-s8c6d\" (UID: \"6f8001d1-a59a-412b-acb9-b4a5c479b06b\") " pod="openshift-image-registry/image-registry-6fdf5fbd67-s8c6d" Jun 10 16:45:16.049810 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:16.049418 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6f8001d1-a59a-412b-acb9-b4a5c479b06b-ca-trust-extracted\") pod \"image-registry-6fdf5fbd67-s8c6d\" (UID: \"6f8001d1-a59a-412b-acb9-b4a5c479b06b\") " pod="openshift-image-registry/image-registry-6fdf5fbd67-s8c6d" Jun 10 16:45:16.049810 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:16.049433 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6f8001d1-a59a-412b-acb9-b4a5c479b06b-trusted-ca\") pod \"image-registry-6fdf5fbd67-s8c6d\" (UID: \"6f8001d1-a59a-412b-acb9-b4a5c479b06b\") " pod="openshift-image-registry/image-registry-6fdf5fbd67-s8c6d" Jun 10 16:45:16.049810 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:16.049461 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bf8qr\" (UniqueName: \"kubernetes.io/projected/6f8001d1-a59a-412b-acb9-b4a5c479b06b-kube-api-access-bf8qr\") pod \"image-registry-6fdf5fbd67-s8c6d\" (UID: \"6f8001d1-a59a-412b-acb9-b4a5c479b06b\") " pod="openshift-image-registry/image-registry-6fdf5fbd67-s8c6d" Jun 10 16:45:16.049810 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:16.049485 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gxsw\" (UniqueName: \"kubernetes.io/projected/eab6293a-4de8-4ed2-9642-c8053281de99-kube-api-access-9gxsw\") pod \"ingress-canary-xlq8r\" (UID: \"eab6293a-4de8-4ed2-9642-c8053281de99\") " pod="openshift-ingress-canary/ingress-canary-xlq8r" Jun 10 16:45:16.049810 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:16.049539 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d4ee7a98-0681-402a-b223-d8160df30d7a-config-volume\") pod \"dns-default-sl6mv\" (UID: \"d4ee7a98-0681-402a-b223-d8160df30d7a\") " pod="openshift-dns/dns-default-sl6mv" Jun 10 16:45:16.050036 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:16.049868 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6f8001d1-a59a-412b-acb9-b4a5c479b06b-ca-trust-extracted\") pod \"image-registry-6fdf5fbd67-s8c6d\" (UID: \"6f8001d1-a59a-412b-acb9-b4a5c479b06b\") " pod="openshift-image-registry/image-registry-6fdf5fbd67-s8c6d" Jun 10 16:45:16.050036 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:16.049895 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6f8001d1-a59a-412b-acb9-b4a5c479b06b-registry-certificates\") pod \"image-registry-6fdf5fbd67-s8c6d\" (UID: \"6f8001d1-a59a-412b-acb9-b4a5c479b06b\") " pod="openshift-image-registry/image-registry-6fdf5fbd67-s8c6d" Jun 10 16:45:16.050138 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:16.050112 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d4ee7a98-0681-402a-b223-d8160df30d7a-config-volume\") pod \"dns-default-sl6mv\" (UID: \"d4ee7a98-0681-402a-b223-d8160df30d7a\") " pod="openshift-dns/dns-default-sl6mv" Jun 10 16:45:16.050740 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:16.050716 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6f8001d1-a59a-412b-acb9-b4a5c479b06b-trusted-ca\") pod \"image-registry-6fdf5fbd67-s8c6d\" (UID: \"6f8001d1-a59a-412b-acb9-b4a5c479b06b\") " pod="openshift-image-registry/image-registry-6fdf5fbd67-s8c6d" Jun 10 16:45:16.053792 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:16.053768 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6f8001d1-a59a-412b-acb9-b4a5c479b06b-image-registry-private-configuration\") pod \"image-registry-6fdf5fbd67-s8c6d\" (UID: \"6f8001d1-a59a-412b-acb9-b4a5c479b06b\") " pod="openshift-image-registry/image-registry-6fdf5fbd67-s8c6d" Jun 10 16:45:16.053998 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:16.053979 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eab6293a-4de8-4ed2-9642-c8053281de99-cert\") pod \"ingress-canary-xlq8r\" (UID: \"eab6293a-4de8-4ed2-9642-c8053281de99\") " pod="openshift-ingress-canary/ingress-canary-xlq8r" Jun 10 16:45:16.054110 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:16.054093 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6f8001d1-a59a-412b-acb9-b4a5c479b06b-installation-pull-secrets\") pod \"image-registry-6fdf5fbd67-s8c6d\" (UID: \"6f8001d1-a59a-412b-acb9-b4a5c479b06b\") " pod="openshift-image-registry/image-registry-6fdf5fbd67-s8c6d" Jun 10 16:45:16.060067 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:16.060046 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndf9m\" (UniqueName: \"kubernetes.io/projected/d4ee7a98-0681-402a-b223-d8160df30d7a-kube-api-access-ndf9m\") pod \"dns-default-sl6mv\" (UID: \"d4ee7a98-0681-402a-b223-d8160df30d7a\") " pod="openshift-dns/dns-default-sl6mv" Jun 10 16:45:16.060401 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:16.060358 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6f8001d1-a59a-412b-acb9-b4a5c479b06b-bound-sa-token\") pod \"image-registry-6fdf5fbd67-s8c6d\" (UID: \"6f8001d1-a59a-412b-acb9-b4a5c479b06b\") " pod="openshift-image-registry/image-registry-6fdf5fbd67-s8c6d" Jun 10 16:45:16.062599 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:16.062578 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bf8qr\" (UniqueName: \"kubernetes.io/projected/6f8001d1-a59a-412b-acb9-b4a5c479b06b-kube-api-access-bf8qr\") pod \"image-registry-6fdf5fbd67-s8c6d\" (UID: \"6f8001d1-a59a-412b-acb9-b4a5c479b06b\") " pod="openshift-image-registry/image-registry-6fdf5fbd67-s8c6d" Jun 10 16:45:16.064334 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:16.064307 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gxsw\" (UniqueName: \"kubernetes.io/projected/eab6293a-4de8-4ed2-9642-c8053281de99-kube-api-access-9gxsw\") pod \"ingress-canary-xlq8r\" (UID: \"eab6293a-4de8-4ed2-9642-c8053281de99\") " pod="openshift-ingress-canary/ingress-canary-xlq8r" Jun 10 16:45:16.171849 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:16.171809 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xlq8r" Jun 10 16:45:16.432181 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:16.432013 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xlq8r"] Jun 10 16:45:16.436670 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:45:16.436641 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeab6293a_4de8_4ed2_9642_c8053281de99.slice/crio-a4e7f6525671d6c954e44330905ef5dc116424658e182fbd7b54de0627e265f7 WatchSource:0}: Error finding container a4e7f6525671d6c954e44330905ef5dc116424658e182fbd7b54de0627e265f7: Status 404 returned error can't find the container with id a4e7f6525671d6c954e44330905ef5dc116424658e182fbd7b54de0627e265f7 Jun 10 16:45:16.554968 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:16.554946 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6f8001d1-a59a-412b-acb9-b4a5c479b06b-registry-tls\") pod \"image-registry-6fdf5fbd67-s8c6d\" (UID: \"6f8001d1-a59a-412b-acb9-b4a5c479b06b\") " pod="openshift-image-registry/image-registry-6fdf5fbd67-s8c6d" Jun 10 16:45:16.555045 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:16.554979 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4ee7a98-0681-402a-b223-d8160df30d7a-metrics-tls\") pod \"dns-default-sl6mv\" (UID: \"d4ee7a98-0681-402a-b223-d8160df30d7a\") " pod="openshift-dns/dns-default-sl6mv" Jun 10 16:45:16.555106 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:45:16.555093 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 16:45:16.555157 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:45:16.555104 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 16:45:16.555157 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:45:16.555124 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fdf5fbd67-s8c6d: secret "image-registry-tls" not found Jun 10 16:45:16.555157 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:45:16.555153 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4ee7a98-0681-402a-b223-d8160df30d7a-metrics-tls podName:d4ee7a98-0681-402a-b223-d8160df30d7a nodeName:}" failed. No retries permitted until 2026-06-10 16:45:17.555128129 +0000 UTC m=+37.079341176 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d4ee7a98-0681-402a-b223-d8160df30d7a-metrics-tls") pod "dns-default-sl6mv" (UID: "d4ee7a98-0681-402a-b223-d8160df30d7a") : secret "dns-default-metrics-tls" not found Jun 10 16:45:16.555301 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:45:16.555191 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6f8001d1-a59a-412b-acb9-b4a5c479b06b-registry-tls podName:6f8001d1-a59a-412b-acb9-b4a5c479b06b nodeName:}" failed. No retries permitted until 2026-06-10 16:45:17.555172626 +0000 UTC m=+37.079385676 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6f8001d1-a59a-412b-acb9-b4a5c479b06b-registry-tls") pod "image-registry-6fdf5fbd67-s8c6d" (UID: "6f8001d1-a59a-412b-acb9-b4a5c479b06b") : secret "image-registry-tls" not found Jun 10 16:45:17.102646 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:17.102593 2562 generic.go:356] "Generic (PLEG): container finished" podID="bedb86e4-97c5-49a2-bbbc-4f13bf6c0426" containerID="5a438173569bdd8842d8c004a8fec86e8c33ec704500e432fe90dbae09ee7185" exitCode=0 Jun 10 16:45:17.103135 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:17.102667 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mfkbh" event={"ID":"bedb86e4-97c5-49a2-bbbc-4f13bf6c0426","Type":"ContainerDied","Data":"5a438173569bdd8842d8c004a8fec86e8c33ec704500e432fe90dbae09ee7185"} Jun 10 16:45:17.103741 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:17.103718 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xlq8r" event={"ID":"eab6293a-4de8-4ed2-9642-c8053281de99","Type":"ContainerStarted","Data":"a4e7f6525671d6c954e44330905ef5dc116424658e182fbd7b54de0627e265f7"} Jun 10 16:45:17.564503 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:17.564417 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4ee7a98-0681-402a-b223-d8160df30d7a-metrics-tls\") pod \"dns-default-sl6mv\" (UID: \"d4ee7a98-0681-402a-b223-d8160df30d7a\") " pod="openshift-dns/dns-default-sl6mv" Jun 10 16:45:17.564713 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:17.564549 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6f8001d1-a59a-412b-acb9-b4a5c479b06b-registry-tls\") pod \"image-registry-6fdf5fbd67-s8c6d\" (UID: \"6f8001d1-a59a-412b-acb9-b4a5c479b06b\") " pod="openshift-image-registry/image-registry-6fdf5fbd67-s8c6d" Jun 10 16:45:17.564713 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:45:17.564577 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 16:45:17.564713 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:45:17.564667 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4ee7a98-0681-402a-b223-d8160df30d7a-metrics-tls podName:d4ee7a98-0681-402a-b223-d8160df30d7a nodeName:}" failed. No retries permitted until 2026-06-10 16:45:19.564647377 +0000 UTC m=+39.088860445 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d4ee7a98-0681-402a-b223-d8160df30d7a-metrics-tls") pod "dns-default-sl6mv" (UID: "d4ee7a98-0681-402a-b223-d8160df30d7a") : secret "dns-default-metrics-tls" not found Jun 10 16:45:17.564713 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:45:17.564694 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 16:45:17.564713 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:45:17.564709 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fdf5fbd67-s8c6d: secret "image-registry-tls" not found Jun 10 16:45:17.564987 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:45:17.564762 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6f8001d1-a59a-412b-acb9-b4a5c479b06b-registry-tls podName:6f8001d1-a59a-412b-acb9-b4a5c479b06b nodeName:}" failed. No retries permitted until 2026-06-10 16:45:19.56474666 +0000 UTC m=+39.088959707 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6f8001d1-a59a-412b-acb9-b4a5c479b06b-registry-tls") pod "image-registry-6fdf5fbd67-s8c6d" (UID: "6f8001d1-a59a-412b-acb9-b4a5c479b06b") : secret "image-registry-tls" not found Jun 10 16:45:18.109454 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:18.109420 2562 generic.go:356] "Generic (PLEG): container finished" podID="bedb86e4-97c5-49a2-bbbc-4f13bf6c0426" containerID="a100a47dce83e4287e328506943131b81a443b8c96c75808cc9e3522c0fd6277" exitCode=0 Jun 10 16:45:18.109830 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:18.109478 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mfkbh" event={"ID":"bedb86e4-97c5-49a2-bbbc-4f13bf6c0426","Type":"ContainerDied","Data":"a100a47dce83e4287e328506943131b81a443b8c96c75808cc9e3522c0fd6277"} Jun 10 16:45:19.115056 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:19.114877 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mfkbh" event={"ID":"bedb86e4-97c5-49a2-bbbc-4f13bf6c0426","Type":"ContainerStarted","Data":"42e70a587f27b969295eef591bb06632abf54009893c5092ac1801b1e85f3f1b"} Jun 10 16:45:19.137877 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:19.137830 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-mfkbh" podStartSLOduration=8.542250914 podStartE2EDuration="38.137815107s" totalImagesPullingTime="29.595564193s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 16:44:41 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:45:19.137266162 +0000 UTC m=+38.661479233" watchObservedRunningTime="2026-06-10 16:45:19.137815107 +0000 UTC m=+38.662028177" Jun 10 16:45:19.582302 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:19.582262 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6f8001d1-a59a-412b-acb9-b4a5c479b06b-registry-tls\") pod \"image-registry-6fdf5fbd67-s8c6d\" (UID: \"6f8001d1-a59a-412b-acb9-b4a5c479b06b\") " pod="openshift-image-registry/image-registry-6fdf5fbd67-s8c6d" Jun 10 16:45:19.582302 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:19.582306 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4ee7a98-0681-402a-b223-d8160df30d7a-metrics-tls\") pod \"dns-default-sl6mv\" (UID: \"d4ee7a98-0681-402a-b223-d8160df30d7a\") " pod="openshift-dns/dns-default-sl6mv" Jun 10 16:45:19.582503 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:45:19.582419 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 16:45:19.582503 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:45:19.582428 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 16:45:19.582503 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:45:19.582449 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fdf5fbd67-s8c6d: secret "image-registry-tls" not found Jun 10 16:45:19.582503 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:45:19.582480 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4ee7a98-0681-402a-b223-d8160df30d7a-metrics-tls podName:d4ee7a98-0681-402a-b223-d8160df30d7a nodeName:}" failed. No retries permitted until 2026-06-10 16:45:23.58246678 +0000 UTC m=+43.106679827 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d4ee7a98-0681-402a-b223-d8160df30d7a-metrics-tls") pod "dns-default-sl6mv" (UID: "d4ee7a98-0681-402a-b223-d8160df30d7a") : secret "dns-default-metrics-tls" not found Jun 10 16:45:19.582503 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:45:19.582499 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6f8001d1-a59a-412b-acb9-b4a5c479b06b-registry-tls podName:6f8001d1-a59a-412b-acb9-b4a5c479b06b nodeName:}" failed. No retries permitted until 2026-06-10 16:45:23.582486396 +0000 UTC m=+43.106699458 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6f8001d1-a59a-412b-acb9-b4a5c479b06b-registry-tls") pod "image-registry-6fdf5fbd67-s8c6d" (UID: "6f8001d1-a59a-412b-acb9-b4a5c479b06b") : secret "image-registry-tls" not found Jun 10 16:45:20.119026 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:20.118993 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xlq8r" event={"ID":"eab6293a-4de8-4ed2-9642-c8053281de99","Type":"ContainerStarted","Data":"24940a767d186fc354f572fc94874d5a3c754c258eda5eec09ce8fdc05d6f739"} Jun 10 16:45:20.134169 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:20.134124 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-xlq8r" podStartSLOduration=2.331522002 podStartE2EDuration="5.134109177s" totalImagesPullingTime="2.802587175s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:45:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:45:20.133244283 +0000 UTC m=+39.657457353" watchObservedRunningTime="2026-06-10 16:45:20.134109177 +0000 UTC m=+39.658322244" Jun 10 16:45:23.614959 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:23.614917 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4ee7a98-0681-402a-b223-d8160df30d7a-metrics-tls\") pod \"dns-default-sl6mv\" (UID: \"d4ee7a98-0681-402a-b223-d8160df30d7a\") " pod="openshift-dns/dns-default-sl6mv" Jun 10 16:45:23.615582 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:23.615015 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6f8001d1-a59a-412b-acb9-b4a5c479b06b-registry-tls\") pod \"image-registry-6fdf5fbd67-s8c6d\" (UID: \"6f8001d1-a59a-412b-acb9-b4a5c479b06b\") " pod="openshift-image-registry/image-registry-6fdf5fbd67-s8c6d" Jun 10 16:45:23.615582 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:45:23.615097 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 16:45:23.615582 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:45:23.615096 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 16:45:23.615582 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:45:23.615181 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4ee7a98-0681-402a-b223-d8160df30d7a-metrics-tls podName:d4ee7a98-0681-402a-b223-d8160df30d7a nodeName:}" failed. No retries permitted until 2026-06-10 16:45:31.615159681 +0000 UTC m=+51.139372733 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d4ee7a98-0681-402a-b223-d8160df30d7a-metrics-tls") pod "dns-default-sl6mv" (UID: "d4ee7a98-0681-402a-b223-d8160df30d7a") : secret "dns-default-metrics-tls" not found Jun 10 16:45:23.615582 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:45:23.615110 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fdf5fbd67-s8c6d: secret "image-registry-tls" not found Jun 10 16:45:23.615582 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:45:23.615242 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6f8001d1-a59a-412b-acb9-b4a5c479b06b-registry-tls podName:6f8001d1-a59a-412b-acb9-b4a5c479b06b nodeName:}" failed. No retries permitted until 2026-06-10 16:45:31.615230076 +0000 UTC m=+51.139443145 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6f8001d1-a59a-412b-acb9-b4a5c479b06b-registry-tls") pod "image-registry-6fdf5fbd67-s8c6d" (UID: "6f8001d1-a59a-412b-acb9-b4a5c479b06b") : secret "image-registry-tls" not found Jun 10 16:45:31.680759 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:31.680718 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6f8001d1-a59a-412b-acb9-b4a5c479b06b-registry-tls\") pod \"image-registry-6fdf5fbd67-s8c6d\" (UID: \"6f8001d1-a59a-412b-acb9-b4a5c479b06b\") " pod="openshift-image-registry/image-registry-6fdf5fbd67-s8c6d" Jun 10 16:45:31.680759 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:31.680762 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4ee7a98-0681-402a-b223-d8160df30d7a-metrics-tls\") pod \"dns-default-sl6mv\" (UID: \"d4ee7a98-0681-402a-b223-d8160df30d7a\") " pod="openshift-dns/dns-default-sl6mv" Jun 10 16:45:31.681315 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:45:31.680861 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 16:45:31.681315 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:45:31.680871 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 16:45:31.681315 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:45:31.680882 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fdf5fbd67-s8c6d: secret "image-registry-tls" not found Jun 10 16:45:31.681315 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:45:31.680931 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6f8001d1-a59a-412b-acb9-b4a5c479b06b-registry-tls podName:6f8001d1-a59a-412b-acb9-b4a5c479b06b nodeName:}" failed. No retries permitted until 2026-06-10 16:45:47.680915091 +0000 UTC m=+67.205128138 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6f8001d1-a59a-412b-acb9-b4a5c479b06b-registry-tls") pod "image-registry-6fdf5fbd67-s8c6d" (UID: "6f8001d1-a59a-412b-acb9-b4a5c479b06b") : secret "image-registry-tls" not found Jun 10 16:45:31.681315 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:45:31.680944 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4ee7a98-0681-402a-b223-d8160df30d7a-metrics-tls podName:d4ee7a98-0681-402a-b223-d8160df30d7a nodeName:}" failed. No retries permitted until 2026-06-10 16:45:47.680938521 +0000 UTC m=+67.205151568 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d4ee7a98-0681-402a-b223-d8160df30d7a-metrics-tls") pod "dns-default-sl6mv" (UID: "d4ee7a98-0681-402a-b223-d8160df30d7a") : secret "dns-default-metrics-tls" not found Jun 10 16:45:41.097031 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:41.097002 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-p96z8" Jun 10 16:45:46.686431 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:46.686388 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1955ad17-c126-4e00-b082-09ca6f6bba61-metrics-certs\") pod \"network-metrics-daemon-frvb8\" (UID: \"1955ad17-c126-4e00-b082-09ca6f6bba61\") " pod="openshift-multus/network-metrics-daemon-frvb8" Jun 10 16:45:46.686938 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:46.686466 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/745cd6f9-646a-4143-b3e5-9c84f4c0869a-original-pull-secret\") pod \"global-pull-secret-syncer-5jkcf\" (UID: \"745cd6f9-646a-4143-b3e5-9c84f4c0869a\") " pod="kube-system/global-pull-secret-syncer-5jkcf" Jun 10 16:45:46.688841 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:46.688809 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 16:45:46.688841 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:46.688828 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 16:45:46.697553 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:45:46.697531 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 10 16:45:46.697648 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:45:46.697603 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1955ad17-c126-4e00-b082-09ca6f6bba61-metrics-certs podName:1955ad17-c126-4e00-b082-09ca6f6bba61 nodeName:}" failed. No retries permitted until 2026-06-10 16:46:50.697584889 +0000 UTC m=+130.221797936 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1955ad17-c126-4e00-b082-09ca6f6bba61-metrics-certs") pod "network-metrics-daemon-frvb8" (UID: "1955ad17-c126-4e00-b082-09ca6f6bba61") : secret "metrics-daemon-secret" not found Jun 10 16:45:46.701411 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:46.701392 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/745cd6f9-646a-4143-b3e5-9c84f4c0869a-original-pull-secret\") pod \"global-pull-secret-syncer-5jkcf\" (UID: \"745cd6f9-646a-4143-b3e5-9c84f4c0869a\") " pod="kube-system/global-pull-secret-syncer-5jkcf" Jun 10 16:45:46.787048 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:46.787003 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27qqr\" (UniqueName: \"kubernetes.io/projected/139ad3f2-9413-4f80-a1a7-b86ae8edb649-kube-api-access-27qqr\") pod \"network-check-target-jwscc\" (UID: \"139ad3f2-9413-4f80-a1a7-b86ae8edb649\") " pod="openshift-network-diagnostics/network-check-target-jwscc" Jun 10 16:45:46.789984 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:46.789960 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 10 16:45:46.799724 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:46.799703 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 10 16:45:46.810796 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:46.810767 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-27qqr\" (UniqueName: \"kubernetes.io/projected/139ad3f2-9413-4f80-a1a7-b86ae8edb649-kube-api-access-27qqr\") pod \"network-check-target-jwscc\" (UID: \"139ad3f2-9413-4f80-a1a7-b86ae8edb649\") " pod="openshift-network-diagnostics/network-check-target-jwscc" Jun 10 16:45:46.853746 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:46.853713 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5jkcf" Jun 10 16:45:46.869457 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:46.869433 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ldbtp\"" Jun 10 16:45:46.877473 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:46.877443 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwscc" Jun 10 16:45:47.030426 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:47.030347 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5jkcf"] Jun 10 16:45:47.034118 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:45:47.034089 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod745cd6f9_646a_4143_b3e5_9c84f4c0869a.slice/crio-6b722a9436d0f050e486ba0ffaa71efef80d09205948d12f11c6c622fa290541 WatchSource:0}: Error finding container 6b722a9436d0f050e486ba0ffaa71efef80d09205948d12f11c6c622fa290541: Status 404 returned error can't find the container with id 6b722a9436d0f050e486ba0ffaa71efef80d09205948d12f11c6c622fa290541 Jun 10 16:45:47.054872 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:47.054833 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jwscc"] Jun 10 16:45:47.072905 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:45:47.072879 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod139ad3f2_9413_4f80_a1a7_b86ae8edb649.slice/crio-02e5fd5e2024427c83f177c23068e4fd257c9e67b7d32b6d6aabb6d364778fa8 WatchSource:0}: Error finding container 02e5fd5e2024427c83f177c23068e4fd257c9e67b7d32b6d6aabb6d364778fa8: Status 404 returned error can't find the container with id 02e5fd5e2024427c83f177c23068e4fd257c9e67b7d32b6d6aabb6d364778fa8 Jun 10 16:45:47.181408 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:47.181365 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jwscc" event={"ID":"139ad3f2-9413-4f80-a1a7-b86ae8edb649","Type":"ContainerStarted","Data":"02e5fd5e2024427c83f177c23068e4fd257c9e67b7d32b6d6aabb6d364778fa8"} Jun 10 16:45:47.182417 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:47.182393 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5jkcf" event={"ID":"745cd6f9-646a-4143-b3e5-9c84f4c0869a","Type":"ContainerStarted","Data":"6b722a9436d0f050e486ba0ffaa71efef80d09205948d12f11c6c622fa290541"} Jun 10 16:45:47.696005 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:47.695967 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6f8001d1-a59a-412b-acb9-b4a5c479b06b-registry-tls\") pod \"image-registry-6fdf5fbd67-s8c6d\" (UID: \"6f8001d1-a59a-412b-acb9-b4a5c479b06b\") " pod="openshift-image-registry/image-registry-6fdf5fbd67-s8c6d" Jun 10 16:45:47.696515 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:47.696009 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4ee7a98-0681-402a-b223-d8160df30d7a-metrics-tls\") pod \"dns-default-sl6mv\" (UID: \"d4ee7a98-0681-402a-b223-d8160df30d7a\") " pod="openshift-dns/dns-default-sl6mv" Jun 10 16:45:47.696515 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:45:47.696144 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 16:45:47.696515 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:45:47.696145 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 16:45:47.696515 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:45:47.696167 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fdf5fbd67-s8c6d: secret "image-registry-tls" not found Jun 10 16:45:47.696515 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:45:47.696210 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4ee7a98-0681-402a-b223-d8160df30d7a-metrics-tls podName:d4ee7a98-0681-402a-b223-d8160df30d7a nodeName:}" failed. No retries permitted until 2026-06-10 16:46:19.696190855 +0000 UTC m=+99.220403903 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d4ee7a98-0681-402a-b223-d8160df30d7a-metrics-tls") pod "dns-default-sl6mv" (UID: "d4ee7a98-0681-402a-b223-d8160df30d7a") : secret "dns-default-metrics-tls" not found Jun 10 16:45:47.696515 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:45:47.696234 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6f8001d1-a59a-412b-acb9-b4a5c479b06b-registry-tls podName:6f8001d1-a59a-412b-acb9-b4a5c479b06b nodeName:}" failed. No retries permitted until 2026-06-10 16:46:19.696216439 +0000 UTC m=+99.220429493 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6f8001d1-a59a-412b-acb9-b4a5c479b06b-registry-tls") pod "image-registry-6fdf5fbd67-s8c6d" (UID: "6f8001d1-a59a-412b-acb9-b4a5c479b06b") : secret "image-registry-tls" not found Jun 10 16:45:50.193587 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:50.193554 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jwscc" event={"ID":"139ad3f2-9413-4f80-a1a7-b86ae8edb649","Type":"ContainerStarted","Data":"da745bba18770ba02ab6bc76c38a294d5d726c2cb1c0723375b9d583ee2ec355"} Jun 10 16:45:50.194162 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:50.193783 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jwscc" Jun 10 16:45:50.208448 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:50.208400 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jwscc" podStartSLOduration=66.226047434 podStartE2EDuration="1m9.208383918s" totalImagesPullingTime="2.982336484s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:44:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:45:50.207656167 +0000 UTC m=+69.731869231" watchObservedRunningTime="2026-06-10 16:45:50.208383918 +0000 UTC m=+69.732596979" Jun 10 16:45:52.200244 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:52.200208 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5jkcf" event={"ID":"745cd6f9-646a-4143-b3e5-9c84f4c0869a","Type":"ContainerStarted","Data":"be83de46438dca68d56a039f8a4da023d940913a11ba76d63ffff66d683f0057"} Jun 10 16:45:52.215518 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:45:52.215471 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5jkcf" podStartSLOduration=66.486520071 podStartE2EDuration="1m11.215456496s" totalImagesPullingTime="4.728936425s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 16:44:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:45:52.214839725 +0000 UTC m=+71.739052795" watchObservedRunningTime="2026-06-10 16:45:52.215456496 +0000 UTC m=+71.739669617" Jun 10 16:46:19.737292 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:46:19.737197 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6f8001d1-a59a-412b-acb9-b4a5c479b06b-registry-tls\") pod \"image-registry-6fdf5fbd67-s8c6d\" (UID: \"6f8001d1-a59a-412b-acb9-b4a5c479b06b\") " pod="openshift-image-registry/image-registry-6fdf5fbd67-s8c6d" Jun 10 16:46:19.737292 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:46:19.737244 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4ee7a98-0681-402a-b223-d8160df30d7a-metrics-tls\") pod \"dns-default-sl6mv\" (UID: \"d4ee7a98-0681-402a-b223-d8160df30d7a\") " pod="openshift-dns/dns-default-sl6mv" Jun 10 16:46:19.737837 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:46:19.737351 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 16:46:19.737837 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:46:19.737395 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 16:46:19.737837 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:46:19.737422 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fdf5fbd67-s8c6d: secret "image-registry-tls" not found Jun 10 16:46:19.737837 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:46:19.737412 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4ee7a98-0681-402a-b223-d8160df30d7a-metrics-tls podName:d4ee7a98-0681-402a-b223-d8160df30d7a nodeName:}" failed. No retries permitted until 2026-06-10 16:47:23.737398675 +0000 UTC m=+163.261611723 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d4ee7a98-0681-402a-b223-d8160df30d7a-metrics-tls") pod "dns-default-sl6mv" (UID: "d4ee7a98-0681-402a-b223-d8160df30d7a") : secret "dns-default-metrics-tls" not found Jun 10 16:46:19.737837 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:46:19.737515 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6f8001d1-a59a-412b-acb9-b4a5c479b06b-registry-tls podName:6f8001d1-a59a-412b-acb9-b4a5c479b06b nodeName:}" failed. No retries permitted until 2026-06-10 16:47:23.737489655 +0000 UTC m=+163.261702706 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6f8001d1-a59a-412b-acb9-b4a5c479b06b-registry-tls") pod "image-registry-6fdf5fbd67-s8c6d" (UID: "6f8001d1-a59a-412b-acb9-b4a5c479b06b") : secret "image-registry-tls" not found Jun 10 16:46:21.198943 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:46:21.198914 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jwscc" Jun 10 16:46:50.755147 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:46:50.755102 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1955ad17-c126-4e00-b082-09ca6f6bba61-metrics-certs\") pod \"network-metrics-daemon-frvb8\" (UID: \"1955ad17-c126-4e00-b082-09ca6f6bba61\") " pod="openshift-multus/network-metrics-daemon-frvb8" Jun 10 16:46:50.755763 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:46:50.755243 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 10 16:46:50.755763 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:46:50.755322 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1955ad17-c126-4e00-b082-09ca6f6bba61-metrics-certs podName:1955ad17-c126-4e00-b082-09ca6f6bba61 nodeName:}" failed. No retries permitted until 2026-06-10 16:48:52.755300426 +0000 UTC m=+252.279513476 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1955ad17-c126-4e00-b082-09ca6f6bba61-metrics-certs") pod "network-metrics-daemon-frvb8" (UID: "1955ad17-c126-4e00-b082-09ca6f6bba61") : secret "metrics-daemon-secret" not found Jun 10 16:47:18.840368 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:47:18.840321 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6fdf5fbd67-s8c6d" podUID="6f8001d1-a59a-412b-acb9-b4a5c479b06b" Jun 10 16:47:18.854886 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:47:18.854856 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-sl6mv" podUID="d4ee7a98-0681-402a-b223-d8160df30d7a" Jun 10 16:47:18.962850 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:47:18.962797 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-frvb8" podUID="1955ad17-c126-4e00-b082-09ca6f6bba61" Jun 10 16:47:19.415200 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:19.415171 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sl6mv" Jun 10 16:47:23.778964 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:23.778905 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6f8001d1-a59a-412b-acb9-b4a5c479b06b-registry-tls\") pod \"image-registry-6fdf5fbd67-s8c6d\" (UID: \"6f8001d1-a59a-412b-acb9-b4a5c479b06b\") " pod="openshift-image-registry/image-registry-6fdf5fbd67-s8c6d" Jun 10 16:47:23.778964 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:23.778967 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4ee7a98-0681-402a-b223-d8160df30d7a-metrics-tls\") pod \"dns-default-sl6mv\" (UID: \"d4ee7a98-0681-402a-b223-d8160df30d7a\") " pod="openshift-dns/dns-default-sl6mv" Jun 10 16:47:23.779518 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:47:23.779062 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 16:47:23.779518 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:47:23.779069 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 16:47:23.779518 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:47:23.779090 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fdf5fbd67-s8c6d: secret "image-registry-tls" not found Jun 10 16:47:23.779518 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:47:23.779117 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4ee7a98-0681-402a-b223-d8160df30d7a-metrics-tls podName:d4ee7a98-0681-402a-b223-d8160df30d7a nodeName:}" failed. No retries permitted until 2026-06-10 16:49:25.779103179 +0000 UTC m=+285.303316227 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d4ee7a98-0681-402a-b223-d8160df30d7a-metrics-tls") pod "dns-default-sl6mv" (UID: "d4ee7a98-0681-402a-b223-d8160df30d7a") : secret "dns-default-metrics-tls" not found Jun 10 16:47:23.779518 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:47:23.779139 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6f8001d1-a59a-412b-acb9-b4a5c479b06b-registry-tls podName:6f8001d1-a59a-412b-acb9-b4a5c479b06b nodeName:}" failed. No retries permitted until 2026-06-10 16:49:25.779123587 +0000 UTC m=+285.303336635 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6f8001d1-a59a-412b-acb9-b4a5c479b06b-registry-tls") pod "image-registry-6fdf5fbd67-s8c6d" (UID: "6f8001d1-a59a-412b-acb9-b4a5c479b06b") : secret "image-registry-tls" not found Jun 10 16:47:30.943263 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:30.943177 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frvb8" Jun 10 16:47:32.945743 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:32.945715 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6fdf5fbd67-s8c6d" Jun 10 16:47:52.650644 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:52.650595 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-wxg56"] Jun 10 16:47:52.653472 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:52.653453 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-wxg56" Jun 10 16:47:52.654972 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:52.654949 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-mgpvj"] Jun 10 16:47:52.655546 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:52.655527 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-p7b6j\"" Jun 10 16:47:52.657601 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:52.657585 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-mgpvj" Jun 10 16:47:52.660551 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:52.660526 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 10 16:47:52.661228 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:52.661197 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 10 16:47:52.661228 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:52.661195 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 10 16:47:52.661375 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:52.661302 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-ss2ds\"" Jun 10 16:47:52.661484 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:52.661466 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 10 16:47:52.664845 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:52.664826 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 10 16:47:52.665450 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:52.665430 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-wxg56"] Jun 10 16:47:52.669956 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:52.669936 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-mgpvj"] Jun 10 16:47:52.778718 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:52.778687 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-bwp8v"] Jun 10 16:47:52.781556 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:52.781535 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-bwp8v" Jun 10 16:47:52.783903 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:52.783883 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8stg\" (UniqueName: \"kubernetes.io/projected/df4f4a0a-8563-43bc-b1a9-c933a16dfa01-kube-api-access-t8stg\") pod \"console-operator-668fdbf85c-mgpvj\" (UID: \"df4f4a0a-8563-43bc-b1a9-c933a16dfa01\") " pod="openshift-console-operator/console-operator-668fdbf85c-mgpvj" Jun 10 16:47:52.783988 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:52.783944 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/df4f4a0a-8563-43bc-b1a9-c933a16dfa01-config\") pod \"console-operator-668fdbf85c-mgpvj\" (UID: \"df4f4a0a-8563-43bc-b1a9-c933a16dfa01\") " pod="openshift-console-operator/console-operator-668fdbf85c-mgpvj" Jun 10 16:47:52.783988 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:52.783963 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/df4f4a0a-8563-43bc-b1a9-c933a16dfa01-trusted-ca\") pod \"console-operator-668fdbf85c-mgpvj\" (UID: \"df4f4a0a-8563-43bc-b1a9-c933a16dfa01\") " pod="openshift-console-operator/console-operator-668fdbf85c-mgpvj" Jun 10 16:47:52.784058 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:52.784021 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/df4f4a0a-8563-43bc-b1a9-c933a16dfa01-serving-cert\") pod \"console-operator-668fdbf85c-mgpvj\" (UID: \"df4f4a0a-8563-43bc-b1a9-c933a16dfa01\") " pod="openshift-console-operator/console-operator-668fdbf85c-mgpvj" Jun 10 16:47:52.784092 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:52.784074 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlvp5\" (UniqueName: \"kubernetes.io/projected/e3fdad97-75db-42a9-a8e6-2c04dddef2ef-kube-api-access-wlvp5\") pod \"network-check-source-dbd9cf844-wxg56\" (UID: \"e3fdad97-75db-42a9-a8e6-2c04dddef2ef\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-wxg56" Jun 10 16:47:52.785026 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:52.785011 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 10 16:47:52.785474 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:52.785461 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-cxhvj\"" Jun 10 16:47:52.786210 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:52.786195 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 10 16:47:52.788623 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:52.788606 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 10 16:47:52.788952 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:52.788938 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 10 16:47:52.799895 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:52.799877 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-hj4jl"] Jun 10 16:47:52.802606 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:52.802587 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-bwp8v"] Jun 10 16:47:52.802728 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:52.802682 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-hj4jl" Jun 10 16:47:52.805370 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:52.805351 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 10 16:47:52.805495 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:52.805481 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 10 16:47:52.805744 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:52.805730 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 10 16:47:52.806170 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:52.806154 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 10 16:47:52.806258 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:52.806244 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-lfz7j\"" Jun 10 16:47:52.814328 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:52.814305 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 10 16:47:52.822420 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:52.822399 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-hj4jl"] Jun 10 16:47:52.884913 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:52.884880 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/df4f4a0a-8563-43bc-b1a9-c933a16dfa01-config\") pod \"console-operator-668fdbf85c-mgpvj\" (UID: \"df4f4a0a-8563-43bc-b1a9-c933a16dfa01\") " pod="openshift-console-operator/console-operator-668fdbf85c-mgpvj" Jun 10 16:47:52.885076 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:52.884934 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jcps\" (UniqueName: \"kubernetes.io/projected/b39153cd-236a-4b99-8314-0781d72ce7e4-kube-api-access-6jcps\") pod \"insights-operator-896549976-hj4jl\" (UID: \"b39153cd-236a-4b99-8314-0781d72ce7e4\") " pod="openshift-insights/insights-operator-896549976-hj4jl" Jun 10 16:47:52.885076 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:52.884955 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b39153cd-236a-4b99-8314-0781d72ce7e4-serving-cert\") pod \"insights-operator-896549976-hj4jl\" (UID: \"b39153cd-236a-4b99-8314-0781d72ce7e4\") " pod="openshift-insights/insights-operator-896549976-hj4jl" Jun 10 16:47:52.885076 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:52.884972 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlvp5\" (UniqueName: \"kubernetes.io/projected/e3fdad97-75db-42a9-a8e6-2c04dddef2ef-kube-api-access-wlvp5\") pod \"network-check-source-dbd9cf844-wxg56\" (UID: \"e3fdad97-75db-42a9-a8e6-2c04dddef2ef\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-wxg56" Jun 10 16:47:52.885076 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:52.884994 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8stg\" (UniqueName: \"kubernetes.io/projected/df4f4a0a-8563-43bc-b1a9-c933a16dfa01-kube-api-access-t8stg\") pod \"console-operator-668fdbf85c-mgpvj\" (UID: \"df4f4a0a-8563-43bc-b1a9-c933a16dfa01\") " pod="openshift-console-operator/console-operator-668fdbf85c-mgpvj" Jun 10 16:47:52.885076 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:52.885010 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7644b2ac-a2ef-4135-8284-bbc1261ff3f5-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-bwp8v\" (UID: \"7644b2ac-a2ef-4135-8284-bbc1261ff3f5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-bwp8v" Jun 10 16:47:52.885076 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:52.885027 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b39153cd-236a-4b99-8314-0781d72ce7e4-trusted-ca-bundle\") pod \"insights-operator-896549976-hj4jl\" (UID: \"b39153cd-236a-4b99-8314-0781d72ce7e4\") " pod="openshift-insights/insights-operator-896549976-hj4jl" Jun 10 16:47:52.885335 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:52.885070 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/df4f4a0a-8563-43bc-b1a9-c933a16dfa01-trusted-ca\") pod \"console-operator-668fdbf85c-mgpvj\" (UID: \"df4f4a0a-8563-43bc-b1a9-c933a16dfa01\") " pod="openshift-console-operator/console-operator-668fdbf85c-mgpvj" Jun 10 16:47:52.885335 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:52.885110 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/df4f4a0a-8563-43bc-b1a9-c933a16dfa01-serving-cert\") pod \"console-operator-668fdbf85c-mgpvj\" (UID: \"df4f4a0a-8563-43bc-b1a9-c933a16dfa01\") " pod="openshift-console-operator/console-operator-668fdbf85c-mgpvj" Jun 10 16:47:52.885335 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:52.885128 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b39153cd-236a-4b99-8314-0781d72ce7e4-tmp\") pod \"insights-operator-896549976-hj4jl\" (UID: \"b39153cd-236a-4b99-8314-0781d72ce7e4\") " pod="openshift-insights/insights-operator-896549976-hj4jl" Jun 10 16:47:52.885335 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:52.885156 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b39153cd-236a-4b99-8314-0781d72ce7e4-snapshots\") pod \"insights-operator-896549976-hj4jl\" (UID: \"b39153cd-236a-4b99-8314-0781d72ce7e4\") " pod="openshift-insights/insights-operator-896549976-hj4jl" Jun 10 16:47:52.885335 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:52.885296 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7644b2ac-a2ef-4135-8284-bbc1261ff3f5-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-bwp8v\" (UID: \"7644b2ac-a2ef-4135-8284-bbc1261ff3f5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-bwp8v" Jun 10 16:47:52.885547 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:52.885365 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pf52b\" (UniqueName: \"kubernetes.io/projected/7644b2ac-a2ef-4135-8284-bbc1261ff3f5-kube-api-access-pf52b\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-bwp8v\" (UID: \"7644b2ac-a2ef-4135-8284-bbc1261ff3f5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-bwp8v" Jun 10 16:47:52.885547 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:52.885401 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b39153cd-236a-4b99-8314-0781d72ce7e4-service-ca-bundle\") pod \"insights-operator-896549976-hj4jl\" (UID: \"b39153cd-236a-4b99-8314-0781d72ce7e4\") " pod="openshift-insights/insights-operator-896549976-hj4jl" Jun 10 16:47:52.885609 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:52.885578 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/df4f4a0a-8563-43bc-b1a9-c933a16dfa01-config\") pod \"console-operator-668fdbf85c-mgpvj\" (UID: \"df4f4a0a-8563-43bc-b1a9-c933a16dfa01\") " pod="openshift-console-operator/console-operator-668fdbf85c-mgpvj" Jun 10 16:47:52.885946 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:52.885928 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/df4f4a0a-8563-43bc-b1a9-c933a16dfa01-trusted-ca\") pod \"console-operator-668fdbf85c-mgpvj\" (UID: \"df4f4a0a-8563-43bc-b1a9-c933a16dfa01\") " pod="openshift-console-operator/console-operator-668fdbf85c-mgpvj" Jun 10 16:47:52.887585 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:52.887567 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/df4f4a0a-8563-43bc-b1a9-c933a16dfa01-serving-cert\") pod \"console-operator-668fdbf85c-mgpvj\" (UID: \"df4f4a0a-8563-43bc-b1a9-c933a16dfa01\") " pod="openshift-console-operator/console-operator-668fdbf85c-mgpvj" Jun 10 16:47:52.893574 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:52.893544 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8stg\" (UniqueName: \"kubernetes.io/projected/df4f4a0a-8563-43bc-b1a9-c933a16dfa01-kube-api-access-t8stg\") pod \"console-operator-668fdbf85c-mgpvj\" (UID: \"df4f4a0a-8563-43bc-b1a9-c933a16dfa01\") " pod="openshift-console-operator/console-operator-668fdbf85c-mgpvj" Jun 10 16:47:52.893761 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:52.893699 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlvp5\" (UniqueName: \"kubernetes.io/projected/e3fdad97-75db-42a9-a8e6-2c04dddef2ef-kube-api-access-wlvp5\") pod \"network-check-source-dbd9cf844-wxg56\" (UID: \"e3fdad97-75db-42a9-a8e6-2c04dddef2ef\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-wxg56" Jun 10 16:47:52.963761 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:52.963672 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-wxg56" Jun 10 16:47:52.969598 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:52.969579 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-mgpvj" Jun 10 16:47:52.986406 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:52.986381 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jcps\" (UniqueName: \"kubernetes.io/projected/b39153cd-236a-4b99-8314-0781d72ce7e4-kube-api-access-6jcps\") pod \"insights-operator-896549976-hj4jl\" (UID: \"b39153cd-236a-4b99-8314-0781d72ce7e4\") " pod="openshift-insights/insights-operator-896549976-hj4jl" Jun 10 16:47:52.986520 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:52.986419 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b39153cd-236a-4b99-8314-0781d72ce7e4-serving-cert\") pod \"insights-operator-896549976-hj4jl\" (UID: \"b39153cd-236a-4b99-8314-0781d72ce7e4\") " pod="openshift-insights/insights-operator-896549976-hj4jl" Jun 10 16:47:52.986581 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:52.986510 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7644b2ac-a2ef-4135-8284-bbc1261ff3f5-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-bwp8v\" (UID: \"7644b2ac-a2ef-4135-8284-bbc1261ff3f5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-bwp8v" Jun 10 16:47:52.986581 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:52.986549 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b39153cd-236a-4b99-8314-0781d72ce7e4-trusted-ca-bundle\") pod \"insights-operator-896549976-hj4jl\" (UID: \"b39153cd-236a-4b99-8314-0781d72ce7e4\") " pod="openshift-insights/insights-operator-896549976-hj4jl" Jun 10 16:47:52.986707 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:52.986594 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b39153cd-236a-4b99-8314-0781d72ce7e4-tmp\") pod \"insights-operator-896549976-hj4jl\" (UID: \"b39153cd-236a-4b99-8314-0781d72ce7e4\") " pod="openshift-insights/insights-operator-896549976-hj4jl" Jun 10 16:47:52.986707 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:52.986624 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b39153cd-236a-4b99-8314-0781d72ce7e4-snapshots\") pod \"insights-operator-896549976-hj4jl\" (UID: \"b39153cd-236a-4b99-8314-0781d72ce7e4\") " pod="openshift-insights/insights-operator-896549976-hj4jl" Jun 10 16:47:52.986707 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:52.986682 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7644b2ac-a2ef-4135-8284-bbc1261ff3f5-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-bwp8v\" (UID: \"7644b2ac-a2ef-4135-8284-bbc1261ff3f5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-bwp8v" Jun 10 16:47:52.986855 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:52.986714 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pf52b\" (UniqueName: \"kubernetes.io/projected/7644b2ac-a2ef-4135-8284-bbc1261ff3f5-kube-api-access-pf52b\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-bwp8v\" (UID: \"7644b2ac-a2ef-4135-8284-bbc1261ff3f5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-bwp8v" Jun 10 16:47:52.986855 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:52.986743 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b39153cd-236a-4b99-8314-0781d72ce7e4-service-ca-bundle\") pod \"insights-operator-896549976-hj4jl\" (UID: \"b39153cd-236a-4b99-8314-0781d72ce7e4\") " pod="openshift-insights/insights-operator-896549976-hj4jl" Jun 10 16:47:52.987301 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:52.987154 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7644b2ac-a2ef-4135-8284-bbc1261ff3f5-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-bwp8v\" (UID: \"7644b2ac-a2ef-4135-8284-bbc1261ff3f5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-bwp8v" Jun 10 16:47:52.987424 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:52.987397 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b39153cd-236a-4b99-8314-0781d72ce7e4-tmp\") pod \"insights-operator-896549976-hj4jl\" (UID: \"b39153cd-236a-4b99-8314-0781d72ce7e4\") " pod="openshift-insights/insights-operator-896549976-hj4jl" Jun 10 16:47:52.987515 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:52.987437 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b39153cd-236a-4b99-8314-0781d72ce7e4-snapshots\") pod \"insights-operator-896549976-hj4jl\" (UID: \"b39153cd-236a-4b99-8314-0781d72ce7e4\") " pod="openshift-insights/insights-operator-896549976-hj4jl" Jun 10 16:47:52.987754 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:52.987695 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b39153cd-236a-4b99-8314-0781d72ce7e4-trusted-ca-bundle\") pod \"insights-operator-896549976-hj4jl\" (UID: \"b39153cd-236a-4b99-8314-0781d72ce7e4\") " pod="openshift-insights/insights-operator-896549976-hj4jl" Jun 10 16:47:52.987945 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:52.987919 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b39153cd-236a-4b99-8314-0781d72ce7e4-service-ca-bundle\") pod \"insights-operator-896549976-hj4jl\" (UID: \"b39153cd-236a-4b99-8314-0781d72ce7e4\") " pod="openshift-insights/insights-operator-896549976-hj4jl" Jun 10 16:47:52.989276 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:52.989245 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b39153cd-236a-4b99-8314-0781d72ce7e4-serving-cert\") pod \"insights-operator-896549976-hj4jl\" (UID: \"b39153cd-236a-4b99-8314-0781d72ce7e4\") " pod="openshift-insights/insights-operator-896549976-hj4jl" Jun 10 16:47:52.989363 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:52.989346 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7644b2ac-a2ef-4135-8284-bbc1261ff3f5-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-bwp8v\" (UID: \"7644b2ac-a2ef-4135-8284-bbc1261ff3f5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-bwp8v" Jun 10 16:47:52.994684 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:52.994618 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pf52b\" (UniqueName: \"kubernetes.io/projected/7644b2ac-a2ef-4135-8284-bbc1261ff3f5-kube-api-access-pf52b\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-bwp8v\" (UID: \"7644b2ac-a2ef-4135-8284-bbc1261ff3f5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-bwp8v" Jun 10 16:47:52.995188 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:52.995167 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jcps\" (UniqueName: \"kubernetes.io/projected/b39153cd-236a-4b99-8314-0781d72ce7e4-kube-api-access-6jcps\") pod \"insights-operator-896549976-hj4jl\" (UID: \"b39153cd-236a-4b99-8314-0781d72ce7e4\") " pod="openshift-insights/insights-operator-896549976-hj4jl" Jun 10 16:47:53.090223 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:53.090183 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-bwp8v" Jun 10 16:47:53.098021 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:53.097993 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-wxg56"] Jun 10 16:47:53.101214 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:47:53.101186 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3fdad97_75db_42a9_a8e6_2c04dddef2ef.slice/crio-ffc7f78c74f76859c62ed6db80eff7728e62600cf3d60bb0f6e7711dccc8bfcd WatchSource:0}: Error finding container ffc7f78c74f76859c62ed6db80eff7728e62600cf3d60bb0f6e7711dccc8bfcd: Status 404 returned error can't find the container with id ffc7f78c74f76859c62ed6db80eff7728e62600cf3d60bb0f6e7711dccc8bfcd Jun 10 16:47:53.112892 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:53.112786 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-mgpvj"] Jun 10 16:47:53.115313 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:53.115288 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-hj4jl" Jun 10 16:47:53.115595 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:47:53.115574 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf4f4a0a_8563_43bc_b1a9_c933a16dfa01.slice/crio-1a7ebae1e37c9b4c6cd82cc1f3318ebad9407a6f167beda05be4de487a429606 WatchSource:0}: Error finding container 1a7ebae1e37c9b4c6cd82cc1f3318ebad9407a6f167beda05be4de487a429606: Status 404 returned error can't find the container with id 1a7ebae1e37c9b4c6cd82cc1f3318ebad9407a6f167beda05be4de487a429606 Jun 10 16:47:53.231491 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:53.231463 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-bwp8v"] Jun 10 16:47:53.233698 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:47:53.233662 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7644b2ac_a2ef_4135_8284_bbc1261ff3f5.slice/crio-6e7794a723e8d7bf327de1604d01ac1c9b91c7bd4db061d2eaf0dad66fe19db4 WatchSource:0}: Error finding container 6e7794a723e8d7bf327de1604d01ac1c9b91c7bd4db061d2eaf0dad66fe19db4: Status 404 returned error can't find the container with id 6e7794a723e8d7bf327de1604d01ac1c9b91c7bd4db061d2eaf0dad66fe19db4 Jun 10 16:47:53.253694 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:53.253608 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-hj4jl"] Jun 10 16:47:53.257203 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:47:53.257171 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb39153cd_236a_4b99_8314_0781d72ce7e4.slice/crio-dbbcc9920dafdc2bab73c4d30dee5096f33a6d7ebceb8a5dcfcf44778484afba WatchSource:0}: Error finding container dbbcc9920dafdc2bab73c4d30dee5096f33a6d7ebceb8a5dcfcf44778484afba: Status 404 returned error can't find the container with id dbbcc9920dafdc2bab73c4d30dee5096f33a6d7ebceb8a5dcfcf44778484afba Jun 10 16:47:53.496363 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:53.496276 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-wxg56" event={"ID":"e3fdad97-75db-42a9-a8e6-2c04dddef2ef","Type":"ContainerStarted","Data":"8862ce6c184c31f004200ab95a6dad057b036f6f7ca0fbb3d70ce50d041fcc28"} Jun 10 16:47:53.496363 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:53.496330 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-wxg56" event={"ID":"e3fdad97-75db-42a9-a8e6-2c04dddef2ef","Type":"ContainerStarted","Data":"ffc7f78c74f76859c62ed6db80eff7728e62600cf3d60bb0f6e7711dccc8bfcd"} Jun 10 16:47:53.497456 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:53.497433 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-hj4jl" event={"ID":"b39153cd-236a-4b99-8314-0781d72ce7e4","Type":"ContainerStarted","Data":"dbbcc9920dafdc2bab73c4d30dee5096f33a6d7ebceb8a5dcfcf44778484afba"} Jun 10 16:47:53.498402 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:53.498380 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-bwp8v" event={"ID":"7644b2ac-a2ef-4135-8284-bbc1261ff3f5","Type":"ContainerStarted","Data":"6e7794a723e8d7bf327de1604d01ac1c9b91c7bd4db061d2eaf0dad66fe19db4"} Jun 10 16:47:53.499472 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:53.499450 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-mgpvj" event={"ID":"df4f4a0a-8563-43bc-b1a9-c933a16dfa01","Type":"ContainerStarted","Data":"1a7ebae1e37c9b4c6cd82cc1f3318ebad9407a6f167beda05be4de487a429606"} Jun 10 16:47:53.510072 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:53.510023 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-wxg56" podStartSLOduration=1.5100056670000002 podStartE2EDuration="1.510005667s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:47:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:47:53.509935382 +0000 UTC m=+193.034148452" watchObservedRunningTime="2026-06-10 16:47:53.510005667 +0000 UTC m=+193.034218738" Jun 10 16:47:56.509876 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:56.509777 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-hj4jl" event={"ID":"b39153cd-236a-4b99-8314-0781d72ce7e4","Type":"ContainerStarted","Data":"c2182d2273a5b19e97780d0163a45a6b30a2152deb35249b5dc231d9b1a040e2"} Jun 10 16:47:56.511372 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:56.511342 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-bwp8v" event={"ID":"7644b2ac-a2ef-4135-8284-bbc1261ff3f5","Type":"ContainerStarted","Data":"c675a0457a493fa28e2bb7d7be946205be607e8fe0f25d0f849e4d13d6282c51"} Jun 10 16:47:56.513094 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:56.513072 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mgpvj_df4f4a0a-8563-43bc-b1a9-c933a16dfa01/console-operator/0.log" Jun 10 16:47:56.513208 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:56.513117 2562 generic.go:356] "Generic (PLEG): container finished" podID="df4f4a0a-8563-43bc-b1a9-c933a16dfa01" containerID="c1c29063da53e596b13da9083a15116d4528dabda6cb8ba45f3a0ecba74bf788" exitCode=255 Jun 10 16:47:56.513208 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:56.513148 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-mgpvj" event={"ID":"df4f4a0a-8563-43bc-b1a9-c933a16dfa01","Type":"ContainerDied","Data":"c1c29063da53e596b13da9083a15116d4528dabda6cb8ba45f3a0ecba74bf788"} Jun 10 16:47:56.513351 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:56.513338 2562 scope.go:117] "RemoveContainer" containerID="c1c29063da53e596b13da9083a15116d4528dabda6cb8ba45f3a0ecba74bf788" Jun 10 16:47:56.525271 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:56.525229 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-hj4jl" podStartSLOduration=1.651828345 podStartE2EDuration="4.525215557s" totalImagesPullingTime="2.873387212s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:47:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:47:56.52417299 +0000 UTC m=+196.048386060" watchObservedRunningTime="2026-06-10 16:47:56.525215557 +0000 UTC m=+196.049428657" Jun 10 16:47:56.553322 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:56.553231 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-bwp8v" podStartSLOduration=1.6589315230000001 podStartE2EDuration="4.553215379s" totalImagesPullingTime="2.894283856s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:47:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:47:56.551881498 +0000 UTC m=+196.076094569" watchObservedRunningTime="2026-06-10 16:47:56.553215379 +0000 UTC m=+196.077428449" Jun 10 16:47:57.222463 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:57.222425 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-ckmdn"] Jun 10 16:47:57.225481 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:57.225447 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-ckmdn" Jun 10 16:47:57.227548 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:57.227523 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 10 16:47:57.227692 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:57.227573 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 10 16:47:57.228286 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:57.228252 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-m92pk\"" Jun 10 16:47:57.234845 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:57.234825 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-ckmdn"] Jun 10 16:47:57.319250 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:57.319210 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbx2b\" (UniqueName: \"kubernetes.io/projected/66b45156-4477-4e76-942c-5f250e31f7ff-kube-api-access-hbx2b\") pod \"migrator-955ffdf5f-ckmdn\" (UID: \"66b45156-4477-4e76-942c-5f250e31f7ff\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-ckmdn" Jun 10 16:47:57.420097 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:57.420012 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbx2b\" (UniqueName: \"kubernetes.io/projected/66b45156-4477-4e76-942c-5f250e31f7ff-kube-api-access-hbx2b\") pod \"migrator-955ffdf5f-ckmdn\" (UID: \"66b45156-4477-4e76-942c-5f250e31f7ff\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-ckmdn" Jun 10 16:47:57.432924 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:57.432888 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbx2b\" (UniqueName: \"kubernetes.io/projected/66b45156-4477-4e76-942c-5f250e31f7ff-kube-api-access-hbx2b\") pod \"migrator-955ffdf5f-ckmdn\" (UID: \"66b45156-4477-4e76-942c-5f250e31f7ff\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-ckmdn" Jun 10 16:47:57.518990 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:57.518961 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mgpvj_df4f4a0a-8563-43bc-b1a9-c933a16dfa01/console-operator/1.log" Jun 10 16:47:57.519456 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:57.519441 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mgpvj_df4f4a0a-8563-43bc-b1a9-c933a16dfa01/console-operator/0.log" Jun 10 16:47:57.519531 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:57.519478 2562 generic.go:356] "Generic (PLEG): container finished" podID="df4f4a0a-8563-43bc-b1a9-c933a16dfa01" containerID="c9fddd2e2c4db04691a11ffb1bd399189b2851184d214586afb6d0660c35f7db" exitCode=255 Jun 10 16:47:57.519602 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:57.519564 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-mgpvj" event={"ID":"df4f4a0a-8563-43bc-b1a9-c933a16dfa01","Type":"ContainerDied","Data":"c9fddd2e2c4db04691a11ffb1bd399189b2851184d214586afb6d0660c35f7db"} Jun 10 16:47:57.519675 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:57.519657 2562 scope.go:117] "RemoveContainer" containerID="c1c29063da53e596b13da9083a15116d4528dabda6cb8ba45f3a0ecba74bf788" Jun 10 16:47:57.519886 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:57.519864 2562 scope.go:117] "RemoveContainer" containerID="c9fddd2e2c4db04691a11ffb1bd399189b2851184d214586afb6d0660c35f7db" Jun 10 16:47:57.520067 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:47:57.520048 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-mgpvj_openshift-console-operator(df4f4a0a-8563-43bc-b1a9-c933a16dfa01)\"" pod="openshift-console-operator/console-operator-668fdbf85c-mgpvj" podUID="df4f4a0a-8563-43bc-b1a9-c933a16dfa01" Jun 10 16:47:57.535301 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:57.535281 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-ckmdn" Jun 10 16:47:57.659679 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:57.659617 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-ckmdn"] Jun 10 16:47:57.663090 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:47:57.663057 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66b45156_4477_4e76_942c_5f250e31f7ff.slice/crio-68ab6d3bb4ac828dcb8af05ac8df2a47d465084c380fd3ecec39d33c84ce5a1e WatchSource:0}: Error finding container 68ab6d3bb4ac828dcb8af05ac8df2a47d465084c380fd3ecec39d33c84ce5a1e: Status 404 returned error can't find the container with id 68ab6d3bb4ac828dcb8af05ac8df2a47d465084c380fd3ecec39d33c84ce5a1e Jun 10 16:47:58.221786 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:58.221745 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-lhsp9"] Jun 10 16:47:58.224911 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:58.224876 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-lhsp9" Jun 10 16:47:58.227299 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:58.227193 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 10 16:47:58.227441 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:58.227303 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 10 16:47:58.227747 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:58.227718 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-9bvwc\"" Jun 10 16:47:58.227885 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:58.227797 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 10 16:47:58.227885 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:58.227725 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 10 16:47:58.238101 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:58.234253 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-lhsp9"] Jun 10 16:47:58.326135 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:58.326094 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/11198af3-d26c-42f3-998c-896935a3b74b-signing-key\") pod \"service-ca-7d74d578b8-lhsp9\" (UID: \"11198af3-d26c-42f3-998c-896935a3b74b\") " pod="openshift-service-ca/service-ca-7d74d578b8-lhsp9" Jun 10 16:47:58.326299 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:58.326157 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsrbk\" (UniqueName: \"kubernetes.io/projected/11198af3-d26c-42f3-998c-896935a3b74b-kube-api-access-nsrbk\") pod \"service-ca-7d74d578b8-lhsp9\" (UID: \"11198af3-d26c-42f3-998c-896935a3b74b\") " pod="openshift-service-ca/service-ca-7d74d578b8-lhsp9" Jun 10 16:47:58.326299 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:58.326243 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/11198af3-d26c-42f3-998c-896935a3b74b-signing-cabundle\") pod \"service-ca-7d74d578b8-lhsp9\" (UID: \"11198af3-d26c-42f3-998c-896935a3b74b\") " pod="openshift-service-ca/service-ca-7d74d578b8-lhsp9" Jun 10 16:47:58.426684 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:58.426645 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/11198af3-d26c-42f3-998c-896935a3b74b-signing-cabundle\") pod \"service-ca-7d74d578b8-lhsp9\" (UID: \"11198af3-d26c-42f3-998c-896935a3b74b\") " pod="openshift-service-ca/service-ca-7d74d578b8-lhsp9" Jun 10 16:47:58.426873 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:58.426732 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/11198af3-d26c-42f3-998c-896935a3b74b-signing-key\") pod \"service-ca-7d74d578b8-lhsp9\" (UID: \"11198af3-d26c-42f3-998c-896935a3b74b\") " pod="openshift-service-ca/service-ca-7d74d578b8-lhsp9" Jun 10 16:47:58.426873 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:58.426776 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsrbk\" (UniqueName: \"kubernetes.io/projected/11198af3-d26c-42f3-998c-896935a3b74b-kube-api-access-nsrbk\") pod \"service-ca-7d74d578b8-lhsp9\" (UID: \"11198af3-d26c-42f3-998c-896935a3b74b\") " pod="openshift-service-ca/service-ca-7d74d578b8-lhsp9" Jun 10 16:47:58.427522 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:58.427467 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/11198af3-d26c-42f3-998c-896935a3b74b-signing-cabundle\") pod \"service-ca-7d74d578b8-lhsp9\" (UID: \"11198af3-d26c-42f3-998c-896935a3b74b\") " pod="openshift-service-ca/service-ca-7d74d578b8-lhsp9" Jun 10 16:47:58.429665 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:58.429621 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/11198af3-d26c-42f3-998c-896935a3b74b-signing-key\") pod \"service-ca-7d74d578b8-lhsp9\" (UID: \"11198af3-d26c-42f3-998c-896935a3b74b\") " pod="openshift-service-ca/service-ca-7d74d578b8-lhsp9" Jun 10 16:47:58.435291 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:58.435271 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsrbk\" (UniqueName: \"kubernetes.io/projected/11198af3-d26c-42f3-998c-896935a3b74b-kube-api-access-nsrbk\") pod \"service-ca-7d74d578b8-lhsp9\" (UID: \"11198af3-d26c-42f3-998c-896935a3b74b\") " pod="openshift-service-ca/service-ca-7d74d578b8-lhsp9" Jun 10 16:47:58.525308 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:58.525223 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mgpvj_df4f4a0a-8563-43bc-b1a9-c933a16dfa01/console-operator/1.log" Jun 10 16:47:58.525777 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:58.525683 2562 scope.go:117] "RemoveContainer" containerID="c9fddd2e2c4db04691a11ffb1bd399189b2851184d214586afb6d0660c35f7db" Jun 10 16:47:58.525899 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:47:58.525877 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-mgpvj_openshift-console-operator(df4f4a0a-8563-43bc-b1a9-c933a16dfa01)\"" pod="openshift-console-operator/console-operator-668fdbf85c-mgpvj" podUID="df4f4a0a-8563-43bc-b1a9-c933a16dfa01" Jun 10 16:47:58.526590 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:58.526548 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-ckmdn" event={"ID":"66b45156-4477-4e76-942c-5f250e31f7ff","Type":"ContainerStarted","Data":"68ab6d3bb4ac828dcb8af05ac8df2a47d465084c380fd3ecec39d33c84ce5a1e"} Jun 10 16:47:58.540438 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:58.540411 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-lhsp9" Jun 10 16:47:58.823039 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:58.823014 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-lhsp9"] Jun 10 16:47:58.826362 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:47:58.826328 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11198af3_d26c_42f3_998c_896935a3b74b.slice/crio-7ff3f4e42d9a860231d96373b6509548fc0b0603109fc823fa50a48ab034c3c7 WatchSource:0}: Error finding container 7ff3f4e42d9a860231d96373b6509548fc0b0603109fc823fa50a48ab034c3c7: Status 404 returned error can't find the container with id 7ff3f4e42d9a860231d96373b6509548fc0b0603109fc823fa50a48ab034c3c7 Jun 10 16:47:59.532157 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:59.532116 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-ckmdn" event={"ID":"66b45156-4477-4e76-942c-5f250e31f7ff","Type":"ContainerStarted","Data":"9c5b299baec343f7952c33b72c5f2ec71e5780537661f5b5873a82eab434e387"} Jun 10 16:47:59.532658 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:59.532191 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-ckmdn" event={"ID":"66b45156-4477-4e76-942c-5f250e31f7ff","Type":"ContainerStarted","Data":"7fe4b7f093cc58d96d5760710c2255d73b359eb2f3673083944dc5f16239388b"} Jun 10 16:47:59.533288 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:59.533262 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-lhsp9" event={"ID":"11198af3-d26c-42f3-998c-896935a3b74b","Type":"ContainerStarted","Data":"7ff3f4e42d9a860231d96373b6509548fc0b0603109fc823fa50a48ab034c3c7"} Jun 10 16:47:59.548843 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:47:59.548791 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-ckmdn" podStartSLOduration=1.473609219 podStartE2EDuration="2.548774234s" totalImagesPullingTime="1.075165015s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:47:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:47:59.54840888 +0000 UTC m=+199.072621947" watchObservedRunningTime="2026-06-10 16:47:59.548774234 +0000 UTC m=+199.072987304" Jun 10 16:48:00.035006 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:00.034975 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-65mjb_224e07b4-de73-42d9-a0b2-300dd5944e96/dns-node-resolver/0.log" Jun 10 16:48:01.035378 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:01.035353 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7s4lf_51c9f98e-ff02-48f2-b3e7-340543a646a6/node-ca/0.log" Jun 10 16:48:01.539955 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:01.539910 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-lhsp9" event={"ID":"11198af3-d26c-42f3-998c-896935a3b74b","Type":"ContainerStarted","Data":"ac8fbf0bd36588c9c8b0b34ee94b5a7633729b597d715d97dc186bf97eecf990"} Jun 10 16:48:01.554217 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:01.554167 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-lhsp9" podStartSLOduration=1.032000712 podStartE2EDuration="3.554153923s" totalImagesPullingTime="2.522153211s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:47:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:48:01.553565718 +0000 UTC m=+201.077778789" watchObservedRunningTime="2026-06-10 16:48:01.554153923 +0000 UTC m=+201.078367064" Jun 10 16:48:02.033046 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:02.033013 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xlq8r_eab6293a-4de8-4ed2-9642-c8053281de99/serve-healthcheck-canary/0.log" Jun 10 16:48:02.432474 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:02.432424 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-ckmdn_66b45156-4477-4e76-942c-5f250e31f7ff/migrator/0.log" Jun 10 16:48:02.633349 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:02.633322 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-ckmdn_66b45156-4477-4e76-942c-5f250e31f7ff/graceful-termination/0.log" Jun 10 16:48:02.834518 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:02.834485 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-bwp8v_7644b2ac-a2ef-4135-8284-bbc1261ff3f5/kube-storage-version-migrator-operator/0.log" Jun 10 16:48:02.970419 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:02.970386 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-mgpvj" Jun 10 16:48:02.970616 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:02.970440 2562 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-mgpvj" Jun 10 16:48:02.970802 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:02.970788 2562 scope.go:117] "RemoveContainer" containerID="c9fddd2e2c4db04691a11ffb1bd399189b2851184d214586afb6d0660c35f7db" Jun 10 16:48:02.970962 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:48:02.970943 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-mgpvj_openshift-console-operator(df4f4a0a-8563-43bc-b1a9-c933a16dfa01)\"" pod="openshift-console-operator/console-operator-668fdbf85c-mgpvj" podUID="df4f4a0a-8563-43bc-b1a9-c933a16dfa01" Jun 10 16:48:16.942897 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:16.942859 2562 scope.go:117] "RemoveContainer" containerID="c9fddd2e2c4db04691a11ffb1bd399189b2851184d214586afb6d0660c35f7db" Jun 10 16:48:17.589223 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:17.589195 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mgpvj_df4f4a0a-8563-43bc-b1a9-c933a16dfa01/console-operator/2.log" Jun 10 16:48:17.589591 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:17.589574 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mgpvj_df4f4a0a-8563-43bc-b1a9-c933a16dfa01/console-operator/1.log" Jun 10 16:48:17.589684 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:17.589608 2562 generic.go:356] "Generic (PLEG): container finished" podID="df4f4a0a-8563-43bc-b1a9-c933a16dfa01" containerID="d32d71c92d5afa93f58fe7f92c0bc88871f388fe7da8f73fbb3613461c332c89" exitCode=255 Jun 10 16:48:17.589721 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:17.589687 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-mgpvj" event={"ID":"df4f4a0a-8563-43bc-b1a9-c933a16dfa01","Type":"ContainerDied","Data":"d32d71c92d5afa93f58fe7f92c0bc88871f388fe7da8f73fbb3613461c332c89"} Jun 10 16:48:17.589752 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:17.589739 2562 scope.go:117] "RemoveContainer" containerID="c9fddd2e2c4db04691a11ffb1bd399189b2851184d214586afb6d0660c35f7db" Jun 10 16:48:17.590063 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:17.590041 2562 scope.go:117] "RemoveContainer" containerID="d32d71c92d5afa93f58fe7f92c0bc88871f388fe7da8f73fbb3613461c332c89" Jun 10 16:48:17.590260 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:48:17.590231 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-mgpvj_openshift-console-operator(df4f4a0a-8563-43bc-b1a9-c933a16dfa01)\"" pod="openshift-console-operator/console-operator-668fdbf85c-mgpvj" podUID="df4f4a0a-8563-43bc-b1a9-c933a16dfa01" Jun 10 16:48:18.595969 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:18.595940 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mgpvj_df4f4a0a-8563-43bc-b1a9-c933a16dfa01/console-operator/2.log" Jun 10 16:48:20.246010 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:20.245978 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-9cvpp"] Jun 10 16:48:20.250280 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:20.250250 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9cvpp" Jun 10 16:48:20.252714 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:20.252695 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 10 16:48:20.252812 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:20.252733 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 10 16:48:20.253275 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:20.253262 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-q9s5x\"" Jun 10 16:48:20.269728 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:20.269706 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9cvpp"] Jun 10 16:48:20.401780 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:20.401749 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e554533a-69f5-40b7-a685-c0d38aa78c6f-crio-socket\") pod \"insights-runtime-extractor-9cvpp\" (UID: \"e554533a-69f5-40b7-a685-c0d38aa78c6f\") " pod="openshift-insights/insights-runtime-extractor-9cvpp" Jun 10 16:48:20.401958 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:20.401821 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e554533a-69f5-40b7-a685-c0d38aa78c6f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9cvpp\" (UID: \"e554533a-69f5-40b7-a685-c0d38aa78c6f\") " pod="openshift-insights/insights-runtime-extractor-9cvpp" Jun 10 16:48:20.401958 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:20.401863 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vf7ff\" (UniqueName: \"kubernetes.io/projected/e554533a-69f5-40b7-a685-c0d38aa78c6f-kube-api-access-vf7ff\") pod \"insights-runtime-extractor-9cvpp\" (UID: \"e554533a-69f5-40b7-a685-c0d38aa78c6f\") " pod="openshift-insights/insights-runtime-extractor-9cvpp" Jun 10 16:48:20.401958 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:20.401889 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e554533a-69f5-40b7-a685-c0d38aa78c6f-data-volume\") pod \"insights-runtime-extractor-9cvpp\" (UID: \"e554533a-69f5-40b7-a685-c0d38aa78c6f\") " pod="openshift-insights/insights-runtime-extractor-9cvpp" Jun 10 16:48:20.401958 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:20.401917 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e554533a-69f5-40b7-a685-c0d38aa78c6f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9cvpp\" (UID: \"e554533a-69f5-40b7-a685-c0d38aa78c6f\") " pod="openshift-insights/insights-runtime-extractor-9cvpp" Jun 10 16:48:20.503039 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:20.502956 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e554533a-69f5-40b7-a685-c0d38aa78c6f-crio-socket\") pod \"insights-runtime-extractor-9cvpp\" (UID: \"e554533a-69f5-40b7-a685-c0d38aa78c6f\") " pod="openshift-insights/insights-runtime-extractor-9cvpp" Jun 10 16:48:20.503039 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:20.503026 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e554533a-69f5-40b7-a685-c0d38aa78c6f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9cvpp\" (UID: \"e554533a-69f5-40b7-a685-c0d38aa78c6f\") " pod="openshift-insights/insights-runtime-extractor-9cvpp" Jun 10 16:48:20.503227 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:20.503080 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vf7ff\" (UniqueName: \"kubernetes.io/projected/e554533a-69f5-40b7-a685-c0d38aa78c6f-kube-api-access-vf7ff\") pod \"insights-runtime-extractor-9cvpp\" (UID: \"e554533a-69f5-40b7-a685-c0d38aa78c6f\") " pod="openshift-insights/insights-runtime-extractor-9cvpp" Jun 10 16:48:20.503227 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:20.503100 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e554533a-69f5-40b7-a685-c0d38aa78c6f-crio-socket\") pod \"insights-runtime-extractor-9cvpp\" (UID: \"e554533a-69f5-40b7-a685-c0d38aa78c6f\") " pod="openshift-insights/insights-runtime-extractor-9cvpp" Jun 10 16:48:20.503227 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:20.503114 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e554533a-69f5-40b7-a685-c0d38aa78c6f-data-volume\") pod \"insights-runtime-extractor-9cvpp\" (UID: \"e554533a-69f5-40b7-a685-c0d38aa78c6f\") " pod="openshift-insights/insights-runtime-extractor-9cvpp" Jun 10 16:48:20.503227 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:20.503139 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e554533a-69f5-40b7-a685-c0d38aa78c6f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9cvpp\" (UID: \"e554533a-69f5-40b7-a685-c0d38aa78c6f\") " pod="openshift-insights/insights-runtime-extractor-9cvpp" Jun 10 16:48:20.503490 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:20.503470 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e554533a-69f5-40b7-a685-c0d38aa78c6f-data-volume\") pod \"insights-runtime-extractor-9cvpp\" (UID: \"e554533a-69f5-40b7-a685-c0d38aa78c6f\") " pod="openshift-insights/insights-runtime-extractor-9cvpp" Jun 10 16:48:20.503589 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:20.503568 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e554533a-69f5-40b7-a685-c0d38aa78c6f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9cvpp\" (UID: \"e554533a-69f5-40b7-a685-c0d38aa78c6f\") " pod="openshift-insights/insights-runtime-extractor-9cvpp" Jun 10 16:48:20.505531 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:20.505510 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e554533a-69f5-40b7-a685-c0d38aa78c6f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9cvpp\" (UID: \"e554533a-69f5-40b7-a685-c0d38aa78c6f\") " pod="openshift-insights/insights-runtime-extractor-9cvpp" Jun 10 16:48:20.513007 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:20.512986 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vf7ff\" (UniqueName: \"kubernetes.io/projected/e554533a-69f5-40b7-a685-c0d38aa78c6f-kube-api-access-vf7ff\") pod \"insights-runtime-extractor-9cvpp\" (UID: \"e554533a-69f5-40b7-a685-c0d38aa78c6f\") " pod="openshift-insights/insights-runtime-extractor-9cvpp" Jun 10 16:48:20.559143 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:20.559112 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9cvpp" Jun 10 16:48:20.689005 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:20.688971 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9cvpp"] Jun 10 16:48:20.691757 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:48:20.691734 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode554533a_69f5_40b7_a685_c0d38aa78c6f.slice/crio-89ff291cb0328346010ac5f8f29070c166a46101a544a9b3057a797d0b9575a2 WatchSource:0}: Error finding container 89ff291cb0328346010ac5f8f29070c166a46101a544a9b3057a797d0b9575a2: Status 404 returned error can't find the container with id 89ff291cb0328346010ac5f8f29070c166a46101a544a9b3057a797d0b9575a2 Jun 10 16:48:21.606213 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:21.606175 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9cvpp" event={"ID":"e554533a-69f5-40b7-a685-c0d38aa78c6f","Type":"ContainerStarted","Data":"c50627d980d9b70b8205f3a6e6e062815adee5f1983acc0df47a87e8b81ed836"} Jun 10 16:48:21.606606 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:21.606245 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9cvpp" event={"ID":"e554533a-69f5-40b7-a685-c0d38aa78c6f","Type":"ContainerStarted","Data":"b18b28a565aebf31d0fbeb4e790917a1cfbf437434d36d7b8c2b3c5899eb6719"} Jun 10 16:48:21.606606 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:21.606280 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9cvpp" event={"ID":"e554533a-69f5-40b7-a685-c0d38aa78c6f","Type":"ContainerStarted","Data":"89ff291cb0328346010ac5f8f29070c166a46101a544a9b3057a797d0b9575a2"} Jun 10 16:48:22.969790 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:22.969773 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-mgpvj" Jun 10 16:48:22.970071 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:22.969811 2562 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-mgpvj" Jun 10 16:48:22.970108 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:22.970085 2562 scope.go:117] "RemoveContainer" containerID="d32d71c92d5afa93f58fe7f92c0bc88871f388fe7da8f73fbb3613461c332c89" Jun 10 16:48:22.970233 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:48:22.970216 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-mgpvj_openshift-console-operator(df4f4a0a-8563-43bc-b1a9-c933a16dfa01)\"" pod="openshift-console-operator/console-operator-668fdbf85c-mgpvj" podUID="df4f4a0a-8563-43bc-b1a9-c933a16dfa01" Jun 10 16:48:23.614567 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:23.614537 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9cvpp" event={"ID":"e554533a-69f5-40b7-a685-c0d38aa78c6f","Type":"ContainerStarted","Data":"5da18e4195ee18f0b7b9d355f03284b1b179f773d1c1733e1cb47aeb83707f28"} Jun 10 16:48:23.631753 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:23.631703 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-9cvpp" podStartSLOduration=1.472493361 podStartE2EDuration="3.63168893s" totalImagesPullingTime="2.159195569s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 16:48:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:48:23.630724336 +0000 UTC m=+223.154937417" watchObservedRunningTime="2026-06-10 16:48:23.63168893 +0000 UTC m=+223.155902001" Jun 10 16:48:31.138321 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:31.138284 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-j6mcx"] Jun 10 16:48:31.173967 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:31.173943 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-j6mcx"] Jun 10 16:48:31.174116 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:31.174038 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-j6mcx" Jun 10 16:48:31.177541 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:31.177516 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-r9sds\"" Jun 10 16:48:31.177708 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:31.177590 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 10 16:48:31.177708 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:31.177557 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 10 16:48:31.177708 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:31.177560 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 10 16:48:31.177708 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:31.177574 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 10 16:48:31.177708 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:31.177545 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 10 16:48:31.289981 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:31.289944 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1d27cdd1-7041-4ba5-94d6-f8dc6c7fa106-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-j6mcx\" (UID: \"1d27cdd1-7041-4ba5-94d6-f8dc6c7fa106\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-j6mcx" Jun 10 16:48:31.289981 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:31.289986 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1d27cdd1-7041-4ba5-94d6-f8dc6c7fa106-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-j6mcx\" (UID: \"1d27cdd1-7041-4ba5-94d6-f8dc6c7fa106\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-j6mcx" Jun 10 16:48:31.290216 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:31.290056 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kk595\" (UniqueName: \"kubernetes.io/projected/1d27cdd1-7041-4ba5-94d6-f8dc6c7fa106-kube-api-access-kk595\") pod \"prometheus-operator-7f7d445d84-j6mcx\" (UID: \"1d27cdd1-7041-4ba5-94d6-f8dc6c7fa106\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-j6mcx" Jun 10 16:48:31.290216 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:31.290120 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d27cdd1-7041-4ba5-94d6-f8dc6c7fa106-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-j6mcx\" (UID: \"1d27cdd1-7041-4ba5-94d6-f8dc6c7fa106\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-j6mcx" Jun 10 16:48:31.390563 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:31.390482 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1d27cdd1-7041-4ba5-94d6-f8dc6c7fa106-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-j6mcx\" (UID: \"1d27cdd1-7041-4ba5-94d6-f8dc6c7fa106\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-j6mcx" Jun 10 16:48:31.390563 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:31.390544 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1d27cdd1-7041-4ba5-94d6-f8dc6c7fa106-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-j6mcx\" (UID: \"1d27cdd1-7041-4ba5-94d6-f8dc6c7fa106\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-j6mcx" Jun 10 16:48:31.390802 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:31.390603 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kk595\" (UniqueName: \"kubernetes.io/projected/1d27cdd1-7041-4ba5-94d6-f8dc6c7fa106-kube-api-access-kk595\") pod \"prometheus-operator-7f7d445d84-j6mcx\" (UID: \"1d27cdd1-7041-4ba5-94d6-f8dc6c7fa106\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-j6mcx" Jun 10 16:48:31.390802 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:31.390689 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d27cdd1-7041-4ba5-94d6-f8dc6c7fa106-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-j6mcx\" (UID: \"1d27cdd1-7041-4ba5-94d6-f8dc6c7fa106\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-j6mcx" Jun 10 16:48:31.391486 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:31.391458 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d27cdd1-7041-4ba5-94d6-f8dc6c7fa106-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-j6mcx\" (UID: \"1d27cdd1-7041-4ba5-94d6-f8dc6c7fa106\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-j6mcx" Jun 10 16:48:31.393017 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:31.392994 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1d27cdd1-7041-4ba5-94d6-f8dc6c7fa106-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-j6mcx\" (UID: \"1d27cdd1-7041-4ba5-94d6-f8dc6c7fa106\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-j6mcx" Jun 10 16:48:31.393108 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:31.393030 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1d27cdd1-7041-4ba5-94d6-f8dc6c7fa106-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-j6mcx\" (UID: \"1d27cdd1-7041-4ba5-94d6-f8dc6c7fa106\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-j6mcx" Jun 10 16:48:31.398025 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:31.398003 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kk595\" (UniqueName: \"kubernetes.io/projected/1d27cdd1-7041-4ba5-94d6-f8dc6c7fa106-kube-api-access-kk595\") pod \"prometheus-operator-7f7d445d84-j6mcx\" (UID: \"1d27cdd1-7041-4ba5-94d6-f8dc6c7fa106\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-j6mcx" Jun 10 16:48:31.483673 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:31.483618 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-j6mcx" Jun 10 16:48:31.632217 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:31.632093 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-j6mcx"] Jun 10 16:48:31.634648 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:48:31.634611 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d27cdd1_7041_4ba5_94d6_f8dc6c7fa106.slice/crio-b4312d7570a42c3c98c097f581a480768a6862af7fe897d04c209a55ad56ad1f WatchSource:0}: Error finding container b4312d7570a42c3c98c097f581a480768a6862af7fe897d04c209a55ad56ad1f: Status 404 returned error can't find the container with id b4312d7570a42c3c98c097f581a480768a6862af7fe897d04c209a55ad56ad1f Jun 10 16:48:31.645425 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:31.645097 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-j6mcx" event={"ID":"1d27cdd1-7041-4ba5-94d6-f8dc6c7fa106","Type":"ContainerStarted","Data":"b4312d7570a42c3c98c097f581a480768a6862af7fe897d04c209a55ad56ad1f"} Jun 10 16:48:33.654175 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:33.654134 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-j6mcx" event={"ID":"1d27cdd1-7041-4ba5-94d6-f8dc6c7fa106","Type":"ContainerStarted","Data":"45e96e2c351b1e66779e6a3ca94b9b17d443c1b1714c4798a37a3c03e9a18550"} Jun 10 16:48:33.654559 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:33.654196 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-j6mcx" event={"ID":"1d27cdd1-7041-4ba5-94d6-f8dc6c7fa106","Type":"ContainerStarted","Data":"ec6090d5da71b17034f9b8f9c541e3b49ccbe34e67a5ae280cdf7d1d3b7a798e"} Jun 10 16:48:33.670412 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:33.670363 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-j6mcx" podStartSLOduration=1.4558001790000001 podStartE2EDuration="2.670348544s" totalImagesPullingTime="1.214548365s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:48:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:48:33.669433413 +0000 UTC m=+233.193646482" watchObservedRunningTime="2026-06-10 16:48:33.670348544 +0000 UTC m=+233.194561613" Jun 10 16:48:35.481331 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:35.481290 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-lmxd7"] Jun 10 16:48:35.483948 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:35.483929 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-lmxd7" Jun 10 16:48:35.486786 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:35.486762 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-gn7jr\"" Jun 10 16:48:35.486912 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:35.486772 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 10 16:48:35.486912 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:35.486772 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 10 16:48:35.486912 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:35.486855 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 10 16:48:35.497813 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:35.497790 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-lmxd7"] Jun 10 16:48:35.502385 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:35.502361 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-46fzb"] Jun 10 16:48:35.505129 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:35.505109 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-46fzb" Jun 10 16:48:35.507420 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:35.507379 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-pzk5s\"" Jun 10 16:48:35.507420 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:35.507396 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 10 16:48:35.507420 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:35.507382 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 10 16:48:35.507668 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:35.507379 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 10 16:48:35.522900 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:35.522877 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6e75343e-4791-4a06-a99c-dd7a6329408c-node-exporter-accelerators-collector-config\") pod \"node-exporter-46fzb\" (UID: \"6e75343e-4791-4a06-a99c-dd7a6329408c\") " pod="openshift-monitoring/node-exporter-46fzb" Jun 10 16:48:35.523026 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:35.522913 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/24ba981e-45f3-411b-afb1-8250622231fa-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-lmxd7\" (UID: \"24ba981e-45f3-411b-afb1-8250622231fa\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-lmxd7" Jun 10 16:48:35.523026 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:35.522944 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n66sr\" (UniqueName: \"kubernetes.io/projected/24ba981e-45f3-411b-afb1-8250622231fa-kube-api-access-n66sr\") pod \"kube-state-metrics-57bbf8bfb5-lmxd7\" (UID: \"24ba981e-45f3-411b-afb1-8250622231fa\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-lmxd7" Jun 10 16:48:35.523026 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:35.523000 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6e75343e-4791-4a06-a99c-dd7a6329408c-node-exporter-wtmp\") pod \"node-exporter-46fzb\" (UID: \"6e75343e-4791-4a06-a99c-dd7a6329408c\") " pod="openshift-monitoring/node-exporter-46fzb" Jun 10 16:48:35.523193 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:35.523054 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6e75343e-4791-4a06-a99c-dd7a6329408c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-46fzb\" (UID: \"6e75343e-4791-4a06-a99c-dd7a6329408c\") " pod="openshift-monitoring/node-exporter-46fzb" Jun 10 16:48:35.523193 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:35.523084 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24ba981e-45f3-411b-afb1-8250622231fa-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-lmxd7\" (UID: \"24ba981e-45f3-411b-afb1-8250622231fa\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-lmxd7" Jun 10 16:48:35.523193 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:35.523149 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6e75343e-4791-4a06-a99c-dd7a6329408c-root\") pod \"node-exporter-46fzb\" (UID: \"6e75343e-4791-4a06-a99c-dd7a6329408c\") " pod="openshift-monitoring/node-exporter-46fzb" Jun 10 16:48:35.523193 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:35.523176 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6e75343e-4791-4a06-a99c-dd7a6329408c-sys\") pod \"node-exporter-46fzb\" (UID: \"6e75343e-4791-4a06-a99c-dd7a6329408c\") " pod="openshift-monitoring/node-exporter-46fzb" Jun 10 16:48:35.523380 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:35.523202 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f79wg\" (UniqueName: \"kubernetes.io/projected/6e75343e-4791-4a06-a99c-dd7a6329408c-kube-api-access-f79wg\") pod \"node-exporter-46fzb\" (UID: \"6e75343e-4791-4a06-a99c-dd7a6329408c\") " pod="openshift-monitoring/node-exporter-46fzb" Jun 10 16:48:35.523380 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:35.523227 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/24ba981e-45f3-411b-afb1-8250622231fa-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-lmxd7\" (UID: \"24ba981e-45f3-411b-afb1-8250622231fa\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-lmxd7" Jun 10 16:48:35.523380 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:35.523251 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6e75343e-4791-4a06-a99c-dd7a6329408c-node-exporter-textfile\") pod \"node-exporter-46fzb\" (UID: \"6e75343e-4791-4a06-a99c-dd7a6329408c\") " pod="openshift-monitoring/node-exporter-46fzb" Jun 10 16:48:35.523380 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:35.523290 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e75343e-4791-4a06-a99c-dd7a6329408c-metrics-client-ca\") pod \"node-exporter-46fzb\" (UID: \"6e75343e-4791-4a06-a99c-dd7a6329408c\") " pod="openshift-monitoring/node-exporter-46fzb" Jun 10 16:48:35.523380 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:35.523322 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/24ba981e-45f3-411b-afb1-8250622231fa-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-lmxd7\" (UID: \"24ba981e-45f3-411b-afb1-8250622231fa\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-lmxd7" Jun 10 16:48:35.523380 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:35.523351 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/24ba981e-45f3-411b-afb1-8250622231fa-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-lmxd7\" (UID: \"24ba981e-45f3-411b-afb1-8250622231fa\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-lmxd7" Jun 10 16:48:35.523380 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:35.523379 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6e75343e-4791-4a06-a99c-dd7a6329408c-node-exporter-tls\") pod \"node-exporter-46fzb\" (UID: \"6e75343e-4791-4a06-a99c-dd7a6329408c\") " pod="openshift-monitoring/node-exporter-46fzb" Jun 10 16:48:35.623884 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:35.623844 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6e75343e-4791-4a06-a99c-dd7a6329408c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-46fzb\" (UID: \"6e75343e-4791-4a06-a99c-dd7a6329408c\") " pod="openshift-monitoring/node-exporter-46fzb" Jun 10 16:48:35.624080 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:35.623888 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24ba981e-45f3-411b-afb1-8250622231fa-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-lmxd7\" (UID: \"24ba981e-45f3-411b-afb1-8250622231fa\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-lmxd7" Jun 10 16:48:35.624080 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:35.623935 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6e75343e-4791-4a06-a99c-dd7a6329408c-root\") pod \"node-exporter-46fzb\" (UID: \"6e75343e-4791-4a06-a99c-dd7a6329408c\") " pod="openshift-monitoring/node-exporter-46fzb" Jun 10 16:48:35.624080 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:35.623956 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6e75343e-4791-4a06-a99c-dd7a6329408c-sys\") pod \"node-exporter-46fzb\" (UID: \"6e75343e-4791-4a06-a99c-dd7a6329408c\") " pod="openshift-monitoring/node-exporter-46fzb" Jun 10 16:48:35.624080 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:35.623982 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f79wg\" (UniqueName: \"kubernetes.io/projected/6e75343e-4791-4a06-a99c-dd7a6329408c-kube-api-access-f79wg\") pod \"node-exporter-46fzb\" (UID: \"6e75343e-4791-4a06-a99c-dd7a6329408c\") " pod="openshift-monitoring/node-exporter-46fzb" Jun 10 16:48:35.624080 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:35.624003 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/24ba981e-45f3-411b-afb1-8250622231fa-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-lmxd7\" (UID: \"24ba981e-45f3-411b-afb1-8250622231fa\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-lmxd7" Jun 10 16:48:35.624080 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:35.624025 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6e75343e-4791-4a06-a99c-dd7a6329408c-node-exporter-textfile\") pod \"node-exporter-46fzb\" (UID: \"6e75343e-4791-4a06-a99c-dd7a6329408c\") " pod="openshift-monitoring/node-exporter-46fzb" Jun 10 16:48:35.624080 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:35.624046 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6e75343e-4791-4a06-a99c-dd7a6329408c-root\") pod \"node-exporter-46fzb\" (UID: \"6e75343e-4791-4a06-a99c-dd7a6329408c\") " pod="openshift-monitoring/node-exporter-46fzb" Jun 10 16:48:35.624080 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:35.624051 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6e75343e-4791-4a06-a99c-dd7a6329408c-sys\") pod \"node-exporter-46fzb\" (UID: \"6e75343e-4791-4a06-a99c-dd7a6329408c\") " pod="openshift-monitoring/node-exporter-46fzb" Jun 10 16:48:35.624526 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:35.624059 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e75343e-4791-4a06-a99c-dd7a6329408c-metrics-client-ca\") pod \"node-exporter-46fzb\" (UID: \"6e75343e-4791-4a06-a99c-dd7a6329408c\") " pod="openshift-monitoring/node-exporter-46fzb" Jun 10 16:48:35.624526 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:35.624120 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/24ba981e-45f3-411b-afb1-8250622231fa-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-lmxd7\" (UID: \"24ba981e-45f3-411b-afb1-8250622231fa\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-lmxd7" Jun 10 16:48:35.624526 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:35.624150 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/24ba981e-45f3-411b-afb1-8250622231fa-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-lmxd7\" (UID: \"24ba981e-45f3-411b-afb1-8250622231fa\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-lmxd7" Jun 10 16:48:35.624526 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:35.624191 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6e75343e-4791-4a06-a99c-dd7a6329408c-node-exporter-tls\") pod \"node-exporter-46fzb\" (UID: \"6e75343e-4791-4a06-a99c-dd7a6329408c\") " pod="openshift-monitoring/node-exporter-46fzb" Jun 10 16:48:35.624526 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:35.624258 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6e75343e-4791-4a06-a99c-dd7a6329408c-node-exporter-accelerators-collector-config\") pod \"node-exporter-46fzb\" (UID: \"6e75343e-4791-4a06-a99c-dd7a6329408c\") " pod="openshift-monitoring/node-exporter-46fzb" Jun 10 16:48:35.624526 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:35.624283 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/24ba981e-45f3-411b-afb1-8250622231fa-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-lmxd7\" (UID: \"24ba981e-45f3-411b-afb1-8250622231fa\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-lmxd7" Jun 10 16:48:35.624526 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:35.624315 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n66sr\" (UniqueName: \"kubernetes.io/projected/24ba981e-45f3-411b-afb1-8250622231fa-kube-api-access-n66sr\") pod \"kube-state-metrics-57bbf8bfb5-lmxd7\" (UID: \"24ba981e-45f3-411b-afb1-8250622231fa\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-lmxd7" Jun 10 16:48:35.624526 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:35.624352 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6e75343e-4791-4a06-a99c-dd7a6329408c-node-exporter-wtmp\") pod \"node-exporter-46fzb\" (UID: \"6e75343e-4791-4a06-a99c-dd7a6329408c\") " pod="openshift-monitoring/node-exporter-46fzb" Jun 10 16:48:35.624526 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:35.624394 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6e75343e-4791-4a06-a99c-dd7a6329408c-node-exporter-textfile\") pod \"node-exporter-46fzb\" (UID: \"6e75343e-4791-4a06-a99c-dd7a6329408c\") " pod="openshift-monitoring/node-exporter-46fzb" Jun 10 16:48:35.624526 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:35.624489 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6e75343e-4791-4a06-a99c-dd7a6329408c-node-exporter-wtmp\") pod \"node-exporter-46fzb\" (UID: \"6e75343e-4791-4a06-a99c-dd7a6329408c\") " pod="openshift-monitoring/node-exporter-46fzb" Jun 10 16:48:35.625012 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:35.624529 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/24ba981e-45f3-411b-afb1-8250622231fa-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-lmxd7\" (UID: \"24ba981e-45f3-411b-afb1-8250622231fa\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-lmxd7" Jun 10 16:48:35.625012 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:35.624855 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e75343e-4791-4a06-a99c-dd7a6329408c-metrics-client-ca\") pod \"node-exporter-46fzb\" (UID: \"6e75343e-4791-4a06-a99c-dd7a6329408c\") " pod="openshift-monitoring/node-exporter-46fzb" Jun 10 16:48:35.625310 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:35.625270 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24ba981e-45f3-411b-afb1-8250622231fa-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-lmxd7\" (UID: \"24ba981e-45f3-411b-afb1-8250622231fa\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-lmxd7" Jun 10 16:48:35.625310 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:35.625270 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/24ba981e-45f3-411b-afb1-8250622231fa-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-lmxd7\" (UID: \"24ba981e-45f3-411b-afb1-8250622231fa\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-lmxd7" Jun 10 16:48:35.625758 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:35.625477 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6e75343e-4791-4a06-a99c-dd7a6329408c-node-exporter-accelerators-collector-config\") pod \"node-exporter-46fzb\" (UID: \"6e75343e-4791-4a06-a99c-dd7a6329408c\") " pod="openshift-monitoring/node-exporter-46fzb" Jun 10 16:48:35.626939 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:35.626920 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6e75343e-4791-4a06-a99c-dd7a6329408c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-46fzb\" (UID: \"6e75343e-4791-4a06-a99c-dd7a6329408c\") " pod="openshift-monitoring/node-exporter-46fzb" Jun 10 16:48:35.627215 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:35.627194 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6e75343e-4791-4a06-a99c-dd7a6329408c-node-exporter-tls\") pod \"node-exporter-46fzb\" (UID: \"6e75343e-4791-4a06-a99c-dd7a6329408c\") " pod="openshift-monitoring/node-exporter-46fzb" Jun 10 16:48:35.627319 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:35.627303 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/24ba981e-45f3-411b-afb1-8250622231fa-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-lmxd7\" (UID: \"24ba981e-45f3-411b-afb1-8250622231fa\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-lmxd7" Jun 10 16:48:35.627358 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:35.627302 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/24ba981e-45f3-411b-afb1-8250622231fa-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-lmxd7\" (UID: \"24ba981e-45f3-411b-afb1-8250622231fa\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-lmxd7" Jun 10 16:48:35.634400 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:35.634378 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f79wg\" (UniqueName: \"kubernetes.io/projected/6e75343e-4791-4a06-a99c-dd7a6329408c-kube-api-access-f79wg\") pod \"node-exporter-46fzb\" (UID: \"6e75343e-4791-4a06-a99c-dd7a6329408c\") " pod="openshift-monitoring/node-exporter-46fzb" Jun 10 16:48:35.634529 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:35.634510 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n66sr\" (UniqueName: \"kubernetes.io/projected/24ba981e-45f3-411b-afb1-8250622231fa-kube-api-access-n66sr\") pod \"kube-state-metrics-57bbf8bfb5-lmxd7\" (UID: \"24ba981e-45f3-411b-afb1-8250622231fa\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-lmxd7" Jun 10 16:48:35.793809 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:35.793725 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-lmxd7" Jun 10 16:48:35.817410 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:35.817233 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-46fzb" Jun 10 16:48:35.829314 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:48:35.829271 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e75343e_4791_4a06_a99c_dd7a6329408c.slice/crio-4d938c09de77ff91094cddb0531371d504c4e4fbed5af245f1b67af823162303 WatchSource:0}: Error finding container 4d938c09de77ff91094cddb0531371d504c4e4fbed5af245f1b67af823162303: Status 404 returned error can't find the container with id 4d938c09de77ff91094cddb0531371d504c4e4fbed5af245f1b67af823162303 Jun 10 16:48:35.935507 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:35.935337 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-lmxd7"] Jun 10 16:48:35.938180 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:48:35.938142 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24ba981e_45f3_411b_afb1_8250622231fa.slice/crio-7d0c5765fd23d41b4ba98e7b04d03da084f458ae3f2102461db94d136084b934 WatchSource:0}: Error finding container 7d0c5765fd23d41b4ba98e7b04d03da084f458ae3f2102461db94d136084b934: Status 404 returned error can't find the container with id 7d0c5765fd23d41b4ba98e7b04d03da084f458ae3f2102461db94d136084b934 Jun 10 16:48:36.667604 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:36.667481 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-lmxd7" event={"ID":"24ba981e-45f3-411b-afb1-8250622231fa","Type":"ContainerStarted","Data":"7d0c5765fd23d41b4ba98e7b04d03da084f458ae3f2102461db94d136084b934"} Jun 10 16:48:36.670080 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:36.670047 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-46fzb" event={"ID":"6e75343e-4791-4a06-a99c-dd7a6329408c","Type":"ContainerStarted","Data":"4d938c09de77ff91094cddb0531371d504c4e4fbed5af245f1b67af823162303"} Jun 10 16:48:37.674649 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:37.674585 2562 generic.go:356] "Generic (PLEG): container finished" podID="6e75343e-4791-4a06-a99c-dd7a6329408c" containerID="ef45c9d6137fb905e2fdaea1d3d9e468a1031fe01209ab852cb8604a3aef5dec" exitCode=0 Jun 10 16:48:37.675087 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:37.674676 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-46fzb" event={"ID":"6e75343e-4791-4a06-a99c-dd7a6329408c","Type":"ContainerDied","Data":"ef45c9d6137fb905e2fdaea1d3d9e468a1031fe01209ab852cb8604a3aef5dec"} Jun 10 16:48:37.676914 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:37.676890 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-lmxd7" event={"ID":"24ba981e-45f3-411b-afb1-8250622231fa","Type":"ContainerStarted","Data":"dfb66b02cccdfa1478ca082d893754439d5579e9ca5918b7fd1c10482668bef3"} Jun 10 16:48:37.677045 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:37.676942 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-lmxd7" event={"ID":"24ba981e-45f3-411b-afb1-8250622231fa","Type":"ContainerStarted","Data":"d3182b8067150fa65585c13dc5c19693f041f84e7a519fd59ded78bfadc34a82"} Jun 10 16:48:37.677045 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:37.676970 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-lmxd7" event={"ID":"24ba981e-45f3-411b-afb1-8250622231fa","Type":"ContainerStarted","Data":"39437f95831aad674c4e1f6f7b7bb1200c1e8115616f38b8351ffde57e4c9714"} Jun 10 16:48:37.713618 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:37.713568 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-lmxd7" podStartSLOduration=1.474663691 podStartE2EDuration="2.713551959s" totalImagesPullingTime="1.238888268s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:48:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:48:37.712228244 +0000 UTC m=+237.236441314" watchObservedRunningTime="2026-06-10 16:48:37.713551959 +0000 UTC m=+237.237765029" Jun 10 16:48:37.942719 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:37.942623 2562 scope.go:117] "RemoveContainer" containerID="d32d71c92d5afa93f58fe7f92c0bc88871f388fe7da8f73fbb3613461c332c89" Jun 10 16:48:38.590749 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:38.590712 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-jss4d"] Jun 10 16:48:38.593317 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:38.593302 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-jss4d" Jun 10 16:48:38.595724 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:38.595698 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-l4qrr\"" Jun 10 16:48:38.595864 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:38.595771 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 10 16:48:38.595936 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:38.595885 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 10 16:48:38.605257 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:38.605234 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-jss4d"] Jun 10 16:48:38.652392 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:38.652358 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrvns\" (UniqueName: \"kubernetes.io/projected/4e2e8592-b013-41c4-b089-4dba9e250839-kube-api-access-nrvns\") pod \"downloads-6657875f97-jss4d\" (UID: \"4e2e8592-b013-41c4-b089-4dba9e250839\") " pod="openshift-console/downloads-6657875f97-jss4d" Jun 10 16:48:38.682155 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:38.682132 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mgpvj_df4f4a0a-8563-43bc-b1a9-c933a16dfa01/console-operator/2.log" Jun 10 16:48:38.682597 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:38.682219 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-mgpvj" event={"ID":"df4f4a0a-8563-43bc-b1a9-c933a16dfa01","Type":"ContainerStarted","Data":"406bfa8b8c0643f0b682bffe2b9736cb568bba60cf7783701f6400cc2ba1b1b4"} Jun 10 16:48:38.682700 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:38.682614 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-mgpvj" Jun 10 16:48:38.685048 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:38.685001 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-46fzb" event={"ID":"6e75343e-4791-4a06-a99c-dd7a6329408c","Type":"ContainerStarted","Data":"2ea5a6568e8a88d07b20d4cf3c3a467a05cef3239f6dd7ded21d9a45b69edb3f"} Jun 10 16:48:38.685181 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:38.685071 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-46fzb" event={"ID":"6e75343e-4791-4a06-a99c-dd7a6329408c","Type":"ContainerStarted","Data":"2cb921e628515980fb6d3ba6866f4ca1a1e6f3080beb0b86f541aab08ca9fbd5"} Jun 10 16:48:38.687822 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:38.687801 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-mgpvj" Jun 10 16:48:38.700502 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:38.700453 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-mgpvj" podStartSLOduration=43.690973631 podStartE2EDuration="46.700434798s" totalImagesPullingTime="3.009461167s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:47:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:48:38.699179222 +0000 UTC m=+238.223392291" watchObservedRunningTime="2026-06-10 16:48:38.700434798 +0000 UTC m=+238.224647873" Jun 10 16:48:38.717180 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:38.717129 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-46fzb" podStartSLOduration=2.758912729 podStartE2EDuration="3.71711632s" totalImagesPullingTime="877.765922ms" totalInitContainerRuntime="80.437669ms" isStatefulPod=true podCreationTimestamp="2026-06-10 16:48:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:48:38.716482061 +0000 UTC m=+238.240695154" watchObservedRunningTime="2026-06-10 16:48:38.71711632 +0000 UTC m=+238.241329390" Jun 10 16:48:38.760292 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:38.760245 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrvns\" (UniqueName: \"kubernetes.io/projected/4e2e8592-b013-41c4-b089-4dba9e250839-kube-api-access-nrvns\") pod \"downloads-6657875f97-jss4d\" (UID: \"4e2e8592-b013-41c4-b089-4dba9e250839\") " pod="openshift-console/downloads-6657875f97-jss4d" Jun 10 16:48:38.763495 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:38.763461 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrvns\" (UniqueName: \"kubernetes.io/projected/4e2e8592-b013-41c4-b089-4dba9e250839-kube-api-access-nrvns\") pod \"downloads-6657875f97-jss4d\" (UID: \"4e2e8592-b013-41c4-b089-4dba9e250839\") " pod="openshift-console/downloads-6657875f97-jss4d" Jun 10 16:48:38.902746 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:38.902655 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-jss4d" Jun 10 16:48:39.033819 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:39.033778 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-jss4d"] Jun 10 16:48:39.038388 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:48:39.038352 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e2e8592_b013_41c4_b089_4dba9e250839.slice/crio-2914b0dbcd9de7778d60b1938b1b80088a220c98527e8257bac3c7458966c1d9 WatchSource:0}: Error finding container 2914b0dbcd9de7778d60b1938b1b80088a220c98527e8257bac3c7458966c1d9: Status 404 returned error can't find the container with id 2914b0dbcd9de7778d60b1938b1b80088a220c98527e8257bac3c7458966c1d9 Jun 10 16:48:39.692454 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:39.692421 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-jss4d" event={"ID":"4e2e8592-b013-41c4-b089-4dba9e250839","Type":"ContainerStarted","Data":"2914b0dbcd9de7778d60b1938b1b80088a220c98527e8257bac3c7458966c1d9"} Jun 10 16:48:39.903295 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:39.903260 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-59648cdb5f-n5bzl"] Jun 10 16:48:39.908192 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:39.908165 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-59648cdb5f-n5bzl" Jun 10 16:48:39.912325 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:39.912300 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 10 16:48:39.912451 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:39.912345 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 10 16:48:39.913262 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:39.913241 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 10 16:48:39.913319 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:39.913253 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-t5qhc\"" Jun 10 16:48:39.913319 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:39.913301 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dgg5071j1k8p2\"" Jun 10 16:48:39.917526 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:39.917507 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 10 16:48:39.922190 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:39.922169 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-59648cdb5f-n5bzl"] Jun 10 16:48:39.972447 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:39.972372 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/de3cfc41-9560-4df6-b26e-dba712b590ef-metrics-server-audit-profiles\") pod \"metrics-server-59648cdb5f-n5bzl\" (UID: \"de3cfc41-9560-4df6-b26e-dba712b590ef\") " pod="openshift-monitoring/metrics-server-59648cdb5f-n5bzl" Jun 10 16:48:39.972447 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:39.972429 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/de3cfc41-9560-4df6-b26e-dba712b590ef-audit-log\") pod \"metrics-server-59648cdb5f-n5bzl\" (UID: \"de3cfc41-9560-4df6-b26e-dba712b590ef\") " pod="openshift-monitoring/metrics-server-59648cdb5f-n5bzl" Jun 10 16:48:39.972592 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:39.972492 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de3cfc41-9560-4df6-b26e-dba712b590ef-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-59648cdb5f-n5bzl\" (UID: \"de3cfc41-9560-4df6-b26e-dba712b590ef\") " pod="openshift-monitoring/metrics-server-59648cdb5f-n5bzl" Jun 10 16:48:39.972592 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:39.972546 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/de3cfc41-9560-4df6-b26e-dba712b590ef-secret-metrics-server-client-certs\") pod \"metrics-server-59648cdb5f-n5bzl\" (UID: \"de3cfc41-9560-4df6-b26e-dba712b590ef\") " pod="openshift-monitoring/metrics-server-59648cdb5f-n5bzl" Jun 10 16:48:39.972592 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:39.972585 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/de3cfc41-9560-4df6-b26e-dba712b590ef-secret-metrics-server-tls\") pod \"metrics-server-59648cdb5f-n5bzl\" (UID: \"de3cfc41-9560-4df6-b26e-dba712b590ef\") " pod="openshift-monitoring/metrics-server-59648cdb5f-n5bzl" Jun 10 16:48:39.972777 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:39.972610 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8l4b\" (UniqueName: \"kubernetes.io/projected/de3cfc41-9560-4df6-b26e-dba712b590ef-kube-api-access-f8l4b\") pod \"metrics-server-59648cdb5f-n5bzl\" (UID: \"de3cfc41-9560-4df6-b26e-dba712b590ef\") " pod="openshift-monitoring/metrics-server-59648cdb5f-n5bzl" Jun 10 16:48:39.972777 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:39.972704 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/de3cfc41-9560-4df6-b26e-dba712b590ef-client-ca-bundle\") pod \"metrics-server-59648cdb5f-n5bzl\" (UID: \"de3cfc41-9560-4df6-b26e-dba712b590ef\") " pod="openshift-monitoring/metrics-server-59648cdb5f-n5bzl" Jun 10 16:48:40.073393 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:40.073355 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/de3cfc41-9560-4df6-b26e-dba712b590ef-secret-metrics-server-client-certs\") pod \"metrics-server-59648cdb5f-n5bzl\" (UID: \"de3cfc41-9560-4df6-b26e-dba712b590ef\") " pod="openshift-monitoring/metrics-server-59648cdb5f-n5bzl" Jun 10 16:48:40.073557 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:40.073416 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/de3cfc41-9560-4df6-b26e-dba712b590ef-secret-metrics-server-tls\") pod \"metrics-server-59648cdb5f-n5bzl\" (UID: \"de3cfc41-9560-4df6-b26e-dba712b590ef\") " pod="openshift-monitoring/metrics-server-59648cdb5f-n5bzl" Jun 10 16:48:40.073557 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:40.073457 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8l4b\" (UniqueName: \"kubernetes.io/projected/de3cfc41-9560-4df6-b26e-dba712b590ef-kube-api-access-f8l4b\") pod \"metrics-server-59648cdb5f-n5bzl\" (UID: \"de3cfc41-9560-4df6-b26e-dba712b590ef\") " pod="openshift-monitoring/metrics-server-59648cdb5f-n5bzl" Jun 10 16:48:40.073557 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:40.073500 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/de3cfc41-9560-4df6-b26e-dba712b590ef-client-ca-bundle\") pod \"metrics-server-59648cdb5f-n5bzl\" (UID: \"de3cfc41-9560-4df6-b26e-dba712b590ef\") " pod="openshift-monitoring/metrics-server-59648cdb5f-n5bzl" Jun 10 16:48:40.073557 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:40.073549 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/de3cfc41-9560-4df6-b26e-dba712b590ef-metrics-server-audit-profiles\") pod \"metrics-server-59648cdb5f-n5bzl\" (UID: \"de3cfc41-9560-4df6-b26e-dba712b590ef\") " pod="openshift-monitoring/metrics-server-59648cdb5f-n5bzl" Jun 10 16:48:40.073776 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:40.073587 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/de3cfc41-9560-4df6-b26e-dba712b590ef-audit-log\") pod \"metrics-server-59648cdb5f-n5bzl\" (UID: \"de3cfc41-9560-4df6-b26e-dba712b590ef\") " pod="openshift-monitoring/metrics-server-59648cdb5f-n5bzl" Jun 10 16:48:40.073776 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:40.073616 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de3cfc41-9560-4df6-b26e-dba712b590ef-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-59648cdb5f-n5bzl\" (UID: \"de3cfc41-9560-4df6-b26e-dba712b590ef\") " pod="openshift-monitoring/metrics-server-59648cdb5f-n5bzl" Jun 10 16:48:40.074265 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:40.074219 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/de3cfc41-9560-4df6-b26e-dba712b590ef-audit-log\") pod \"metrics-server-59648cdb5f-n5bzl\" (UID: \"de3cfc41-9560-4df6-b26e-dba712b590ef\") " pod="openshift-monitoring/metrics-server-59648cdb5f-n5bzl" Jun 10 16:48:40.074590 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:40.074564 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de3cfc41-9560-4df6-b26e-dba712b590ef-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-59648cdb5f-n5bzl\" (UID: \"de3cfc41-9560-4df6-b26e-dba712b590ef\") " pod="openshift-monitoring/metrics-server-59648cdb5f-n5bzl" Jun 10 16:48:40.074676 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:40.074574 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/de3cfc41-9560-4df6-b26e-dba712b590ef-metrics-server-audit-profiles\") pod \"metrics-server-59648cdb5f-n5bzl\" (UID: \"de3cfc41-9560-4df6-b26e-dba712b590ef\") " pod="openshift-monitoring/metrics-server-59648cdb5f-n5bzl" Jun 10 16:48:40.076066 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:40.076049 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/de3cfc41-9560-4df6-b26e-dba712b590ef-secret-metrics-server-client-certs\") pod \"metrics-server-59648cdb5f-n5bzl\" (UID: \"de3cfc41-9560-4df6-b26e-dba712b590ef\") " pod="openshift-monitoring/metrics-server-59648cdb5f-n5bzl" Jun 10 16:48:40.076510 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:40.076486 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/de3cfc41-9560-4df6-b26e-dba712b590ef-secret-metrics-server-tls\") pod \"metrics-server-59648cdb5f-n5bzl\" (UID: \"de3cfc41-9560-4df6-b26e-dba712b590ef\") " pod="openshift-monitoring/metrics-server-59648cdb5f-n5bzl" Jun 10 16:48:40.076687 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:40.076665 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/de3cfc41-9560-4df6-b26e-dba712b590ef-client-ca-bundle\") pod \"metrics-server-59648cdb5f-n5bzl\" (UID: \"de3cfc41-9560-4df6-b26e-dba712b590ef\") " pod="openshift-monitoring/metrics-server-59648cdb5f-n5bzl" Jun 10 16:48:40.081764 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:40.081743 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8l4b\" (UniqueName: \"kubernetes.io/projected/de3cfc41-9560-4df6-b26e-dba712b590ef-kube-api-access-f8l4b\") pod \"metrics-server-59648cdb5f-n5bzl\" (UID: \"de3cfc41-9560-4df6-b26e-dba712b590ef\") " pod="openshift-monitoring/metrics-server-59648cdb5f-n5bzl" Jun 10 16:48:40.217986 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:40.217953 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-59648cdb5f-n5bzl" Jun 10 16:48:40.393035 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:40.393011 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-59648cdb5f-n5bzl"] Jun 10 16:48:40.395321 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:48:40.395292 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde3cfc41_9560_4df6_b26e_dba712b590ef.slice/crio-a6737f4b235a1b8e8a67250f34a53d095429cf456f293281b794d900790a4b7d WatchSource:0}: Error finding container a6737f4b235a1b8e8a67250f34a53d095429cf456f293281b794d900790a4b7d: Status 404 returned error can't find the container with id a6737f4b235a1b8e8a67250f34a53d095429cf456f293281b794d900790a4b7d Jun 10 16:48:40.696503 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:40.696467 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-59648cdb5f-n5bzl" event={"ID":"de3cfc41-9560-4df6-b26e-dba712b590ef","Type":"ContainerStarted","Data":"a6737f4b235a1b8e8a67250f34a53d095429cf456f293281b794d900790a4b7d"} Jun 10 16:48:41.691643 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.691599 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 16:48:41.698058 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.698033 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:48:41.702936 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.702884 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 10 16:48:41.702936 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.702898 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 10 16:48:41.704190 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.703187 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 10 16:48:41.704190 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.703551 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-88fmvqikmalfl\"" Jun 10 16:48:41.704190 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.703771 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 10 16:48:41.704190 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.703962 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 10 16:48:41.704190 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.704054 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 10 16:48:41.704190 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.704120 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 10 16:48:41.704907 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.704565 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 10 16:48:41.704907 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.704679 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 10 16:48:41.705078 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.704918 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 10 16:48:41.705078 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.705073 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-2hkvn\"" Jun 10 16:48:41.705425 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.705254 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 10 16:48:41.706189 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.705732 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 10 16:48:41.707192 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.707159 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 10 16:48:41.709734 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.709691 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 10 16:48:41.713397 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.713191 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 16:48:41.793757 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.793714 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b7811958-8338-4bec-9351-2df8c6c1271e-web-config\") pod \"prometheus-k8s-0\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:48:41.793948 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.793763 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b7811958-8338-4bec-9351-2df8c6c1271e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:48:41.793948 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.793799 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b7811958-8338-4bec-9351-2df8c6c1271e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:48:41.793948 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.793817 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b7811958-8338-4bec-9351-2df8c6c1271e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:48:41.793948 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.793838 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b7811958-8338-4bec-9351-2df8c6c1271e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:48:41.793948 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.793880 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b7811958-8338-4bec-9351-2df8c6c1271e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:48:41.793948 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.793900 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gf9h\" (UniqueName: \"kubernetes.io/projected/b7811958-8338-4bec-9351-2df8c6c1271e-kube-api-access-5gf9h\") pod \"prometheus-k8s-0\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:48:41.793948 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.793920 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b7811958-8338-4bec-9351-2df8c6c1271e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:48:41.793948 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.793946 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b7811958-8338-4bec-9351-2df8c6c1271e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:48:41.794367 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.794028 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b7811958-8338-4bec-9351-2df8c6c1271e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:48:41.794367 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.794066 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b7811958-8338-4bec-9351-2df8c6c1271e-config-out\") pod \"prometheus-k8s-0\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:48:41.794367 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.794096 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b7811958-8338-4bec-9351-2df8c6c1271e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:48:41.794367 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.794128 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7811958-8338-4bec-9351-2df8c6c1271e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:48:41.794367 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.794150 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b7811958-8338-4bec-9351-2df8c6c1271e-config\") pod \"prometheus-k8s-0\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:48:41.794367 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.794217 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7811958-8338-4bec-9351-2df8c6c1271e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:48:41.794367 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.794260 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7811958-8338-4bec-9351-2df8c6c1271e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:48:41.794367 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.794347 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b7811958-8338-4bec-9351-2df8c6c1271e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:48:41.794775 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.794404 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b7811958-8338-4bec-9351-2df8c6c1271e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:48:41.794775 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.794441 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7811958-8338-4bec-9351-2df8c6c1271e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:48:41.794775 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.794497 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b7811958-8338-4bec-9351-2df8c6c1271e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:48:41.895711 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.895667 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b7811958-8338-4bec-9351-2df8c6c1271e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:48:41.895910 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.895736 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b7811958-8338-4bec-9351-2df8c6c1271e-config-out\") pod \"prometheus-k8s-0\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:48:41.895910 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.895762 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b7811958-8338-4bec-9351-2df8c6c1271e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:48:41.895910 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.895791 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7811958-8338-4bec-9351-2df8c6c1271e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:48:41.895910 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.895815 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b7811958-8338-4bec-9351-2df8c6c1271e-config\") pod \"prometheus-k8s-0\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:48:41.895910 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.895865 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7811958-8338-4bec-9351-2df8c6c1271e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:48:41.895910 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.895891 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7811958-8338-4bec-9351-2df8c6c1271e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:48:41.896209 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.895929 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b7811958-8338-4bec-9351-2df8c6c1271e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:48:41.896209 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.895974 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b7811958-8338-4bec-9351-2df8c6c1271e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:48:41.896209 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.896005 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7811958-8338-4bec-9351-2df8c6c1271e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:48:41.896209 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.896058 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b7811958-8338-4bec-9351-2df8c6c1271e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:48:41.896209 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.896088 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b7811958-8338-4bec-9351-2df8c6c1271e-web-config\") pod \"prometheus-k8s-0\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:48:41.896209 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.896114 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b7811958-8338-4bec-9351-2df8c6c1271e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:48:41.896209 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.896154 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b7811958-8338-4bec-9351-2df8c6c1271e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:48:41.896209 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.896178 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b7811958-8338-4bec-9351-2df8c6c1271e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:48:41.896209 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.896201 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b7811958-8338-4bec-9351-2df8c6c1271e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:48:41.896759 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.896226 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b7811958-8338-4bec-9351-2df8c6c1271e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:48:41.896759 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.896252 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gf9h\" (UniqueName: \"kubernetes.io/projected/b7811958-8338-4bec-9351-2df8c6c1271e-kube-api-access-5gf9h\") pod \"prometheus-k8s-0\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:48:41.896759 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.896286 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b7811958-8338-4bec-9351-2df8c6c1271e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:48:41.896759 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.896311 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b7811958-8338-4bec-9351-2df8c6c1271e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:48:41.897182 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.896923 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7811958-8338-4bec-9351-2df8c6c1271e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:48:41.897182 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.897074 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b7811958-8338-4bec-9351-2df8c6c1271e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:48:41.897498 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.897478 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7811958-8338-4bec-9351-2df8c6c1271e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:48:41.898423 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.898024 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7811958-8338-4bec-9351-2df8c6c1271e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:48:41.899095 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.899068 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b7811958-8338-4bec-9351-2df8c6c1271e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:48:41.899554 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.899530 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b7811958-8338-4bec-9351-2df8c6c1271e-config-out\") pod \"prometheus-k8s-0\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:48:41.900155 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.900128 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7811958-8338-4bec-9351-2df8c6c1271e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:48:41.900242 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.900220 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b7811958-8338-4bec-9351-2df8c6c1271e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:48:41.900385 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.900365 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b7811958-8338-4bec-9351-2df8c6c1271e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:48:41.901293 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.901267 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b7811958-8338-4bec-9351-2df8c6c1271e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:48:41.901939 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.901919 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/b7811958-8338-4bec-9351-2df8c6c1271e-config\") pod \"prometheus-k8s-0\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:48:41.902480 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.902424 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b7811958-8338-4bec-9351-2df8c6c1271e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:48:41.903654 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.903596 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b7811958-8338-4bec-9351-2df8c6c1271e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:48:41.903883 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.903858 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b7811958-8338-4bec-9351-2df8c6c1271e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:48:41.904562 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.904534 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b7811958-8338-4bec-9351-2df8c6c1271e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:48:41.905560 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.905515 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b7811958-8338-4bec-9351-2df8c6c1271e-web-config\") pod \"prometheus-k8s-0\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:48:41.906307 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.906282 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b7811958-8338-4bec-9351-2df8c6c1271e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:48:41.906914 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.906889 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b7811958-8338-4bec-9351-2df8c6c1271e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:48:41.907710 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.907689 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b7811958-8338-4bec-9351-2df8c6c1271e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:48:41.909680 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:41.909618 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gf9h\" (UniqueName: \"kubernetes.io/projected/b7811958-8338-4bec-9351-2df8c6c1271e-kube-api-access-5gf9h\") pod \"prometheus-k8s-0\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:48:42.015404 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:42.015380 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:48:42.183849 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:42.183815 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 16:48:42.187353 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:48:42.187321 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7811958_8338_4bec_9351_2df8c6c1271e.slice/crio-6bcd65f558b899b1efc0486f41d7faead563913131a3e4b8f6a86c5378916271 WatchSource:0}: Error finding container 6bcd65f558b899b1efc0486f41d7faead563913131a3e4b8f6a86c5378916271: Status 404 returned error can't find the container with id 6bcd65f558b899b1efc0486f41d7faead563913131a3e4b8f6a86c5378916271 Jun 10 16:48:42.710162 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:42.710119 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b7811958-8338-4bec-9351-2df8c6c1271e","Type":"ContainerStarted","Data":"6bcd65f558b899b1efc0486f41d7faead563913131a3e4b8f6a86c5378916271"} Jun 10 16:48:42.711923 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:42.711890 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-59648cdb5f-n5bzl" event={"ID":"de3cfc41-9560-4df6-b26e-dba712b590ef","Type":"ContainerStarted","Data":"921790278df373fc88dab56cdd6aa1cdfe9aa6b9c6c85659efe7e3f41b4587e7"} Jun 10 16:48:42.729764 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:42.729710 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-59648cdb5f-n5bzl" podStartSLOduration=2.13295373 podStartE2EDuration="3.729692549s" totalImagesPullingTime="1.596738819s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:48:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:48:42.728065968 +0000 UTC m=+242.252279039" watchObservedRunningTime="2026-06-10 16:48:42.729692549 +0000 UTC m=+242.253905620" Jun 10 16:48:43.718486 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:43.718447 2562 generic.go:356] "Generic (PLEG): container finished" podID="b7811958-8338-4bec-9351-2df8c6c1271e" containerID="9a72380c991924d9e9d28fcbf60f291d3db429109ddaba7f9f411d3f940a0074" exitCode=0 Jun 10 16:48:43.718956 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:43.718559 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b7811958-8338-4bec-9351-2df8c6c1271e","Type":"ContainerDied","Data":"9a72380c991924d9e9d28fcbf60f291d3db429109ddaba7f9f411d3f940a0074"} Jun 10 16:48:47.741422 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:47.741379 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b7811958-8338-4bec-9351-2df8c6c1271e","Type":"ContainerStarted","Data":"042620527d17fa0c923a0112a172d470a01563e4fa5b0f6c81261d73649c2191"} Jun 10 16:48:47.741887 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:47.741458 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b7811958-8338-4bec-9351-2df8c6c1271e","Type":"ContainerStarted","Data":"ebe34a9fb696135953c73445ab8794827faee7d956e3e8a16caeb4a6ed1472b9"} Jun 10 16:48:49.757681 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:49.757607 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b7811958-8338-4bec-9351-2df8c6c1271e","Type":"ContainerStarted","Data":"5194b95c205d3e8f5cbe0b44ef470bccc062b9d46df37c1ec46aae01bf66a82d"} Jun 10 16:48:49.758054 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:49.757719 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b7811958-8338-4bec-9351-2df8c6c1271e","Type":"ContainerStarted","Data":"9a7acb39dcaf771543c85b5169390bf74899cb3c3768c23e811487f187bd8dbd"} Jun 10 16:48:49.758054 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:49.757763 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b7811958-8338-4bec-9351-2df8c6c1271e","Type":"ContainerStarted","Data":"72ae761989a470c935e1aac985118dc97440b9ce76a01d060faddeacd042e1e4"} Jun 10 16:48:50.766532 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:50.766496 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b7811958-8338-4bec-9351-2df8c6c1271e","Type":"ContainerStarted","Data":"ec71e1efeaff95bfdd8d68cec4874f8afdc525a4651f0b7f301226fb2b12eb37"} Jun 10 16:48:50.794115 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:50.794050 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.140745789 podStartE2EDuration="9.794029297s" totalImagesPullingTime="6.627543521s" totalInitContainerRuntime="25.739987ms" isStatefulPod=false podCreationTimestamp="2026-06-10 16:48:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:48:50.792448011 +0000 UTC m=+250.316661078" watchObservedRunningTime="2026-06-10 16:48:50.794029297 +0000 UTC m=+250.318242368" Jun 10 16:48:52.016473 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:52.016441 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:48:52.821758 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:52.821702 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1955ad17-c126-4e00-b082-09ca6f6bba61-metrics-certs\") pod \"network-metrics-daemon-frvb8\" (UID: \"1955ad17-c126-4e00-b082-09ca6f6bba61\") " pod="openshift-multus/network-metrics-daemon-frvb8" Jun 10 16:48:52.824812 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:52.824751 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1955ad17-c126-4e00-b082-09ca6f6bba61-metrics-certs\") pod \"network-metrics-daemon-frvb8\" (UID: \"1955ad17-c126-4e00-b082-09ca6f6bba61\") " pod="openshift-multus/network-metrics-daemon-frvb8" Jun 10 16:48:52.845854 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:52.845830 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zxq5w\"" Jun 10 16:48:52.853887 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:52.853858 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frvb8" Jun 10 16:48:59.430230 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:59.430199 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-frvb8"] Jun 10 16:48:59.436934 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:48:59.436909 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1955ad17_c126_4e00_b082_09ca6f6bba61.slice/crio-4e819e724fcbed019f7c2f2f00722bcf860edaffb680b5b6943122d717623843 WatchSource:0}: Error finding container 4e819e724fcbed019f7c2f2f00722bcf860edaffb680b5b6943122d717623843: Status 404 returned error can't find the container with id 4e819e724fcbed019f7c2f2f00722bcf860edaffb680b5b6943122d717623843 Jun 10 16:48:59.806866 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:59.806807 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-jss4d" event={"ID":"4e2e8592-b013-41c4-b089-4dba9e250839","Type":"ContainerStarted","Data":"8bdc9068a70dd5c86ff99120f0dd5d20f97b0f1eb6665d086b339712cad6bd0a"} Jun 10 16:48:59.807519 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:59.807488 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-jss4d" Jun 10 16:48:59.809102 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:59.809009 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-frvb8" event={"ID":"1955ad17-c126-4e00-b082-09ca6f6bba61","Type":"ContainerStarted","Data":"4e819e724fcbed019f7c2f2f00722bcf860edaffb680b5b6943122d717623843"} Jun 10 16:48:59.821173 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:59.821131 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-jss4d" Jun 10 16:48:59.827448 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:48:59.827396 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-jss4d" podStartSLOduration=1.464216844 podStartE2EDuration="21.827377344s" totalImagesPullingTime="20.3631605s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:48:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:48:59.82598456 +0000 UTC m=+259.350197629" watchObservedRunningTime="2026-06-10 16:48:59.827377344 +0000 UTC m=+259.351590415" Jun 10 16:49:00.218771 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:49:00.218602 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-59648cdb5f-n5bzl" Jun 10 16:49:00.219041 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:49:00.219019 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-59648cdb5f-n5bzl" Jun 10 16:49:00.821745 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:49:00.821651 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-frvb8" event={"ID":"1955ad17-c126-4e00-b082-09ca6f6bba61","Type":"ContainerStarted","Data":"5f5f5b7c2474e695acf8c84cfef04056dd35e0ebc778e00f7e97ebf9cf975439"} Jun 10 16:49:00.822181 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:49:00.821754 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-frvb8" event={"ID":"1955ad17-c126-4e00-b082-09ca6f6bba61","Type":"ContainerStarted","Data":"041babbe125402329d97f6762b72c30896a0c66afaf32a16fd53e94f7a5af954"} Jun 10 16:49:00.840976 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:49:00.840926 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-frvb8" podStartSLOduration=258.896277957 podStartE2EDuration="4m19.840910848s" totalImagesPullingTime="944.632891ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:44:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:49:00.839656175 +0000 UTC m=+260.363869246" watchObservedRunningTime="2026-06-10 16:49:00.840910848 +0000 UTC m=+260.365123918" Jun 10 16:49:01.828469 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:49:01.828432 2562 generic.go:356] "Generic (PLEG): container finished" podID="7644b2ac-a2ef-4135-8284-bbc1261ff3f5" containerID="c675a0457a493fa28e2bb7d7be946205be607e8fe0f25d0f849e4d13d6282c51" exitCode=0 Jun 10 16:49:01.828893 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:49:01.828740 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-bwp8v" event={"ID":"7644b2ac-a2ef-4135-8284-bbc1261ff3f5","Type":"ContainerDied","Data":"c675a0457a493fa28e2bb7d7be946205be607e8fe0f25d0f849e4d13d6282c51"} Jun 10 16:49:01.829096 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:49:01.829074 2562 scope.go:117] "RemoveContainer" containerID="c675a0457a493fa28e2bb7d7be946205be607e8fe0f25d0f849e4d13d6282c51" Jun 10 16:49:02.835238 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:49:02.835199 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-bwp8v" event={"ID":"7644b2ac-a2ef-4135-8284-bbc1261ff3f5","Type":"ContainerStarted","Data":"3b49564ef634b5e42bba2adb4b4afab5d174ec72ad3e5f1bbfc7b8aef2a65989"} Jun 10 16:49:07.858030 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:49:07.857987 2562 generic.go:356] "Generic (PLEG): container finished" podID="b39153cd-236a-4b99-8314-0781d72ce7e4" containerID="c2182d2273a5b19e97780d0163a45a6b30a2152deb35249b5dc231d9b1a040e2" exitCode=0 Jun 10 16:49:07.858030 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:49:07.858034 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-hj4jl" event={"ID":"b39153cd-236a-4b99-8314-0781d72ce7e4","Type":"ContainerDied","Data":"c2182d2273a5b19e97780d0163a45a6b30a2152deb35249b5dc231d9b1a040e2"} Jun 10 16:49:07.858541 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:49:07.858452 2562 scope.go:117] "RemoveContainer" containerID="c2182d2273a5b19e97780d0163a45a6b30a2152deb35249b5dc231d9b1a040e2" Jun 10 16:49:08.864268 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:49:08.864233 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-hj4jl" event={"ID":"b39153cd-236a-4b99-8314-0781d72ce7e4","Type":"ContainerStarted","Data":"1026ecb376ed85a948f2c7885b5133e42951ce88188e1a092204b16e46db0e0f"} Jun 10 16:49:12.384969 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:49:12.384941 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-lmxd7_24ba981e-45f3-411b-afb1-8250622231fa/kube-state-metrics/0.log" Jun 10 16:49:12.585675 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:49:12.585643 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-lmxd7_24ba981e-45f3-411b-afb1-8250622231fa/kube-rbac-proxy-main/0.log" Jun 10 16:49:12.785405 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:49:12.785333 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-lmxd7_24ba981e-45f3-411b-afb1-8250622231fa/kube-rbac-proxy-self/0.log" Jun 10 16:49:12.985276 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:49:12.985253 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-59648cdb5f-n5bzl_de3cfc41-9560-4df6-b26e-dba712b590ef/metrics-server/0.log" Jun 10 16:49:13.384673 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:49:13.384646 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-46fzb_6e75343e-4791-4a06-a99c-dd7a6329408c/init-textfile/0.log" Jun 10 16:49:13.584499 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:49:13.584469 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-46fzb_6e75343e-4791-4a06-a99c-dd7a6329408c/node-exporter/0.log" Jun 10 16:49:13.784577 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:49:13.784505 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-46fzb_6e75343e-4791-4a06-a99c-dd7a6329408c/kube-rbac-proxy/0.log" Jun 10 16:49:15.784011 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:49:15.783984 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b7811958-8338-4bec-9351-2df8c6c1271e/init-config-reloader/0.log" Jun 10 16:49:15.984846 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:49:15.984816 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b7811958-8338-4bec-9351-2df8c6c1271e/prometheus/0.log" Jun 10 16:49:16.183591 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:49:16.183539 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b7811958-8338-4bec-9351-2df8c6c1271e/config-reloader/0.log" Jun 10 16:49:16.384517 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:49:16.384482 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b7811958-8338-4bec-9351-2df8c6c1271e/thanos-sidecar/0.log" Jun 10 16:49:16.584132 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:49:16.584109 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b7811958-8338-4bec-9351-2df8c6c1271e/kube-rbac-proxy-web/0.log" Jun 10 16:49:16.784315 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:49:16.784287 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b7811958-8338-4bec-9351-2df8c6c1271e/kube-rbac-proxy/0.log" Jun 10 16:49:16.985296 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:49:16.985221 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b7811958-8338-4bec-9351-2df8c6c1271e/kube-rbac-proxy-thanos/0.log" Jun 10 16:49:17.186282 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:49:17.186257 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-j6mcx_1d27cdd1-7041-4ba5-94d6-f8dc6c7fa106/prometheus-operator/0.log" Jun 10 16:49:17.384679 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:49:17.384652 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-j6mcx_1d27cdd1-7041-4ba5-94d6-f8dc6c7fa106/kube-rbac-proxy/0.log" Jun 10 16:49:19.783820 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:49:19.783741 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mgpvj_df4f4a0a-8563-43bc-b1a9-c933a16dfa01/console-operator/2.log" Jun 10 16:49:19.985395 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:49:19.985370 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mgpvj_df4f4a0a-8563-43bc-b1a9-c933a16dfa01/console-operator/3.log" Jun 10 16:49:20.224122 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:49:20.224096 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-59648cdb5f-n5bzl" Jun 10 16:49:20.227846 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:49:20.227821 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-59648cdb5f-n5bzl" Jun 10 16:49:20.586128 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:49:20.586095 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-jss4d_4e2e8592-b013-41c4-b089-4dba9e250839/download-server/0.log" Jun 10 16:49:21.984045 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:49:21.984017 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-65mjb_224e07b4-de73-42d9-a0b2-300dd5944e96/dns-node-resolver/0.log" Jun 10 16:49:22.416750 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:49:22.416705 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-sl6mv" podUID="d4ee7a98-0681-402a-b223-d8160df30d7a" Jun 10 16:49:22.920839 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:49:22.920812 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sl6mv" Jun 10 16:49:22.984349 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:49:22.984324 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7s4lf_51c9f98e-ff02-48f2-b3e7-340543a646a6/node-ca/0.log" Jun 10 16:49:23.984363 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:49:23.984333 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xlq8r_eab6293a-4de8-4ed2-9642-c8053281de99/serve-healthcheck-canary/0.log" Jun 10 16:49:25.850837 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:49:25.850796 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4ee7a98-0681-402a-b223-d8160df30d7a-metrics-tls\") pod \"dns-default-sl6mv\" (UID: \"d4ee7a98-0681-402a-b223-d8160df30d7a\") " pod="openshift-dns/dns-default-sl6mv" Jun 10 16:49:25.851907 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:49:25.851881 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6f8001d1-a59a-412b-acb9-b4a5c479b06b-registry-tls\") pod \"image-registry-6fdf5fbd67-s8c6d\" (UID: \"6f8001d1-a59a-412b-acb9-b4a5c479b06b\") " pod="openshift-image-registry/image-registry-6fdf5fbd67-s8c6d" Jun 10 16:49:25.855739 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:49:25.855689 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6f8001d1-a59a-412b-acb9-b4a5c479b06b-registry-tls\") pod \"image-registry-6fdf5fbd67-s8c6d\" (UID: \"6f8001d1-a59a-412b-acb9-b4a5c479b06b\") " pod="openshift-image-registry/image-registry-6fdf5fbd67-s8c6d" Jun 10 16:49:25.858042 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:49:25.858018 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4ee7a98-0681-402a-b223-d8160df30d7a-metrics-tls\") pod \"dns-default-sl6mv\" (UID: \"d4ee7a98-0681-402a-b223-d8160df30d7a\") " pod="openshift-dns/dns-default-sl6mv" Jun 10 16:49:25.924130 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:49:25.924045 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xq2hm\"" Jun 10 16:49:25.932111 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:49:25.932082 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sl6mv" Jun 10 16:49:26.049520 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:49:26.049488 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4p9m8\"" Jun 10 16:49:26.058251 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:49:26.057987 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6fdf5fbd67-s8c6d" Jun 10 16:49:26.108412 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:49:26.108322 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sl6mv"] Jun 10 16:49:26.112448 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:49:26.112417 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4ee7a98_0681_402a_b223_d8160df30d7a.slice/crio-4198fb7e24d8c21c01c7dd7458cc49961c6368301f805f4e7f892db7449f04ae WatchSource:0}: Error finding container 4198fb7e24d8c21c01c7dd7458cc49961c6368301f805f4e7f892db7449f04ae: Status 404 returned error can't find the container with id 4198fb7e24d8c21c01c7dd7458cc49961c6368301f805f4e7f892db7449f04ae Jun 10 16:49:26.246890 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:49:26.246861 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6fdf5fbd67-s8c6d"] Jun 10 16:49:26.249999 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:49:26.249971 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f8001d1_a59a_412b_acb9_b4a5c479b06b.slice/crio-f3ed8dec5506ea0da9eed5bf3069fa6530688554a5e575d9fc2b25e25f1665fd WatchSource:0}: Error finding container f3ed8dec5506ea0da9eed5bf3069fa6530688554a5e575d9fc2b25e25f1665fd: Status 404 returned error can't find the container with id f3ed8dec5506ea0da9eed5bf3069fa6530688554a5e575d9fc2b25e25f1665fd Jun 10 16:49:26.961784 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:49:26.961756 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6fdf5fbd67-s8c6d" Jun 10 16:49:26.962171 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:49:26.961811 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6fdf5fbd67-s8c6d" event={"ID":"6f8001d1-a59a-412b-acb9-b4a5c479b06b","Type":"ContainerStarted","Data":"088df1396d61cbcc40541690bd062e0bbf900d990bc137a57ccb833acf8f7d38"} Jun 10 16:49:26.962171 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:49:26.961840 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6fdf5fbd67-s8c6d" event={"ID":"6f8001d1-a59a-412b-acb9-b4a5c479b06b","Type":"ContainerStarted","Data":"f3ed8dec5506ea0da9eed5bf3069fa6530688554a5e575d9fc2b25e25f1665fd"} Jun 10 16:49:26.962171 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:49:26.961859 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sl6mv" event={"ID":"d4ee7a98-0681-402a-b223-d8160df30d7a","Type":"ContainerStarted","Data":"4198fb7e24d8c21c01c7dd7458cc49961c6368301f805f4e7f892db7449f04ae"} Jun 10 16:49:26.979578 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:49:26.979525 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6fdf5fbd67-s8c6d" podStartSLOduration=285.979510265 podStartE2EDuration="4m45.979510265s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:44:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:49:26.979146161 +0000 UTC m=+286.503359232" watchObservedRunningTime="2026-06-10 16:49:26.979510265 +0000 UTC m=+286.503723334" Jun 10 16:49:28.970975 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:49:28.970944 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sl6mv" event={"ID":"d4ee7a98-0681-402a-b223-d8160df30d7a","Type":"ContainerStarted","Data":"c010db55d29e0764f867d544cdaf793ec116c9887785d07c68ba9bcbb76492b2"} Jun 10 16:49:28.971387 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:49:28.970992 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sl6mv" event={"ID":"d4ee7a98-0681-402a-b223-d8160df30d7a","Type":"ContainerStarted","Data":"55e4ce2e19683c2b225a784ae200af1fb00b8195440b777ce434c84b5d5ce953"} Jun 10 16:49:28.971387 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:49:28.971060 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-sl6mv" Jun 10 16:49:28.989143 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:49:28.989097 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-sl6mv" podStartSLOduration=251.604026705 podStartE2EDuration="4m13.989079492s" totalImagesPullingTime="2.385052787s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:45:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:49:28.987419744 +0000 UTC m=+288.511632815" watchObservedRunningTime="2026-06-10 16:49:28.989079492 +0000 UTC m=+288.513292884" Jun 10 16:49:38.977654 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:49:38.977601 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-sl6mv" Jun 10 16:49:40.889740 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:49:40.889707 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mgpvj_df4f4a0a-8563-43bc-b1a9-c933a16dfa01/console-operator/2.log" Jun 10 16:49:40.892215 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:49:40.892189 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mgpvj_df4f4a0a-8563-43bc-b1a9-c933a16dfa01/console-operator/2.log" Jun 10 16:49:40.894477 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:49:40.894456 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p96z8_a9624b92-752b-4888-99da-f864e807a6f0/ovn-acl-logging/0.log" Jun 10 16:49:40.897014 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:49:40.896996 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p96z8_a9624b92-752b-4888-99da-f864e807a6f0/ovn-acl-logging/0.log" Jun 10 16:49:40.901283 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:49:40.901267 2562 kubelet.go:1648] "Image garbage collection succeeded" Jun 10 16:49:42.015960 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:49:42.015920 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:49:42.066068 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:49:42.066040 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:49:43.040892 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:49:43.040864 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:49:46.062887 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:49:46.062852 2562 patch_prober.go:28] interesting pod/image-registry-6fdf5fbd67-s8c6d container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 16:49:46.063266 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:49:46.062906 2562 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6fdf5fbd67-s8c6d" podUID="6f8001d1-a59a-412b-acb9-b4a5c479b06b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 16:49:47.964915 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:49:47.964881 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6fdf5fbd67-s8c6d"] Jun 10 16:49:47.969139 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:49:47.969112 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6fdf5fbd67-s8c6d" Jun 10 16:50:00.195137 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:00.195082 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 16:50:00.195607 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:00.195479 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b7811958-8338-4bec-9351-2df8c6c1271e" containerName="kube-rbac-proxy" containerID="cri-o://5194b95c205d3e8f5cbe0b44ef470bccc062b9d46df37c1ec46aae01bf66a82d" gracePeriod=600 Jun 10 16:50:00.195607 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:00.195522 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b7811958-8338-4bec-9351-2df8c6c1271e" containerName="config-reloader" containerID="cri-o://042620527d17fa0c923a0112a172d470a01563e4fa5b0f6c81261d73649c2191" gracePeriod=600 Jun 10 16:50:00.195607 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:00.195541 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b7811958-8338-4bec-9351-2df8c6c1271e" containerName="kube-rbac-proxy-thanos" containerID="cri-o://ec71e1efeaff95bfdd8d68cec4874f8afdc525a4651f0b7f301226fb2b12eb37" gracePeriod=600 Jun 10 16:50:00.195607 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:00.195584 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b7811958-8338-4bec-9351-2df8c6c1271e" containerName="kube-rbac-proxy-web" containerID="cri-o://9a7acb39dcaf771543c85b5169390bf74899cb3c3768c23e811487f187bd8dbd" gracePeriod=600 Jun 10 16:50:00.195845 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:00.195540 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b7811958-8338-4bec-9351-2df8c6c1271e" containerName="thanos-sidecar" containerID="cri-o://72ae761989a470c935e1aac985118dc97440b9ce76a01d060faddeacd042e1e4" gracePeriod=600 Jun 10 16:50:00.195845 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:00.195664 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b7811958-8338-4bec-9351-2df8c6c1271e" containerName="prometheus" containerID="cri-o://ebe34a9fb696135953c73445ab8794827faee7d956e3e8a16caeb4a6ed1472b9" gracePeriod=600 Jun 10 16:50:00.447461 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:00.447402 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:50:00.576128 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:00.576094 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b7811958-8338-4bec-9351-2df8c6c1271e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"b7811958-8338-4bec-9351-2df8c6c1271e\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " Jun 10 16:50:00.576286 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:00.576139 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b7811958-8338-4bec-9351-2df8c6c1271e-config\") pod \"b7811958-8338-4bec-9351-2df8c6c1271e\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " Jun 10 16:50:00.576286 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:00.576193 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7811958-8338-4bec-9351-2df8c6c1271e-configmap-serving-certs-ca-bundle\") pod \"b7811958-8338-4bec-9351-2df8c6c1271e\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " Jun 10 16:50:00.576286 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:00.576229 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7811958-8338-4bec-9351-2df8c6c1271e-prometheus-trusted-ca-bundle\") pod \"b7811958-8338-4bec-9351-2df8c6c1271e\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " Jun 10 16:50:00.576471 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:00.576337 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b7811958-8338-4bec-9351-2df8c6c1271e-secret-grpc-tls\") pod \"b7811958-8338-4bec-9351-2df8c6c1271e\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " Jun 10 16:50:00.576471 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:00.576364 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b7811958-8338-4bec-9351-2df8c6c1271e-secret-prometheus-k8s-tls\") pod \"b7811958-8338-4bec-9351-2df8c6c1271e\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " Jun 10 16:50:00.576471 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:00.576396 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b7811958-8338-4bec-9351-2df8c6c1271e-config-out\") pod \"b7811958-8338-4bec-9351-2df8c6c1271e\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " Jun 10 16:50:00.576471 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:00.576436 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b7811958-8338-4bec-9351-2df8c6c1271e-prometheus-k8s-db\") pod \"b7811958-8338-4bec-9351-2df8c6c1271e\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " Jun 10 16:50:00.576471 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:00.576460 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b7811958-8338-4bec-9351-2df8c6c1271e-prometheus-k8s-rulefiles-0\") pod \"b7811958-8338-4bec-9351-2df8c6c1271e\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " Jun 10 16:50:00.576859 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:00.576495 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b7811958-8338-4bec-9351-2df8c6c1271e-thanos-prometheus-http-client-file\") pod \"b7811958-8338-4bec-9351-2df8c6c1271e\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " Jun 10 16:50:00.576859 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:00.576536 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b7811958-8338-4bec-9351-2df8c6c1271e-secret-kube-rbac-proxy\") pod \"b7811958-8338-4bec-9351-2df8c6c1271e\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " Jun 10 16:50:00.576859 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:00.576560 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b7811958-8338-4bec-9351-2df8c6c1271e-tls-assets\") pod \"b7811958-8338-4bec-9351-2df8c6c1271e\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " Jun 10 16:50:00.576859 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:00.576543 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7811958-8338-4bec-9351-2df8c6c1271e-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "b7811958-8338-4bec-9351-2df8c6c1271e" (UID: "b7811958-8338-4bec-9351-2df8c6c1271e"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 16:50:00.576859 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:00.576585 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b7811958-8338-4bec-9351-2df8c6c1271e-secret-metrics-client-certs\") pod \"b7811958-8338-4bec-9351-2df8c6c1271e\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " Jun 10 16:50:00.576859 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:00.576668 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7811958-8338-4bec-9351-2df8c6c1271e-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "b7811958-8338-4bec-9351-2df8c6c1271e" (UID: "b7811958-8338-4bec-9351-2df8c6c1271e"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 16:50:00.577617 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:00.577462 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7811958-8338-4bec-9351-2df8c6c1271e-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "b7811958-8338-4bec-9351-2df8c6c1271e" (UID: "b7811958-8338-4bec-9351-2df8c6c1271e"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 16:50:00.579248 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:00.579214 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7811958-8338-4bec-9351-2df8c6c1271e-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "b7811958-8338-4bec-9351-2df8c6c1271e" (UID: "b7811958-8338-4bec-9351-2df8c6c1271e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 16:50:00.579396 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:00.579297 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7811958-8338-4bec-9351-2df8c6c1271e-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "b7811958-8338-4bec-9351-2df8c6c1271e" (UID: "b7811958-8338-4bec-9351-2df8c6c1271e"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 16:50:00.579471 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:00.579411 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7811958-8338-4bec-9351-2df8c6c1271e-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "b7811958-8338-4bec-9351-2df8c6c1271e" (UID: "b7811958-8338-4bec-9351-2df8c6c1271e"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 16:50:00.579471 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:00.579464 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b7811958-8338-4bec-9351-2df8c6c1271e-prometheus-k8s-rulefiles-1\") pod \"b7811958-8338-4bec-9351-2df8c6c1271e\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " Jun 10 16:50:00.579579 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:00.579465 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7811958-8338-4bec-9351-2df8c6c1271e-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "b7811958-8338-4bec-9351-2df8c6c1271e" (UID: "b7811958-8338-4bec-9351-2df8c6c1271e"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 16:50:00.579579 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:00.579498 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b7811958-8338-4bec-9351-2df8c6c1271e-prometheus-k8s-rulefiles-2\") pod \"b7811958-8338-4bec-9351-2df8c6c1271e\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " Jun 10 16:50:00.579579 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:00.579532 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5gf9h\" (UniqueName: \"kubernetes.io/projected/b7811958-8338-4bec-9351-2df8c6c1271e-kube-api-access-5gf9h\") pod \"b7811958-8338-4bec-9351-2df8c6c1271e\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " Jun 10 16:50:00.579579 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:00.579559 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7811958-8338-4bec-9351-2df8c6c1271e-configmap-metrics-client-ca\") pod \"b7811958-8338-4bec-9351-2df8c6c1271e\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " Jun 10 16:50:00.579808 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:00.579587 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7811958-8338-4bec-9351-2df8c6c1271e-configmap-kubelet-serving-ca-bundle\") pod \"b7811958-8338-4bec-9351-2df8c6c1271e\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " Jun 10 16:50:00.579808 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:00.579704 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b7811958-8338-4bec-9351-2df8c6c1271e-web-config\") pod \"b7811958-8338-4bec-9351-2df8c6c1271e\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " Jun 10 16:50:00.579808 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:00.579742 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b7811958-8338-4bec-9351-2df8c6c1271e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"b7811958-8338-4bec-9351-2df8c6c1271e\" (UID: \"b7811958-8338-4bec-9351-2df8c6c1271e\") " Jun 10 16:50:00.579808 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:00.579798 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7811958-8338-4bec-9351-2df8c6c1271e-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "b7811958-8338-4bec-9351-2df8c6c1271e" (UID: "b7811958-8338-4bec-9351-2df8c6c1271e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 16:50:00.580043 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:00.580028 2562 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7811958-8338-4bec-9351-2df8c6c1271e-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-143-240.ec2.internal\" DevicePath \"\"" Jun 10 16:50:00.580107 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:00.580049 2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7811958-8338-4bec-9351-2df8c6c1271e-prometheus-trusted-ca-bundle\") on node \"ip-10-0-143-240.ec2.internal\" DevicePath \"\"" Jun 10 16:50:00.580107 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:00.580065 2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b7811958-8338-4bec-9351-2df8c6c1271e-secret-prometheus-k8s-tls\") on node \"ip-10-0-143-240.ec2.internal\" DevicePath \"\"" Jun 10 16:50:00.580107 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:00.580079 2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b7811958-8338-4bec-9351-2df8c6c1271e-prometheus-k8s-db\") on node \"ip-10-0-143-240.ec2.internal\" DevicePath \"\"" Jun 10 16:50:00.580107 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:00.580076 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7811958-8338-4bec-9351-2df8c6c1271e-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "b7811958-8338-4bec-9351-2df8c6c1271e" (UID: "b7811958-8338-4bec-9351-2df8c6c1271e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 16:50:00.580107 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:00.580096 2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b7811958-8338-4bec-9351-2df8c6c1271e-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-143-240.ec2.internal\" DevicePath \"\"" Jun 10 16:50:00.580342 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:00.580111 2562 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b7811958-8338-4bec-9351-2df8c6c1271e-thanos-prometheus-http-client-file\") on node \"ip-10-0-143-240.ec2.internal\" DevicePath \"\"" Jun 10 16:50:00.580342 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:00.580127 2562 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b7811958-8338-4bec-9351-2df8c6c1271e-secret-metrics-client-certs\") on node \"ip-10-0-143-240.ec2.internal\" DevicePath \"\"" Jun 10 16:50:00.580342 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:00.580142 2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b7811958-8338-4bec-9351-2df8c6c1271e-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-143-240.ec2.internal\" DevicePath \"\"" Jun 10 16:50:00.580342 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:00.580144 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7811958-8338-4bec-9351-2df8c6c1271e-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "b7811958-8338-4bec-9351-2df8c6c1271e" (UID: "b7811958-8338-4bec-9351-2df8c6c1271e"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 16:50:00.580342 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:00.580187 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7811958-8338-4bec-9351-2df8c6c1271e-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "b7811958-8338-4bec-9351-2df8c6c1271e" (UID: "b7811958-8338-4bec-9351-2df8c6c1271e"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 16:50:00.580699 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:00.580674 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7811958-8338-4bec-9351-2df8c6c1271e-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "b7811958-8338-4bec-9351-2df8c6c1271e" (UID: "b7811958-8338-4bec-9351-2df8c6c1271e"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 16:50:00.581426 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:00.581352 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7811958-8338-4bec-9351-2df8c6c1271e-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "b7811958-8338-4bec-9351-2df8c6c1271e" (UID: "b7811958-8338-4bec-9351-2df8c6c1271e"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 16:50:00.581903 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:00.581857 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7811958-8338-4bec-9351-2df8c6c1271e-config-out" (OuterVolumeSpecName: "config-out") pod "b7811958-8338-4bec-9351-2df8c6c1271e" (UID: "b7811958-8338-4bec-9351-2df8c6c1271e"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 16:50:00.581903 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:00.581890 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7811958-8338-4bec-9351-2df8c6c1271e-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "b7811958-8338-4bec-9351-2df8c6c1271e" (UID: "b7811958-8338-4bec-9351-2df8c6c1271e"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 16:50:00.582511 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:00.582209 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7811958-8338-4bec-9351-2df8c6c1271e-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "b7811958-8338-4bec-9351-2df8c6c1271e" (UID: "b7811958-8338-4bec-9351-2df8c6c1271e"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 16:50:00.582511 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:00.582456 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7811958-8338-4bec-9351-2df8c6c1271e-config" (OuterVolumeSpecName: "config") pod "b7811958-8338-4bec-9351-2df8c6c1271e" (UID: "b7811958-8338-4bec-9351-2df8c6c1271e"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 16:50:00.582664 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:00.582622 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7811958-8338-4bec-9351-2df8c6c1271e-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "b7811958-8338-4bec-9351-2df8c6c1271e" (UID: "b7811958-8338-4bec-9351-2df8c6c1271e"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 16:50:00.582819 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:00.582797 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7811958-8338-4bec-9351-2df8c6c1271e-kube-api-access-5gf9h" (OuterVolumeSpecName: "kube-api-access-5gf9h") pod "b7811958-8338-4bec-9351-2df8c6c1271e" (UID: "b7811958-8338-4bec-9351-2df8c6c1271e"). InnerVolumeSpecName "kube-api-access-5gf9h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 16:50:00.594720 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:00.594689 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7811958-8338-4bec-9351-2df8c6c1271e-web-config" (OuterVolumeSpecName: "web-config") pod "b7811958-8338-4bec-9351-2df8c6c1271e" (UID: "b7811958-8338-4bec-9351-2df8c6c1271e"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 16:50:00.681517 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:00.681475 2562 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b7811958-8338-4bec-9351-2df8c6c1271e-secret-grpc-tls\") on node \"ip-10-0-143-240.ec2.internal\" DevicePath \"\"" Jun 10 16:50:00.681517 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:00.681507 2562 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b7811958-8338-4bec-9351-2df8c6c1271e-config-out\") on node \"ip-10-0-143-240.ec2.internal\" DevicePath \"\"" Jun 10 16:50:00.681517 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:00.681517 2562 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b7811958-8338-4bec-9351-2df8c6c1271e-secret-kube-rbac-proxy\") on node \"ip-10-0-143-240.ec2.internal\" DevicePath \"\"" Jun 10 16:50:00.681517 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:00.681528 2562 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b7811958-8338-4bec-9351-2df8c6c1271e-tls-assets\") on node \"ip-10-0-143-240.ec2.internal\" DevicePath \"\"" Jun 10 16:50:00.681870 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:00.681537 2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b7811958-8338-4bec-9351-2df8c6c1271e-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-143-240.ec2.internal\" DevicePath \"\"" Jun 10 16:50:00.681870 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:00.681546 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5gf9h\" (UniqueName: \"kubernetes.io/projected/b7811958-8338-4bec-9351-2df8c6c1271e-kube-api-access-5gf9h\") on node \"ip-10-0-143-240.ec2.internal\" DevicePath \"\"" Jun 10 16:50:00.681870 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:00.681554 2562 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7811958-8338-4bec-9351-2df8c6c1271e-configmap-metrics-client-ca\") on node \"ip-10-0-143-240.ec2.internal\" DevicePath \"\"" Jun 10 16:50:00.681870 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:00.681565 2562 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7811958-8338-4bec-9351-2df8c6c1271e-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-143-240.ec2.internal\" DevicePath \"\"" Jun 10 16:50:00.681870 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:00.681573 2562 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b7811958-8338-4bec-9351-2df8c6c1271e-web-config\") on node \"ip-10-0-143-240.ec2.internal\" DevicePath \"\"" Jun 10 16:50:00.681870 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:00.681582 2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b7811958-8338-4bec-9351-2df8c6c1271e-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-143-240.ec2.internal\" DevicePath \"\"" Jun 10 16:50:00.681870 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:00.681590 2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b7811958-8338-4bec-9351-2df8c6c1271e-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-143-240.ec2.internal\" DevicePath \"\"" Jun 10 16:50:00.681870 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:00.681598 2562 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/b7811958-8338-4bec-9351-2df8c6c1271e-config\") on node \"ip-10-0-143-240.ec2.internal\" DevicePath \"\"" Jun 10 16:50:01.097476 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.097441 2562 generic.go:356] "Generic (PLEG): container finished" podID="b7811958-8338-4bec-9351-2df8c6c1271e" containerID="ec71e1efeaff95bfdd8d68cec4874f8afdc525a4651f0b7f301226fb2b12eb37" exitCode=0 Jun 10 16:50:01.097476 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.097467 2562 generic.go:356] "Generic (PLEG): container finished" podID="b7811958-8338-4bec-9351-2df8c6c1271e" containerID="5194b95c205d3e8f5cbe0b44ef470bccc062b9d46df37c1ec46aae01bf66a82d" exitCode=0 Jun 10 16:50:01.097476 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.097476 2562 generic.go:356] "Generic (PLEG): container finished" podID="b7811958-8338-4bec-9351-2df8c6c1271e" containerID="9a7acb39dcaf771543c85b5169390bf74899cb3c3768c23e811487f187bd8dbd" exitCode=0 Jun 10 16:50:01.097476 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.097484 2562 generic.go:356] "Generic (PLEG): container finished" podID="b7811958-8338-4bec-9351-2df8c6c1271e" containerID="72ae761989a470c935e1aac985118dc97440b9ce76a01d060faddeacd042e1e4" exitCode=0 Jun 10 16:50:01.097776 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.097490 2562 generic.go:356] "Generic (PLEG): container finished" podID="b7811958-8338-4bec-9351-2df8c6c1271e" containerID="042620527d17fa0c923a0112a172d470a01563e4fa5b0f6c81261d73649c2191" exitCode=0 Jun 10 16:50:01.097776 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.097495 2562 generic.go:356] "Generic (PLEG): container finished" podID="b7811958-8338-4bec-9351-2df8c6c1271e" containerID="ebe34a9fb696135953c73445ab8794827faee7d956e3e8a16caeb4a6ed1472b9" exitCode=0 Jun 10 16:50:01.097776 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.097519 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b7811958-8338-4bec-9351-2df8c6c1271e","Type":"ContainerDied","Data":"ec71e1efeaff95bfdd8d68cec4874f8afdc525a4651f0b7f301226fb2b12eb37"} Jun 10 16:50:01.097776 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.097586 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b7811958-8338-4bec-9351-2df8c6c1271e","Type":"ContainerDied","Data":"5194b95c205d3e8f5cbe0b44ef470bccc062b9d46df37c1ec46aae01bf66a82d"} Jun 10 16:50:01.097776 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.097530 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:50:01.097776 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.097612 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b7811958-8338-4bec-9351-2df8c6c1271e","Type":"ContainerDied","Data":"9a7acb39dcaf771543c85b5169390bf74899cb3c3768c23e811487f187bd8dbd"} Jun 10 16:50:01.097776 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.097656 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b7811958-8338-4bec-9351-2df8c6c1271e","Type":"ContainerDied","Data":"72ae761989a470c935e1aac985118dc97440b9ce76a01d060faddeacd042e1e4"} Jun 10 16:50:01.097776 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.097682 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b7811958-8338-4bec-9351-2df8c6c1271e","Type":"ContainerDied","Data":"042620527d17fa0c923a0112a172d470a01563e4fa5b0f6c81261d73649c2191"} Jun 10 16:50:01.097776 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.097720 2562 scope.go:117] "RemoveContainer" containerID="ec71e1efeaff95bfdd8d68cec4874f8afdc525a4651f0b7f301226fb2b12eb37" Jun 10 16:50:01.098106 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.097708 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b7811958-8338-4bec-9351-2df8c6c1271e","Type":"ContainerDied","Data":"ebe34a9fb696135953c73445ab8794827faee7d956e3e8a16caeb4a6ed1472b9"} Jun 10 16:50:01.098106 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.097823 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b7811958-8338-4bec-9351-2df8c6c1271e","Type":"ContainerDied","Data":"6bcd65f558b899b1efc0486f41d7faead563913131a3e4b8f6a86c5378916271"} Jun 10 16:50:01.105709 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.105695 2562 scope.go:117] "RemoveContainer" containerID="5194b95c205d3e8f5cbe0b44ef470bccc062b9d46df37c1ec46aae01bf66a82d" Jun 10 16:50:01.112551 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.112533 2562 scope.go:117] "RemoveContainer" containerID="9a7acb39dcaf771543c85b5169390bf74899cb3c3768c23e811487f187bd8dbd" Jun 10 16:50:01.119889 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.119871 2562 scope.go:117] "RemoveContainer" containerID="72ae761989a470c935e1aac985118dc97440b9ce76a01d060faddeacd042e1e4" Jun 10 16:50:01.120922 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.120901 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 16:50:01.125041 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.125019 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 16:50:01.127519 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.127504 2562 scope.go:117] "RemoveContainer" containerID="042620527d17fa0c923a0112a172d470a01563e4fa5b0f6c81261d73649c2191" Jun 10 16:50:01.134230 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.134213 2562 scope.go:117] "RemoveContainer" containerID="ebe34a9fb696135953c73445ab8794827faee7d956e3e8a16caeb4a6ed1472b9" Jun 10 16:50:01.141211 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.141191 2562 scope.go:117] "RemoveContainer" containerID="9a72380c991924d9e9d28fcbf60f291d3db429109ddaba7f9f411d3f940a0074" Jun 10 16:50:01.148030 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.148015 2562 scope.go:117] "RemoveContainer" containerID="ec71e1efeaff95bfdd8d68cec4874f8afdc525a4651f0b7f301226fb2b12eb37" Jun 10 16:50:01.148329 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:50:01.148293 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec71e1efeaff95bfdd8d68cec4874f8afdc525a4651f0b7f301226fb2b12eb37\": container with ID starting with ec71e1efeaff95bfdd8d68cec4874f8afdc525a4651f0b7f301226fb2b12eb37 not found: ID does not exist" containerID="ec71e1efeaff95bfdd8d68cec4874f8afdc525a4651f0b7f301226fb2b12eb37" Jun 10 16:50:01.148760 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.148339 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec71e1efeaff95bfdd8d68cec4874f8afdc525a4651f0b7f301226fb2b12eb37"} err="failed to get container status \"ec71e1efeaff95bfdd8d68cec4874f8afdc525a4651f0b7f301226fb2b12eb37\": rpc error: code = NotFound desc = could not find container \"ec71e1efeaff95bfdd8d68cec4874f8afdc525a4651f0b7f301226fb2b12eb37\": container with ID starting with ec71e1efeaff95bfdd8d68cec4874f8afdc525a4651f0b7f301226fb2b12eb37 not found: ID does not exist" Jun 10 16:50:01.148876 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.148767 2562 scope.go:117] "RemoveContainer" containerID="5194b95c205d3e8f5cbe0b44ef470bccc062b9d46df37c1ec46aae01bf66a82d" Jun 10 16:50:01.149264 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:50:01.149148 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5194b95c205d3e8f5cbe0b44ef470bccc062b9d46df37c1ec46aae01bf66a82d\": container with ID starting with 5194b95c205d3e8f5cbe0b44ef470bccc062b9d46df37c1ec46aae01bf66a82d not found: ID does not exist" containerID="5194b95c205d3e8f5cbe0b44ef470bccc062b9d46df37c1ec46aae01bf66a82d" Jun 10 16:50:01.149264 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.149179 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5194b95c205d3e8f5cbe0b44ef470bccc062b9d46df37c1ec46aae01bf66a82d"} err="failed to get container status \"5194b95c205d3e8f5cbe0b44ef470bccc062b9d46df37c1ec46aae01bf66a82d\": rpc error: code = NotFound desc = could not find container \"5194b95c205d3e8f5cbe0b44ef470bccc062b9d46df37c1ec46aae01bf66a82d\": container with ID starting with 5194b95c205d3e8f5cbe0b44ef470bccc062b9d46df37c1ec46aae01bf66a82d not found: ID does not exist" Jun 10 16:50:01.149264 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.149201 2562 scope.go:117] "RemoveContainer" containerID="9a7acb39dcaf771543c85b5169390bf74899cb3c3768c23e811487f187bd8dbd" Jun 10 16:50:01.149592 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:50:01.149572 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a7acb39dcaf771543c85b5169390bf74899cb3c3768c23e811487f187bd8dbd\": container with ID starting with 9a7acb39dcaf771543c85b5169390bf74899cb3c3768c23e811487f187bd8dbd not found: ID does not exist" containerID="9a7acb39dcaf771543c85b5169390bf74899cb3c3768c23e811487f187bd8dbd" Jun 10 16:50:01.149665 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.149598 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a7acb39dcaf771543c85b5169390bf74899cb3c3768c23e811487f187bd8dbd"} err="failed to get container status \"9a7acb39dcaf771543c85b5169390bf74899cb3c3768c23e811487f187bd8dbd\": rpc error: code = NotFound desc = could not find container \"9a7acb39dcaf771543c85b5169390bf74899cb3c3768c23e811487f187bd8dbd\": container with ID starting with 9a7acb39dcaf771543c85b5169390bf74899cb3c3768c23e811487f187bd8dbd not found: ID does not exist" Jun 10 16:50:01.149665 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.149616 2562 scope.go:117] "RemoveContainer" containerID="72ae761989a470c935e1aac985118dc97440b9ce76a01d060faddeacd042e1e4" Jun 10 16:50:01.149931 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:50:01.149911 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72ae761989a470c935e1aac985118dc97440b9ce76a01d060faddeacd042e1e4\": container with ID starting with 72ae761989a470c935e1aac985118dc97440b9ce76a01d060faddeacd042e1e4 not found: ID does not exist" containerID="72ae761989a470c935e1aac985118dc97440b9ce76a01d060faddeacd042e1e4" Jun 10 16:50:01.149990 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.149936 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72ae761989a470c935e1aac985118dc97440b9ce76a01d060faddeacd042e1e4"} err="failed to get container status \"72ae761989a470c935e1aac985118dc97440b9ce76a01d060faddeacd042e1e4\": rpc error: code = NotFound desc = could not find container \"72ae761989a470c935e1aac985118dc97440b9ce76a01d060faddeacd042e1e4\": container with ID starting with 72ae761989a470c935e1aac985118dc97440b9ce76a01d060faddeacd042e1e4 not found: ID does not exist" Jun 10 16:50:01.149990 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.149950 2562 scope.go:117] "RemoveContainer" containerID="042620527d17fa0c923a0112a172d470a01563e4fa5b0f6c81261d73649c2191" Jun 10 16:50:01.150226 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:50:01.150205 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"042620527d17fa0c923a0112a172d470a01563e4fa5b0f6c81261d73649c2191\": container with ID starting with 042620527d17fa0c923a0112a172d470a01563e4fa5b0f6c81261d73649c2191 not found: ID does not exist" containerID="042620527d17fa0c923a0112a172d470a01563e4fa5b0f6c81261d73649c2191" Jun 10 16:50:01.150305 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.150227 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"042620527d17fa0c923a0112a172d470a01563e4fa5b0f6c81261d73649c2191"} err="failed to get container status \"042620527d17fa0c923a0112a172d470a01563e4fa5b0f6c81261d73649c2191\": rpc error: code = NotFound desc = could not find container \"042620527d17fa0c923a0112a172d470a01563e4fa5b0f6c81261d73649c2191\": container with ID starting with 042620527d17fa0c923a0112a172d470a01563e4fa5b0f6c81261d73649c2191 not found: ID does not exist" Jun 10 16:50:01.150305 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.150243 2562 scope.go:117] "RemoveContainer" containerID="ebe34a9fb696135953c73445ab8794827faee7d956e3e8a16caeb4a6ed1472b9" Jun 10 16:50:01.150305 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.150273 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 16:50:01.150504 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:50:01.150484 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ebe34a9fb696135953c73445ab8794827faee7d956e3e8a16caeb4a6ed1472b9\": container with ID starting with ebe34a9fb696135953c73445ab8794827faee7d956e3e8a16caeb4a6ed1472b9 not found: ID does not exist" containerID="ebe34a9fb696135953c73445ab8794827faee7d956e3e8a16caeb4a6ed1472b9" Jun 10 16:50:01.150545 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.150508 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebe34a9fb696135953c73445ab8794827faee7d956e3e8a16caeb4a6ed1472b9"} err="failed to get container status \"ebe34a9fb696135953c73445ab8794827faee7d956e3e8a16caeb4a6ed1472b9\": rpc error: code = NotFound desc = could not find container \"ebe34a9fb696135953c73445ab8794827faee7d956e3e8a16caeb4a6ed1472b9\": container with ID starting with ebe34a9fb696135953c73445ab8794827faee7d956e3e8a16caeb4a6ed1472b9 not found: ID does not exist" Jun 10 16:50:01.150545 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.150519 2562 scope.go:117] "RemoveContainer" containerID="9a72380c991924d9e9d28fcbf60f291d3db429109ddaba7f9f411d3f940a0074" Jun 10 16:50:01.150622 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.150607 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7811958-8338-4bec-9351-2df8c6c1271e" containerName="config-reloader" Jun 10 16:50:01.150681 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.150623 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7811958-8338-4bec-9351-2df8c6c1271e" containerName="config-reloader" Jun 10 16:50:01.150681 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.150664 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7811958-8338-4bec-9351-2df8c6c1271e" containerName="kube-rbac-proxy" Jun 10 16:50:01.150681 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.150673 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7811958-8338-4bec-9351-2df8c6c1271e" containerName="kube-rbac-proxy" Jun 10 16:50:01.150791 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.150686 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7811958-8338-4bec-9351-2df8c6c1271e" containerName="kube-rbac-proxy-web" Jun 10 16:50:01.150791 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.150695 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7811958-8338-4bec-9351-2df8c6c1271e" containerName="kube-rbac-proxy-web" Jun 10 16:50:01.150791 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.150703 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7811958-8338-4bec-9351-2df8c6c1271e" containerName="init-config-reloader" Jun 10 16:50:01.150791 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.150711 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7811958-8338-4bec-9351-2df8c6c1271e" containerName="init-config-reloader" Jun 10 16:50:01.150791 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.150729 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7811958-8338-4bec-9351-2df8c6c1271e" containerName="kube-rbac-proxy-thanos" Jun 10 16:50:01.150791 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.150735 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7811958-8338-4bec-9351-2df8c6c1271e" containerName="kube-rbac-proxy-thanos" Jun 10 16:50:01.150791 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.150746 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7811958-8338-4bec-9351-2df8c6c1271e" containerName="prometheus" Jun 10 16:50:01.150791 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.150755 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7811958-8338-4bec-9351-2df8c6c1271e" containerName="prometheus" Jun 10 16:50:01.150791 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:50:01.150754 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a72380c991924d9e9d28fcbf60f291d3db429109ddaba7f9f411d3f940a0074\": container with ID starting with 9a72380c991924d9e9d28fcbf60f291d3db429109ddaba7f9f411d3f940a0074 not found: ID does not exist" containerID="9a72380c991924d9e9d28fcbf60f291d3db429109ddaba7f9f411d3f940a0074" Jun 10 16:50:01.150791 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.150763 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7811958-8338-4bec-9351-2df8c6c1271e" containerName="thanos-sidecar" Jun 10 16:50:01.150791 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.150769 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7811958-8338-4bec-9351-2df8c6c1271e" containerName="thanos-sidecar" Jun 10 16:50:01.150791 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.150770 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a72380c991924d9e9d28fcbf60f291d3db429109ddaba7f9f411d3f940a0074"} err="failed to get container status \"9a72380c991924d9e9d28fcbf60f291d3db429109ddaba7f9f411d3f940a0074\": rpc error: code = NotFound desc = could not find container \"9a72380c991924d9e9d28fcbf60f291d3db429109ddaba7f9f411d3f940a0074\": container with ID starting with 9a72380c991924d9e9d28fcbf60f291d3db429109ddaba7f9f411d3f940a0074 not found: ID does not exist" Jun 10 16:50:01.150791 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.150782 2562 scope.go:117] "RemoveContainer" containerID="ec71e1efeaff95bfdd8d68cec4874f8afdc525a4651f0b7f301226fb2b12eb37" Jun 10 16:50:01.151248 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.150819 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7811958-8338-4bec-9351-2df8c6c1271e" containerName="kube-rbac-proxy" Jun 10 16:50:01.151248 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.150828 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7811958-8338-4bec-9351-2df8c6c1271e" containerName="kube-rbac-proxy-thanos" Jun 10 16:50:01.151248 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.150835 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7811958-8338-4bec-9351-2df8c6c1271e" containerName="config-reloader" Jun 10 16:50:01.151248 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.150843 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7811958-8338-4bec-9351-2df8c6c1271e" containerName="kube-rbac-proxy-web" Jun 10 16:50:01.151248 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.150850 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7811958-8338-4bec-9351-2df8c6c1271e" containerName="thanos-sidecar" Jun 10 16:50:01.151248 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.150856 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7811958-8338-4bec-9351-2df8c6c1271e" containerName="prometheus" Jun 10 16:50:01.151248 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.150996 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec71e1efeaff95bfdd8d68cec4874f8afdc525a4651f0b7f301226fb2b12eb37"} err="failed to get container status \"ec71e1efeaff95bfdd8d68cec4874f8afdc525a4651f0b7f301226fb2b12eb37\": rpc error: code = NotFound desc = could not find container \"ec71e1efeaff95bfdd8d68cec4874f8afdc525a4651f0b7f301226fb2b12eb37\": container with ID starting with ec71e1efeaff95bfdd8d68cec4874f8afdc525a4651f0b7f301226fb2b12eb37 not found: ID does not exist" Jun 10 16:50:01.151248 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.151012 2562 scope.go:117] "RemoveContainer" containerID="5194b95c205d3e8f5cbe0b44ef470bccc062b9d46df37c1ec46aae01bf66a82d" Jun 10 16:50:01.151516 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.151304 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5194b95c205d3e8f5cbe0b44ef470bccc062b9d46df37c1ec46aae01bf66a82d"} err="failed to get container status \"5194b95c205d3e8f5cbe0b44ef470bccc062b9d46df37c1ec46aae01bf66a82d\": rpc error: code = NotFound desc = could not find container \"5194b95c205d3e8f5cbe0b44ef470bccc062b9d46df37c1ec46aae01bf66a82d\": container with ID starting with 5194b95c205d3e8f5cbe0b44ef470bccc062b9d46df37c1ec46aae01bf66a82d not found: ID does not exist" Jun 10 16:50:01.151516 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.151322 2562 scope.go:117] "RemoveContainer" containerID="9a7acb39dcaf771543c85b5169390bf74899cb3c3768c23e811487f187bd8dbd" Jun 10 16:50:01.151588 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.151550 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a7acb39dcaf771543c85b5169390bf74899cb3c3768c23e811487f187bd8dbd"} err="failed to get container status \"9a7acb39dcaf771543c85b5169390bf74899cb3c3768c23e811487f187bd8dbd\": rpc error: code = NotFound desc = could not find container \"9a7acb39dcaf771543c85b5169390bf74899cb3c3768c23e811487f187bd8dbd\": container with ID starting with 9a7acb39dcaf771543c85b5169390bf74899cb3c3768c23e811487f187bd8dbd not found: ID does not exist" Jun 10 16:50:01.151588 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.151564 2562 scope.go:117] "RemoveContainer" containerID="72ae761989a470c935e1aac985118dc97440b9ce76a01d060faddeacd042e1e4" Jun 10 16:50:01.151853 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.151836 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72ae761989a470c935e1aac985118dc97440b9ce76a01d060faddeacd042e1e4"} err="failed to get container status \"72ae761989a470c935e1aac985118dc97440b9ce76a01d060faddeacd042e1e4\": rpc error: code = NotFound desc = could not find container \"72ae761989a470c935e1aac985118dc97440b9ce76a01d060faddeacd042e1e4\": container with ID starting with 72ae761989a470c935e1aac985118dc97440b9ce76a01d060faddeacd042e1e4 not found: ID does not exist" Jun 10 16:50:01.151907 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.151854 2562 scope.go:117] "RemoveContainer" containerID="042620527d17fa0c923a0112a172d470a01563e4fa5b0f6c81261d73649c2191" Jun 10 16:50:01.152066 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.152048 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"042620527d17fa0c923a0112a172d470a01563e4fa5b0f6c81261d73649c2191"} err="failed to get container status \"042620527d17fa0c923a0112a172d470a01563e4fa5b0f6c81261d73649c2191\": rpc error: code = NotFound desc = could not find container \"042620527d17fa0c923a0112a172d470a01563e4fa5b0f6c81261d73649c2191\": container with ID starting with 042620527d17fa0c923a0112a172d470a01563e4fa5b0f6c81261d73649c2191 not found: ID does not exist" Jun 10 16:50:01.152110 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.152065 2562 scope.go:117] "RemoveContainer" containerID="ebe34a9fb696135953c73445ab8794827faee7d956e3e8a16caeb4a6ed1472b9" Jun 10 16:50:01.152276 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.152257 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebe34a9fb696135953c73445ab8794827faee7d956e3e8a16caeb4a6ed1472b9"} err="failed to get container status \"ebe34a9fb696135953c73445ab8794827faee7d956e3e8a16caeb4a6ed1472b9\": rpc error: code = NotFound desc = could not find container \"ebe34a9fb696135953c73445ab8794827faee7d956e3e8a16caeb4a6ed1472b9\": container with ID starting with ebe34a9fb696135953c73445ab8794827faee7d956e3e8a16caeb4a6ed1472b9 not found: ID does not exist" Jun 10 16:50:01.152318 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.152277 2562 scope.go:117] "RemoveContainer" containerID="9a72380c991924d9e9d28fcbf60f291d3db429109ddaba7f9f411d3f940a0074" Jun 10 16:50:01.152555 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.152536 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a72380c991924d9e9d28fcbf60f291d3db429109ddaba7f9f411d3f940a0074"} err="failed to get container status \"9a72380c991924d9e9d28fcbf60f291d3db429109ddaba7f9f411d3f940a0074\": rpc error: code = NotFound desc = could not find container \"9a72380c991924d9e9d28fcbf60f291d3db429109ddaba7f9f411d3f940a0074\": container with ID starting with 9a72380c991924d9e9d28fcbf60f291d3db429109ddaba7f9f411d3f940a0074 not found: ID does not exist" Jun 10 16:50:01.152555 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.152554 2562 scope.go:117] "RemoveContainer" containerID="ec71e1efeaff95bfdd8d68cec4874f8afdc525a4651f0b7f301226fb2b12eb37" Jun 10 16:50:01.152834 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.152813 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec71e1efeaff95bfdd8d68cec4874f8afdc525a4651f0b7f301226fb2b12eb37"} err="failed to get container status \"ec71e1efeaff95bfdd8d68cec4874f8afdc525a4651f0b7f301226fb2b12eb37\": rpc error: code = NotFound desc = could not find container \"ec71e1efeaff95bfdd8d68cec4874f8afdc525a4651f0b7f301226fb2b12eb37\": container with ID starting with ec71e1efeaff95bfdd8d68cec4874f8afdc525a4651f0b7f301226fb2b12eb37 not found: ID does not exist" Jun 10 16:50:01.152834 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.152833 2562 scope.go:117] "RemoveContainer" containerID="5194b95c205d3e8f5cbe0b44ef470bccc062b9d46df37c1ec46aae01bf66a82d" Jun 10 16:50:01.153094 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.153075 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5194b95c205d3e8f5cbe0b44ef470bccc062b9d46df37c1ec46aae01bf66a82d"} err="failed to get container status \"5194b95c205d3e8f5cbe0b44ef470bccc062b9d46df37c1ec46aae01bf66a82d\": rpc error: code = NotFound desc = could not find container \"5194b95c205d3e8f5cbe0b44ef470bccc062b9d46df37c1ec46aae01bf66a82d\": container with ID starting with 5194b95c205d3e8f5cbe0b44ef470bccc062b9d46df37c1ec46aae01bf66a82d not found: ID does not exist" Jun 10 16:50:01.153161 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.153094 2562 scope.go:117] "RemoveContainer" containerID="9a7acb39dcaf771543c85b5169390bf74899cb3c3768c23e811487f187bd8dbd" Jun 10 16:50:01.153336 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.153315 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a7acb39dcaf771543c85b5169390bf74899cb3c3768c23e811487f187bd8dbd"} err="failed to get container status \"9a7acb39dcaf771543c85b5169390bf74899cb3c3768c23e811487f187bd8dbd\": rpc error: code = NotFound desc = could not find container \"9a7acb39dcaf771543c85b5169390bf74899cb3c3768c23e811487f187bd8dbd\": container with ID starting with 9a7acb39dcaf771543c85b5169390bf74899cb3c3768c23e811487f187bd8dbd not found: ID does not exist" Jun 10 16:50:01.153384 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.153337 2562 scope.go:117] "RemoveContainer" containerID="72ae761989a470c935e1aac985118dc97440b9ce76a01d060faddeacd042e1e4" Jun 10 16:50:01.153558 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.153540 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72ae761989a470c935e1aac985118dc97440b9ce76a01d060faddeacd042e1e4"} err="failed to get container status \"72ae761989a470c935e1aac985118dc97440b9ce76a01d060faddeacd042e1e4\": rpc error: code = NotFound desc = could not find container \"72ae761989a470c935e1aac985118dc97440b9ce76a01d060faddeacd042e1e4\": container with ID starting with 72ae761989a470c935e1aac985118dc97440b9ce76a01d060faddeacd042e1e4 not found: ID does not exist" Jun 10 16:50:01.153651 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.153558 2562 scope.go:117] "RemoveContainer" containerID="042620527d17fa0c923a0112a172d470a01563e4fa5b0f6c81261d73649c2191" Jun 10 16:50:01.153844 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.153822 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"042620527d17fa0c923a0112a172d470a01563e4fa5b0f6c81261d73649c2191"} err="failed to get container status \"042620527d17fa0c923a0112a172d470a01563e4fa5b0f6c81261d73649c2191\": rpc error: code = NotFound desc = could not find container \"042620527d17fa0c923a0112a172d470a01563e4fa5b0f6c81261d73649c2191\": container with ID starting with 042620527d17fa0c923a0112a172d470a01563e4fa5b0f6c81261d73649c2191 not found: ID does not exist" Jun 10 16:50:01.153844 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.153844 2562 scope.go:117] "RemoveContainer" containerID="ebe34a9fb696135953c73445ab8794827faee7d956e3e8a16caeb4a6ed1472b9" Jun 10 16:50:01.154095 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.154075 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebe34a9fb696135953c73445ab8794827faee7d956e3e8a16caeb4a6ed1472b9"} err="failed to get container status \"ebe34a9fb696135953c73445ab8794827faee7d956e3e8a16caeb4a6ed1472b9\": rpc error: code = NotFound desc = could not find container \"ebe34a9fb696135953c73445ab8794827faee7d956e3e8a16caeb4a6ed1472b9\": container with ID starting with ebe34a9fb696135953c73445ab8794827faee7d956e3e8a16caeb4a6ed1472b9 not found: ID does not exist" Jun 10 16:50:01.154151 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.154097 2562 scope.go:117] "RemoveContainer" containerID="9a72380c991924d9e9d28fcbf60f291d3db429109ddaba7f9f411d3f940a0074" Jun 10 16:50:01.154393 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.154330 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a72380c991924d9e9d28fcbf60f291d3db429109ddaba7f9f411d3f940a0074"} err="failed to get container status \"9a72380c991924d9e9d28fcbf60f291d3db429109ddaba7f9f411d3f940a0074\": rpc error: code = NotFound desc = could not find container \"9a72380c991924d9e9d28fcbf60f291d3db429109ddaba7f9f411d3f940a0074\": container with ID starting with 9a72380c991924d9e9d28fcbf60f291d3db429109ddaba7f9f411d3f940a0074 not found: ID does not exist" Jun 10 16:50:01.154393 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.154393 2562 scope.go:117] "RemoveContainer" containerID="ec71e1efeaff95bfdd8d68cec4874f8afdc525a4651f0b7f301226fb2b12eb37" Jun 10 16:50:01.154702 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.154676 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec71e1efeaff95bfdd8d68cec4874f8afdc525a4651f0b7f301226fb2b12eb37"} err="failed to get container status \"ec71e1efeaff95bfdd8d68cec4874f8afdc525a4651f0b7f301226fb2b12eb37\": rpc error: code = NotFound desc = could not find container \"ec71e1efeaff95bfdd8d68cec4874f8afdc525a4651f0b7f301226fb2b12eb37\": container with ID starting with ec71e1efeaff95bfdd8d68cec4874f8afdc525a4651f0b7f301226fb2b12eb37 not found: ID does not exist" Jun 10 16:50:01.154702 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.154702 2562 scope.go:117] "RemoveContainer" containerID="5194b95c205d3e8f5cbe0b44ef470bccc062b9d46df37c1ec46aae01bf66a82d" Jun 10 16:50:01.154959 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.154931 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5194b95c205d3e8f5cbe0b44ef470bccc062b9d46df37c1ec46aae01bf66a82d"} err="failed to get container status \"5194b95c205d3e8f5cbe0b44ef470bccc062b9d46df37c1ec46aae01bf66a82d\": rpc error: code = NotFound desc = could not find container \"5194b95c205d3e8f5cbe0b44ef470bccc062b9d46df37c1ec46aae01bf66a82d\": container with ID starting with 5194b95c205d3e8f5cbe0b44ef470bccc062b9d46df37c1ec46aae01bf66a82d not found: ID does not exist" Jun 10 16:50:01.154959 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.154953 2562 scope.go:117] "RemoveContainer" containerID="9a7acb39dcaf771543c85b5169390bf74899cb3c3768c23e811487f187bd8dbd" Jun 10 16:50:01.155096 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.154996 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:50:01.155240 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.155214 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a7acb39dcaf771543c85b5169390bf74899cb3c3768c23e811487f187bd8dbd"} err="failed to get container status \"9a7acb39dcaf771543c85b5169390bf74899cb3c3768c23e811487f187bd8dbd\": rpc error: code = NotFound desc = could not find container \"9a7acb39dcaf771543c85b5169390bf74899cb3c3768c23e811487f187bd8dbd\": container with ID starting with 9a7acb39dcaf771543c85b5169390bf74899cb3c3768c23e811487f187bd8dbd not found: ID does not exist" Jun 10 16:50:01.155315 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.155243 2562 scope.go:117] "RemoveContainer" containerID="72ae761989a470c935e1aac985118dc97440b9ce76a01d060faddeacd042e1e4" Jun 10 16:50:01.155692 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.155666 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72ae761989a470c935e1aac985118dc97440b9ce76a01d060faddeacd042e1e4"} err="failed to get container status \"72ae761989a470c935e1aac985118dc97440b9ce76a01d060faddeacd042e1e4\": rpc error: code = NotFound desc = could not find container \"72ae761989a470c935e1aac985118dc97440b9ce76a01d060faddeacd042e1e4\": container with ID starting with 72ae761989a470c935e1aac985118dc97440b9ce76a01d060faddeacd042e1e4 not found: ID does not exist" Jun 10 16:50:01.155783 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.155693 2562 scope.go:117] "RemoveContainer" containerID="042620527d17fa0c923a0112a172d470a01563e4fa5b0f6c81261d73649c2191" Jun 10 16:50:01.155950 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.155931 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"042620527d17fa0c923a0112a172d470a01563e4fa5b0f6c81261d73649c2191"} err="failed to get container status \"042620527d17fa0c923a0112a172d470a01563e4fa5b0f6c81261d73649c2191\": rpc error: code = NotFound desc = could not find container \"042620527d17fa0c923a0112a172d470a01563e4fa5b0f6c81261d73649c2191\": container with ID starting with 042620527d17fa0c923a0112a172d470a01563e4fa5b0f6c81261d73649c2191 not found: ID does not exist" Jun 10 16:50:01.155999 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.155951 2562 scope.go:117] "RemoveContainer" containerID="ebe34a9fb696135953c73445ab8794827faee7d956e3e8a16caeb4a6ed1472b9" Jun 10 16:50:01.156189 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.156173 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebe34a9fb696135953c73445ab8794827faee7d956e3e8a16caeb4a6ed1472b9"} err="failed to get container status \"ebe34a9fb696135953c73445ab8794827faee7d956e3e8a16caeb4a6ed1472b9\": rpc error: code = NotFound desc = could not find container \"ebe34a9fb696135953c73445ab8794827faee7d956e3e8a16caeb4a6ed1472b9\": container with ID starting with ebe34a9fb696135953c73445ab8794827faee7d956e3e8a16caeb4a6ed1472b9 not found: ID does not exist" Jun 10 16:50:01.156231 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.156190 2562 scope.go:117] "RemoveContainer" containerID="9a72380c991924d9e9d28fcbf60f291d3db429109ddaba7f9f411d3f940a0074" Jun 10 16:50:01.156390 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.156370 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a72380c991924d9e9d28fcbf60f291d3db429109ddaba7f9f411d3f940a0074"} err="failed to get container status \"9a72380c991924d9e9d28fcbf60f291d3db429109ddaba7f9f411d3f940a0074\": rpc error: code = NotFound desc = could not find container \"9a72380c991924d9e9d28fcbf60f291d3db429109ddaba7f9f411d3f940a0074\": container with ID starting with 9a72380c991924d9e9d28fcbf60f291d3db429109ddaba7f9f411d3f940a0074 not found: ID does not exist" Jun 10 16:50:01.156433 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.156392 2562 scope.go:117] "RemoveContainer" containerID="ec71e1efeaff95bfdd8d68cec4874f8afdc525a4651f0b7f301226fb2b12eb37" Jun 10 16:50:01.156600 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.156578 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec71e1efeaff95bfdd8d68cec4874f8afdc525a4651f0b7f301226fb2b12eb37"} err="failed to get container status \"ec71e1efeaff95bfdd8d68cec4874f8afdc525a4651f0b7f301226fb2b12eb37\": rpc error: code = NotFound desc = could not find container \"ec71e1efeaff95bfdd8d68cec4874f8afdc525a4651f0b7f301226fb2b12eb37\": container with ID starting with ec71e1efeaff95bfdd8d68cec4874f8afdc525a4651f0b7f301226fb2b12eb37 not found: ID does not exist" Jun 10 16:50:01.156659 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.156604 2562 scope.go:117] "RemoveContainer" containerID="5194b95c205d3e8f5cbe0b44ef470bccc062b9d46df37c1ec46aae01bf66a82d" Jun 10 16:50:01.156832 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.156817 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5194b95c205d3e8f5cbe0b44ef470bccc062b9d46df37c1ec46aae01bf66a82d"} err="failed to get container status \"5194b95c205d3e8f5cbe0b44ef470bccc062b9d46df37c1ec46aae01bf66a82d\": rpc error: code = NotFound desc = could not find container \"5194b95c205d3e8f5cbe0b44ef470bccc062b9d46df37c1ec46aae01bf66a82d\": container with ID starting with 5194b95c205d3e8f5cbe0b44ef470bccc062b9d46df37c1ec46aae01bf66a82d not found: ID does not exist" Jun 10 16:50:01.156868 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.156832 2562 scope.go:117] "RemoveContainer" containerID="9a7acb39dcaf771543c85b5169390bf74899cb3c3768c23e811487f187bd8dbd" Jun 10 16:50:01.157006 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.156992 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a7acb39dcaf771543c85b5169390bf74899cb3c3768c23e811487f187bd8dbd"} err="failed to get container status \"9a7acb39dcaf771543c85b5169390bf74899cb3c3768c23e811487f187bd8dbd\": rpc error: code = NotFound desc = could not find container \"9a7acb39dcaf771543c85b5169390bf74899cb3c3768c23e811487f187bd8dbd\": container with ID starting with 9a7acb39dcaf771543c85b5169390bf74899cb3c3768c23e811487f187bd8dbd not found: ID does not exist" Jun 10 16:50:01.157046 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.157007 2562 scope.go:117] "RemoveContainer" containerID="72ae761989a470c935e1aac985118dc97440b9ce76a01d060faddeacd042e1e4" Jun 10 16:50:01.157256 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.157234 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72ae761989a470c935e1aac985118dc97440b9ce76a01d060faddeacd042e1e4"} err="failed to get container status \"72ae761989a470c935e1aac985118dc97440b9ce76a01d060faddeacd042e1e4\": rpc error: code = NotFound desc = could not find container \"72ae761989a470c935e1aac985118dc97440b9ce76a01d060faddeacd042e1e4\": container with ID starting with 72ae761989a470c935e1aac985118dc97440b9ce76a01d060faddeacd042e1e4 not found: ID does not exist" Jun 10 16:50:01.157256 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.157256 2562 scope.go:117] "RemoveContainer" containerID="042620527d17fa0c923a0112a172d470a01563e4fa5b0f6c81261d73649c2191" Jun 10 16:50:01.157439 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.157345 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 10 16:50:01.157534 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.157454 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"042620527d17fa0c923a0112a172d470a01563e4fa5b0f6c81261d73649c2191"} err="failed to get container status \"042620527d17fa0c923a0112a172d470a01563e4fa5b0f6c81261d73649c2191\": rpc error: code = NotFound desc = could not find container \"042620527d17fa0c923a0112a172d470a01563e4fa5b0f6c81261d73649c2191\": container with ID starting with 042620527d17fa0c923a0112a172d470a01563e4fa5b0f6c81261d73649c2191 not found: ID does not exist" Jun 10 16:50:01.157534 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.157475 2562 scope.go:117] "RemoveContainer" containerID="ebe34a9fb696135953c73445ab8794827faee7d956e3e8a16caeb4a6ed1472b9" Jun 10 16:50:01.157899 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.157880 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 10 16:50:01.157986 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.157901 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 10 16:50:01.157986 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.157911 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 10 16:50:01.158167 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.158139 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebe34a9fb696135953c73445ab8794827faee7d956e3e8a16caeb4a6ed1472b9"} err="failed to get container status \"ebe34a9fb696135953c73445ab8794827faee7d956e3e8a16caeb4a6ed1472b9\": rpc error: code = NotFound desc = could not find container \"ebe34a9fb696135953c73445ab8794827faee7d956e3e8a16caeb4a6ed1472b9\": container with ID starting with ebe34a9fb696135953c73445ab8794827faee7d956e3e8a16caeb4a6ed1472b9 not found: ID does not exist" Jun 10 16:50:01.158167 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.158159 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-2hkvn\"" Jun 10 16:50:01.158437 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.158168 2562 scope.go:117] "RemoveContainer" containerID="9a72380c991924d9e9d28fcbf60f291d3db429109ddaba7f9f411d3f940a0074" Jun 10 16:50:01.158437 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.158154 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 10 16:50:01.158437 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.158226 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 10 16:50:01.158437 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.158229 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 10 16:50:01.158437 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.158404 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-88fmvqikmalfl\"" Jun 10 16:50:01.158437 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.158408 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a72380c991924d9e9d28fcbf60f291d3db429109ddaba7f9f411d3f940a0074"} err="failed to get container status \"9a72380c991924d9e9d28fcbf60f291d3db429109ddaba7f9f411d3f940a0074\": rpc error: code = NotFound desc = could not find container \"9a72380c991924d9e9d28fcbf60f291d3db429109ddaba7f9f411d3f940a0074\": container with ID starting with 9a72380c991924d9e9d28fcbf60f291d3db429109ddaba7f9f411d3f940a0074 not found: ID does not exist" Jun 10 16:50:01.158437 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.158430 2562 scope.go:117] "RemoveContainer" containerID="ec71e1efeaff95bfdd8d68cec4874f8afdc525a4651f0b7f301226fb2b12eb37" Jun 10 16:50:01.158952 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.158720 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec71e1efeaff95bfdd8d68cec4874f8afdc525a4651f0b7f301226fb2b12eb37"} err="failed to get container status \"ec71e1efeaff95bfdd8d68cec4874f8afdc525a4651f0b7f301226fb2b12eb37\": rpc error: code = NotFound desc = could not find container \"ec71e1efeaff95bfdd8d68cec4874f8afdc525a4651f0b7f301226fb2b12eb37\": container with ID starting with ec71e1efeaff95bfdd8d68cec4874f8afdc525a4651f0b7f301226fb2b12eb37 not found: ID does not exist" Jun 10 16:50:01.158952 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.158745 2562 scope.go:117] "RemoveContainer" containerID="5194b95c205d3e8f5cbe0b44ef470bccc062b9d46df37c1ec46aae01bf66a82d" Jun 10 16:50:01.158952 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.158775 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 10 16:50:01.159096 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.159038 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 10 16:50:01.159096 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.159044 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 10 16:50:01.159185 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.159169 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5194b95c205d3e8f5cbe0b44ef470bccc062b9d46df37c1ec46aae01bf66a82d"} err="failed to get container status \"5194b95c205d3e8f5cbe0b44ef470bccc062b9d46df37c1ec46aae01bf66a82d\": rpc error: code = NotFound desc = could not find container \"5194b95c205d3e8f5cbe0b44ef470bccc062b9d46df37c1ec46aae01bf66a82d\": container with ID starting with 5194b95c205d3e8f5cbe0b44ef470bccc062b9d46df37c1ec46aae01bf66a82d not found: ID does not exist" Jun 10 16:50:01.159245 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.159190 2562 scope.go:117] "RemoveContainer" containerID="9a7acb39dcaf771543c85b5169390bf74899cb3c3768c23e811487f187bd8dbd" Jun 10 16:50:01.159350 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.159335 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 10 16:50:01.159499 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.159473 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a7acb39dcaf771543c85b5169390bf74899cb3c3768c23e811487f187bd8dbd"} err="failed to get container status \"9a7acb39dcaf771543c85b5169390bf74899cb3c3768c23e811487f187bd8dbd\": rpc error: code = NotFound desc = could not find container \"9a7acb39dcaf771543c85b5169390bf74899cb3c3768c23e811487f187bd8dbd\": container with ID starting with 9a7acb39dcaf771543c85b5169390bf74899cb3c3768c23e811487f187bd8dbd not found: ID does not exist" Jun 10 16:50:01.159583 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.159502 2562 scope.go:117] "RemoveContainer" containerID="72ae761989a470c935e1aac985118dc97440b9ce76a01d060faddeacd042e1e4" Jun 10 16:50:01.159776 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.159727 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 10 16:50:01.159867 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.159810 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72ae761989a470c935e1aac985118dc97440b9ce76a01d060faddeacd042e1e4"} err="failed to get container status \"72ae761989a470c935e1aac985118dc97440b9ce76a01d060faddeacd042e1e4\": rpc error: code = NotFound desc = could not find container \"72ae761989a470c935e1aac985118dc97440b9ce76a01d060faddeacd042e1e4\": container with ID starting with 72ae761989a470c935e1aac985118dc97440b9ce76a01d060faddeacd042e1e4 not found: ID does not exist" Jun 10 16:50:01.159867 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.159833 2562 scope.go:117] "RemoveContainer" containerID="042620527d17fa0c923a0112a172d470a01563e4fa5b0f6c81261d73649c2191" Jun 10 16:50:01.160360 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.160334 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"042620527d17fa0c923a0112a172d470a01563e4fa5b0f6c81261d73649c2191"} err="failed to get container status \"042620527d17fa0c923a0112a172d470a01563e4fa5b0f6c81261d73649c2191\": rpc error: code = NotFound desc = could not find container \"042620527d17fa0c923a0112a172d470a01563e4fa5b0f6c81261d73649c2191\": container with ID starting with 042620527d17fa0c923a0112a172d470a01563e4fa5b0f6c81261d73649c2191 not found: ID does not exist" Jun 10 16:50:01.160444 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.160362 2562 scope.go:117] "RemoveContainer" containerID="ebe34a9fb696135953c73445ab8794827faee7d956e3e8a16caeb4a6ed1472b9" Jun 10 16:50:01.160690 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.160658 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebe34a9fb696135953c73445ab8794827faee7d956e3e8a16caeb4a6ed1472b9"} err="failed to get container status \"ebe34a9fb696135953c73445ab8794827faee7d956e3e8a16caeb4a6ed1472b9\": rpc error: code = NotFound desc = could not find container \"ebe34a9fb696135953c73445ab8794827faee7d956e3e8a16caeb4a6ed1472b9\": container with ID starting with ebe34a9fb696135953c73445ab8794827faee7d956e3e8a16caeb4a6ed1472b9 not found: ID does not exist" Jun 10 16:50:01.160690 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.160686 2562 scope.go:117] "RemoveContainer" containerID="9a72380c991924d9e9d28fcbf60f291d3db429109ddaba7f9f411d3f940a0074" Jun 10 16:50:01.160986 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.160962 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a72380c991924d9e9d28fcbf60f291d3db429109ddaba7f9f411d3f940a0074"} err="failed to get container status \"9a72380c991924d9e9d28fcbf60f291d3db429109ddaba7f9f411d3f940a0074\": rpc error: code = NotFound desc = could not find container \"9a72380c991924d9e9d28fcbf60f291d3db429109ddaba7f9f411d3f940a0074\": container with ID starting with 9a72380c991924d9e9d28fcbf60f291d3db429109ddaba7f9f411d3f940a0074 not found: ID does not exist" Jun 10 16:50:01.161640 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.161607 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 10 16:50:01.164317 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.164299 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 10 16:50:01.175462 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.175429 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 16:50:01.286355 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.286320 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5aad5fa1-d307-4ff8-a9ba-12677c9ed53a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5aad5fa1-d307-4ff8-a9ba-12677c9ed53a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:50:01.286355 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.286356 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5aad5fa1-d307-4ff8-a9ba-12677c9ed53a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5aad5fa1-d307-4ff8-a9ba-12677c9ed53a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:50:01.286903 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.286387 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5aad5fa1-d307-4ff8-a9ba-12677c9ed53a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5aad5fa1-d307-4ff8-a9ba-12677c9ed53a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:50:01.286903 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.286403 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5aad5fa1-d307-4ff8-a9ba-12677c9ed53a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5aad5fa1-d307-4ff8-a9ba-12677c9ed53a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:50:01.286903 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.286446 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5aad5fa1-d307-4ff8-a9ba-12677c9ed53a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5aad5fa1-d307-4ff8-a9ba-12677c9ed53a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:50:01.286903 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.286464 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5aad5fa1-d307-4ff8-a9ba-12677c9ed53a-config\") pod \"prometheus-k8s-0\" (UID: \"5aad5fa1-d307-4ff8-a9ba-12677c9ed53a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:50:01.286903 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.286481 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5t8z\" (UniqueName: \"kubernetes.io/projected/5aad5fa1-d307-4ff8-a9ba-12677c9ed53a-kube-api-access-l5t8z\") pod \"prometheus-k8s-0\" (UID: \"5aad5fa1-d307-4ff8-a9ba-12677c9ed53a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:50:01.286903 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.286506 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5aad5fa1-d307-4ff8-a9ba-12677c9ed53a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5aad5fa1-d307-4ff8-a9ba-12677c9ed53a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:50:01.286903 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.286521 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5aad5fa1-d307-4ff8-a9ba-12677c9ed53a-web-config\") pod \"prometheus-k8s-0\" (UID: \"5aad5fa1-d307-4ff8-a9ba-12677c9ed53a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:50:01.286903 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.286539 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5aad5fa1-d307-4ff8-a9ba-12677c9ed53a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5aad5fa1-d307-4ff8-a9ba-12677c9ed53a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:50:01.286903 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.286557 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5aad5fa1-d307-4ff8-a9ba-12677c9ed53a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5aad5fa1-d307-4ff8-a9ba-12677c9ed53a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:50:01.286903 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.286575 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5aad5fa1-d307-4ff8-a9ba-12677c9ed53a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5aad5fa1-d307-4ff8-a9ba-12677c9ed53a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:50:01.286903 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.286621 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5aad5fa1-d307-4ff8-a9ba-12677c9ed53a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5aad5fa1-d307-4ff8-a9ba-12677c9ed53a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:50:01.286903 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.286698 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5aad5fa1-d307-4ff8-a9ba-12677c9ed53a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5aad5fa1-d307-4ff8-a9ba-12677c9ed53a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:50:01.286903 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.286735 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5aad5fa1-d307-4ff8-a9ba-12677c9ed53a-config-out\") pod \"prometheus-k8s-0\" (UID: \"5aad5fa1-d307-4ff8-a9ba-12677c9ed53a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:50:01.286903 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.286761 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5aad5fa1-d307-4ff8-a9ba-12677c9ed53a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5aad5fa1-d307-4ff8-a9ba-12677c9ed53a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:50:01.286903 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.286790 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5aad5fa1-d307-4ff8-a9ba-12677c9ed53a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5aad5fa1-d307-4ff8-a9ba-12677c9ed53a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:50:01.286903 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.286842 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5aad5fa1-d307-4ff8-a9ba-12677c9ed53a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5aad5fa1-d307-4ff8-a9ba-12677c9ed53a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:50:01.287437 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.286868 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5aad5fa1-d307-4ff8-a9ba-12677c9ed53a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5aad5fa1-d307-4ff8-a9ba-12677c9ed53a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:50:01.287437 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.286897 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5aad5fa1-d307-4ff8-a9ba-12677c9ed53a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5aad5fa1-d307-4ff8-a9ba-12677c9ed53a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:50:01.387940 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.387909 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5aad5fa1-d307-4ff8-a9ba-12677c9ed53a-config\") pod \"prometheus-k8s-0\" (UID: \"5aad5fa1-d307-4ff8-a9ba-12677c9ed53a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:50:01.388106 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.387947 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5t8z\" (UniqueName: \"kubernetes.io/projected/5aad5fa1-d307-4ff8-a9ba-12677c9ed53a-kube-api-access-l5t8z\") pod \"prometheus-k8s-0\" (UID: \"5aad5fa1-d307-4ff8-a9ba-12677c9ed53a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:50:01.388106 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.387966 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5aad5fa1-d307-4ff8-a9ba-12677c9ed53a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5aad5fa1-d307-4ff8-a9ba-12677c9ed53a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:50:01.388106 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.387981 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5aad5fa1-d307-4ff8-a9ba-12677c9ed53a-web-config\") pod \"prometheus-k8s-0\" (UID: \"5aad5fa1-d307-4ff8-a9ba-12677c9ed53a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:50:01.388106 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.387999 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5aad5fa1-d307-4ff8-a9ba-12677c9ed53a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5aad5fa1-d307-4ff8-a9ba-12677c9ed53a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:50:01.388312 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.388189 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5aad5fa1-d307-4ff8-a9ba-12677c9ed53a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5aad5fa1-d307-4ff8-a9ba-12677c9ed53a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:50:01.388312 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.388210 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5aad5fa1-d307-4ff8-a9ba-12677c9ed53a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5aad5fa1-d307-4ff8-a9ba-12677c9ed53a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:50:01.388312 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.388224 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5aad5fa1-d307-4ff8-a9ba-12677c9ed53a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5aad5fa1-d307-4ff8-a9ba-12677c9ed53a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:50:01.388312 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.388242 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5aad5fa1-d307-4ff8-a9ba-12677c9ed53a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5aad5fa1-d307-4ff8-a9ba-12677c9ed53a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:50:01.388312 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.388275 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5aad5fa1-d307-4ff8-a9ba-12677c9ed53a-config-out\") pod \"prometheus-k8s-0\" (UID: \"5aad5fa1-d307-4ff8-a9ba-12677c9ed53a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:50:01.388312 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.388300 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5aad5fa1-d307-4ff8-a9ba-12677c9ed53a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5aad5fa1-d307-4ff8-a9ba-12677c9ed53a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:50:01.388545 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.388332 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5aad5fa1-d307-4ff8-a9ba-12677c9ed53a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5aad5fa1-d307-4ff8-a9ba-12677c9ed53a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:50:01.388545 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.388377 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5aad5fa1-d307-4ff8-a9ba-12677c9ed53a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5aad5fa1-d307-4ff8-a9ba-12677c9ed53a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:50:01.388545 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.388405 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5aad5fa1-d307-4ff8-a9ba-12677c9ed53a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5aad5fa1-d307-4ff8-a9ba-12677c9ed53a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:50:01.388545 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.388436 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5aad5fa1-d307-4ff8-a9ba-12677c9ed53a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5aad5fa1-d307-4ff8-a9ba-12677c9ed53a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:50:01.388545 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.388466 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5aad5fa1-d307-4ff8-a9ba-12677c9ed53a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5aad5fa1-d307-4ff8-a9ba-12677c9ed53a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:50:01.388545 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.388489 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5aad5fa1-d307-4ff8-a9ba-12677c9ed53a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5aad5fa1-d307-4ff8-a9ba-12677c9ed53a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:50:01.388545 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.388524 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5aad5fa1-d307-4ff8-a9ba-12677c9ed53a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5aad5fa1-d307-4ff8-a9ba-12677c9ed53a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:50:01.389049 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.388550 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5aad5fa1-d307-4ff8-a9ba-12677c9ed53a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5aad5fa1-d307-4ff8-a9ba-12677c9ed53a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:50:01.389049 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.388602 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5aad5fa1-d307-4ff8-a9ba-12677c9ed53a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5aad5fa1-d307-4ff8-a9ba-12677c9ed53a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:50:01.389424 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.389398 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5aad5fa1-d307-4ff8-a9ba-12677c9ed53a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5aad5fa1-d307-4ff8-a9ba-12677c9ed53a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:50:01.390043 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.390014 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5aad5fa1-d307-4ff8-a9ba-12677c9ed53a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5aad5fa1-d307-4ff8-a9ba-12677c9ed53a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:50:01.390560 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.390536 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5aad5fa1-d307-4ff8-a9ba-12677c9ed53a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5aad5fa1-d307-4ff8-a9ba-12677c9ed53a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:50:01.393557 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.391209 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/5aad5fa1-d307-4ff8-a9ba-12677c9ed53a-config\") pod \"prometheus-k8s-0\" (UID: \"5aad5fa1-d307-4ff8-a9ba-12677c9ed53a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:50:01.393557 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.391225 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5aad5fa1-d307-4ff8-a9ba-12677c9ed53a-config-out\") pod \"prometheus-k8s-0\" (UID: \"5aad5fa1-d307-4ff8-a9ba-12677c9ed53a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:50:01.393557 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.391417 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5aad5fa1-d307-4ff8-a9ba-12677c9ed53a-web-config\") pod \"prometheus-k8s-0\" (UID: \"5aad5fa1-d307-4ff8-a9ba-12677c9ed53a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:50:01.393557 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.391463 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5aad5fa1-d307-4ff8-a9ba-12677c9ed53a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5aad5fa1-d307-4ff8-a9ba-12677c9ed53a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:50:01.393557 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.391489 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5aad5fa1-d307-4ff8-a9ba-12677c9ed53a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5aad5fa1-d307-4ff8-a9ba-12677c9ed53a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:50:01.393557 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.391656 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5aad5fa1-d307-4ff8-a9ba-12677c9ed53a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5aad5fa1-d307-4ff8-a9ba-12677c9ed53a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:50:01.393557 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.392114 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5aad5fa1-d307-4ff8-a9ba-12677c9ed53a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5aad5fa1-d307-4ff8-a9ba-12677c9ed53a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:50:01.393557 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.392352 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5aad5fa1-d307-4ff8-a9ba-12677c9ed53a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5aad5fa1-d307-4ff8-a9ba-12677c9ed53a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:50:01.393557 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.392852 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5aad5fa1-d307-4ff8-a9ba-12677c9ed53a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5aad5fa1-d307-4ff8-a9ba-12677c9ed53a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:50:01.393557 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.393208 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5aad5fa1-d307-4ff8-a9ba-12677c9ed53a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5aad5fa1-d307-4ff8-a9ba-12677c9ed53a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:50:01.393557 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.393513 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5aad5fa1-d307-4ff8-a9ba-12677c9ed53a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5aad5fa1-d307-4ff8-a9ba-12677c9ed53a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:50:01.394341 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.393911 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5aad5fa1-d307-4ff8-a9ba-12677c9ed53a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5aad5fa1-d307-4ff8-a9ba-12677c9ed53a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:50:01.394341 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.394002 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5aad5fa1-d307-4ff8-a9ba-12677c9ed53a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5aad5fa1-d307-4ff8-a9ba-12677c9ed53a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:50:01.394341 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.394136 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5aad5fa1-d307-4ff8-a9ba-12677c9ed53a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5aad5fa1-d307-4ff8-a9ba-12677c9ed53a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:50:01.394863 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.394840 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5aad5fa1-d307-4ff8-a9ba-12677c9ed53a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5aad5fa1-d307-4ff8-a9ba-12677c9ed53a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:50:01.395252 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.395232 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5aad5fa1-d307-4ff8-a9ba-12677c9ed53a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5aad5fa1-d307-4ff8-a9ba-12677c9ed53a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:50:01.396269 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.396249 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5t8z\" (UniqueName: \"kubernetes.io/projected/5aad5fa1-d307-4ff8-a9ba-12677c9ed53a-kube-api-access-l5t8z\") pod \"prometheus-k8s-0\" (UID: \"5aad5fa1-d307-4ff8-a9ba-12677c9ed53a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:50:01.466414 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.466321 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:50:01.607207 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:01.607181 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 16:50:01.609007 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:50:01.608980 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5aad5fa1_d307_4ff8_a9ba_12677c9ed53a.slice/crio-cfa2a74b251ba21cc23f9c0578bdf5bb08ca9e6051d535c5f25ab911d203005e WatchSource:0}: Error finding container cfa2a74b251ba21cc23f9c0578bdf5bb08ca9e6051d535c5f25ab911d203005e: Status 404 returned error can't find the container with id cfa2a74b251ba21cc23f9c0578bdf5bb08ca9e6051d535c5f25ab911d203005e Jun 10 16:50:02.104205 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:02.104174 2562 generic.go:356] "Generic (PLEG): container finished" podID="5aad5fa1-d307-4ff8-a9ba-12677c9ed53a" containerID="9980ae89eeec6a95d3d015d179bb80dd02ff4288a4be492bb2ddd5c25853409e" exitCode=0 Jun 10 16:50:02.104205 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:02.104209 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5aad5fa1-d307-4ff8-a9ba-12677c9ed53a","Type":"ContainerDied","Data":"9980ae89eeec6a95d3d015d179bb80dd02ff4288a4be492bb2ddd5c25853409e"} Jun 10 16:50:02.104430 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:02.104259 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5aad5fa1-d307-4ff8-a9ba-12677c9ed53a","Type":"ContainerStarted","Data":"cfa2a74b251ba21cc23f9c0578bdf5bb08ca9e6051d535c5f25ab911d203005e"} Jun 10 16:50:02.947573 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:02.947540 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7811958-8338-4bec-9351-2df8c6c1271e" path="/var/lib/kubelet/pods/b7811958-8338-4bec-9351-2df8c6c1271e/volumes" Jun 10 16:50:03.111077 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:03.111048 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5aad5fa1-d307-4ff8-a9ba-12677c9ed53a","Type":"ContainerStarted","Data":"f83ecfd53b65c37417616e59a4cfe4890448b5c332e41b3ff2042bab80e16177"} Jun 10 16:50:03.111226 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:03.111108 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5aad5fa1-d307-4ff8-a9ba-12677c9ed53a","Type":"ContainerStarted","Data":"d26b0774c77d00538b44514c60fe197e6e162bcdcdd31c42aa391109eec0411f"} Jun 10 16:50:03.111226 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:03.111134 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5aad5fa1-d307-4ff8-a9ba-12677c9ed53a","Type":"ContainerStarted","Data":"5ba219a16fd4adeaa0e03b4821dfc27c17c5ceefc09926e29818e1b1aa5e5949"} Jun 10 16:50:03.111226 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:03.111158 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5aad5fa1-d307-4ff8-a9ba-12677c9ed53a","Type":"ContainerStarted","Data":"0e543fe9829e3e47e9decf9a604b57014e3e964450c34064eb62e37c363613c8"} Jun 10 16:50:03.111226 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:03.111189 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5aad5fa1-d307-4ff8-a9ba-12677c9ed53a","Type":"ContainerStarted","Data":"7168e005066512ac711b320c2b71adc28e90e4e7adadb01bb9cea171acd33087"} Jun 10 16:50:03.111226 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:03.111213 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5aad5fa1-d307-4ff8-a9ba-12677c9ed53a","Type":"ContainerStarted","Data":"153e33f9a854952f60784ce5a63de235c0b769b2e97742ddbb65da4e8006e6de"} Jun 10 16:50:03.139234 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:03.139176 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.120345168 podStartE2EDuration="2.139158464s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.813296ms" isStatefulPod=false podCreationTimestamp="2026-06-10 16:50:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:50:03.138243171 +0000 UTC m=+322.662456243" watchObservedRunningTime="2026-06-10 16:50:03.139158464 +0000 UTC m=+322.663371534" Jun 10 16:50:06.467115 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:06.467077 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:50:12.987200 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:12.987139 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6fdf5fbd67-s8c6d" podUID="6f8001d1-a59a-412b-acb9-b4a5c479b06b" containerName="registry" containerID="cri-o://088df1396d61cbcc40541690bd062e0bbf900d990bc137a57ccb833acf8f7d38" gracePeriod=30 Jun 10 16:50:13.154078 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:13.154040 2562 generic.go:356] "Generic (PLEG): container finished" podID="6f8001d1-a59a-412b-acb9-b4a5c479b06b" containerID="088df1396d61cbcc40541690bd062e0bbf900d990bc137a57ccb833acf8f7d38" exitCode=0 Jun 10 16:50:13.154257 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:13.154113 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6fdf5fbd67-s8c6d" event={"ID":"6f8001d1-a59a-412b-acb9-b4a5c479b06b","Type":"ContainerDied","Data":"088df1396d61cbcc40541690bd062e0bbf900d990bc137a57ccb833acf8f7d38"} Jun 10 16:50:13.231956 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:13.231930 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6fdf5fbd67-s8c6d" Jun 10 16:50:13.292824 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:13.292750 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6f8001d1-a59a-412b-acb9-b4a5c479b06b-image-registry-private-configuration\") pod \"6f8001d1-a59a-412b-acb9-b4a5c479b06b\" (UID: \"6f8001d1-a59a-412b-acb9-b4a5c479b06b\") " Jun 10 16:50:13.292824 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:13.292801 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6f8001d1-a59a-412b-acb9-b4a5c479b06b-bound-sa-token\") pod \"6f8001d1-a59a-412b-acb9-b4a5c479b06b\" (UID: \"6f8001d1-a59a-412b-acb9-b4a5c479b06b\") " Jun 10 16:50:13.293040 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:13.292837 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6f8001d1-a59a-412b-acb9-b4a5c479b06b-registry-tls\") pod \"6f8001d1-a59a-412b-acb9-b4a5c479b06b\" (UID: \"6f8001d1-a59a-412b-acb9-b4a5c479b06b\") " Jun 10 16:50:13.293040 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:13.292867 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6f8001d1-a59a-412b-acb9-b4a5c479b06b-ca-trust-extracted\") pod \"6f8001d1-a59a-412b-acb9-b4a5c479b06b\" (UID: \"6f8001d1-a59a-412b-acb9-b4a5c479b06b\") " Jun 10 16:50:13.293040 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:13.292891 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6f8001d1-a59a-412b-acb9-b4a5c479b06b-trusted-ca\") pod \"6f8001d1-a59a-412b-acb9-b4a5c479b06b\" (UID: \"6f8001d1-a59a-412b-acb9-b4a5c479b06b\") " Jun 10 16:50:13.293040 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:13.292917 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6f8001d1-a59a-412b-acb9-b4a5c479b06b-installation-pull-secrets\") pod \"6f8001d1-a59a-412b-acb9-b4a5c479b06b\" (UID: \"6f8001d1-a59a-412b-acb9-b4a5c479b06b\") " Jun 10 16:50:13.293040 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:13.292963 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6f8001d1-a59a-412b-acb9-b4a5c479b06b-registry-certificates\") pod \"6f8001d1-a59a-412b-acb9-b4a5c479b06b\" (UID: \"6f8001d1-a59a-412b-acb9-b4a5c479b06b\") " Jun 10 16:50:13.293040 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:13.293000 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bf8qr\" (UniqueName: \"kubernetes.io/projected/6f8001d1-a59a-412b-acb9-b4a5c479b06b-kube-api-access-bf8qr\") pod \"6f8001d1-a59a-412b-acb9-b4a5c479b06b\" (UID: \"6f8001d1-a59a-412b-acb9-b4a5c479b06b\") " Jun 10 16:50:13.293367 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:13.293332 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f8001d1-a59a-412b-acb9-b4a5c479b06b-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "6f8001d1-a59a-412b-acb9-b4a5c479b06b" (UID: "6f8001d1-a59a-412b-acb9-b4a5c479b06b"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 16:50:13.293915 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:13.293870 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f8001d1-a59a-412b-acb9-b4a5c479b06b-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "6f8001d1-a59a-412b-acb9-b4a5c479b06b" (UID: "6f8001d1-a59a-412b-acb9-b4a5c479b06b"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 16:50:13.295421 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:13.295321 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f8001d1-a59a-412b-acb9-b4a5c479b06b-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "6f8001d1-a59a-412b-acb9-b4a5c479b06b" (UID: "6f8001d1-a59a-412b-acb9-b4a5c479b06b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 16:50:13.295772 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:13.295484 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f8001d1-a59a-412b-acb9-b4a5c479b06b-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "6f8001d1-a59a-412b-acb9-b4a5c479b06b" (UID: "6f8001d1-a59a-412b-acb9-b4a5c479b06b"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 16:50:13.295853 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:13.295830 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f8001d1-a59a-412b-acb9-b4a5c479b06b-kube-api-access-bf8qr" (OuterVolumeSpecName: "kube-api-access-bf8qr") pod "6f8001d1-a59a-412b-acb9-b4a5c479b06b" (UID: "6f8001d1-a59a-412b-acb9-b4a5c479b06b"). InnerVolumeSpecName "kube-api-access-bf8qr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 16:50:13.295902 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:13.295848 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f8001d1-a59a-412b-acb9-b4a5c479b06b-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "6f8001d1-a59a-412b-acb9-b4a5c479b06b" (UID: "6f8001d1-a59a-412b-acb9-b4a5c479b06b"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 16:50:13.295939 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:13.295908 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f8001d1-a59a-412b-acb9-b4a5c479b06b-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "6f8001d1-a59a-412b-acb9-b4a5c479b06b" (UID: "6f8001d1-a59a-412b-acb9-b4a5c479b06b"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 16:50:13.301850 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:13.301826 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f8001d1-a59a-412b-acb9-b4a5c479b06b-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "6f8001d1-a59a-412b-acb9-b4a5c479b06b" (UID: "6f8001d1-a59a-412b-acb9-b4a5c479b06b"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 16:50:13.393978 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:13.393930 2562 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6f8001d1-a59a-412b-acb9-b4a5c479b06b-ca-trust-extracted\") on node \"ip-10-0-143-240.ec2.internal\" DevicePath \"\"" Jun 10 16:50:13.393978 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:13.393972 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6f8001d1-a59a-412b-acb9-b4a5c479b06b-trusted-ca\") on node \"ip-10-0-143-240.ec2.internal\" DevicePath \"\"" Jun 10 16:50:13.393978 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:13.393982 2562 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6f8001d1-a59a-412b-acb9-b4a5c479b06b-installation-pull-secrets\") on node \"ip-10-0-143-240.ec2.internal\" DevicePath \"\"" Jun 10 16:50:13.393978 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:13.393992 2562 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6f8001d1-a59a-412b-acb9-b4a5c479b06b-registry-certificates\") on node \"ip-10-0-143-240.ec2.internal\" DevicePath \"\"" Jun 10 16:50:13.393978 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:13.394000 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bf8qr\" (UniqueName: \"kubernetes.io/projected/6f8001d1-a59a-412b-acb9-b4a5c479b06b-kube-api-access-bf8qr\") on node \"ip-10-0-143-240.ec2.internal\" DevicePath \"\"" Jun 10 16:50:13.394278 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:13.394010 2562 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6f8001d1-a59a-412b-acb9-b4a5c479b06b-image-registry-private-configuration\") on node \"ip-10-0-143-240.ec2.internal\" DevicePath \"\"" Jun 10 16:50:13.394278 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:13.394019 2562 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6f8001d1-a59a-412b-acb9-b4a5c479b06b-bound-sa-token\") on node \"ip-10-0-143-240.ec2.internal\" DevicePath \"\"" Jun 10 16:50:13.394278 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:13.394027 2562 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6f8001d1-a59a-412b-acb9-b4a5c479b06b-registry-tls\") on node \"ip-10-0-143-240.ec2.internal\" DevicePath \"\"" Jun 10 16:50:14.159676 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:14.159621 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6fdf5fbd67-s8c6d" event={"ID":"6f8001d1-a59a-412b-acb9-b4a5c479b06b","Type":"ContainerDied","Data":"f3ed8dec5506ea0da9eed5bf3069fa6530688554a5e575d9fc2b25e25f1665fd"} Jun 10 16:50:14.159676 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:14.159667 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6fdf5fbd67-s8c6d" Jun 10 16:50:14.160186 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:14.159704 2562 scope.go:117] "RemoveContainer" containerID="088df1396d61cbcc40541690bd062e0bbf900d990bc137a57ccb833acf8f7d38" Jun 10 16:50:14.184904 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:14.184876 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6fdf5fbd67-s8c6d"] Jun 10 16:50:14.189236 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:14.189213 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6fdf5fbd67-s8c6d"] Jun 10 16:50:14.947386 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:50:14.947350 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f8001d1-a59a-412b-acb9-b4a5c479b06b" path="/var/lib/kubelet/pods/6f8001d1-a59a-412b-acb9-b4a5c479b06b/volumes" Jun 10 16:51:01.467163 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:51:01.467122 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:51:01.483160 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:51:01.483138 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:51:02.368225 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:51:02.368196 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 16:52:18.401214 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:52:18.401182 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-l6rvr"] Jun 10 16:52:18.401686 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:52:18.401476 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f8001d1-a59a-412b-acb9-b4a5c479b06b" containerName="registry" Jun 10 16:52:18.401686 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:52:18.401486 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f8001d1-a59a-412b-acb9-b4a5c479b06b" containerName="registry" Jun 10 16:52:18.401686 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:52:18.401535 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f8001d1-a59a-412b-acb9-b4a5c479b06b" containerName="registry" Jun 10 16:52:18.404393 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:52:18.404372 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-l6rvr" Jun 10 16:52:18.406594 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:52:18.406572 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 10 16:52:18.406742 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:52:18.406682 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-xj72w\"" Jun 10 16:52:18.406811 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:52:18.406755 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 10 16:52:18.413550 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:52:18.413529 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-l6rvr"] Jun 10 16:52:18.435733 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:52:18.435702 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/13b2cdb3-63a4-4c2b-b65a-142dbcc075d1-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-l6rvr\" (UID: \"13b2cdb3-63a4-4c2b-b65a-142dbcc075d1\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-l6rvr" Jun 10 16:52:18.435878 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:52:18.435757 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mg2f\" (UniqueName: \"kubernetes.io/projected/13b2cdb3-63a4-4c2b-b65a-142dbcc075d1-kube-api-access-4mg2f\") pod \"cert-manager-cainjector-5d99449ffd-l6rvr\" (UID: \"13b2cdb3-63a4-4c2b-b65a-142dbcc075d1\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-l6rvr" Jun 10 16:52:18.536348 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:52:18.536314 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/13b2cdb3-63a4-4c2b-b65a-142dbcc075d1-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-l6rvr\" (UID: \"13b2cdb3-63a4-4c2b-b65a-142dbcc075d1\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-l6rvr" Jun 10 16:52:18.536529 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:52:18.536358 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mg2f\" (UniqueName: \"kubernetes.io/projected/13b2cdb3-63a4-4c2b-b65a-142dbcc075d1-kube-api-access-4mg2f\") pod \"cert-manager-cainjector-5d99449ffd-l6rvr\" (UID: \"13b2cdb3-63a4-4c2b-b65a-142dbcc075d1\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-l6rvr" Jun 10 16:52:18.546236 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:52:18.546207 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/13b2cdb3-63a4-4c2b-b65a-142dbcc075d1-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-l6rvr\" (UID: \"13b2cdb3-63a4-4c2b-b65a-142dbcc075d1\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-l6rvr" Jun 10 16:52:18.546816 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:52:18.546798 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mg2f\" (UniqueName: \"kubernetes.io/projected/13b2cdb3-63a4-4c2b-b65a-142dbcc075d1-kube-api-access-4mg2f\") pod \"cert-manager-cainjector-5d99449ffd-l6rvr\" (UID: \"13b2cdb3-63a4-4c2b-b65a-142dbcc075d1\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-l6rvr" Jun 10 16:52:18.726197 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:52:18.726108 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-l6rvr" Jun 10 16:52:18.856967 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:52:18.856933 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-l6rvr"] Jun 10 16:52:18.860330 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:52:18.860302 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod13b2cdb3_63a4_4c2b_b65a_142dbcc075d1.slice/crio-dec9675236339f3747ee83fec38ee4e97d094d405324bc958254d5a2fe17470a WatchSource:0}: Error finding container dec9675236339f3747ee83fec38ee4e97d094d405324bc958254d5a2fe17470a: Status 404 returned error can't find the container with id dec9675236339f3747ee83fec38ee4e97d094d405324bc958254d5a2fe17470a Jun 10 16:52:18.862201 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:52:18.862180 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 16:52:19.649578 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:52:19.649531 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-l6rvr" event={"ID":"13b2cdb3-63a4-4c2b-b65a-142dbcc075d1","Type":"ContainerStarted","Data":"dec9675236339f3747ee83fec38ee4e97d094d405324bc958254d5a2fe17470a"} Jun 10 16:52:22.662505 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:52:22.662467 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-l6rvr" event={"ID":"13b2cdb3-63a4-4c2b-b65a-142dbcc075d1","Type":"ContainerStarted","Data":"bb60a2004b378cd25479b190ff67fae72d45e7b4c8ac5f2aeb8116b783839a69"} Jun 10 16:52:22.686015 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:52:22.685970 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-l6rvr" podStartSLOduration=1.723897922 podStartE2EDuration="4.685955142s" totalImagesPullingTime="2.96205722s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:52:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:52:22.684497171 +0000 UTC m=+462.208710241" watchObservedRunningTime="2026-06-10 16:52:22.685955142 +0000 UTC m=+462.210168214" Jun 10 16:52:54.499787 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:52:54.499747 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5b699dc98-jfx9w"] Jun 10 16:52:54.503156 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:52:54.503137 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5b699dc98-jfx9w" Jun 10 16:52:54.507184 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:52:54.507164 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-t289x\"" Jun 10 16:52:54.507690 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:52:54.507669 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 10 16:52:54.507787 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:52:54.507697 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 10 16:52:54.507787 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:52:54.507699 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 10 16:52:54.507787 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:52:54.507712 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 10 16:52:54.507787 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:52:54.507701 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 10 16:52:54.524784 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:52:54.524760 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5b699dc98-jfx9w"] Jun 10 16:52:54.561575 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:52:54.561546 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2544dd78-9acb-4f6e-b0f9-f1a725c8dbe4-metrics-cert\") pod \"lws-controller-manager-5b699dc98-jfx9w\" (UID: \"2544dd78-9acb-4f6e-b0f9-f1a725c8dbe4\") " pod="openshift-lws-operator/lws-controller-manager-5b699dc98-jfx9w" Jun 10 16:52:54.561738 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:52:54.561582 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2544dd78-9acb-4f6e-b0f9-f1a725c8dbe4-cert\") pod \"lws-controller-manager-5b699dc98-jfx9w\" (UID: \"2544dd78-9acb-4f6e-b0f9-f1a725c8dbe4\") " pod="openshift-lws-operator/lws-controller-manager-5b699dc98-jfx9w" Jun 10 16:52:54.561738 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:52:54.561597 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2544dd78-9acb-4f6e-b0f9-f1a725c8dbe4-manager-config\") pod \"lws-controller-manager-5b699dc98-jfx9w\" (UID: \"2544dd78-9acb-4f6e-b0f9-f1a725c8dbe4\") " pod="openshift-lws-operator/lws-controller-manager-5b699dc98-jfx9w" Jun 10 16:52:54.561738 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:52:54.561641 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rt78\" (UniqueName: \"kubernetes.io/projected/2544dd78-9acb-4f6e-b0f9-f1a725c8dbe4-kube-api-access-6rt78\") pod \"lws-controller-manager-5b699dc98-jfx9w\" (UID: \"2544dd78-9acb-4f6e-b0f9-f1a725c8dbe4\") " pod="openshift-lws-operator/lws-controller-manager-5b699dc98-jfx9w" Jun 10 16:52:54.662090 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:52:54.662056 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2544dd78-9acb-4f6e-b0f9-f1a725c8dbe4-metrics-cert\") pod \"lws-controller-manager-5b699dc98-jfx9w\" (UID: \"2544dd78-9acb-4f6e-b0f9-f1a725c8dbe4\") " pod="openshift-lws-operator/lws-controller-manager-5b699dc98-jfx9w" Jun 10 16:52:54.662299 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:52:54.662121 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2544dd78-9acb-4f6e-b0f9-f1a725c8dbe4-cert\") pod \"lws-controller-manager-5b699dc98-jfx9w\" (UID: \"2544dd78-9acb-4f6e-b0f9-f1a725c8dbe4\") " pod="openshift-lws-operator/lws-controller-manager-5b699dc98-jfx9w" Jun 10 16:52:54.662299 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:52:54.662150 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2544dd78-9acb-4f6e-b0f9-f1a725c8dbe4-manager-config\") pod \"lws-controller-manager-5b699dc98-jfx9w\" (UID: \"2544dd78-9acb-4f6e-b0f9-f1a725c8dbe4\") " pod="openshift-lws-operator/lws-controller-manager-5b699dc98-jfx9w" Jun 10 16:52:54.662299 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:52:54.662188 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rt78\" (UniqueName: \"kubernetes.io/projected/2544dd78-9acb-4f6e-b0f9-f1a725c8dbe4-kube-api-access-6rt78\") pod \"lws-controller-manager-5b699dc98-jfx9w\" (UID: \"2544dd78-9acb-4f6e-b0f9-f1a725c8dbe4\") " pod="openshift-lws-operator/lws-controller-manager-5b699dc98-jfx9w" Jun 10 16:52:54.663182 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:52:54.663158 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2544dd78-9acb-4f6e-b0f9-f1a725c8dbe4-manager-config\") pod \"lws-controller-manager-5b699dc98-jfx9w\" (UID: \"2544dd78-9acb-4f6e-b0f9-f1a725c8dbe4\") " pod="openshift-lws-operator/lws-controller-manager-5b699dc98-jfx9w" Jun 10 16:52:54.664893 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:52:54.664865 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2544dd78-9acb-4f6e-b0f9-f1a725c8dbe4-cert\") pod \"lws-controller-manager-5b699dc98-jfx9w\" (UID: \"2544dd78-9acb-4f6e-b0f9-f1a725c8dbe4\") " pod="openshift-lws-operator/lws-controller-manager-5b699dc98-jfx9w" Jun 10 16:52:54.665035 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:52:54.665017 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2544dd78-9acb-4f6e-b0f9-f1a725c8dbe4-metrics-cert\") pod \"lws-controller-manager-5b699dc98-jfx9w\" (UID: \"2544dd78-9acb-4f6e-b0f9-f1a725c8dbe4\") " pod="openshift-lws-operator/lws-controller-manager-5b699dc98-jfx9w" Jun 10 16:52:54.672957 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:52:54.672936 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rt78\" (UniqueName: \"kubernetes.io/projected/2544dd78-9acb-4f6e-b0f9-f1a725c8dbe4-kube-api-access-6rt78\") pod \"lws-controller-manager-5b699dc98-jfx9w\" (UID: \"2544dd78-9acb-4f6e-b0f9-f1a725c8dbe4\") " pod="openshift-lws-operator/lws-controller-manager-5b699dc98-jfx9w" Jun 10 16:52:54.812243 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:52:54.812147 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5b699dc98-jfx9w" Jun 10 16:52:54.951967 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:52:54.951937 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2544dd78_9acb_4f6e_b0f9_f1a725c8dbe4.slice/crio-54b0bef7148e49b9bae0c8039219dd7213b2ee4b0c5c6feb4cbc4fc589009705 WatchSource:0}: Error finding container 54b0bef7148e49b9bae0c8039219dd7213b2ee4b0c5c6feb4cbc4fc589009705: Status 404 returned error can't find the container with id 54b0bef7148e49b9bae0c8039219dd7213b2ee4b0c5c6feb4cbc4fc589009705 Jun 10 16:52:54.953196 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:52:54.953164 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5b699dc98-jfx9w"] Jun 10 16:52:55.789850 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:52:55.789816 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5b699dc98-jfx9w" event={"ID":"2544dd78-9acb-4f6e-b0f9-f1a725c8dbe4","Type":"ContainerStarted","Data":"54b0bef7148e49b9bae0c8039219dd7213b2ee4b0c5c6feb4cbc4fc589009705"} Jun 10 16:52:56.404765 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:52:56.403406 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-696f888447-tvng9"] Jun 10 16:52:56.409092 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:52:56.409066 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-696f888447-tvng9" Jun 10 16:52:56.412385 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:52:56.411948 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 10 16:52:56.413116 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:52:56.413008 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 10 16:52:56.413116 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:52:56.413090 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 10 16:52:56.413505 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:52:56.413377 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 10 16:52:56.413505 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:52:56.413392 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-dr7hr\"" Jun 10 16:52:56.432337 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:52:56.432308 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-696f888447-tvng9"] Jun 10 16:52:56.479822 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:52:56.479785 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/45702933-4cc4-4790-8a39-396071b97238-tmp\") pod \"opendatahub-operator-controller-manager-696f888447-tvng9\" (UID: \"45702933-4cc4-4790-8a39-396071b97238\") " pod="opendatahub/opendatahub-operator-controller-manager-696f888447-tvng9" Jun 10 16:52:56.479982 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:52:56.479833 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqpnt\" (UniqueName: \"kubernetes.io/projected/45702933-4cc4-4790-8a39-396071b97238-kube-api-access-nqpnt\") pod \"opendatahub-operator-controller-manager-696f888447-tvng9\" (UID: \"45702933-4cc4-4790-8a39-396071b97238\") " pod="opendatahub/opendatahub-operator-controller-manager-696f888447-tvng9" Jun 10 16:52:56.479982 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:52:56.479876 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/45702933-4cc4-4790-8a39-396071b97238-manifests\") pod \"opendatahub-operator-controller-manager-696f888447-tvng9\" (UID: \"45702933-4cc4-4790-8a39-396071b97238\") " pod="opendatahub/opendatahub-operator-controller-manager-696f888447-tvng9" Jun 10 16:52:56.479982 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:52:56.479921 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/45702933-4cc4-4790-8a39-396071b97238-apiservice-cert\") pod \"opendatahub-operator-controller-manager-696f888447-tvng9\" (UID: \"45702933-4cc4-4790-8a39-396071b97238\") " pod="opendatahub/opendatahub-operator-controller-manager-696f888447-tvng9" Jun 10 16:52:56.480170 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:52:56.479990 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/45702933-4cc4-4790-8a39-396071b97238-webhook-cert\") pod \"opendatahub-operator-controller-manager-696f888447-tvng9\" (UID: \"45702933-4cc4-4790-8a39-396071b97238\") " pod="opendatahub/opendatahub-operator-controller-manager-696f888447-tvng9" Jun 10 16:52:56.581084 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:52:56.581044 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/45702933-4cc4-4790-8a39-396071b97238-apiservice-cert\") pod \"opendatahub-operator-controller-manager-696f888447-tvng9\" (UID: \"45702933-4cc4-4790-8a39-396071b97238\") " pod="opendatahub/opendatahub-operator-controller-manager-696f888447-tvng9" Jun 10 16:52:56.581284 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:52:56.581145 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/45702933-4cc4-4790-8a39-396071b97238-webhook-cert\") pod \"opendatahub-operator-controller-manager-696f888447-tvng9\" (UID: \"45702933-4cc4-4790-8a39-396071b97238\") " pod="opendatahub/opendatahub-operator-controller-manager-696f888447-tvng9" Jun 10 16:52:56.581284 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:52:56.581183 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/45702933-4cc4-4790-8a39-396071b97238-tmp\") pod \"opendatahub-operator-controller-manager-696f888447-tvng9\" (UID: \"45702933-4cc4-4790-8a39-396071b97238\") " pod="opendatahub/opendatahub-operator-controller-manager-696f888447-tvng9" Jun 10 16:52:56.581284 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:52:56.581216 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqpnt\" (UniqueName: \"kubernetes.io/projected/45702933-4cc4-4790-8a39-396071b97238-kube-api-access-nqpnt\") pod \"opendatahub-operator-controller-manager-696f888447-tvng9\" (UID: \"45702933-4cc4-4790-8a39-396071b97238\") " pod="opendatahub/opendatahub-operator-controller-manager-696f888447-tvng9" Jun 10 16:52:56.581284 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:52:56.581251 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/45702933-4cc4-4790-8a39-396071b97238-manifests\") pod \"opendatahub-operator-controller-manager-696f888447-tvng9\" (UID: \"45702933-4cc4-4790-8a39-396071b97238\") " pod="opendatahub/opendatahub-operator-controller-manager-696f888447-tvng9" Jun 10 16:52:56.581712 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:52:56.581673 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/45702933-4cc4-4790-8a39-396071b97238-manifests\") pod \"opendatahub-operator-controller-manager-696f888447-tvng9\" (UID: \"45702933-4cc4-4790-8a39-396071b97238\") " pod="opendatahub/opendatahub-operator-controller-manager-696f888447-tvng9" Jun 10 16:52:56.583774 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:52:56.583752 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/45702933-4cc4-4790-8a39-396071b97238-tmp\") pod \"opendatahub-operator-controller-manager-696f888447-tvng9\" (UID: \"45702933-4cc4-4790-8a39-396071b97238\") " pod="opendatahub/opendatahub-operator-controller-manager-696f888447-tvng9" Jun 10 16:52:56.584046 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:52:56.584026 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/45702933-4cc4-4790-8a39-396071b97238-webhook-cert\") pod \"opendatahub-operator-controller-manager-696f888447-tvng9\" (UID: \"45702933-4cc4-4790-8a39-396071b97238\") " pod="opendatahub/opendatahub-operator-controller-manager-696f888447-tvng9" Jun 10 16:52:56.584120 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:52:56.584042 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/45702933-4cc4-4790-8a39-396071b97238-apiservice-cert\") pod \"opendatahub-operator-controller-manager-696f888447-tvng9\" (UID: \"45702933-4cc4-4790-8a39-396071b97238\") " pod="opendatahub/opendatahub-operator-controller-manager-696f888447-tvng9" Jun 10 16:52:56.597401 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:52:56.597372 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqpnt\" (UniqueName: \"kubernetes.io/projected/45702933-4cc4-4790-8a39-396071b97238-kube-api-access-nqpnt\") pod \"opendatahub-operator-controller-manager-696f888447-tvng9\" (UID: \"45702933-4cc4-4790-8a39-396071b97238\") " pod="opendatahub/opendatahub-operator-controller-manager-696f888447-tvng9" Jun 10 16:52:56.727379 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:52:56.727290 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-696f888447-tvng9" Jun 10 16:52:56.876276 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:52:56.876239 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-696f888447-tvng9"] Jun 10 16:52:57.778508 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:52:57.778471 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45702933_4cc4_4790_8a39_396071b97238.slice/crio-3fb3b57ab9d42354d4e49128e4d9b4c6670e432c6e61c17889b1aa1db22be8de WatchSource:0}: Error finding container 3fb3b57ab9d42354d4e49128e4d9b4c6670e432c6e61c17889b1aa1db22be8de: Status 404 returned error can't find the container with id 3fb3b57ab9d42354d4e49128e4d9b4c6670e432c6e61c17889b1aa1db22be8de Jun 10 16:52:57.801926 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:52:57.801892 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-696f888447-tvng9" event={"ID":"45702933-4cc4-4790-8a39-396071b97238","Type":"ContainerStarted","Data":"3fb3b57ab9d42354d4e49128e4d9b4c6670e432c6e61c17889b1aa1db22be8de"} Jun 10 16:52:58.809826 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:52:58.809788 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5b699dc98-jfx9w" event={"ID":"2544dd78-9acb-4f6e-b0f9-f1a725c8dbe4","Type":"ContainerStarted","Data":"8b2f8f9ad33eae878931dee7d2308a8c6c37f1f0d5753168e274516cb453c742"} Jun 10 16:52:58.810326 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:52:58.809965 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5b699dc98-jfx9w" Jun 10 16:52:58.832400 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:52:58.832341 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5b699dc98-jfx9w" podStartSLOduration=1.977459394 podStartE2EDuration="4.832323384s" totalImagesPullingTime="2.85486399s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:52:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:52:58.83091067 +0000 UTC m=+498.355123741" watchObservedRunningTime="2026-06-10 16:52:58.832323384 +0000 UTC m=+498.356536454" Jun 10 16:53:00.820825 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:53:00.820781 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-696f888447-tvng9" event={"ID":"45702933-4cc4-4790-8a39-396071b97238","Type":"ContainerStarted","Data":"adda5253e95996121ce72c68ddfb3b209182c0272f3a2b9ce5b2aea645564b46"} Jun 10 16:53:01.826941 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:53:01.826903 2562 generic.go:356] "Generic (PLEG): container finished" podID="45702933-4cc4-4790-8a39-396071b97238" containerID="adda5253e95996121ce72c68ddfb3b209182c0272f3a2b9ce5b2aea645564b46" exitCode=0 Jun 10 16:53:01.827330 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:53:01.826989 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-696f888447-tvng9" event={"ID":"45702933-4cc4-4790-8a39-396071b97238","Type":"ContainerDied","Data":"adda5253e95996121ce72c68ddfb3b209182c0272f3a2b9ce5b2aea645564b46"} Jun 10 16:53:02.833488 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:53:02.833452 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-696f888447-tvng9" event={"ID":"45702933-4cc4-4790-8a39-396071b97238","Type":"ContainerStarted","Data":"43a97cccdd99240a6c888a7eff08fb4ca8025be1fb3e778135d23905aa04ed6f"} Jun 10 16:53:02.833880 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:53:02.833572 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-696f888447-tvng9" Jun 10 16:53:02.860434 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:53:02.860388 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-696f888447-tvng9" podStartSLOduration=2.626111185 podStartE2EDuration="6.860372331s" totalImagesPullingTime="3.298606222s" totalInitContainerRuntime="935.654924ms" isStatefulPod=false podCreationTimestamp="2026-06-10 16:52:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:53:02.859516615 +0000 UTC m=+502.383729685" watchObservedRunningTime="2026-06-10 16:53:02.860372331 +0000 UTC m=+502.384585401" Jun 10 16:53:09.816422 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:53:09.816391 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5b699dc98-jfx9w" Jun 10 16:53:13.840099 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:53:13.840066 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-696f888447-tvng9" Jun 10 16:53:16.148707 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:53:16.148667 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-67bbd649b8-prvf7"] Jun 10 16:53:16.158008 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:53:16.157980 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-67bbd649b8-prvf7" Jun 10 16:53:16.162325 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:53:16.162272 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 10 16:53:16.163045 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:53:16.162785 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-4q92m\"" Jun 10 16:53:16.163045 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:53:16.162786 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 10 16:53:16.163045 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:53:16.163002 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 10 16:53:16.163275 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:53:16.163194 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 10 16:53:16.179033 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:53:16.179007 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-67bbd649b8-prvf7"] Jun 10 16:53:16.255772 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:53:16.255741 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e473311-eebd-4930-8049-ce66bd17ad3a-tls-certs\") pod \"kube-auth-proxy-67bbd649b8-prvf7\" (UID: \"2e473311-eebd-4930-8049-ce66bd17ad3a\") " pod="openshift-ingress/kube-auth-proxy-67bbd649b8-prvf7" Jun 10 16:53:16.255983 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:53:16.255830 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e473311-eebd-4930-8049-ce66bd17ad3a-tmp\") pod \"kube-auth-proxy-67bbd649b8-prvf7\" (UID: \"2e473311-eebd-4930-8049-ce66bd17ad3a\") " pod="openshift-ingress/kube-auth-proxy-67bbd649b8-prvf7" Jun 10 16:53:16.255983 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:53:16.255860 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dr5jl\" (UniqueName: \"kubernetes.io/projected/2e473311-eebd-4930-8049-ce66bd17ad3a-kube-api-access-dr5jl\") pod \"kube-auth-proxy-67bbd649b8-prvf7\" (UID: \"2e473311-eebd-4930-8049-ce66bd17ad3a\") " pod="openshift-ingress/kube-auth-proxy-67bbd649b8-prvf7" Jun 10 16:53:16.357067 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:53:16.357032 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e473311-eebd-4930-8049-ce66bd17ad3a-tls-certs\") pod \"kube-auth-proxy-67bbd649b8-prvf7\" (UID: \"2e473311-eebd-4930-8049-ce66bd17ad3a\") " pod="openshift-ingress/kube-auth-proxy-67bbd649b8-prvf7" Jun 10 16:53:16.357276 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:53:16.357110 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e473311-eebd-4930-8049-ce66bd17ad3a-tmp\") pod \"kube-auth-proxy-67bbd649b8-prvf7\" (UID: \"2e473311-eebd-4930-8049-ce66bd17ad3a\") " pod="openshift-ingress/kube-auth-proxy-67bbd649b8-prvf7" Jun 10 16:53:16.357276 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:53:16.357140 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dr5jl\" (UniqueName: \"kubernetes.io/projected/2e473311-eebd-4930-8049-ce66bd17ad3a-kube-api-access-dr5jl\") pod \"kube-auth-proxy-67bbd649b8-prvf7\" (UID: \"2e473311-eebd-4930-8049-ce66bd17ad3a\") " pod="openshift-ingress/kube-auth-proxy-67bbd649b8-prvf7" Jun 10 16:53:16.359540 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:53:16.359515 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e473311-eebd-4930-8049-ce66bd17ad3a-tmp\") pod \"kube-auth-proxy-67bbd649b8-prvf7\" (UID: \"2e473311-eebd-4930-8049-ce66bd17ad3a\") " pod="openshift-ingress/kube-auth-proxy-67bbd649b8-prvf7" Jun 10 16:53:16.360041 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:53:16.360019 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e473311-eebd-4930-8049-ce66bd17ad3a-tls-certs\") pod \"kube-auth-proxy-67bbd649b8-prvf7\" (UID: \"2e473311-eebd-4930-8049-ce66bd17ad3a\") " pod="openshift-ingress/kube-auth-proxy-67bbd649b8-prvf7" Jun 10 16:53:16.376587 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:53:16.376553 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dr5jl\" (UniqueName: \"kubernetes.io/projected/2e473311-eebd-4930-8049-ce66bd17ad3a-kube-api-access-dr5jl\") pod \"kube-auth-proxy-67bbd649b8-prvf7\" (UID: \"2e473311-eebd-4930-8049-ce66bd17ad3a\") " pod="openshift-ingress/kube-auth-proxy-67bbd649b8-prvf7" Jun 10 16:53:16.470203 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:53:16.470121 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-67bbd649b8-prvf7" Jun 10 16:53:16.621218 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:53:16.621186 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-67bbd649b8-prvf7"] Jun 10 16:53:16.624375 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:53:16.624347 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e473311_eebd_4930_8049_ce66bd17ad3a.slice/crio-8b3688a31a7fd2aee27ef03af2053677f0146cb206419d159d1ab4419219e4fa WatchSource:0}: Error finding container 8b3688a31a7fd2aee27ef03af2053677f0146cb206419d159d1ab4419219e4fa: Status 404 returned error can't find the container with id 8b3688a31a7fd2aee27ef03af2053677f0146cb206419d159d1ab4419219e4fa Jun 10 16:53:16.904430 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:53:16.904394 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-67bbd649b8-prvf7" event={"ID":"2e473311-eebd-4930-8049-ce66bd17ad3a","Type":"ContainerStarted","Data":"8b3688a31a7fd2aee27ef03af2053677f0146cb206419d159d1ab4419219e4fa"} Jun 10 16:53:19.919528 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:53:19.919491 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-67bbd649b8-prvf7" event={"ID":"2e473311-eebd-4930-8049-ce66bd17ad3a","Type":"ContainerStarted","Data":"9138522ec28b6747efae0433e452e79c36275983e88f9c8e31e8668744fb6ea8"} Jun 10 16:53:19.939807 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:53:19.939752 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-67bbd649b8-prvf7" podStartSLOduration=1.114862317 podStartE2EDuration="3.939731213s" totalImagesPullingTime="2.824868896s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:53:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:53:19.937586817 +0000 UTC m=+519.461799888" watchObservedRunningTime="2026-06-10 16:53:19.939731213 +0000 UTC m=+519.463944284" Jun 10 16:53:45.302480 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:53:45.302400 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-6785b76bc9-k8k6v"] Jun 10 16:53:45.310460 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:53:45.310430 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6785b76bc9-k8k6v" Jun 10 16:53:45.314117 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:53:45.314096 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 10 16:53:45.314328 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:53:45.314309 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-k7dwj\"" Jun 10 16:53:45.321034 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:53:45.321011 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6785b76bc9-k8k6v"] Jun 10 16:53:45.418243 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:53:45.418208 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tzml\" (UniqueName: \"kubernetes.io/projected/3b1b801b-bfa5-4b56-8207-334a9d9969b3-kube-api-access-8tzml\") pod \"dashboard-redirect-6785b76bc9-k8k6v\" (UID: \"3b1b801b-bfa5-4b56-8207-334a9d9969b3\") " pod="opendatahub/dashboard-redirect-6785b76bc9-k8k6v" Jun 10 16:53:45.418427 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:53:45.418255 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/3b1b801b-bfa5-4b56-8207-334a9d9969b3-redirect-config\") pod \"dashboard-redirect-6785b76bc9-k8k6v\" (UID: \"3b1b801b-bfa5-4b56-8207-334a9d9969b3\") " pod="opendatahub/dashboard-redirect-6785b76bc9-k8k6v" Jun 10 16:53:45.518814 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:53:45.518777 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tzml\" (UniqueName: \"kubernetes.io/projected/3b1b801b-bfa5-4b56-8207-334a9d9969b3-kube-api-access-8tzml\") pod \"dashboard-redirect-6785b76bc9-k8k6v\" (UID: \"3b1b801b-bfa5-4b56-8207-334a9d9969b3\") " pod="opendatahub/dashboard-redirect-6785b76bc9-k8k6v" Jun 10 16:53:45.519010 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:53:45.518824 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/3b1b801b-bfa5-4b56-8207-334a9d9969b3-redirect-config\") pod \"dashboard-redirect-6785b76bc9-k8k6v\" (UID: \"3b1b801b-bfa5-4b56-8207-334a9d9969b3\") " pod="opendatahub/dashboard-redirect-6785b76bc9-k8k6v" Jun 10 16:53:45.519567 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:53:45.519540 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/3b1b801b-bfa5-4b56-8207-334a9d9969b3-redirect-config\") pod \"dashboard-redirect-6785b76bc9-k8k6v\" (UID: \"3b1b801b-bfa5-4b56-8207-334a9d9969b3\") " pod="opendatahub/dashboard-redirect-6785b76bc9-k8k6v" Jun 10 16:53:45.527370 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:53:45.527343 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tzml\" (UniqueName: \"kubernetes.io/projected/3b1b801b-bfa5-4b56-8207-334a9d9969b3-kube-api-access-8tzml\") pod \"dashboard-redirect-6785b76bc9-k8k6v\" (UID: \"3b1b801b-bfa5-4b56-8207-334a9d9969b3\") " pod="opendatahub/dashboard-redirect-6785b76bc9-k8k6v" Jun 10 16:53:45.620844 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:53:45.620814 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6785b76bc9-k8k6v" Jun 10 16:53:45.752917 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:53:45.752883 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6785b76bc9-k8k6v"] Jun 10 16:53:45.755931 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:53:45.755897 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b1b801b_bfa5_4b56_8207_334a9d9969b3.slice/crio-ae6db6044c27b1fb81db90ff53072b7e9edbe8402db14001d98453c20103e4dc WatchSource:0}: Error finding container ae6db6044c27b1fb81db90ff53072b7e9edbe8402db14001d98453c20103e4dc: Status 404 returned error can't find the container with id ae6db6044c27b1fb81db90ff53072b7e9edbe8402db14001d98453c20103e4dc Jun 10 16:53:46.048108 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:53:46.048022 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6785b76bc9-k8k6v" event={"ID":"3b1b801b-bfa5-4b56-8207-334a9d9969b3","Type":"ContainerStarted","Data":"ae6db6044c27b1fb81db90ff53072b7e9edbe8402db14001d98453c20103e4dc"} Jun 10 16:53:51.073956 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:53:51.073912 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6785b76bc9-k8k6v" event={"ID":"3b1b801b-bfa5-4b56-8207-334a9d9969b3","Type":"ContainerStarted","Data":"28390f1e6a244421335e4d9b43a0acfa23576944530e694e92e213252621d7d0"} Jun 10 16:53:51.097454 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:53:51.097404 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-6785b76bc9-k8k6v" podStartSLOduration=1.4258961 podStartE2EDuration="6.097388579s" totalImagesPullingTime="4.671492479s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:53:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:53:51.096556091 +0000 UTC m=+550.620769158" watchObservedRunningTime="2026-06-10 16:53:51.097388579 +0000 UTC m=+550.621601675" Jun 10 16:54:40.918554 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:54:40.918524 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mgpvj_df4f4a0a-8563-43bc-b1a9-c933a16dfa01/console-operator/2.log" Jun 10 16:54:40.919097 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:54:40.919080 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mgpvj_df4f4a0a-8563-43bc-b1a9-c933a16dfa01/console-operator/2.log" Jun 10 16:54:40.922793 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:54:40.922769 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p96z8_a9624b92-752b-4888-99da-f864e807a6f0/ovn-acl-logging/0.log" Jun 10 16:54:40.923516 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:54:40.923496 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p96z8_a9624b92-752b-4888-99da-f864e807a6f0/ovn-acl-logging/0.log" Jun 10 16:54:54.661820 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:54:54.661786 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-49fr6"] Jun 10 16:54:54.664258 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:54:54.664240 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-49fr6" Jun 10 16:54:54.666692 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:54:54.666669 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 10 16:54:54.666812 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:54:54.666716 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 10 16:54:54.666873 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:54:54.666852 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 10 16:54:54.667387 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:54:54.667364 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-ft79b\"" Jun 10 16:54:54.667499 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:54:54.667396 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 10 16:54:54.675716 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:54:54.675694 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-49fr6"] Jun 10 16:54:54.847166 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:54:54.847139 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5092d086-e5d7-4181-bfd0-df341566c732-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-49fr6\" (UID: \"5092d086-e5d7-4181-bfd0-df341566c732\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-49fr6" Jun 10 16:54:54.847338 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:54:54.847186 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5092d086-e5d7-4181-bfd0-df341566c732-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-49fr6\" (UID: \"5092d086-e5d7-4181-bfd0-df341566c732\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-49fr6" Jun 10 16:54:54.847338 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:54:54.847212 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zqhj\" (UniqueName: \"kubernetes.io/projected/5092d086-e5d7-4181-bfd0-df341566c732-kube-api-access-9zqhj\") pod \"kuadrant-console-plugin-66b5774985-49fr6\" (UID: \"5092d086-e5d7-4181-bfd0-df341566c732\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-49fr6" Jun 10 16:54:54.947859 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:54:54.947781 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5092d086-e5d7-4181-bfd0-df341566c732-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-49fr6\" (UID: \"5092d086-e5d7-4181-bfd0-df341566c732\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-49fr6" Jun 10 16:54:54.947859 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:54:54.947821 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zqhj\" (UniqueName: \"kubernetes.io/projected/5092d086-e5d7-4181-bfd0-df341566c732-kube-api-access-9zqhj\") pod \"kuadrant-console-plugin-66b5774985-49fr6\" (UID: \"5092d086-e5d7-4181-bfd0-df341566c732\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-49fr6" Jun 10 16:54:54.948087 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:54:54.947883 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5092d086-e5d7-4181-bfd0-df341566c732-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-49fr6\" (UID: \"5092d086-e5d7-4181-bfd0-df341566c732\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-49fr6" Jun 10 16:54:54.948408 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:54:54.948375 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5092d086-e5d7-4181-bfd0-df341566c732-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-49fr6\" (UID: \"5092d086-e5d7-4181-bfd0-df341566c732\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-49fr6" Jun 10 16:54:54.950465 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:54:54.950442 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5092d086-e5d7-4181-bfd0-df341566c732-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-49fr6\" (UID: \"5092d086-e5d7-4181-bfd0-df341566c732\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-49fr6" Jun 10 16:54:54.959233 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:54:54.959207 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zqhj\" (UniqueName: \"kubernetes.io/projected/5092d086-e5d7-4181-bfd0-df341566c732-kube-api-access-9zqhj\") pod \"kuadrant-console-plugin-66b5774985-49fr6\" (UID: \"5092d086-e5d7-4181-bfd0-df341566c732\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-49fr6" Jun 10 16:54:54.973973 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:54:54.973952 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-49fr6" Jun 10 16:54:55.104208 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:54:55.104176 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-49fr6"] Jun 10 16:54:55.107731 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:54:55.107697 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5092d086_e5d7_4181_bfd0_df341566c732.slice/crio-dcaed72db32f43ee3ccd1a722466ebd4a4b349148651d9255d365ead79ac58c1 WatchSource:0}: Error finding container dcaed72db32f43ee3ccd1a722466ebd4a4b349148651d9255d365ead79ac58c1: Status 404 returned error can't find the container with id dcaed72db32f43ee3ccd1a722466ebd4a4b349148651d9255d365ead79ac58c1 Jun 10 16:54:55.362391 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:54:55.362359 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-49fr6" event={"ID":"5092d086-e5d7-4181-bfd0-df341566c732","Type":"ContainerStarted","Data":"dcaed72db32f43ee3ccd1a722466ebd4a4b349148651d9255d365ead79ac58c1"} Jun 10 16:55:05.550930 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:55:05.550844 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7jhjn"] Jun 10 16:55:05.555398 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:55:05.555375 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7jhjn" Jun 10 16:55:05.557588 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:55:05.557562 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-n4tj9\"" Jun 10 16:55:05.569202 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:55:05.569175 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7jhjn"] Jun 10 16:55:05.653210 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:55:05.653156 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzbfk\" (UniqueName: \"kubernetes.io/projected/60769c4b-c196-4485-a291-3c28bd543d3a-kube-api-access-hzbfk\") pod \"kuadrant-operator-controller-manager-86878c769f-7jhjn\" (UID: \"60769c4b-c196-4485-a291-3c28bd543d3a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7jhjn" Jun 10 16:55:05.653399 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:55:05.653289 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/60769c4b-c196-4485-a291-3c28bd543d3a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-7jhjn\" (UID: \"60769c4b-c196-4485-a291-3c28bd543d3a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7jhjn" Jun 10 16:55:05.754579 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:55:05.754534 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzbfk\" (UniqueName: \"kubernetes.io/projected/60769c4b-c196-4485-a291-3c28bd543d3a-kube-api-access-hzbfk\") pod \"kuadrant-operator-controller-manager-86878c769f-7jhjn\" (UID: \"60769c4b-c196-4485-a291-3c28bd543d3a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7jhjn" Jun 10 16:55:05.754794 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:55:05.754623 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/60769c4b-c196-4485-a291-3c28bd543d3a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-7jhjn\" (UID: \"60769c4b-c196-4485-a291-3c28bd543d3a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7jhjn" Jun 10 16:55:05.755074 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:55:05.755047 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/60769c4b-c196-4485-a291-3c28bd543d3a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-7jhjn\" (UID: \"60769c4b-c196-4485-a291-3c28bd543d3a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7jhjn" Jun 10 16:55:05.765790 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:55:05.765764 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzbfk\" (UniqueName: \"kubernetes.io/projected/60769c4b-c196-4485-a291-3c28bd543d3a-kube-api-access-hzbfk\") pod \"kuadrant-operator-controller-manager-86878c769f-7jhjn\" (UID: \"60769c4b-c196-4485-a291-3c28bd543d3a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7jhjn" Jun 10 16:55:05.868274 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:55:05.868235 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7jhjn" Jun 10 16:55:20.214034 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:55:20.214007 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7jhjn"] Jun 10 16:55:20.216929 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:55:20.216900 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60769c4b_c196_4485_a291_3c28bd543d3a.slice/crio-038a0c73ed34d2d1d5e1af7909a920bbfc9fcf19ea6723f357bab7abf75fe18c WatchSource:0}: Error finding container 038a0c73ed34d2d1d5e1af7909a920bbfc9fcf19ea6723f357bab7abf75fe18c: Status 404 returned error can't find the container with id 038a0c73ed34d2d1d5e1af7909a920bbfc9fcf19ea6723f357bab7abf75fe18c Jun 10 16:55:20.489842 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:55:20.489762 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7jhjn" event={"ID":"60769c4b-c196-4485-a291-3c28bd543d3a","Type":"ContainerStarted","Data":"038a0c73ed34d2d1d5e1af7909a920bbfc9fcf19ea6723f357bab7abf75fe18c"} Jun 10 16:55:21.498405 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:55:21.498374 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-49fr6" event={"ID":"5092d086-e5d7-4181-bfd0-df341566c732","Type":"ContainerStarted","Data":"805773b6a2ab601ee422d6b113d7655c9a263e226e27a384c0d889ee35fb3946"} Jun 10 16:55:21.515741 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:55:21.515688 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-49fr6" podStartSLOduration=2.128472221 podStartE2EDuration="27.515670296s" totalImagesPullingTime="25.387198075s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:54:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:55:21.514652503 +0000 UTC m=+641.038865574" watchObservedRunningTime="2026-06-10 16:55:21.515670296 +0000 UTC m=+641.039883366" Jun 10 16:55:28.534483 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:55:28.534443 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7jhjn" event={"ID":"60769c4b-c196-4485-a291-3c28bd543d3a","Type":"ContainerStarted","Data":"285eaf7ae65f2ac3747278d3ceb238438f298dbb9ec00f3468ee3977dc597047"} Jun 10 16:55:28.535003 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:55:28.534546 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7jhjn" Jun 10 16:55:28.556221 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:55:28.556165 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7jhjn" podStartSLOduration=16.12638445 podStartE2EDuration="23.556149575s" totalImagesPullingTime="7.429765125s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:55:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:55:28.554100488 +0000 UTC m=+648.078313559" watchObservedRunningTime="2026-06-10 16:55:28.556149575 +0000 UTC m=+648.080362645" Jun 10 16:55:39.541992 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:55:39.541962 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7jhjn" Jun 10 16:57:06.665970 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:06.665833 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 16:57:06.668762 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:06.668745 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 16:57:06.670965 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:06.670940 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 10 16:57:06.671081 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:06.670940 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 10 16:57:06.671081 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:06.671053 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 10 16:57:06.671690 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:06.671674 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-gfkgp\"" Jun 10 16:57:06.677578 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:06.677557 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 16:57:06.740001 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:06.739963 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bvh7\" (UniqueName: \"kubernetes.io/projected/16cfe4c0-82cb-4096-b4b5-dba1b9867f86-kube-api-access-2bvh7\") pod \"maas-keycloak-0\" (UID: \"16cfe4c0-82cb-4096-b4b5-dba1b9867f86\") " pod="keycloak-system/maas-keycloak-0" Jun 10 16:57:06.841024 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:06.840990 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bvh7\" (UniqueName: \"kubernetes.io/projected/16cfe4c0-82cb-4096-b4b5-dba1b9867f86-kube-api-access-2bvh7\") pod \"maas-keycloak-0\" (UID: \"16cfe4c0-82cb-4096-b4b5-dba1b9867f86\") " pod="keycloak-system/maas-keycloak-0" Jun 10 16:57:06.849655 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:06.849598 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bvh7\" (UniqueName: \"kubernetes.io/projected/16cfe4c0-82cb-4096-b4b5-dba1b9867f86-kube-api-access-2bvh7\") pod \"maas-keycloak-0\" (UID: \"16cfe4c0-82cb-4096-b4b5-dba1b9867f86\") " pod="keycloak-system/maas-keycloak-0" Jun 10 16:57:06.979895 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:06.979815 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 16:57:07.115869 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:07.115842 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 16:57:07.118021 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:57:07.117996 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16cfe4c0_82cb_4096_b4b5_dba1b9867f86.slice/crio-d448e1311938513caa17d6780000129d61b64e39b7453c79b582abf9a003951e WatchSource:0}: Error finding container d448e1311938513caa17d6780000129d61b64e39b7453c79b582abf9a003951e: Status 404 returned error can't find the container with id d448e1311938513caa17d6780000129d61b64e39b7453c79b582abf9a003951e Jun 10 16:57:07.981526 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:07.981478 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"16cfe4c0-82cb-4096-b4b5-dba1b9867f86","Type":"ContainerStarted","Data":"d448e1311938513caa17d6780000129d61b64e39b7453c79b582abf9a003951e"} Jun 10 16:57:13.012752 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:13.012706 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"16cfe4c0-82cb-4096-b4b5-dba1b9867f86","Type":"ContainerStarted","Data":"53ebf55dbffb3d8be9b9df31d65632df881cd2735766eb43a2c116b5bb14aa0f"} Jun 10 16:57:13.033284 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:13.033216 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.691023474 podStartE2EDuration="7.033193212s" totalImagesPullingTime="5.342169738s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:57:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:57:13.031421704 +0000 UTC m=+752.555634812" watchObservedRunningTime="2026-06-10 16:57:13.033193212 +0000 UTC m=+752.557406284" Jun 10 16:57:13.980805 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:13.980757 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 10 16:57:13.982497 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:13.982456 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="16cfe4c0-82cb-4096-b4b5-dba1b9867f86" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.29:9000/health/started\": dial tcp 10.132.0.29:9000: connect: connection refused" Jun 10 16:57:14.980302 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:14.980260 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="16cfe4c0-82cb-4096-b4b5-dba1b9867f86" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.29:9000/health/started\": dial tcp 10.132.0.29:9000: connect: connection refused" Jun 10 16:57:15.980695 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:15.980649 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="16cfe4c0-82cb-4096-b4b5-dba1b9867f86" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.29:9000/health/started\": dial tcp 10.132.0.29:9000: connect: connection refused" Jun 10 16:57:16.980186 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:16.980144 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 10 16:57:16.980928 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:16.980506 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="16cfe4c0-82cb-4096-b4b5-dba1b9867f86" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.29:9000/health/started\": dial tcp 10.132.0.29:9000: connect: connection refused" Jun 10 16:57:17.980321 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:17.980273 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="16cfe4c0-82cb-4096-b4b5-dba1b9867f86" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.29:9000/health/started\": dial tcp 10.132.0.29:9000: connect: connection refused" Jun 10 16:57:18.981256 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:18.981208 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="16cfe4c0-82cb-4096-b4b5-dba1b9867f86" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.29:9000/health/started\": dial tcp 10.132.0.29:9000: connect: connection refused" Jun 10 16:57:19.981105 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:19.981050 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="16cfe4c0-82cb-4096-b4b5-dba1b9867f86" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.29:9000/health/started\": dial tcp 10.132.0.29:9000: connect: connection refused" Jun 10 16:57:20.980112 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:20.980067 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="16cfe4c0-82cb-4096-b4b5-dba1b9867f86" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.29:9000/health/started\": dial tcp 10.132.0.29:9000: connect: connection refused" Jun 10 16:57:21.981189 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:21.981138 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="16cfe4c0-82cb-4096-b4b5-dba1b9867f86" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.29:9000/health/started\": dial tcp 10.132.0.29:9000: connect: connection refused" Jun 10 16:57:22.981243 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:22.981193 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="16cfe4c0-82cb-4096-b4b5-dba1b9867f86" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.29:9000/health/started\": dial tcp 10.132.0.29:9000: connect: connection refused" Jun 10 16:57:23.980576 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:23.980535 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="16cfe4c0-82cb-4096-b4b5-dba1b9867f86" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.29:9000/health/started\": dial tcp 10.132.0.29:9000: connect: connection refused" Jun 10 16:57:24.980393 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:24.980355 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="16cfe4c0-82cb-4096-b4b5-dba1b9867f86" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.29:9000/health/started\": dial tcp 10.132.0.29:9000: connect: connection refused" Jun 10 16:57:26.103375 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:26.103341 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 10 16:57:26.117317 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:26.117260 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="16cfe4c0-82cb-4096-b4b5-dba1b9867f86" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 16:57:36.109895 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:36.109858 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 10 16:57:42.536519 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:42.536479 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-58557849cf-qgqhb"] Jun 10 16:57:42.545419 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:42.545396 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58557849cf-qgqhb" Jun 10 16:57:42.548078 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:42.547990 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 10 16:57:42.548078 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:42.548054 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 10 16:57:42.548078 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:42.548076 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-6hkc2\"" Jun 10 16:57:42.549757 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:42.549734 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-58557849cf-qgqhb"] Jun 10 16:57:42.595022 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:42.594991 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m85qc\" (UniqueName: \"kubernetes.io/projected/f0819d0d-66a9-4ab8-acb3-0a1be45dc30f-kube-api-access-m85qc\") pod \"maas-controller-58557849cf-qgqhb\" (UID: \"f0819d0d-66a9-4ab8-acb3-0a1be45dc30f\") " pod="opendatahub/maas-controller-58557849cf-qgqhb" Jun 10 16:57:42.595181 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:42.595097 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f0819d0d-66a9-4ab8-acb3-0a1be45dc30f-webhook-cert\") pod \"maas-controller-58557849cf-qgqhb\" (UID: \"f0819d0d-66a9-4ab8-acb3-0a1be45dc30f\") " pod="opendatahub/maas-controller-58557849cf-qgqhb" Jun 10 16:57:42.696274 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:42.696243 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f0819d0d-66a9-4ab8-acb3-0a1be45dc30f-webhook-cert\") pod \"maas-controller-58557849cf-qgqhb\" (UID: \"f0819d0d-66a9-4ab8-acb3-0a1be45dc30f\") " pod="opendatahub/maas-controller-58557849cf-qgqhb" Jun 10 16:57:42.696436 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:42.696314 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m85qc\" (UniqueName: \"kubernetes.io/projected/f0819d0d-66a9-4ab8-acb3-0a1be45dc30f-kube-api-access-m85qc\") pod \"maas-controller-58557849cf-qgqhb\" (UID: \"f0819d0d-66a9-4ab8-acb3-0a1be45dc30f\") " pod="opendatahub/maas-controller-58557849cf-qgqhb" Jun 10 16:57:42.696436 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:57:42.696390 2562 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jun 10 16:57:42.696506 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:57:42.696470 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0819d0d-66a9-4ab8-acb3-0a1be45dc30f-webhook-cert podName:f0819d0d-66a9-4ab8-acb3-0a1be45dc30f nodeName:}" failed. No retries permitted until 2026-06-10 16:57:43.196448555 +0000 UTC m=+782.720661604 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/f0819d0d-66a9-4ab8-acb3-0a1be45dc30f-webhook-cert") pod "maas-controller-58557849cf-qgqhb" (UID: "f0819d0d-66a9-4ab8-acb3-0a1be45dc30f") : secret "maas-controller-webhook-cert" not found Jun 10 16:57:42.706295 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:42.706265 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m85qc\" (UniqueName: \"kubernetes.io/projected/f0819d0d-66a9-4ab8-acb3-0a1be45dc30f-kube-api-access-m85qc\") pod \"maas-controller-58557849cf-qgqhb\" (UID: \"f0819d0d-66a9-4ab8-acb3-0a1be45dc30f\") " pod="opendatahub/maas-controller-58557849cf-qgqhb" Jun 10 16:57:42.725411 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:42.725379 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-b9cfccf58-9zwdw"] Jun 10 16:57:42.728743 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:42.728723 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b9cfccf58-9zwdw" Jun 10 16:57:42.740418 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:42.740394 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-b9cfccf58-9zwdw"] Jun 10 16:57:42.797285 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:42.797190 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/484af365-6912-4582-a120-8f9f42dab5cd-webhook-cert\") pod \"maas-controller-b9cfccf58-9zwdw\" (UID: \"484af365-6912-4582-a120-8f9f42dab5cd\") " pod="opendatahub/maas-controller-b9cfccf58-9zwdw" Jun 10 16:57:42.797285 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:42.797277 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5gtr\" (UniqueName: \"kubernetes.io/projected/484af365-6912-4582-a120-8f9f42dab5cd-kube-api-access-f5gtr\") pod \"maas-controller-b9cfccf58-9zwdw\" (UID: \"484af365-6912-4582-a120-8f9f42dab5cd\") " pod="opendatahub/maas-controller-b9cfccf58-9zwdw" Jun 10 16:57:42.898219 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:42.898186 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/484af365-6912-4582-a120-8f9f42dab5cd-webhook-cert\") pod \"maas-controller-b9cfccf58-9zwdw\" (UID: \"484af365-6912-4582-a120-8f9f42dab5cd\") " pod="opendatahub/maas-controller-b9cfccf58-9zwdw" Jun 10 16:57:42.898411 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:42.898264 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5gtr\" (UniqueName: \"kubernetes.io/projected/484af365-6912-4582-a120-8f9f42dab5cd-kube-api-access-f5gtr\") pod \"maas-controller-b9cfccf58-9zwdw\" (UID: \"484af365-6912-4582-a120-8f9f42dab5cd\") " pod="opendatahub/maas-controller-b9cfccf58-9zwdw" Jun 10 16:57:42.898411 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:57:42.898319 2562 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jun 10 16:57:42.898411 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:57:42.898388 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/484af365-6912-4582-a120-8f9f42dab5cd-webhook-cert podName:484af365-6912-4582-a120-8f9f42dab5cd nodeName:}" failed. No retries permitted until 2026-06-10 16:57:43.398372664 +0000 UTC m=+782.922585712 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/484af365-6912-4582-a120-8f9f42dab5cd-webhook-cert") pod "maas-controller-b9cfccf58-9zwdw" (UID: "484af365-6912-4582-a120-8f9f42dab5cd") : secret "maas-controller-webhook-cert" not found Jun 10 16:57:42.906513 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:42.906486 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5gtr\" (UniqueName: \"kubernetes.io/projected/484af365-6912-4582-a120-8f9f42dab5cd-kube-api-access-f5gtr\") pod \"maas-controller-b9cfccf58-9zwdw\" (UID: \"484af365-6912-4582-a120-8f9f42dab5cd\") " pod="opendatahub/maas-controller-b9cfccf58-9zwdw" Jun 10 16:57:43.200937 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:43.200898 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f0819d0d-66a9-4ab8-acb3-0a1be45dc30f-webhook-cert\") pod \"maas-controller-58557849cf-qgqhb\" (UID: \"f0819d0d-66a9-4ab8-acb3-0a1be45dc30f\") " pod="opendatahub/maas-controller-58557849cf-qgqhb" Jun 10 16:57:43.203623 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:43.203593 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f0819d0d-66a9-4ab8-acb3-0a1be45dc30f-webhook-cert\") pod \"maas-controller-58557849cf-qgqhb\" (UID: \"f0819d0d-66a9-4ab8-acb3-0a1be45dc30f\") " pod="opendatahub/maas-controller-58557849cf-qgqhb" Jun 10 16:57:43.402890 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:43.402855 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/484af365-6912-4582-a120-8f9f42dab5cd-webhook-cert\") pod \"maas-controller-b9cfccf58-9zwdw\" (UID: \"484af365-6912-4582-a120-8f9f42dab5cd\") " pod="opendatahub/maas-controller-b9cfccf58-9zwdw" Jun 10 16:57:43.405271 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:43.405247 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/484af365-6912-4582-a120-8f9f42dab5cd-webhook-cert\") pod \"maas-controller-b9cfccf58-9zwdw\" (UID: \"484af365-6912-4582-a120-8f9f42dab5cd\") " pod="opendatahub/maas-controller-b9cfccf58-9zwdw" Jun 10 16:57:43.458828 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:43.458754 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58557849cf-qgqhb" Jun 10 16:57:43.600240 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:43.600215 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-58557849cf-qgqhb"] Jun 10 16:57:43.602500 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:57:43.602475 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0819d0d_66a9_4ab8_acb3_0a1be45dc30f.slice/crio-a045c1c8df61968637ad4244e55c49220417c466dfcf47c0de93095a15b7710e WatchSource:0}: Error finding container a045c1c8df61968637ad4244e55c49220417c466dfcf47c0de93095a15b7710e: Status 404 returned error can't find the container with id a045c1c8df61968637ad4244e55c49220417c466dfcf47c0de93095a15b7710e Jun 10 16:57:43.604344 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:43.604228 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 16:57:43.639726 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:43.639700 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b9cfccf58-9zwdw" Jun 10 16:57:43.776046 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:43.776021 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-b9cfccf58-9zwdw"] Jun 10 16:57:43.778494 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:57:43.778463 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod484af365_6912_4582_a120_8f9f42dab5cd.slice/crio-91e75664adfc7f57a475036e569f90b99086dd1e69c875e75d725e3e08656761 WatchSource:0}: Error finding container 91e75664adfc7f57a475036e569f90b99086dd1e69c875e75d725e3e08656761: Status 404 returned error can't find the container with id 91e75664adfc7f57a475036e569f90b99086dd1e69c875e75d725e3e08656761 Jun 10 16:57:44.188896 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:44.188855 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b9cfccf58-9zwdw" event={"ID":"484af365-6912-4582-a120-8f9f42dab5cd","Type":"ContainerStarted","Data":"91e75664adfc7f57a475036e569f90b99086dd1e69c875e75d725e3e08656761"} Jun 10 16:57:44.189980 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:44.189945 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58557849cf-qgqhb" event={"ID":"f0819d0d-66a9-4ab8-acb3-0a1be45dc30f","Type":"ContainerStarted","Data":"a045c1c8df61968637ad4244e55c49220417c466dfcf47c0de93095a15b7710e"} Jun 10 16:57:47.206462 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:47.206423 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58557849cf-qgqhb" event={"ID":"f0819d0d-66a9-4ab8-acb3-0a1be45dc30f","Type":"ContainerStarted","Data":"999f139711a08a133557c3047126a87b8d1cf6934485079a94d2700e42a393cd"} Jun 10 16:57:47.206956 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:47.206490 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-58557849cf-qgqhb" Jun 10 16:57:47.207947 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:47.207921 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b9cfccf58-9zwdw" event={"ID":"484af365-6912-4582-a120-8f9f42dab5cd","Type":"ContainerStarted","Data":"01bd2916ef8fef9f5bd87b69f170af2a7ff85e0af0f916cc846557e4e2689da5"} Jun 10 16:57:47.208059 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:47.207982 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-b9cfccf58-9zwdw" Jun 10 16:57:47.229607 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:47.229511 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-58557849cf-qgqhb" podStartSLOduration=2.4784896229999998 podStartE2EDuration="5.229488261s" totalImagesPullingTime="2.750998638s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:57:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:57:47.225736639 +0000 UTC m=+786.749949708" watchObservedRunningTime="2026-06-10 16:57:47.229488261 +0000 UTC m=+786.753701382" Jun 10 16:57:47.245394 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:47.245345 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-b9cfccf58-9zwdw" podStartSLOduration=2.680074112 podStartE2EDuration="5.245328693s" totalImagesPullingTime="2.565254581s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:57:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:57:47.243835726 +0000 UTC m=+786.768048796" watchObservedRunningTime="2026-06-10 16:57:47.245328693 +0000 UTC m=+786.769541812" Jun 10 16:57:58.218241 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:58.218206 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-b9cfccf58-9zwdw" Jun 10 16:57:58.218653 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:58.218379 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-58557849cf-qgqhb" Jun 10 16:57:58.287887 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:58.287808 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-58557849cf-qgqhb"] Jun 10 16:57:58.288062 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:58.288013 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-58557849cf-qgqhb" podUID="f0819d0d-66a9-4ab8-acb3-0a1be45dc30f" containerName="manager" containerID="cri-o://999f139711a08a133557c3047126a87b8d1cf6934485079a94d2700e42a393cd" gracePeriod=30 Jun 10 16:57:58.538955 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:58.538928 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58557849cf-qgqhb" Jun 10 16:57:58.643552 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:58.643515 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m85qc\" (UniqueName: \"kubernetes.io/projected/f0819d0d-66a9-4ab8-acb3-0a1be45dc30f-kube-api-access-m85qc\") pod \"f0819d0d-66a9-4ab8-acb3-0a1be45dc30f\" (UID: \"f0819d0d-66a9-4ab8-acb3-0a1be45dc30f\") " Jun 10 16:57:58.643552 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:58.643556 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f0819d0d-66a9-4ab8-acb3-0a1be45dc30f-webhook-cert\") pod \"f0819d0d-66a9-4ab8-acb3-0a1be45dc30f\" (UID: \"f0819d0d-66a9-4ab8-acb3-0a1be45dc30f\") " Jun 10 16:57:58.645891 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:58.645854 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0819d0d-66a9-4ab8-acb3-0a1be45dc30f-kube-api-access-m85qc" (OuterVolumeSpecName: "kube-api-access-m85qc") pod "f0819d0d-66a9-4ab8-acb3-0a1be45dc30f" (UID: "f0819d0d-66a9-4ab8-acb3-0a1be45dc30f"). InnerVolumeSpecName "kube-api-access-m85qc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 16:57:58.645891 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:58.645869 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0819d0d-66a9-4ab8-acb3-0a1be45dc30f-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "f0819d0d-66a9-4ab8-acb3-0a1be45dc30f" (UID: "f0819d0d-66a9-4ab8-acb3-0a1be45dc30f"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 16:57:58.744301 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:58.744266 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m85qc\" (UniqueName: \"kubernetes.io/projected/f0819d0d-66a9-4ab8-acb3-0a1be45dc30f-kube-api-access-m85qc\") on node \"ip-10-0-143-240.ec2.internal\" DevicePath \"\"" Jun 10 16:57:58.744301 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:58.744294 2562 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f0819d0d-66a9-4ab8-acb3-0a1be45dc30f-webhook-cert\") on node \"ip-10-0-143-240.ec2.internal\" DevicePath \"\"" Jun 10 16:57:59.266284 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:59.266191 2562 generic.go:356] "Generic (PLEG): container finished" podID="f0819d0d-66a9-4ab8-acb3-0a1be45dc30f" containerID="999f139711a08a133557c3047126a87b8d1cf6934485079a94d2700e42a393cd" exitCode=0 Jun 10 16:57:59.266284 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:59.266239 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58557849cf-qgqhb" Jun 10 16:57:59.266284 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:59.266259 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58557849cf-qgqhb" event={"ID":"f0819d0d-66a9-4ab8-acb3-0a1be45dc30f","Type":"ContainerDied","Data":"999f139711a08a133557c3047126a87b8d1cf6934485079a94d2700e42a393cd"} Jun 10 16:57:59.266789 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:59.266311 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58557849cf-qgqhb" event={"ID":"f0819d0d-66a9-4ab8-acb3-0a1be45dc30f","Type":"ContainerDied","Data":"a045c1c8df61968637ad4244e55c49220417c466dfcf47c0de93095a15b7710e"} Jun 10 16:57:59.266789 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:59.266342 2562 scope.go:117] "RemoveContainer" containerID="999f139711a08a133557c3047126a87b8d1cf6934485079a94d2700e42a393cd" Jun 10 16:57:59.274938 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:59.274922 2562 scope.go:117] "RemoveContainer" containerID="999f139711a08a133557c3047126a87b8d1cf6934485079a94d2700e42a393cd" Jun 10 16:57:59.275163 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:57:59.275144 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"999f139711a08a133557c3047126a87b8d1cf6934485079a94d2700e42a393cd\": container with ID starting with 999f139711a08a133557c3047126a87b8d1cf6934485079a94d2700e42a393cd not found: ID does not exist" containerID="999f139711a08a133557c3047126a87b8d1cf6934485079a94d2700e42a393cd" Jun 10 16:57:59.275222 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:59.275175 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"999f139711a08a133557c3047126a87b8d1cf6934485079a94d2700e42a393cd"} err="failed to get container status \"999f139711a08a133557c3047126a87b8d1cf6934485079a94d2700e42a393cd\": rpc error: code = NotFound desc = could not find container \"999f139711a08a133557c3047126a87b8d1cf6934485079a94d2700e42a393cd\": container with ID starting with 999f139711a08a133557c3047126a87b8d1cf6934485079a94d2700e42a393cd not found: ID does not exist" Jun 10 16:57:59.282206 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:59.282185 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-58557849cf-qgqhb"] Jun 10 16:57:59.287727 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:57:59.287705 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-58557849cf-qgqhb"] Jun 10 16:58:00.953321 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:00.953287 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0819d0d-66a9-4ab8-acb3-0a1be45dc30f" path="/var/lib/kubelet/pods/f0819d0d-66a9-4ab8-acb3-0a1be45dc30f/volumes" Jun 10 16:58:17.750867 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:17.750831 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-849cd4c7d7-2wdn7"] Jun 10 16:58:17.751455 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:17.751359 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0819d0d-66a9-4ab8-acb3-0a1be45dc30f" containerName="manager" Jun 10 16:58:17.751455 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:17.751381 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0819d0d-66a9-4ab8-acb3-0a1be45dc30f" containerName="manager" Jun 10 16:58:17.751573 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:17.751495 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0819d0d-66a9-4ab8-acb3-0a1be45dc30f" containerName="manager" Jun 10 16:58:17.757755 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:17.757732 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-849cd4c7d7-2wdn7" Jun 10 16:58:17.760059 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:17.760036 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 10 16:58:17.760184 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:17.760040 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-9hqfr\"" Jun 10 16:58:17.767641 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:17.767602 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-849cd4c7d7-2wdn7"] Jun 10 16:58:17.912045 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:17.912009 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8spmn\" (UniqueName: \"kubernetes.io/projected/a839d619-8f21-4ee9-bf82-4d3ac3fc3741-kube-api-access-8spmn\") pod \"maas-api-849cd4c7d7-2wdn7\" (UID: \"a839d619-8f21-4ee9-bf82-4d3ac3fc3741\") " pod="opendatahub/maas-api-849cd4c7d7-2wdn7" Jun 10 16:58:17.912217 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:17.912066 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a839d619-8f21-4ee9-bf82-4d3ac3fc3741-maas-api-tls\") pod \"maas-api-849cd4c7d7-2wdn7\" (UID: \"a839d619-8f21-4ee9-bf82-4d3ac3fc3741\") " pod="opendatahub/maas-api-849cd4c7d7-2wdn7" Jun 10 16:58:18.012848 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:18.012757 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a839d619-8f21-4ee9-bf82-4d3ac3fc3741-maas-api-tls\") pod \"maas-api-849cd4c7d7-2wdn7\" (UID: \"a839d619-8f21-4ee9-bf82-4d3ac3fc3741\") " pod="opendatahub/maas-api-849cd4c7d7-2wdn7" Jun 10 16:58:18.012999 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:18.012863 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8spmn\" (UniqueName: \"kubernetes.io/projected/a839d619-8f21-4ee9-bf82-4d3ac3fc3741-kube-api-access-8spmn\") pod \"maas-api-849cd4c7d7-2wdn7\" (UID: \"a839d619-8f21-4ee9-bf82-4d3ac3fc3741\") " pod="opendatahub/maas-api-849cd4c7d7-2wdn7" Jun 10 16:58:18.015357 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:18.015335 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a839d619-8f21-4ee9-bf82-4d3ac3fc3741-maas-api-tls\") pod \"maas-api-849cd4c7d7-2wdn7\" (UID: \"a839d619-8f21-4ee9-bf82-4d3ac3fc3741\") " pod="opendatahub/maas-api-849cd4c7d7-2wdn7" Jun 10 16:58:18.027867 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:18.027836 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8spmn\" (UniqueName: \"kubernetes.io/projected/a839d619-8f21-4ee9-bf82-4d3ac3fc3741-kube-api-access-8spmn\") pod \"maas-api-849cd4c7d7-2wdn7\" (UID: \"a839d619-8f21-4ee9-bf82-4d3ac3fc3741\") " pod="opendatahub/maas-api-849cd4c7d7-2wdn7" Jun 10 16:58:18.069729 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:18.069698 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-849cd4c7d7-2wdn7" Jun 10 16:58:18.211400 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:18.211376 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-849cd4c7d7-2wdn7"] Jun 10 16:58:18.214247 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:58:18.214217 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda839d619_8f21_4ee9_bf82_4d3ac3fc3741.slice/crio-c1277e52f8ce41e44e3f951a70a62575aba9cc6ebd0e637e50cfe59f9a89083a WatchSource:0}: Error finding container c1277e52f8ce41e44e3f951a70a62575aba9cc6ebd0e637e50cfe59f9a89083a: Status 404 returned error can't find the container with id c1277e52f8ce41e44e3f951a70a62575aba9cc6ebd0e637e50cfe59f9a89083a Jun 10 16:58:18.356259 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:18.356225 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-849cd4c7d7-2wdn7" event={"ID":"a839d619-8f21-4ee9-bf82-4d3ac3fc3741","Type":"ContainerStarted","Data":"c1277e52f8ce41e44e3f951a70a62575aba9cc6ebd0e637e50cfe59f9a89083a"} Jun 10 16:58:18.384845 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:18.384816 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-pr5sv"] Jun 10 16:58:18.390102 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:18.390078 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-pr5sv" Jun 10 16:58:18.392427 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:18.392408 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-55rgz\"" Jun 10 16:58:18.392952 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:18.392938 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 10 16:58:18.401606 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:18.401587 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-pr5sv"] Jun 10 16:58:18.417272 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:18.417247 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-j94gv"] Jun 10 16:58:18.420876 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:18.420858 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-j94gv" Jun 10 16:58:18.440077 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:18.440054 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-j94gv"] Jun 10 16:58:18.516701 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:18.516670 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8bjw\" (UniqueName: \"kubernetes.io/projected/c3041df1-3c4e-4477-82cc-582ef92219bd-kube-api-access-s8bjw\") pod \"payload-processing-699b6cd6c-j94gv\" (UID: \"c3041df1-3c4e-4477-82cc-582ef92219bd\") " pod="openshift-ingress/payload-processing-699b6cd6c-j94gv" Jun 10 16:58:18.516878 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:18.516748 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tmwk\" (UniqueName: \"kubernetes.io/projected/8cd21bb0-1d8d-4402-ac9e-1b957a4bf3ca-kube-api-access-8tmwk\") pod \"payload-pre-processing-579785bc64-pr5sv\" (UID: \"8cd21bb0-1d8d-4402-ac9e-1b957a4bf3ca\") " pod="openshift-ingress/payload-pre-processing-579785bc64-pr5sv" Jun 10 16:58:18.618082 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:18.617994 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8bjw\" (UniqueName: \"kubernetes.io/projected/c3041df1-3c4e-4477-82cc-582ef92219bd-kube-api-access-s8bjw\") pod \"payload-processing-699b6cd6c-j94gv\" (UID: \"c3041df1-3c4e-4477-82cc-582ef92219bd\") " pod="openshift-ingress/payload-processing-699b6cd6c-j94gv" Jun 10 16:58:18.618082 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:18.618059 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tmwk\" (UniqueName: \"kubernetes.io/projected/8cd21bb0-1d8d-4402-ac9e-1b957a4bf3ca-kube-api-access-8tmwk\") pod \"payload-pre-processing-579785bc64-pr5sv\" (UID: \"8cd21bb0-1d8d-4402-ac9e-1b957a4bf3ca\") " pod="openshift-ingress/payload-pre-processing-579785bc64-pr5sv" Jun 10 16:58:18.628418 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:18.628389 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tmwk\" (UniqueName: \"kubernetes.io/projected/8cd21bb0-1d8d-4402-ac9e-1b957a4bf3ca-kube-api-access-8tmwk\") pod \"payload-pre-processing-579785bc64-pr5sv\" (UID: \"8cd21bb0-1d8d-4402-ac9e-1b957a4bf3ca\") " pod="openshift-ingress/payload-pre-processing-579785bc64-pr5sv" Jun 10 16:58:18.628418 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:18.628402 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8bjw\" (UniqueName: \"kubernetes.io/projected/c3041df1-3c4e-4477-82cc-582ef92219bd-kube-api-access-s8bjw\") pod \"payload-processing-699b6cd6c-j94gv\" (UID: \"c3041df1-3c4e-4477-82cc-582ef92219bd\") " pod="openshift-ingress/payload-processing-699b6cd6c-j94gv" Jun 10 16:58:18.701378 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:18.701341 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-pr5sv" Jun 10 16:58:18.731989 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:18.731960 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-j94gv" Jun 10 16:58:18.854792 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:18.854761 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-pr5sv"] Jun 10 16:58:18.856685 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:58:18.856650 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cd21bb0_1d8d_4402_ac9e_1b957a4bf3ca.slice/crio-d42da949dc0cf157212d4a29278d17cda4520c06e3ca8a0c8d4b347f444d8a2d WatchSource:0}: Error finding container d42da949dc0cf157212d4a29278d17cda4520c06e3ca8a0c8d4b347f444d8a2d: Status 404 returned error can't find the container with id d42da949dc0cf157212d4a29278d17cda4520c06e3ca8a0c8d4b347f444d8a2d Jun 10 16:58:18.890548 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:18.890521 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-j94gv"] Jun 10 16:58:19.363077 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:19.363036 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-pr5sv" event={"ID":"8cd21bb0-1d8d-4402-ac9e-1b957a4bf3ca","Type":"ContainerStarted","Data":"d42da949dc0cf157212d4a29278d17cda4520c06e3ca8a0c8d4b347f444d8a2d"} Jun 10 16:58:19.364214 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:19.364185 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-j94gv" event={"ID":"c3041df1-3c4e-4477-82cc-582ef92219bd","Type":"ContainerStarted","Data":"51dd6e5a60bf20f256376c99b33c6e88a210662ca4a508c61952b3b12a3f98b6"} Jun 10 16:58:21.379347 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:21.379312 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-849cd4c7d7-2wdn7" event={"ID":"a839d619-8f21-4ee9-bf82-4d3ac3fc3741","Type":"ContainerStarted","Data":"84500615b4512bdd7f6452557043a414a07280315cd7200158d87bd9dcd24893"} Jun 10 16:58:21.379827 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:21.379436 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-849cd4c7d7-2wdn7" Jun 10 16:58:21.397789 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:21.397739 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-849cd4c7d7-2wdn7" podStartSLOduration=2.212375732 podStartE2EDuration="4.397721805s" totalImagesPullingTime="2.185346073s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:58:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:58:21.396485595 +0000 UTC m=+820.920698658" watchObservedRunningTime="2026-06-10 16:58:21.397721805 +0000 UTC m=+820.921934876" Jun 10 16:58:22.385208 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:22.385169 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-pr5sv" event={"ID":"8cd21bb0-1d8d-4402-ac9e-1b957a4bf3ca","Type":"ContainerStarted","Data":"139bdb2af5f3fea3fdd0bac1ffc436c6d6863da06d04410d06d97c2b27f7dcb3"} Jun 10 16:58:22.385701 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:22.385328 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-579785bc64-pr5sv" Jun 10 16:58:22.386825 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:22.386796 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-j94gv" event={"ID":"c3041df1-3c4e-4477-82cc-582ef92219bd","Type":"ContainerStarted","Data":"0e9d6c39e4a06b818434c371eba374b4253dcadbd1fd9e488bbffe91e9f291d5"} Jun 10 16:58:22.386924 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:22.386896 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-699b6cd6c-j94gv" Jun 10 16:58:22.407798 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:22.407755 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-579785bc64-pr5sv" podStartSLOduration=1.7941537840000001 podStartE2EDuration="4.407742774s" totalImagesPullingTime="2.61358899s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:58:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:58:22.405897953 +0000 UTC m=+821.930111029" watchObservedRunningTime="2026-06-10 16:58:22.407742774 +0000 UTC m=+821.931955854" Jun 10 16:58:22.423270 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:22.423229 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-699b6cd6c-j94gv" podStartSLOduration=1.841627833 podStartE2EDuration="4.423214976s" totalImagesPullingTime="2.581587143s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:58:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:58:22.422284219 +0000 UTC m=+821.946497294" watchObservedRunningTime="2026-06-10 16:58:22.423214976 +0000 UTC m=+821.947428046" Jun 10 16:58:27.391927 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:27.391901 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-849cd4c7d7-2wdn7" Jun 10 16:58:29.270975 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:29.270936 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 16:58:29.271383 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:29.271127 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="16cfe4c0-82cb-4096-b4b5-dba1b9867f86" containerName="keycloak" containerID="cri-o://53ebf55dbffb3d8be9b9df31d65632df881cd2735766eb43a2c116b5bb14aa0f" gracePeriod=30 Jun 10 16:58:30.831701 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:30.831678 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 16:58:30.925143 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:30.925060 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2bvh7\" (UniqueName: \"kubernetes.io/projected/16cfe4c0-82cb-4096-b4b5-dba1b9867f86-kube-api-access-2bvh7\") pod \"16cfe4c0-82cb-4096-b4b5-dba1b9867f86\" (UID: \"16cfe4c0-82cb-4096-b4b5-dba1b9867f86\") " Jun 10 16:58:30.927400 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:30.927366 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16cfe4c0-82cb-4096-b4b5-dba1b9867f86-kube-api-access-2bvh7" (OuterVolumeSpecName: "kube-api-access-2bvh7") pod "16cfe4c0-82cb-4096-b4b5-dba1b9867f86" (UID: "16cfe4c0-82cb-4096-b4b5-dba1b9867f86"). InnerVolumeSpecName "kube-api-access-2bvh7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 16:58:31.026551 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:31.026512 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2bvh7\" (UniqueName: \"kubernetes.io/projected/16cfe4c0-82cb-4096-b4b5-dba1b9867f86-kube-api-access-2bvh7\") on node \"ip-10-0-143-240.ec2.internal\" DevicePath \"\"" Jun 10 16:58:31.430812 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:31.430779 2562 generic.go:356] "Generic (PLEG): container finished" podID="16cfe4c0-82cb-4096-b4b5-dba1b9867f86" containerID="53ebf55dbffb3d8be9b9df31d65632df881cd2735766eb43a2c116b5bb14aa0f" exitCode=143 Jun 10 16:58:31.430812 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:31.430816 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"16cfe4c0-82cb-4096-b4b5-dba1b9867f86","Type":"ContainerDied","Data":"53ebf55dbffb3d8be9b9df31d65632df881cd2735766eb43a2c116b5bb14aa0f"} Jun 10 16:58:31.431088 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:31.430845 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 16:58:31.431088 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:31.430855 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"16cfe4c0-82cb-4096-b4b5-dba1b9867f86","Type":"ContainerDied","Data":"d448e1311938513caa17d6780000129d61b64e39b7453c79b582abf9a003951e"} Jun 10 16:58:31.431088 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:31.430874 2562 scope.go:117] "RemoveContainer" containerID="53ebf55dbffb3d8be9b9df31d65632df881cd2735766eb43a2c116b5bb14aa0f" Jun 10 16:58:31.440560 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:31.440543 2562 scope.go:117] "RemoveContainer" containerID="53ebf55dbffb3d8be9b9df31d65632df881cd2735766eb43a2c116b5bb14aa0f" Jun 10 16:58:31.440864 ip-10-0-143-240 kubenswrapper[2562]: E0610 16:58:31.440840 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53ebf55dbffb3d8be9b9df31d65632df881cd2735766eb43a2c116b5bb14aa0f\": container with ID starting with 53ebf55dbffb3d8be9b9df31d65632df881cd2735766eb43a2c116b5bb14aa0f not found: ID does not exist" containerID="53ebf55dbffb3d8be9b9df31d65632df881cd2735766eb43a2c116b5bb14aa0f" Jun 10 16:58:31.440933 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:31.440875 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53ebf55dbffb3d8be9b9df31d65632df881cd2735766eb43a2c116b5bb14aa0f"} err="failed to get container status \"53ebf55dbffb3d8be9b9df31d65632df881cd2735766eb43a2c116b5bb14aa0f\": rpc error: code = NotFound desc = could not find container \"53ebf55dbffb3d8be9b9df31d65632df881cd2735766eb43a2c116b5bb14aa0f\": container with ID starting with 53ebf55dbffb3d8be9b9df31d65632df881cd2735766eb43a2c116b5bb14aa0f not found: ID does not exist" Jun 10 16:58:31.447115 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:31.447092 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 16:58:31.450463 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:31.450443 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 16:58:31.470902 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:31.470878 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 16:58:31.471341 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:31.471324 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16cfe4c0-82cb-4096-b4b5-dba1b9867f86" containerName="keycloak" Jun 10 16:58:31.471403 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:31.471343 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="16cfe4c0-82cb-4096-b4b5-dba1b9867f86" containerName="keycloak" Jun 10 16:58:31.471439 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:31.471409 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="16cfe4c0-82cb-4096-b4b5-dba1b9867f86" containerName="keycloak" Jun 10 16:58:31.473887 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:31.473872 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 16:58:31.476203 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:31.476179 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 10 16:58:31.476304 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:31.476215 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 10 16:58:31.476304 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:31.476216 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 10 16:58:31.476418 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:31.476312 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 10 16:58:31.476669 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:31.476624 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-gfkgp\"" Jun 10 16:58:31.483743 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:31.483710 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 16:58:31.530686 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:31.530648 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/9fa22e56-3d06-45e8-9f2b-b1f94ec6e034-test-realms\") pod \"maas-keycloak-0\" (UID: \"9fa22e56-3d06-45e8-9f2b-b1f94ec6e034\") " pod="keycloak-system/maas-keycloak-0" Jun 10 16:58:31.530861 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:31.530689 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lch54\" (UniqueName: \"kubernetes.io/projected/9fa22e56-3d06-45e8-9f2b-b1f94ec6e034-kube-api-access-lch54\") pod \"maas-keycloak-0\" (UID: \"9fa22e56-3d06-45e8-9f2b-b1f94ec6e034\") " pod="keycloak-system/maas-keycloak-0" Jun 10 16:58:31.631722 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:31.631684 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/9fa22e56-3d06-45e8-9f2b-b1f94ec6e034-test-realms\") pod \"maas-keycloak-0\" (UID: \"9fa22e56-3d06-45e8-9f2b-b1f94ec6e034\") " pod="keycloak-system/maas-keycloak-0" Jun 10 16:58:31.631722 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:31.631721 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lch54\" (UniqueName: \"kubernetes.io/projected/9fa22e56-3d06-45e8-9f2b-b1f94ec6e034-kube-api-access-lch54\") pod \"maas-keycloak-0\" (UID: \"9fa22e56-3d06-45e8-9f2b-b1f94ec6e034\") " pod="keycloak-system/maas-keycloak-0" Jun 10 16:58:31.632402 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:31.632384 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/9fa22e56-3d06-45e8-9f2b-b1f94ec6e034-test-realms\") pod \"maas-keycloak-0\" (UID: \"9fa22e56-3d06-45e8-9f2b-b1f94ec6e034\") " pod="keycloak-system/maas-keycloak-0" Jun 10 16:58:31.640554 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:31.640531 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lch54\" (UniqueName: \"kubernetes.io/projected/9fa22e56-3d06-45e8-9f2b-b1f94ec6e034-kube-api-access-lch54\") pod \"maas-keycloak-0\" (UID: \"9fa22e56-3d06-45e8-9f2b-b1f94ec6e034\") " pod="keycloak-system/maas-keycloak-0" Jun 10 16:58:31.785741 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:31.785616 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 16:58:31.919413 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:31.919390 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 16:58:31.921943 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:58:31.921915 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fa22e56_3d06_45e8_9f2b_b1f94ec6e034.slice/crio-2a22350621bf6d9b01d6648704ca2f66b1f356a8034156dce185378e7eac02db WatchSource:0}: Error finding container 2a22350621bf6d9b01d6648704ca2f66b1f356a8034156dce185378e7eac02db: Status 404 returned error can't find the container with id 2a22350621bf6d9b01d6648704ca2f66b1f356a8034156dce185378e7eac02db Jun 10 16:58:32.448149 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:32.448042 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"9fa22e56-3d06-45e8-9f2b-b1f94ec6e034","Type":"ContainerStarted","Data":"6c509b0d85dae554e782929924c8b4cf44b1ac4f01b6a73398909b6d3fdc1a1f"} Jun 10 16:58:32.448149 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:32.448097 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"9fa22e56-3d06-45e8-9f2b-b1f94ec6e034","Type":"ContainerStarted","Data":"2a22350621bf6d9b01d6648704ca2f66b1f356a8034156dce185378e7eac02db"} Jun 10 16:58:32.467078 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:32.467025 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.2145486380000001 podStartE2EDuration="1.467008436s" totalImagesPullingTime="252.459798ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:58:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:58:32.466145767 +0000 UTC m=+831.990358849" watchObservedRunningTime="2026-06-10 16:58:32.467008436 +0000 UTC m=+831.991221504" Jun 10 16:58:32.786348 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:32.786252 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 10 16:58:32.787754 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:32.787723 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9fa22e56-3d06-45e8-9f2b-b1f94ec6e034" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.35:9000/health/started\": dial tcp 10.132.0.35:9000: connect: connection refused" Jun 10 16:58:32.950140 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:32.950101 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16cfe4c0-82cb-4096-b4b5-dba1b9867f86" path="/var/lib/kubelet/pods/16cfe4c0-82cb-4096-b4b5-dba1b9867f86/volumes" Jun 10 16:58:33.393494 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:33.393459 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-579785bc64-pr5sv" Jun 10 16:58:33.393823 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:33.393803 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-699b6cd6c-j94gv" Jun 10 16:58:33.786591 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:33.786480 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9fa22e56-3d06-45e8-9f2b-b1f94ec6e034" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.35:9000/health/started\": dial tcp 10.132.0.35:9000: connect: connection refused" Jun 10 16:58:34.786308 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:34.786239 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9fa22e56-3d06-45e8-9f2b-b1f94ec6e034" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.35:9000/health/started\": dial tcp 10.132.0.35:9000: connect: connection refused" Jun 10 16:58:35.786963 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:35.786908 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9fa22e56-3d06-45e8-9f2b-b1f94ec6e034" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.35:9000/health/started\": dial tcp 10.132.0.35:9000: connect: connection refused" Jun 10 16:58:36.787157 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:36.787099 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9fa22e56-3d06-45e8-9f2b-b1f94ec6e034" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.35:9000/health/started\": dial tcp 10.132.0.35:9000: connect: connection refused" Jun 10 16:58:37.786746 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:37.786692 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9fa22e56-3d06-45e8-9f2b-b1f94ec6e034" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.35:9000/health/started\": dial tcp 10.132.0.35:9000: connect: connection refused" Jun 10 16:58:38.787023 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:38.786963 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9fa22e56-3d06-45e8-9f2b-b1f94ec6e034" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.35:9000/health/started\": dial tcp 10.132.0.35:9000: connect: connection refused" Jun 10 16:58:39.787131 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:39.787077 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9fa22e56-3d06-45e8-9f2b-b1f94ec6e034" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.35:9000/health/started\": dial tcp 10.132.0.35:9000: connect: connection refused" Jun 10 16:58:40.786788 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:40.786739 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9fa22e56-3d06-45e8-9f2b-b1f94ec6e034" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.35:9000/health/started\": dial tcp 10.132.0.35:9000: connect: connection refused" Jun 10 16:58:41.786600 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:41.786551 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 10 16:58:41.787140 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:41.786948 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9fa22e56-3d06-45e8-9f2b-b1f94ec6e034" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.35:9000/health/started\": dial tcp 10.132.0.35:9000: connect: connection refused" Jun 10 16:58:42.785999 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:42.785956 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9fa22e56-3d06-45e8-9f2b-b1f94ec6e034" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.35:9000/health/started\": dial tcp 10.132.0.35:9000: connect: connection refused" Jun 10 16:58:43.786150 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:43.786101 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9fa22e56-3d06-45e8-9f2b-b1f94ec6e034" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.35:9000/health/started\": dial tcp 10.132.0.35:9000: connect: connection refused" Jun 10 16:58:44.786234 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:44.786182 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9fa22e56-3d06-45e8-9f2b-b1f94ec6e034" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.35:9000/health/started\": dial tcp 10.132.0.35:9000: connect: connection refused" Jun 10 16:58:45.913787 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:45.913741 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 10 16:58:45.932043 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:45.931991 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="9fa22e56-3d06-45e8-9f2b-b1f94ec6e034" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 16:58:55.920142 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:58:55.920098 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 10 16:59:19.561440 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:59:19.561407 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-p442k"] Jun 10 16:59:19.565138 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:59:19.565114 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-p442k" Jun 10 16:59:19.567467 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:59:19.567441 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 10 16:59:19.568166 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:59:19.568113 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 10 16:59:19.568166 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:59:19.568140 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-gnjgd\"" Jun 10 16:59:19.568379 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:59:19.568114 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 10 16:59:19.577093 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:59:19.577069 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9ad7e908-23fb-421c-ad98-1f5e674a0af5-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-p442k\" (UID: \"9ad7e908-23fb-421c-ad98-1f5e674a0af5\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-p442k" Jun 10 16:59:19.577214 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:59:19.577118 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ad7e908-23fb-421c-ad98-1f5e674a0af5-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-p442k\" (UID: \"9ad7e908-23fb-421c-ad98-1f5e674a0af5\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-p442k" Jun 10 16:59:19.577214 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:59:19.577143 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ad7e908-23fb-421c-ad98-1f5e674a0af5-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-p442k\" (UID: \"9ad7e908-23fb-421c-ad98-1f5e674a0af5\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-p442k" Jun 10 16:59:19.577321 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:59:19.577219 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ad7e908-23fb-421c-ad98-1f5e674a0af5-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-p442k\" (UID: \"9ad7e908-23fb-421c-ad98-1f5e674a0af5\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-p442k" Jun 10 16:59:19.577321 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:59:19.577254 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zphm8\" (UniqueName: \"kubernetes.io/projected/9ad7e908-23fb-421c-ad98-1f5e674a0af5-kube-api-access-zphm8\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-p442k\" (UID: \"9ad7e908-23fb-421c-ad98-1f5e674a0af5\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-p442k" Jun 10 16:59:19.577421 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:59:19.577319 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ad7e908-23fb-421c-ad98-1f5e674a0af5-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-p442k\" (UID: \"9ad7e908-23fb-421c-ad98-1f5e674a0af5\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-p442k" Jun 10 16:59:19.578040 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:59:19.578017 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-p442k"] Jun 10 16:59:19.678217 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:59:19.678184 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ad7e908-23fb-421c-ad98-1f5e674a0af5-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-p442k\" (UID: \"9ad7e908-23fb-421c-ad98-1f5e674a0af5\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-p442k" Jun 10 16:59:19.678414 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:59:19.678235 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9ad7e908-23fb-421c-ad98-1f5e674a0af5-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-p442k\" (UID: \"9ad7e908-23fb-421c-ad98-1f5e674a0af5\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-p442k" Jun 10 16:59:19.678414 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:59:19.678270 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ad7e908-23fb-421c-ad98-1f5e674a0af5-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-p442k\" (UID: \"9ad7e908-23fb-421c-ad98-1f5e674a0af5\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-p442k" Jun 10 16:59:19.678414 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:59:19.678291 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ad7e908-23fb-421c-ad98-1f5e674a0af5-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-p442k\" (UID: \"9ad7e908-23fb-421c-ad98-1f5e674a0af5\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-p442k" Jun 10 16:59:19.678414 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:59:19.678312 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ad7e908-23fb-421c-ad98-1f5e674a0af5-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-p442k\" (UID: \"9ad7e908-23fb-421c-ad98-1f5e674a0af5\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-p442k" Jun 10 16:59:19.678414 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:59:19.678335 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zphm8\" (UniqueName: \"kubernetes.io/projected/9ad7e908-23fb-421c-ad98-1f5e674a0af5-kube-api-access-zphm8\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-p442k\" (UID: \"9ad7e908-23fb-421c-ad98-1f5e674a0af5\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-p442k" Jun 10 16:59:19.678738 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:59:19.678704 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ad7e908-23fb-421c-ad98-1f5e674a0af5-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-p442k\" (UID: \"9ad7e908-23fb-421c-ad98-1f5e674a0af5\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-p442k" Jun 10 16:59:19.678846 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:59:19.678721 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9ad7e908-23fb-421c-ad98-1f5e674a0af5-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-p442k\" (UID: \"9ad7e908-23fb-421c-ad98-1f5e674a0af5\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-p442k" Jun 10 16:59:19.678846 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:59:19.678817 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ad7e908-23fb-421c-ad98-1f5e674a0af5-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-p442k\" (UID: \"9ad7e908-23fb-421c-ad98-1f5e674a0af5\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-p442k" Jun 10 16:59:19.680804 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:59:19.680785 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ad7e908-23fb-421c-ad98-1f5e674a0af5-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-p442k\" (UID: \"9ad7e908-23fb-421c-ad98-1f5e674a0af5\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-p442k" Jun 10 16:59:19.680894 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:59:19.680878 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ad7e908-23fb-421c-ad98-1f5e674a0af5-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-p442k\" (UID: \"9ad7e908-23fb-421c-ad98-1f5e674a0af5\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-p442k" Jun 10 16:59:19.688047 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:59:19.688023 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zphm8\" (UniqueName: \"kubernetes.io/projected/9ad7e908-23fb-421c-ad98-1f5e674a0af5-kube-api-access-zphm8\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-p442k\" (UID: \"9ad7e908-23fb-421c-ad98-1f5e674a0af5\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-p442k" Jun 10 16:59:19.876474 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:59:19.876430 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-p442k" Jun 10 16:59:20.019685 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:59:20.019661 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-p442k"] Jun 10 16:59:20.022599 ip-10-0-143-240 kubenswrapper[2562]: W0610 16:59:20.022552 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ad7e908_23fb_421c_ad98_1f5e674a0af5.slice/crio-bc1c6d9e81c3421f2ee0ec3cf3a82151c12cc324e235f1a68fbf093d7596d9ab WatchSource:0}: Error finding container bc1c6d9e81c3421f2ee0ec3cf3a82151c12cc324e235f1a68fbf093d7596d9ab: Status 404 returned error can't find the container with id bc1c6d9e81c3421f2ee0ec3cf3a82151c12cc324e235f1a68fbf093d7596d9ab Jun 10 16:59:20.731179 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:59:20.731147 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-p442k" event={"ID":"9ad7e908-23fb-421c-ad98-1f5e674a0af5","Type":"ContainerStarted","Data":"bc1c6d9e81c3421f2ee0ec3cf3a82151c12cc324e235f1a68fbf093d7596d9ab"} Jun 10 16:59:24.753544 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:59:24.753503 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-p442k" event={"ID":"9ad7e908-23fb-421c-ad98-1f5e674a0af5","Type":"ContainerStarted","Data":"5310458c73529394907a4c226718d82da17f710e90b2d864732fedf983b8908d"} Jun 10 16:59:26.765706 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:59:26.765669 2562 generic.go:356] "Generic (PLEG): container finished" podID="9ad7e908-23fb-421c-ad98-1f5e674a0af5" containerID="5310458c73529394907a4c226718d82da17f710e90b2d864732fedf983b8908d" exitCode=0 Jun 10 16:59:26.766094 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:59:26.765743 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-p442k" event={"ID":"9ad7e908-23fb-421c-ad98-1f5e674a0af5","Type":"ContainerDied","Data":"5310458c73529394907a4c226718d82da17f710e90b2d864732fedf983b8908d"} Jun 10 16:59:28.779499 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:59:28.779462 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-p442k" event={"ID":"9ad7e908-23fb-421c-ad98-1f5e674a0af5","Type":"ContainerStarted","Data":"1754f2b56f8e976120a098e0710ca15534f180943825fbf7fdcfc8ee75fdc6a6"} Jun 10 16:59:28.798112 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:59:28.798061 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-p442k" podStartSLOduration=2.8328354669999998 podStartE2EDuration="9.798046407s" totalImagesPullingTime="5.240267796s" totalInitContainerRuntime="1.724943144s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:59:19 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:59:28.797444605 +0000 UTC m=+888.321657670" watchObservedRunningTime="2026-06-10 16:59:28.798046407 +0000 UTC m=+888.322259506" Jun 10 16:59:29.876857 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:59:29.876828 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-p442k" Jun 10 16:59:29.876857 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:59:29.876878 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-p442k" Jun 10 16:59:29.889202 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:59:29.889175 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-p442k" Jun 10 16:59:30.800597 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:59:30.800563 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-p442k" Jun 10 16:59:40.950314 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:59:40.950284 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mgpvj_df4f4a0a-8563-43bc-b1a9-c933a16dfa01/console-operator/2.log" Jun 10 16:59:40.951536 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:59:40.951512 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mgpvj_df4f4a0a-8563-43bc-b1a9-c933a16dfa01/console-operator/2.log" Jun 10 16:59:40.954657 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:59:40.954620 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p96z8_a9624b92-752b-4888-99da-f864e807a6f0/ovn-acl-logging/0.log" Jun 10 16:59:40.955693 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:59:40.955677 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p96z8_a9624b92-752b-4888-99da-f864e807a6f0/ovn-acl-logging/0.log" Jun 10 16:59:59.695794 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:59:59.695758 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwn267"] Jun 10 16:59:59.697962 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:59:59.697947 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwn267" Jun 10 16:59:59.701035 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:59:59.701010 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 10 16:59:59.712664 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:59:59.712641 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwn267"] Jun 10 16:59:59.743620 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:59:59.743581 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b6ad1aa-78f7-4649-ac32-e7f00b150f54-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwn267\" (UID: \"0b6ad1aa-78f7-4649-ac32-e7f00b150f54\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwn267" Jun 10 16:59:59.743935 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:59:59.743893 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0b6ad1aa-78f7-4649-ac32-e7f00b150f54-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwn267\" (UID: \"0b6ad1aa-78f7-4649-ac32-e7f00b150f54\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwn267" Jun 10 16:59:59.744060 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:59:59.743938 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0b6ad1aa-78f7-4649-ac32-e7f00b150f54-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwn267\" (UID: \"0b6ad1aa-78f7-4649-ac32-e7f00b150f54\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwn267" Jun 10 16:59:59.744060 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:59:59.744010 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0b6ad1aa-78f7-4649-ac32-e7f00b150f54-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwn267\" (UID: \"0b6ad1aa-78f7-4649-ac32-e7f00b150f54\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwn267" Jun 10 16:59:59.744060 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:59:59.744033 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pc7zc\" (UniqueName: \"kubernetes.io/projected/0b6ad1aa-78f7-4649-ac32-e7f00b150f54-kube-api-access-pc7zc\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwn267\" (UID: \"0b6ad1aa-78f7-4649-ac32-e7f00b150f54\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwn267" Jun 10 16:59:59.744224 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:59:59.744110 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0b6ad1aa-78f7-4649-ac32-e7f00b150f54-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwn267\" (UID: \"0b6ad1aa-78f7-4649-ac32-e7f00b150f54\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwn267" Jun 10 16:59:59.845303 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:59:59.845270 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0b6ad1aa-78f7-4649-ac32-e7f00b150f54-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwn267\" (UID: \"0b6ad1aa-78f7-4649-ac32-e7f00b150f54\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwn267" Jun 10 16:59:59.845303 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:59:59.845310 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b6ad1aa-78f7-4649-ac32-e7f00b150f54-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwn267\" (UID: \"0b6ad1aa-78f7-4649-ac32-e7f00b150f54\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwn267" Jun 10 16:59:59.845581 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:59:59.845343 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0b6ad1aa-78f7-4649-ac32-e7f00b150f54-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwn267\" (UID: \"0b6ad1aa-78f7-4649-ac32-e7f00b150f54\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwn267" Jun 10 16:59:59.845581 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:59:59.845360 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0b6ad1aa-78f7-4649-ac32-e7f00b150f54-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwn267\" (UID: \"0b6ad1aa-78f7-4649-ac32-e7f00b150f54\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwn267" Jun 10 16:59:59.845581 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:59:59.845400 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0b6ad1aa-78f7-4649-ac32-e7f00b150f54-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwn267\" (UID: \"0b6ad1aa-78f7-4649-ac32-e7f00b150f54\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwn267" Jun 10 16:59:59.845581 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:59:59.845415 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pc7zc\" (UniqueName: \"kubernetes.io/projected/0b6ad1aa-78f7-4649-ac32-e7f00b150f54-kube-api-access-pc7zc\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwn267\" (UID: \"0b6ad1aa-78f7-4649-ac32-e7f00b150f54\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwn267" Jun 10 16:59:59.845841 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:59:59.845799 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0b6ad1aa-78f7-4649-ac32-e7f00b150f54-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwn267\" (UID: \"0b6ad1aa-78f7-4649-ac32-e7f00b150f54\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwn267" Jun 10 16:59:59.845890 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:59:59.845841 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0b6ad1aa-78f7-4649-ac32-e7f00b150f54-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwn267\" (UID: \"0b6ad1aa-78f7-4649-ac32-e7f00b150f54\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwn267" Jun 10 16:59:59.845890 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:59:59.845881 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0b6ad1aa-78f7-4649-ac32-e7f00b150f54-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwn267\" (UID: \"0b6ad1aa-78f7-4649-ac32-e7f00b150f54\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwn267" Jun 10 16:59:59.847884 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:59:59.847863 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0b6ad1aa-78f7-4649-ac32-e7f00b150f54-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwn267\" (UID: \"0b6ad1aa-78f7-4649-ac32-e7f00b150f54\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwn267" Jun 10 16:59:59.848295 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:59:59.848274 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b6ad1aa-78f7-4649-ac32-e7f00b150f54-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwn267\" (UID: \"0b6ad1aa-78f7-4649-ac32-e7f00b150f54\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwn267" Jun 10 16:59:59.852798 ip-10-0-143-240 kubenswrapper[2562]: I0610 16:59:59.852765 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pc7zc\" (UniqueName: \"kubernetes.io/projected/0b6ad1aa-78f7-4649-ac32-e7f00b150f54-kube-api-access-pc7zc\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwn267\" (UID: \"0b6ad1aa-78f7-4649-ac32-e7f00b150f54\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwn267" Jun 10 17:00:00.008504 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:00:00.008415 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwn267" Jun 10 17:00:00.152738 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:00:00.152700 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwn267"] Jun 10 17:00:00.155972 ip-10-0-143-240 kubenswrapper[2562]: W0610 17:00:00.155943 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b6ad1aa_78f7_4649_ac32_e7f00b150f54.slice/crio-c778f2990cc25a9f5dc3b65baaa237c10ee8159ac390cf47a815ce77d748e5af WatchSource:0}: Error finding container c778f2990cc25a9f5dc3b65baaa237c10ee8159ac390cf47a815ce77d748e5af: Status 404 returned error can't find the container with id c778f2990cc25a9f5dc3b65baaa237c10ee8159ac390cf47a815ce77d748e5af Jun 10 17:00:00.931985 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:00:00.931948 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwn267" event={"ID":"0b6ad1aa-78f7-4649-ac32-e7f00b150f54","Type":"ContainerStarted","Data":"aa5cd19c10a9c7ce097aa34d2bd0c4b564d911247fe37dc551ef533dec8e5bf6"} Jun 10 17:00:00.932359 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:00:00.932019 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwn267" event={"ID":"0b6ad1aa-78f7-4649-ac32-e7f00b150f54","Type":"ContainerStarted","Data":"c778f2990cc25a9f5dc3b65baaa237c10ee8159ac390cf47a815ce77d748e5af"} Jun 10 17:00:01.939762 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:00:01.939615 2562 generic.go:356] "Generic (PLEG): container finished" podID="0b6ad1aa-78f7-4649-ac32-e7f00b150f54" containerID="aa5cd19c10a9c7ce097aa34d2bd0c4b564d911247fe37dc551ef533dec8e5bf6" exitCode=0 Jun 10 17:00:01.939762 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:00:01.939706 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwn267" event={"ID":"0b6ad1aa-78f7-4649-ac32-e7f00b150f54","Type":"ContainerDied","Data":"aa5cd19c10a9c7ce097aa34d2bd0c4b564d911247fe37dc551ef533dec8e5bf6"} Jun 10 17:00:11.985732 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:00:11.985693 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwn267" event={"ID":"0b6ad1aa-78f7-4649-ac32-e7f00b150f54","Type":"ContainerStarted","Data":"0e4ce9173c5c82e32acec0b3944caee3a21b7f355afd2aa08daa30237ac24004"} Jun 10 17:00:12.006598 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:00:12.006539 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwn267" podStartSLOduration=2.209150467 podStartE2EDuration="13.00652292s" totalImagesPullingTime="9.387448038s" totalInitContainerRuntime="1.409924415s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:59:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:00:12.005273077 +0000 UTC m=+931.529486148" watchObservedRunningTime="2026-06-10 17:00:12.00652292 +0000 UTC m=+931.530735989" Jun 10 17:00:20.009267 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:00:20.009231 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwn267" Jun 10 17:00:20.009671 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:00:20.009296 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwn267" Jun 10 17:00:20.022029 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:00:20.022008 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwn267" Jun 10 17:00:20.036231 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:00:20.036207 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwn267" Jun 10 17:00:29.461807 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:00:29.461771 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-gh7n6"] Jun 10 17:00:29.464690 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:00:29.464664 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gh7n6" Jun 10 17:00:29.466876 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:00:29.466857 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 10 17:00:29.474464 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:00:29.474441 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-gh7n6"] Jun 10 17:00:29.623172 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:00:29.623132 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da380965-d2ca-440c-b521-2fca7ab7a3d9-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gh7n6\" (UID: \"da380965-d2ca-440c-b521-2fca7ab7a3d9\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gh7n6" Jun 10 17:00:29.623172 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:00:29.623174 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da380965-d2ca-440c-b521-2fca7ab7a3d9-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gh7n6\" (UID: \"da380965-d2ca-440c-b521-2fca7ab7a3d9\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gh7n6" Jun 10 17:00:29.623393 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:00:29.623208 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da380965-d2ca-440c-b521-2fca7ab7a3d9-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gh7n6\" (UID: \"da380965-d2ca-440c-b521-2fca7ab7a3d9\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gh7n6" Jun 10 17:00:29.623393 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:00:29.623280 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/da380965-d2ca-440c-b521-2fca7ab7a3d9-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gh7n6\" (UID: \"da380965-d2ca-440c-b521-2fca7ab7a3d9\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gh7n6" Jun 10 17:00:29.623393 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:00:29.623303 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da380965-d2ca-440c-b521-2fca7ab7a3d9-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gh7n6\" (UID: \"da380965-d2ca-440c-b521-2fca7ab7a3d9\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gh7n6" Jun 10 17:00:29.623393 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:00:29.623329 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gccvt\" (UniqueName: \"kubernetes.io/projected/da380965-d2ca-440c-b521-2fca7ab7a3d9-kube-api-access-gccvt\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gh7n6\" (UID: \"da380965-d2ca-440c-b521-2fca7ab7a3d9\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gh7n6" Jun 10 17:00:29.724350 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:00:29.724246 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da380965-d2ca-440c-b521-2fca7ab7a3d9-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gh7n6\" (UID: \"da380965-d2ca-440c-b521-2fca7ab7a3d9\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gh7n6" Jun 10 17:00:29.724350 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:00:29.724309 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da380965-d2ca-440c-b521-2fca7ab7a3d9-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gh7n6\" (UID: \"da380965-d2ca-440c-b521-2fca7ab7a3d9\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gh7n6" Jun 10 17:00:29.724617 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:00:29.724371 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/da380965-d2ca-440c-b521-2fca7ab7a3d9-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gh7n6\" (UID: \"da380965-d2ca-440c-b521-2fca7ab7a3d9\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gh7n6" Jun 10 17:00:29.724617 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:00:29.724399 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da380965-d2ca-440c-b521-2fca7ab7a3d9-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gh7n6\" (UID: \"da380965-d2ca-440c-b521-2fca7ab7a3d9\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gh7n6" Jun 10 17:00:29.724617 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:00:29.724439 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gccvt\" (UniqueName: \"kubernetes.io/projected/da380965-d2ca-440c-b521-2fca7ab7a3d9-kube-api-access-gccvt\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gh7n6\" (UID: \"da380965-d2ca-440c-b521-2fca7ab7a3d9\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gh7n6" Jun 10 17:00:29.724617 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:00:29.724504 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da380965-d2ca-440c-b521-2fca7ab7a3d9-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gh7n6\" (UID: \"da380965-d2ca-440c-b521-2fca7ab7a3d9\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gh7n6" Jun 10 17:00:29.724864 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:00:29.724729 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da380965-d2ca-440c-b521-2fca7ab7a3d9-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gh7n6\" (UID: \"da380965-d2ca-440c-b521-2fca7ab7a3d9\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gh7n6" Jun 10 17:00:29.724864 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:00:29.724779 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da380965-d2ca-440c-b521-2fca7ab7a3d9-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gh7n6\" (UID: \"da380965-d2ca-440c-b521-2fca7ab7a3d9\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gh7n6" Jun 10 17:00:29.724864 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:00:29.724797 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/da380965-d2ca-440c-b521-2fca7ab7a3d9-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gh7n6\" (UID: \"da380965-d2ca-440c-b521-2fca7ab7a3d9\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gh7n6" Jun 10 17:00:29.726856 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:00:29.726835 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da380965-d2ca-440c-b521-2fca7ab7a3d9-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gh7n6\" (UID: \"da380965-d2ca-440c-b521-2fca7ab7a3d9\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gh7n6" Jun 10 17:00:29.727222 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:00:29.727205 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da380965-d2ca-440c-b521-2fca7ab7a3d9-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gh7n6\" (UID: \"da380965-d2ca-440c-b521-2fca7ab7a3d9\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gh7n6" Jun 10 17:00:29.733115 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:00:29.733092 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gccvt\" (UniqueName: \"kubernetes.io/projected/da380965-d2ca-440c-b521-2fca7ab7a3d9-kube-api-access-gccvt\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gh7n6\" (UID: \"da380965-d2ca-440c-b521-2fca7ab7a3d9\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gh7n6" Jun 10 17:00:29.774206 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:00:29.774167 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gh7n6" Jun 10 17:00:29.934999 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:00:29.934971 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-gh7n6"] Jun 10 17:00:29.937319 ip-10-0-143-240 kubenswrapper[2562]: W0610 17:00:29.937284 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda380965_d2ca_440c_b521_2fca7ab7a3d9.slice/crio-bc1ff7ef7f2623edc7c4dcef3cec981ec823bd88d664d5c13bbabd7ae3f68e21 WatchSource:0}: Error finding container bc1ff7ef7f2623edc7c4dcef3cec981ec823bd88d664d5c13bbabd7ae3f68e21: Status 404 returned error can't find the container with id bc1ff7ef7f2623edc7c4dcef3cec981ec823bd88d664d5c13bbabd7ae3f68e21 Jun 10 17:00:30.076989 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:00:30.076949 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gh7n6" event={"ID":"da380965-d2ca-440c-b521-2fca7ab7a3d9","Type":"ContainerStarted","Data":"e12150aadc6c8360da42f37ab25397313c1a4e77744e1d72bfdfcdfdf186a3da"} Jun 10 17:00:30.077155 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:00:30.076997 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gh7n6" event={"ID":"da380965-d2ca-440c-b521-2fca7ab7a3d9","Type":"ContainerStarted","Data":"bc1ff7ef7f2623edc7c4dcef3cec981ec823bd88d664d5c13bbabd7ae3f68e21"} Jun 10 17:00:32.090430 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:00:32.090385 2562 generic.go:356] "Generic (PLEG): container finished" podID="da380965-d2ca-440c-b521-2fca7ab7a3d9" containerID="e12150aadc6c8360da42f37ab25397313c1a4e77744e1d72bfdfcdfdf186a3da" exitCode=0 Jun 10 17:00:32.090942 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:00:32.090464 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gh7n6" event={"ID":"da380965-d2ca-440c-b521-2fca7ab7a3d9","Type":"ContainerDied","Data":"e12150aadc6c8360da42f37ab25397313c1a4e77744e1d72bfdfcdfdf186a3da"} Jun 10 17:00:35.109018 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:00:35.108978 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gh7n6" event={"ID":"da380965-d2ca-440c-b521-2fca7ab7a3d9","Type":"ContainerStarted","Data":"74f83a014c2eb28603734a0dbaa3f2c47e98581ef1fc4fce2157c9f50f0dfeab"} Jun 10 17:00:35.128429 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:00:35.128376 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gh7n6" podStartSLOduration=2.46193788 podStartE2EDuration="6.128361866s" totalImagesPullingTime="2.302512088s" totalInitContainerRuntime="1.363911898s" isStatefulPod=false podCreationTimestamp="2026-06-10 17:00:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:00:35.12717305 +0000 UTC m=+954.651386121" watchObservedRunningTime="2026-06-10 17:00:35.128361866 +0000 UTC m=+954.652574937" Jun 10 17:00:39.774476 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:00:39.774439 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gh7n6" Jun 10 17:00:39.774894 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:00:39.774488 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gh7n6" Jun 10 17:00:39.786897 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:00:39.786870 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gh7n6" Jun 10 17:00:40.143007 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:00:40.142982 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gh7n6" Jun 10 17:04:17.304957 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:17.304919 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6785b76bc9-k8k6v_3b1b801b-bfa5-4b56-8207-334a9d9969b3/nginx/0.log" Jun 10 17:04:17.650725 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:17.650690 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-849cd4c7d7-2wdn7_a839d619-8f21-4ee9-bf82-4d3ac3fc3741/maas-api/0.log" Jun 10 17:04:17.862691 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:17.862651 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-b9cfccf58-9zwdw_484af365-6912-4582-a120-8f9f42dab5cd/manager/0.log" Jun 10 17:04:18.440475 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:18.440447 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-696f888447-tvng9_45702933-4cc4-4790-8a39-396071b97238/copy-manifests/0.log" Jun 10 17:04:18.447378 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:18.447353 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-696f888447-tvng9_45702933-4cc4-4790-8a39-396071b97238/manager/0.log" Jun 10 17:04:20.109313 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:20.109285 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-49fr6_5092d086-e5d7-4181-bfd0-df341566c732/kuadrant-console-plugin/0.log" Jun 10 17:04:20.339691 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:20.339656 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-7jhjn_60769c4b-c196-4485-a291-3c28bd543d3a/manager/0.log" Jun 10 17:04:21.239432 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:21.239374 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-67bbd649b8-prvf7_2e473311-eebd-4930-8049-ce66bd17ad3a/kube-auth-proxy/0.log" Jun 10 17:04:21.463856 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:21.463828 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-pr5sv_8cd21bb0-1d8d-4402-ac9e-1b957a4bf3ca/payload-pre-processing/0.log" Jun 10 17:04:21.578800 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:21.578771 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-j94gv_c3041df1-3c4e-4477-82cc-582ef92219bd/payload-processing/0.log" Jun 10 17:04:22.024331 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:22.024248 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-p442k_9ad7e908-23fb-421c-ad98-1f5e674a0af5/storage-initializer/0.log" Jun 10 17:04:22.031651 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:22.031600 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-p442k_9ad7e908-23fb-421c-ad98-1f5e674a0af5/main/0.log" Jun 10 17:04:22.374586 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:22.374525 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwn267_0b6ad1aa-78f7-4649-ac32-e7f00b150f54/storage-initializer/0.log" Jun 10 17:04:22.383544 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:22.383518 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwn267_0b6ad1aa-78f7-4649-ac32-e7f00b150f54/main/0.log" Jun 10 17:04:22.602491 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:22.602460 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-gh7n6_da380965-d2ca-440c-b521-2fca7ab7a3d9/storage-initializer/0.log" Jun 10 17:04:22.609598 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:22.609544 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-gh7n6_da380965-d2ca-440c-b521-2fca7ab7a3d9/main/0.log" Jun 10 17:04:29.077707 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:29.077673 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5jkcf_745cd6f9-646a-4143-b3e5-9c84f4c0869a/global-pull-secret-syncer/0.log" Jun 10 17:04:29.252289 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:29.252253 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-ghpgs_a8c96b8d-5704-4cf6-86b8-633cb01726a6/konnectivity-agent/0.log" Jun 10 17:04:29.353194 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:29.353084 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-240.ec2.internal_9b7ffcb998d117f623e995855278ca37/haproxy/0.log" Jun 10 17:04:34.469065 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:34.469034 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-49fr6_5092d086-e5d7-4181-bfd0-df341566c732/kuadrant-console-plugin/0.log" Jun 10 17:04:34.546156 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:34.546120 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-7jhjn_60769c4b-c196-4485-a291-3c28bd543d3a/manager/0.log" Jun 10 17:04:36.364861 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:36.364827 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-lmxd7_24ba981e-45f3-411b-afb1-8250622231fa/kube-state-metrics/0.log" Jun 10 17:04:36.385908 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:36.385877 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-lmxd7_24ba981e-45f3-411b-afb1-8250622231fa/kube-rbac-proxy-main/0.log" Jun 10 17:04:36.415380 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:36.415353 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-lmxd7_24ba981e-45f3-411b-afb1-8250622231fa/kube-rbac-proxy-self/0.log" Jun 10 17:04:36.450444 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:36.450412 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-59648cdb5f-n5bzl_de3cfc41-9560-4df6-b26e-dba712b590ef/metrics-server/0.log" Jun 10 17:04:36.521309 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:36.521285 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-46fzb_6e75343e-4791-4a06-a99c-dd7a6329408c/node-exporter/0.log" Jun 10 17:04:36.544254 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:36.544175 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-46fzb_6e75343e-4791-4a06-a99c-dd7a6329408c/kube-rbac-proxy/0.log" Jun 10 17:04:36.571152 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:36.571127 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-46fzb_6e75343e-4791-4a06-a99c-dd7a6329408c/init-textfile/0.log" Jun 10 17:04:36.885140 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:36.885106 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5aad5fa1-d307-4ff8-a9ba-12677c9ed53a/prometheus/0.log" Jun 10 17:04:36.909320 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:36.909293 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5aad5fa1-d307-4ff8-a9ba-12677c9ed53a/config-reloader/0.log" Jun 10 17:04:36.928946 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:36.928917 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5aad5fa1-d307-4ff8-a9ba-12677c9ed53a/thanos-sidecar/0.log" Jun 10 17:04:36.953933 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:36.953905 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5aad5fa1-d307-4ff8-a9ba-12677c9ed53a/kube-rbac-proxy-web/0.log" Jun 10 17:04:36.984207 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:36.984181 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5aad5fa1-d307-4ff8-a9ba-12677c9ed53a/kube-rbac-proxy/0.log" Jun 10 17:04:37.025251 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:37.025221 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5aad5fa1-d307-4ff8-a9ba-12677c9ed53a/kube-rbac-proxy-thanos/0.log" Jun 10 17:04:37.054343 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:37.054309 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5aad5fa1-d307-4ff8-a9ba-12677c9ed53a/init-config-reloader/0.log" Jun 10 17:04:37.086706 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:37.086604 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-j6mcx_1d27cdd1-7041-4ba5-94d6-f8dc6c7fa106/prometheus-operator/0.log" Jun 10 17:04:37.106759 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:37.106738 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-j6mcx_1d27cdd1-7041-4ba5-94d6-f8dc6c7fa106/kube-rbac-proxy/0.log" Jun 10 17:04:39.736106 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:39.736067 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mgpvj_df4f4a0a-8563-43bc-b1a9-c933a16dfa01/console-operator/2.log" Jun 10 17:04:39.744801 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:39.744770 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mgpvj_df4f4a0a-8563-43bc-b1a9-c933a16dfa01/console-operator/3.log" Jun 10 17:04:40.327394 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:40.327364 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-jss4d_4e2e8592-b013-41c4-b089-4dba9e250839/download-server/0.log" Jun 10 17:04:40.540793 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:40.540760 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-854d7/perf-node-gather-daemonset-6kfm4"] Jun 10 17:04:40.543426 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:40.543401 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-854d7/perf-node-gather-daemonset-6kfm4" Jun 10 17:04:40.545513 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:40.545483 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-854d7\"/\"openshift-service-ca.crt\"" Jun 10 17:04:40.545624 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:40.545490 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-854d7\"/\"kube-root-ca.crt\"" Jun 10 17:04:40.545624 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:40.545594 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-854d7\"/\"default-dockercfg-cd8ht\"" Jun 10 17:04:40.551710 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:40.551687 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-854d7/perf-node-gather-daemonset-6kfm4"] Jun 10 17:04:40.632668 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:40.632560 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b3675487-d832-4e1c-8255-1be285aa36d5-podres\") pod \"perf-node-gather-daemonset-6kfm4\" (UID: \"b3675487-d832-4e1c-8255-1be285aa36d5\") " pod="openshift-must-gather-854d7/perf-node-gather-daemonset-6kfm4" Jun 10 17:04:40.632668 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:40.632644 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b3675487-d832-4e1c-8255-1be285aa36d5-proc\") pod \"perf-node-gather-daemonset-6kfm4\" (UID: \"b3675487-d832-4e1c-8255-1be285aa36d5\") " pod="openshift-must-gather-854d7/perf-node-gather-daemonset-6kfm4" Jun 10 17:04:40.632849 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:40.632671 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ws9g\" (UniqueName: \"kubernetes.io/projected/b3675487-d832-4e1c-8255-1be285aa36d5-kube-api-access-6ws9g\") pod \"perf-node-gather-daemonset-6kfm4\" (UID: \"b3675487-d832-4e1c-8255-1be285aa36d5\") " pod="openshift-must-gather-854d7/perf-node-gather-daemonset-6kfm4" Jun 10 17:04:40.632849 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:40.632746 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b3675487-d832-4e1c-8255-1be285aa36d5-lib-modules\") pod \"perf-node-gather-daemonset-6kfm4\" (UID: \"b3675487-d832-4e1c-8255-1be285aa36d5\") " pod="openshift-must-gather-854d7/perf-node-gather-daemonset-6kfm4" Jun 10 17:04:40.632849 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:40.632789 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b3675487-d832-4e1c-8255-1be285aa36d5-sys\") pod \"perf-node-gather-daemonset-6kfm4\" (UID: \"b3675487-d832-4e1c-8255-1be285aa36d5\") " pod="openshift-must-gather-854d7/perf-node-gather-daemonset-6kfm4" Jun 10 17:04:40.733809 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:40.733777 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b3675487-d832-4e1c-8255-1be285aa36d5-proc\") pod \"perf-node-gather-daemonset-6kfm4\" (UID: \"b3675487-d832-4e1c-8255-1be285aa36d5\") " pod="openshift-must-gather-854d7/perf-node-gather-daemonset-6kfm4" Jun 10 17:04:40.733809 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:40.733810 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ws9g\" (UniqueName: \"kubernetes.io/projected/b3675487-d832-4e1c-8255-1be285aa36d5-kube-api-access-6ws9g\") pod \"perf-node-gather-daemonset-6kfm4\" (UID: \"b3675487-d832-4e1c-8255-1be285aa36d5\") " pod="openshift-must-gather-854d7/perf-node-gather-daemonset-6kfm4" Jun 10 17:04:40.734013 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:40.733905 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b3675487-d832-4e1c-8255-1be285aa36d5-proc\") pod \"perf-node-gather-daemonset-6kfm4\" (UID: \"b3675487-d832-4e1c-8255-1be285aa36d5\") " pod="openshift-must-gather-854d7/perf-node-gather-daemonset-6kfm4" Jun 10 17:04:40.734013 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:40.733943 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b3675487-d832-4e1c-8255-1be285aa36d5-lib-modules\") pod \"perf-node-gather-daemonset-6kfm4\" (UID: \"b3675487-d832-4e1c-8255-1be285aa36d5\") " pod="openshift-must-gather-854d7/perf-node-gather-daemonset-6kfm4" Jun 10 17:04:40.734013 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:40.734007 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b3675487-d832-4e1c-8255-1be285aa36d5-sys\") pod \"perf-node-gather-daemonset-6kfm4\" (UID: \"b3675487-d832-4e1c-8255-1be285aa36d5\") " pod="openshift-must-gather-854d7/perf-node-gather-daemonset-6kfm4" Jun 10 17:04:40.734130 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:40.734043 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b3675487-d832-4e1c-8255-1be285aa36d5-podres\") pod \"perf-node-gather-daemonset-6kfm4\" (UID: \"b3675487-d832-4e1c-8255-1be285aa36d5\") " pod="openshift-must-gather-854d7/perf-node-gather-daemonset-6kfm4" Jun 10 17:04:40.734130 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:40.734103 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b3675487-d832-4e1c-8255-1be285aa36d5-sys\") pod \"perf-node-gather-daemonset-6kfm4\" (UID: \"b3675487-d832-4e1c-8255-1be285aa36d5\") " pod="openshift-must-gather-854d7/perf-node-gather-daemonset-6kfm4" Jun 10 17:04:40.734130 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:40.734115 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b3675487-d832-4e1c-8255-1be285aa36d5-lib-modules\") pod \"perf-node-gather-daemonset-6kfm4\" (UID: \"b3675487-d832-4e1c-8255-1be285aa36d5\") " pod="openshift-must-gather-854d7/perf-node-gather-daemonset-6kfm4" Jun 10 17:04:40.734223 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:40.734160 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b3675487-d832-4e1c-8255-1be285aa36d5-podres\") pod \"perf-node-gather-daemonset-6kfm4\" (UID: \"b3675487-d832-4e1c-8255-1be285aa36d5\") " pod="openshift-must-gather-854d7/perf-node-gather-daemonset-6kfm4" Jun 10 17:04:40.743902 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:40.743881 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ws9g\" (UniqueName: \"kubernetes.io/projected/b3675487-d832-4e1c-8255-1be285aa36d5-kube-api-access-6ws9g\") pod \"perf-node-gather-daemonset-6kfm4\" (UID: \"b3675487-d832-4e1c-8255-1be285aa36d5\") " pod="openshift-must-gather-854d7/perf-node-gather-daemonset-6kfm4" Jun 10 17:04:40.853804 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:40.853764 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-854d7/perf-node-gather-daemonset-6kfm4" Jun 10 17:04:40.985787 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:40.985752 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mgpvj_df4f4a0a-8563-43bc-b1a9-c933a16dfa01/console-operator/2.log" Jun 10 17:04:40.988271 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:40.988249 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mgpvj_df4f4a0a-8563-43bc-b1a9-c933a16dfa01/console-operator/2.log" Jun 10 17:04:40.990462 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:40.990435 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p96z8_a9624b92-752b-4888-99da-f864e807a6f0/ovn-acl-logging/0.log" Jun 10 17:04:40.992646 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:40.992613 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p96z8_a9624b92-752b-4888-99da-f864e807a6f0/ovn-acl-logging/0.log" Jun 10 17:04:40.999921 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:40.999896 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-854d7/perf-node-gather-daemonset-6kfm4"] Jun 10 17:04:41.005573 ip-10-0-143-240 kubenswrapper[2562]: W0610 17:04:41.005543 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb3675487_d832_4e1c_8255_1be285aa36d5.slice/crio-de30216865741aa1bee7d44a270fa5d8429f083d10ddd99943341f2ab591673c WatchSource:0}: Error finding container de30216865741aa1bee7d44a270fa5d8429f083d10ddd99943341f2ab591673c: Status 404 returned error can't find the container with id de30216865741aa1bee7d44a270fa5d8429f083d10ddd99943341f2ab591673c Jun 10 17:04:41.312725 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:41.312623 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-854d7/perf-node-gather-daemonset-6kfm4" event={"ID":"b3675487-d832-4e1c-8255-1be285aa36d5","Type":"ContainerStarted","Data":"7137e48b72b25d595279562db647836ffe548f6e45d31c3b573d4dcf0ce75cef"} Jun 10 17:04:41.312725 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:41.312690 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-854d7/perf-node-gather-daemonset-6kfm4" event={"ID":"b3675487-d832-4e1c-8255-1be285aa36d5","Type":"ContainerStarted","Data":"de30216865741aa1bee7d44a270fa5d8429f083d10ddd99943341f2ab591673c"} Jun 10 17:04:41.312908 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:41.312817 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-854d7/perf-node-gather-daemonset-6kfm4" Jun 10 17:04:41.328700 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:41.328653 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-854d7/perf-node-gather-daemonset-6kfm4" podStartSLOduration=1.328617883 podStartE2EDuration="1.328617883s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 17:04:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:04:41.32668423 +0000 UTC m=+1200.850897294" watchObservedRunningTime="2026-06-10 17:04:41.328617883 +0000 UTC m=+1200.852830953" Jun 10 17:04:42.297796 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:42.297764 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sl6mv_d4ee7a98-0681-402a-b223-d8160df30d7a/dns/0.log" Jun 10 17:04:42.315867 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:42.315842 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sl6mv_d4ee7a98-0681-402a-b223-d8160df30d7a/kube-rbac-proxy/0.log" Jun 10 17:04:42.382090 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:42.382031 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-65mjb_224e07b4-de73-42d9-a0b2-300dd5944e96/dns-node-resolver/0.log" Jun 10 17:04:42.977119 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:42.977095 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7s4lf_51c9f98e-ff02-48f2-b3e7-340543a646a6/node-ca/0.log" Jun 10 17:04:44.120775 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:44.120741 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-67bbd649b8-prvf7_2e473311-eebd-4930-8049-ce66bd17ad3a/kube-auth-proxy/0.log" Jun 10 17:04:44.164298 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:44.164273 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-pr5sv_8cd21bb0-1d8d-4402-ac9e-1b957a4bf3ca/payload-pre-processing/0.log" Jun 10 17:04:44.186691 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:44.186650 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-j94gv_c3041df1-3c4e-4477-82cc-582ef92219bd/payload-processing/0.log" Jun 10 17:04:44.839472 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:44.839439 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xlq8r_eab6293a-4de8-4ed2-9642-c8053281de99/serve-healthcheck-canary/0.log" Jun 10 17:04:45.406823 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:45.406778 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-hj4jl_b39153cd-236a-4b99-8314-0781d72ce7e4/insights-operator/0.log" Jun 10 17:04:45.410073 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:45.410049 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-hj4jl_b39153cd-236a-4b99-8314-0781d72ce7e4/insights-operator/1.log" Jun 10 17:04:45.427246 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:45.427215 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9cvpp_e554533a-69f5-40b7-a685-c0d38aa78c6f/kube-rbac-proxy/0.log" Jun 10 17:04:45.445093 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:45.445063 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9cvpp_e554533a-69f5-40b7-a685-c0d38aa78c6f/exporter/0.log" Jun 10 17:04:45.463008 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:45.462972 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9cvpp_e554533a-69f5-40b7-a685-c0d38aa78c6f/extractor/0.log" Jun 10 17:04:47.329339 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:47.329315 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-854d7/perf-node-gather-daemonset-6kfm4" Jun 10 17:04:47.916586 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:47.916555 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6785b76bc9-k8k6v_3b1b801b-bfa5-4b56-8207-334a9d9969b3/nginx/0.log" Jun 10 17:04:48.007233 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:48.007183 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-849cd4c7d7-2wdn7_a839d619-8f21-4ee9-bf82-4d3ac3fc3741/maas-api/0.log" Jun 10 17:04:48.067754 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:48.067725 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-b9cfccf58-9zwdw_484af365-6912-4582-a120-8f9f42dab5cd/manager/0.log" Jun 10 17:04:48.304666 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:48.304532 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-696f888447-tvng9_45702933-4cc4-4790-8a39-396071b97238/manager/0.log" Jun 10 17:04:48.324351 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:48.324325 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-696f888447-tvng9_45702933-4cc4-4790-8a39-396071b97238/copy-manifests/0.log" Jun 10 17:04:50.146988 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:50.146962 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5b699dc98-jfx9w_2544dd78-9acb-4f6e-b0f9-f1a725c8dbe4/manager/0.log" Jun 10 17:04:55.437279 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:55.437243 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-ckmdn_66b45156-4477-4e76-942c-5f250e31f7ff/migrator/0.log" Jun 10 17:04:55.454052 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:55.454007 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-ckmdn_66b45156-4477-4e76-942c-5f250e31f7ff/graceful-termination/0.log" Jun 10 17:04:55.917735 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:55.917703 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-bwp8v_7644b2ac-a2ef-4135-8284-bbc1261ff3f5/kube-storage-version-migrator-operator/1.log" Jun 10 17:04:55.919591 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:55.919549 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-bwp8v_7644b2ac-a2ef-4135-8284-bbc1261ff3f5/kube-storage-version-migrator-operator/0.log" Jun 10 17:04:56.181646 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:56.181589 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-67bbd649b8-prvf7_2e473311-eebd-4930-8049-ce66bd17ad3a/kube-auth-proxy/0.log" Jun 10 17:04:56.211277 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:56.211249 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-pr5sv_8cd21bb0-1d8d-4402-ac9e-1b957a4bf3ca/payload-pre-processing/0.log" Jun 10 17:04:56.223312 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:56.223286 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-j94gv_c3041df1-3c4e-4477-82cc-582ef92219bd/payload-processing/0.log" Jun 10 17:04:57.345827 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:57.345801 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mfkbh_bedb86e4-97c5-49a2-bbbc-4f13bf6c0426/kube-multus-additional-cni-plugins/0.log" Jun 10 17:04:57.363887 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:57.363863 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mfkbh_bedb86e4-97c5-49a2-bbbc-4f13bf6c0426/egress-router-binary-copy/0.log" Jun 10 17:04:57.381305 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:57.381270 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mfkbh_bedb86e4-97c5-49a2-bbbc-4f13bf6c0426/cni-plugins/0.log" Jun 10 17:04:57.400469 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:57.400445 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mfkbh_bedb86e4-97c5-49a2-bbbc-4f13bf6c0426/bond-cni-plugin/0.log" Jun 10 17:04:57.427490 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:57.427470 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mfkbh_bedb86e4-97c5-49a2-bbbc-4f13bf6c0426/routeoverride-cni/0.log" Jun 10 17:04:57.445265 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:57.445243 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mfkbh_bedb86e4-97c5-49a2-bbbc-4f13bf6c0426/whereabouts-cni-bincopy/0.log" Jun 10 17:04:57.455010 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:57.454993 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-67bbd649b8-prvf7_2e473311-eebd-4930-8049-ce66bd17ad3a/kube-auth-proxy/0.log" Jun 10 17:04:57.461806 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:57.461790 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mfkbh_bedb86e4-97c5-49a2-bbbc-4f13bf6c0426/whereabouts-cni/0.log" Jun 10 17:04:57.482300 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:57.482261 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-pr5sv_8cd21bb0-1d8d-4402-ac9e-1b957a4bf3ca/payload-pre-processing/0.log" Jun 10 17:04:57.497889 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:57.497845 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-j94gv_c3041df1-3c4e-4477-82cc-582ef92219bd/payload-processing/0.log" Jun 10 17:04:57.524158 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:57.524110 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-km7gt_04d3d006-a5bb-45bc-9aee-25b04c2b7560/kube-multus/0.log" Jun 10 17:04:57.588518 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:57.588490 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-frvb8_1955ad17-c126-4e00-b082-09ca6f6bba61/network-metrics-daemon/0.log" Jun 10 17:04:57.606413 ip-10-0-143-240 kubenswrapper[2562]: I0610 17:04:57.606341 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-frvb8_1955ad17-c126-4e00-b082-09ca6f6bba61/kube-rbac-proxy/0.log"