Jun 08 21:07:18.642572 ip-10-0-133-247 systemd[1]: Starting Kubernetes Kubelet... Jun 08 21:07:18.984328 ip-10-0-133-247 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 21:07:18.984328 ip-10-0-133-247 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 08 21:07:18.984328 ip-10-0-133-247 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 21:07:18.984328 ip-10-0-133-247 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 08 21:07:18.984328 ip-10-0-133-247 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 21:07:18.985057 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.984963 2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 08 21:07:18.988721 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988702 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 21:07:18.988721 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988720 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 21:07:18.988721 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988725 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 21:07:18.988877 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988729 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 21:07:18.988877 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988733 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 21:07:18.988877 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988736 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 21:07:18.988877 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988739 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 21:07:18.988877 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988743 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 21:07:18.988877 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988746 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 21:07:18.988877 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988749 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 21:07:18.988877 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988751 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 21:07:18.988877 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988754 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 21:07:18.988877 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988757 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 21:07:18.988877 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988760 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 21:07:18.988877 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988763 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 21:07:18.988877 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988765 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 21:07:18.988877 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988769 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 21:07:18.988877 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988772 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 21:07:18.988877 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988776 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 21:07:18.988877 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988780 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 21:07:18.988877 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988784 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 21:07:18.988877 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988788 2564 feature_gate.go:328] unrecognized feature gate: Example Jun 08 21:07:18.989375 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988791 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 21:07:18.989375 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988794 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 21:07:18.989375 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988797 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 21:07:18.989375 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988800 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 21:07:18.989375 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988803 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 21:07:18.989375 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988806 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 21:07:18.989375 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988809 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 21:07:18.989375 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988811 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 21:07:18.989375 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988814 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 21:07:18.989375 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988816 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 21:07:18.989375 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988819 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 21:07:18.989375 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988821 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 21:07:18.989375 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988824 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 21:07:18.989375 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988826 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 21:07:18.989375 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988830 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 21:07:18.989375 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988833 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 21:07:18.989375 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988836 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 21:07:18.989375 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988838 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 21:07:18.989375 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988841 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 21:07:18.989375 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988844 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 21:07:18.989865 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988848 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 21:07:18.989865 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988850 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 21:07:18.989865 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988853 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 21:07:18.989865 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988855 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 21:07:18.989865 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988858 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 21:07:18.989865 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988860 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 21:07:18.989865 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988863 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 21:07:18.989865 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988865 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 21:07:18.989865 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988868 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 21:07:18.989865 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988870 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 21:07:18.989865 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988874 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 21:07:18.989865 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988877 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 21:07:18.989865 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988879 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 21:07:18.989865 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988882 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 21:07:18.989865 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988885 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 21:07:18.989865 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988887 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 21:07:18.989865 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988890 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 21:07:18.989865 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988892 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 21:07:18.989865 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988895 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 21:07:18.990395 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988898 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 21:07:18.990395 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988901 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 21:07:18.990395 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988904 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 21:07:18.990395 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988906 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 21:07:18.990395 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988909 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 21:07:18.990395 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988911 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 21:07:18.990395 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988914 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 21:07:18.990395 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988919 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 21:07:18.990395 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988922 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 21:07:18.990395 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988925 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 21:07:18.990395 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988928 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 21:07:18.990395 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988930 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 21:07:18.990395 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988933 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 21:07:18.990395 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988935 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 21:07:18.990395 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988938 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 21:07:18.990395 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988940 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 21:07:18.990395 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988943 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 21:07:18.990395 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988946 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 21:07:18.990395 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988948 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 21:07:18.990395 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988950 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 21:07:18.990883 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988953 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 21:07:18.990883 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988955 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 21:07:18.990883 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988958 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 21:07:18.990883 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988960 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 21:07:18.990883 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988963 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 21:07:18.990883 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988966 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 21:07:18.990883 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988969 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 21:07:18.990883 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988971 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 21:07:18.990883 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988974 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 21:07:18.990883 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988977 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 21:07:18.990883 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988979 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 21:07:18.990883 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988982 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 21:07:18.990883 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988984 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 21:07:18.990883 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988987 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 21:07:18.990883 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988989 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 21:07:18.990883 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988991 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 21:07:18.990883 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988994 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 21:07:18.990883 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.988996 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 21:07:18.990883 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989768 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 21:07:18.990883 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989776 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 21:07:18.991406 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989779 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 21:07:18.991406 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989782 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 21:07:18.991406 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989785 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 21:07:18.991406 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989789 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 21:07:18.991406 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989792 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 21:07:18.991406 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989796 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 21:07:18.991406 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989800 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 21:07:18.991406 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989803 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 21:07:18.991406 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989807 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 21:07:18.991406 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989809 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 21:07:18.991406 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989812 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 21:07:18.991406 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989815 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 21:07:18.991406 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989818 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 21:07:18.991406 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989821 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 21:07:18.991406 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989823 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 21:07:18.991406 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989826 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 21:07:18.991406 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989829 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 21:07:18.991406 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989832 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 21:07:18.991406 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989834 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 21:07:18.991967 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989837 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 21:07:18.991967 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989840 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 21:07:18.991967 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989842 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 21:07:18.991967 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989846 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 21:07:18.991967 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989850 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 21:07:18.991967 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989853 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 21:07:18.991967 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989856 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 21:07:18.991967 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989859 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 21:07:18.991967 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989863 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 21:07:18.991967 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989866 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 21:07:18.991967 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989869 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 21:07:18.991967 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989872 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 21:07:18.991967 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989874 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 21:07:18.991967 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989877 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 21:07:18.991967 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989880 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 21:07:18.991967 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989882 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 21:07:18.991967 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989885 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 21:07:18.991967 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989888 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 21:07:18.991967 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989891 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 21:07:18.992450 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989893 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 21:07:18.992450 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989896 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 21:07:18.992450 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989898 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 21:07:18.992450 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989901 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 21:07:18.992450 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989903 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 21:07:18.992450 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989906 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 21:07:18.992450 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989909 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 21:07:18.992450 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989912 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 21:07:18.992450 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989915 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 21:07:18.992450 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989918 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 21:07:18.992450 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989920 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 21:07:18.992450 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989923 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 21:07:18.992450 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989925 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 21:07:18.992450 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989928 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 21:07:18.992450 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989930 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 21:07:18.992450 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989933 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 21:07:18.992450 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989936 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 21:07:18.992450 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989938 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 21:07:18.992450 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989941 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 21:07:18.992450 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989944 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 21:07:18.992960 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989946 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 21:07:18.992960 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989949 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 21:07:18.992960 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989951 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 21:07:18.992960 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989956 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 21:07:18.992960 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989959 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 21:07:18.992960 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989962 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 21:07:18.992960 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989966 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 21:07:18.992960 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989969 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 21:07:18.992960 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989972 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 21:07:18.992960 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989975 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 21:07:18.992960 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989978 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 21:07:18.992960 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989981 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 21:07:18.992960 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989984 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 21:07:18.992960 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989987 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 21:07:18.992960 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989989 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 21:07:18.992960 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989992 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 21:07:18.992960 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989994 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 21:07:18.992960 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989997 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 21:07:18.992960 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.989999 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 21:07:18.993459 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990002 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 21:07:18.993459 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990004 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 21:07:18.993459 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990007 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 21:07:18.993459 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990009 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 21:07:18.993459 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990012 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 21:07:18.993459 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990014 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 21:07:18.993459 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990017 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 21:07:18.993459 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990019 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 21:07:18.993459 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990022 2564 feature_gate.go:328] unrecognized feature gate: Example Jun 08 21:07:18.993459 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990025 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 21:07:18.993459 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990028 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 21:07:18.993459 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990031 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 21:07:18.993459 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990034 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 21:07:18.993459 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990036 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 21:07:18.993459 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990039 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 21:07:18.993459 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990042 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 21:07:18.993459 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990044 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 21:07:18.993459 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990047 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 21:07:18.993459 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990049 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 21:07:18.993459 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990052 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 21:07:18.993952 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990470 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 21:07:18.993952 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990477 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 21:07:18.993952 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990482 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 21:07:18.993952 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990485 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 21:07:18.993952 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990489 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 21:07:18.993952 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990492 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 21:07:18.993952 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990495 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 21:07:18.993952 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990497 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 21:07:18.993952 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990501 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 21:07:18.993952 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990503 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 21:07:18.993952 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990506 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 21:07:18.993952 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990509 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 21:07:18.993952 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990511 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 21:07:18.993952 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990514 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 21:07:18.993952 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990517 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 21:07:18.993952 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990519 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 21:07:18.993952 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990522 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 21:07:18.993952 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990524 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 21:07:18.993952 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990527 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 21:07:18.993952 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990529 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 21:07:18.994463 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990532 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 21:07:18.994463 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990535 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 21:07:18.994463 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990537 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 21:07:18.994463 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990546 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 21:07:18.994463 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990548 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 21:07:18.994463 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990551 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 21:07:18.994463 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990554 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 21:07:18.994463 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990556 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 21:07:18.994463 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990559 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 21:07:18.994463 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990561 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 21:07:18.994463 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990564 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 21:07:18.994463 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990567 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 21:07:18.994463 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990569 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 21:07:18.994463 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990572 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 21:07:18.994463 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990575 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 21:07:18.994463 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990577 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 21:07:18.994463 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990580 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 21:07:18.994463 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990583 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 21:07:18.994463 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990586 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 21:07:18.994463 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990589 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 21:07:18.994981 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990591 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 21:07:18.994981 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990595 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 21:07:18.994981 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990598 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 21:07:18.994981 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990600 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 21:07:18.994981 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990603 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 21:07:18.994981 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990606 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 21:07:18.994981 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990608 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 21:07:18.994981 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990611 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 21:07:18.994981 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990613 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 21:07:18.994981 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990616 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 21:07:18.994981 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990618 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 21:07:18.994981 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990621 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 21:07:18.994981 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990623 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 21:07:18.994981 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990626 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 21:07:18.994981 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990629 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 21:07:18.994981 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990633 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 21:07:18.994981 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990636 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 21:07:18.994981 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990638 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 21:07:18.994981 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990641 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 21:07:18.994981 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990643 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 21:07:18.995502 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990646 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 21:07:18.995502 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990648 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 21:07:18.995502 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990651 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 21:07:18.995502 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990654 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 21:07:18.995502 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990656 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 21:07:18.995502 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990659 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 21:07:18.995502 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990662 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 21:07:18.995502 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990664 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 21:07:18.995502 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990667 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 21:07:18.995502 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990671 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 21:07:18.995502 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990674 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 21:07:18.995502 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990676 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 21:07:18.995502 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990679 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 21:07:18.995502 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990681 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 21:07:18.995502 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990684 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 21:07:18.995502 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990686 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 21:07:18.995502 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990689 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 21:07:18.995502 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990691 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 21:07:18.995502 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990694 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 21:07:18.995502 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990697 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 21:07:18.995975 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990699 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 21:07:18.995975 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990703 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 21:07:18.995975 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990706 2564 feature_gate.go:328] unrecognized feature gate: Example Jun 08 21:07:18.995975 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990709 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 21:07:18.995975 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990713 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 21:07:18.995975 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990715 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 21:07:18.995975 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990718 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 21:07:18.995975 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990722 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 21:07:18.995975 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990726 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 21:07:18.995975 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990730 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 21:07:18.995975 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990733 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 21:07:18.995975 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990736 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 21:07:18.995975 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990738 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 21:07:18.995975 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990741 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 21:07:18.995975 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990744 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 21:07:18.995975 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990747 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 21:07:18.995975 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990749 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 21:07:18.995975 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990752 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 21:07:18.995975 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.990754 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 21:07:18.996466 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.990833 2564 flags.go:64] FLAG: --address="0.0.0.0" Jun 08 21:07:18.996466 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.990842 2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 08 21:07:18.996466 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.990848 2564 flags.go:64] FLAG: --anonymous-auth="true" Jun 08 21:07:18.996466 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.990852 2564 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 08 21:07:18.996466 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.990858 2564 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 08 21:07:18.996466 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.990861 2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 08 21:07:18.996466 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.990865 2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 08 21:07:18.996466 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.990870 2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 08 21:07:18.996466 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.990873 2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 08 21:07:18.996466 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.990876 2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 08 21:07:18.996466 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.990879 2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 08 21:07:18.996466 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.990883 2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 08 21:07:18.996466 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.990886 2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 08 21:07:18.996466 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.990889 2564 flags.go:64] FLAG: --cgroup-root="" Jun 08 21:07:18.996466 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.990893 2564 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 08 21:07:18.996466 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.990896 2564 flags.go:64] FLAG: --client-ca-file="" Jun 08 21:07:18.996466 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.990899 2564 flags.go:64] FLAG: --cloud-provider="external" Jun 08 21:07:18.996466 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.990902 2564 flags.go:64] FLAG: --cluster-dns="[]" Jun 08 21:07:18.996466 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.990908 2564 flags.go:64] FLAG: --cluster-domain="" Jun 08 21:07:18.996466 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.990910 2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 08 21:07:18.996466 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.990915 2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 08 21:07:18.996466 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.990919 2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 08 21:07:18.996466 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.990923 2564 flags.go:64] FLAG: --container-log-max-files="5" Jun 08 21:07:18.996466 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.990927 2564 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 08 21:07:18.997076 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.990930 2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 08 21:07:18.997076 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.990933 2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 08 21:07:18.997076 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.990936 2564 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 08 21:07:18.997076 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.990939 2564 flags.go:64] FLAG: --contention-profiling="false" Jun 08 21:07:18.997076 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.990942 2564 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 08 21:07:18.997076 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.990946 2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 08 21:07:18.997076 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.990949 2564 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 08 21:07:18.997076 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.990952 2564 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 08 21:07:18.997076 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.990957 2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 08 21:07:18.997076 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.990960 2564 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 08 21:07:18.997076 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.990963 2564 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 08 21:07:18.997076 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.990966 2564 flags.go:64] FLAG: --enable-load-reader="false" Jun 08 21:07:18.997076 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.990969 2564 flags.go:64] FLAG: --enable-server="true" Jun 08 21:07:18.997076 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.990978 2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 08 21:07:18.997076 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.990983 2564 flags.go:64] FLAG: --event-burst="100" Jun 08 21:07:18.997076 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.990986 2564 flags.go:64] FLAG: --event-qps="50" Jun 08 21:07:18.997076 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.990989 2564 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 08 21:07:18.997076 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.990992 2564 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 08 21:07:18.997076 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.990995 2564 flags.go:64] FLAG: --eviction-hard="" Jun 08 21:07:18.997076 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.990999 2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 08 21:07:18.997076 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991002 2564 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 08 21:07:18.997076 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991005 2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 08 21:07:18.997076 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991009 2564 flags.go:64] FLAG: --eviction-soft="" Jun 08 21:07:18.997076 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991011 2564 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 08 21:07:18.997076 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991014 2564 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 08 21:07:18.997714 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991017 2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 08 21:07:18.997714 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991020 2564 flags.go:64] FLAG: --experimental-mounter-path="" Jun 08 21:07:18.997714 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991023 2564 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 08 21:07:18.997714 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991029 2564 flags.go:64] FLAG: --fail-swap-on="true" Jun 08 21:07:18.997714 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991032 2564 flags.go:64] FLAG: --feature-gates="" Jun 08 21:07:18.997714 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991036 2564 flags.go:64] FLAG: --file-check-frequency="20s" Jun 08 21:07:18.997714 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991039 2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 08 21:07:18.997714 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991043 2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 08 21:07:18.997714 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991046 2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 08 21:07:18.997714 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991049 2564 flags.go:64] FLAG: --healthz-port="10248" Jun 08 21:07:18.997714 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991052 2564 flags.go:64] FLAG: --help="false" Jun 08 21:07:18.997714 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991055 2564 flags.go:64] FLAG: --hostname-override="ip-10-0-133-247.ec2.internal" Jun 08 21:07:18.997714 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991058 2564 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 08 21:07:18.997714 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991061 2564 flags.go:64] FLAG: --http-check-frequency="20s" Jun 08 21:07:18.997714 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991063 2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 08 21:07:18.997714 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991067 2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 08 21:07:18.997714 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991070 2564 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 08 21:07:18.997714 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991073 2564 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 08 21:07:18.997714 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991076 2564 flags.go:64] FLAG: --image-service-endpoint="" Jun 08 21:07:18.997714 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991079 2564 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 08 21:07:18.997714 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991082 2564 flags.go:64] FLAG: --kube-api-burst="100" Jun 08 21:07:18.997714 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991090 2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 08 21:07:18.997714 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991094 2564 flags.go:64] FLAG: --kube-api-qps="50" Jun 08 21:07:18.997714 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991097 2564 flags.go:64] FLAG: --kube-reserved="" Jun 08 21:07:18.998352 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991100 2564 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 08 21:07:18.998352 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991103 2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 08 21:07:18.998352 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991106 2564 flags.go:64] FLAG: --kubelet-cgroups="" Jun 08 21:07:18.998352 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991109 2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 08 21:07:18.998352 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991111 2564 flags.go:64] FLAG: --lock-file="" Jun 08 21:07:18.998352 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991114 2564 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 08 21:07:18.998352 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991117 2564 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 08 21:07:18.998352 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991120 2564 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 08 21:07:18.998352 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991126 2564 flags.go:64] FLAG: --log-json-split-stream="false" Jun 08 21:07:18.998352 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991129 2564 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 08 21:07:18.998352 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991132 2564 flags.go:64] FLAG: --log-text-split-stream="false" Jun 08 21:07:18.998352 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991137 2564 flags.go:64] FLAG: --logging-format="text" Jun 08 21:07:18.998352 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991140 2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 08 21:07:18.998352 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991143 2564 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 08 21:07:18.998352 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991146 2564 flags.go:64] FLAG: --manifest-url="" Jun 08 21:07:18.998352 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991149 2564 flags.go:64] FLAG: --manifest-url-header="" Jun 08 21:07:18.998352 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991154 2564 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 08 21:07:18.998352 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991157 2564 flags.go:64] FLAG: --max-open-files="1000000" Jun 08 21:07:18.998352 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991161 2564 flags.go:64] FLAG: --max-pods="110" Jun 08 21:07:18.998352 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991164 2564 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 08 21:07:18.998352 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991167 2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 08 21:07:18.998352 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991170 2564 flags.go:64] FLAG: --memory-manager-policy="None" Jun 08 21:07:18.998352 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991173 2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 08 21:07:18.998352 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991176 2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 08 21:07:18.998352 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991179 2564 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 08 21:07:18.998960 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991182 2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 08 21:07:18.998960 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991191 2564 flags.go:64] FLAG: --node-status-max-images="50" Jun 08 21:07:18.998960 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991194 2564 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 08 21:07:18.998960 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991197 2564 flags.go:64] FLAG: --oom-score-adj="-999" Jun 08 21:07:18.998960 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991201 2564 flags.go:64] FLAG: --pod-cidr="" Jun 08 21:07:18.998960 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991209 2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 08 21:07:18.998960 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991214 2564 flags.go:64] FLAG: --pod-manifest-path="" Jun 08 21:07:18.998960 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991218 2564 flags.go:64] FLAG: --pod-max-pids="-1" Jun 08 21:07:18.998960 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991221 2564 flags.go:64] FLAG: --pods-per-core="0" Jun 08 21:07:18.998960 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991224 2564 flags.go:64] FLAG: --port="10250" Jun 08 21:07:18.998960 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991227 2564 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 08 21:07:18.998960 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991230 2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-05dabd64c83bfff27" Jun 08 21:07:18.998960 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991233 2564 flags.go:64] FLAG: --qos-reserved="" Jun 08 21:07:18.998960 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991236 2564 flags.go:64] FLAG: --read-only-port="10255" Jun 08 21:07:18.998960 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991239 2564 flags.go:64] FLAG: --register-node="true" Jun 08 21:07:18.998960 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991242 2564 flags.go:64] FLAG: --register-with-taints="" Jun 08 21:07:18.998960 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991250 2564 flags.go:64] FLAG: --registry-burst="10" Jun 08 21:07:18.998960 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991253 2564 flags.go:64] FLAG: --registry-qps="5" Jun 08 21:07:18.998960 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991260 2564 flags.go:64] FLAG: --reserved-cpus="" Jun 08 21:07:18.998960 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991277 2564 flags.go:64] FLAG: --reserved-memory="" Jun 08 21:07:18.998960 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991281 2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 08 21:07:18.998960 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991284 2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 08 21:07:18.998960 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991288 2564 flags.go:64] FLAG: --rotate-certificates="false" Jun 08 21:07:18.998960 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991291 2564 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 08 21:07:18.998960 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991293 2564 flags.go:64] FLAG: --runonce="false" Jun 08 21:07:18.999674 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991297 2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 08 21:07:18.999674 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991300 2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 08 21:07:18.999674 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991303 2564 flags.go:64] FLAG: --seccomp-default="false" Jun 08 21:07:18.999674 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991306 2564 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 08 21:07:18.999674 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991309 2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 08 21:07:18.999674 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991312 2564 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 08 21:07:18.999674 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991315 2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 08 21:07:18.999674 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991318 2564 flags.go:64] FLAG: --storage-driver-password="root" Jun 08 21:07:18.999674 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991321 2564 flags.go:64] FLAG: --storage-driver-secure="false" Jun 08 21:07:18.999674 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991324 2564 flags.go:64] FLAG: --storage-driver-table="stats" Jun 08 21:07:18.999674 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991327 2564 flags.go:64] FLAG: --storage-driver-user="root" Jun 08 21:07:18.999674 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991330 2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 08 21:07:18.999674 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991333 2564 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 08 21:07:18.999674 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991344 2564 flags.go:64] FLAG: --system-cgroups="" Jun 08 21:07:18.999674 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991347 2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 08 21:07:18.999674 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991352 2564 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 08 21:07:18.999674 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991355 2564 flags.go:64] FLAG: --tls-cert-file="" Jun 08 21:07:18.999674 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991358 2564 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 08 21:07:18.999674 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991376 2564 flags.go:64] FLAG: --tls-min-version="" Jun 08 21:07:18.999674 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991379 2564 flags.go:64] FLAG: --tls-private-key-file="" Jun 08 21:07:18.999674 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991383 2564 flags.go:64] FLAG: --topology-manager-policy="none" Jun 08 21:07:18.999674 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991386 2564 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 08 21:07:18.999674 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991390 2564 flags.go:64] FLAG: --topology-manager-scope="container" Jun 08 21:07:18.999674 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991393 2564 flags.go:64] FLAG: --v="2" Jun 08 21:07:18.999674 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991397 2564 flags.go:64] FLAG: --version="false" Jun 08 21:07:19.000314 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991402 2564 flags.go:64] FLAG: --vmodule="" Jun 08 21:07:19.000314 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991407 2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 08 21:07:19.000314 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991411 2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 08 21:07:19.000314 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991537 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 21:07:19.000314 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991541 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 21:07:19.000314 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991544 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 21:07:19.000314 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991547 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 21:07:19.000314 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991551 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 21:07:19.000314 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991554 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 21:07:19.000314 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991556 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 21:07:19.000314 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991559 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 21:07:19.000314 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991563 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 21:07:19.000314 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991566 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 21:07:19.000314 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991570 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 21:07:19.000314 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991573 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 21:07:19.000314 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991576 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 21:07:19.000314 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991578 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 21:07:19.000314 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991581 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 21:07:19.000314 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991584 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 21:07:19.000314 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991587 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 21:07:19.000808 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991589 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 21:07:19.000808 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991598 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 21:07:19.000808 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991601 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 21:07:19.000808 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991603 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 21:07:19.000808 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991606 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 21:07:19.000808 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991608 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 21:07:19.000808 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991611 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 21:07:19.000808 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991614 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 21:07:19.000808 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991616 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 21:07:19.000808 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991619 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 21:07:19.000808 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991622 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 21:07:19.000808 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991624 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 21:07:19.000808 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991628 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 21:07:19.000808 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991632 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 21:07:19.000808 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991634 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 21:07:19.000808 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991637 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 21:07:19.000808 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991640 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 21:07:19.000808 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991642 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 21:07:19.000808 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991645 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 21:07:19.000808 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991647 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 21:07:19.001316 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991650 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 21:07:19.001316 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991653 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 21:07:19.001316 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991656 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 21:07:19.001316 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991658 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 21:07:19.001316 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991661 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 21:07:19.001316 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991665 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 21:07:19.001316 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991668 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 21:07:19.001316 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991671 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 21:07:19.001316 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991674 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 21:07:19.001316 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991677 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 21:07:19.001316 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991680 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 21:07:19.001316 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991683 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 21:07:19.001316 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991686 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 21:07:19.001316 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991688 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 21:07:19.001316 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991691 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 21:07:19.001316 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991694 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 21:07:19.001316 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991697 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 21:07:19.001316 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991699 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 21:07:19.001316 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991701 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 21:07:19.001316 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991704 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 21:07:19.001811 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991706 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 21:07:19.001811 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991709 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 21:07:19.001811 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991712 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 21:07:19.001811 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991714 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 21:07:19.001811 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991718 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 21:07:19.001811 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991722 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 21:07:19.001811 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991725 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 21:07:19.001811 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991727 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 21:07:19.001811 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991730 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 21:07:19.001811 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991732 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 21:07:19.001811 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991735 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 21:07:19.001811 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991737 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 21:07:19.001811 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991740 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 21:07:19.001811 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991743 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 21:07:19.001811 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991745 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 21:07:19.001811 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991748 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 21:07:19.001811 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991750 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 21:07:19.001811 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991753 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 21:07:19.001811 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991756 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 21:07:19.002332 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991758 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 21:07:19.002332 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991761 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 21:07:19.002332 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991763 2564 feature_gate.go:328] unrecognized feature gate: Example Jun 08 21:07:19.002332 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991766 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 21:07:19.002332 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991768 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 21:07:19.002332 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991771 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 21:07:19.002332 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991773 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 21:07:19.002332 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991775 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 21:07:19.002332 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991779 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 21:07:19.002332 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991781 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 21:07:19.002332 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991784 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 21:07:19.002332 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991786 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 21:07:19.002332 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991788 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 21:07:19.002332 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991791 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 21:07:19.002332 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991793 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 21:07:19.002332 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991796 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 21:07:19.002332 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991798 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 21:07:19.002332 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991802 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 21:07:19.002332 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991806 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 21:07:19.002332 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991810 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 21:07:19.002823 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991814 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 21:07:19.002823 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991816 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 21:07:19.002823 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.991819 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 21:07:19.002823 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.991824 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 21:07:19.002823 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.998657 2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 08 21:07:19.002823 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.998672 2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 08 21:07:19.002823 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.998686 2564 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 08 21:07:19.002823 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.998693 2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 08 21:07:19.002823 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998748 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 21:07:19.002823 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998752 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 21:07:19.002823 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998757 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 21:07:19.002823 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998760 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 21:07:19.002823 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998763 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 21:07:19.002823 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998766 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 21:07:19.002823 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998768 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 21:07:19.003189 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998771 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 21:07:19.003189 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998774 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 21:07:19.003189 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998777 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 21:07:19.003189 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998779 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 21:07:19.003189 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998782 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 21:07:19.003189 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998785 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 21:07:19.003189 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998788 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 21:07:19.003189 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998790 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 21:07:19.003189 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998793 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 21:07:19.003189 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998795 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 21:07:19.003189 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998798 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 21:07:19.003189 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998801 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 21:07:19.003189 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998803 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 21:07:19.003189 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998806 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 21:07:19.003189 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998809 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 21:07:19.003189 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998812 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 21:07:19.003189 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998817 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 21:07:19.003189 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998820 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 21:07:19.003189 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998823 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 21:07:19.003785 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998826 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 21:07:19.003785 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998829 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 21:07:19.003785 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998832 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 21:07:19.003785 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998835 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 21:07:19.003785 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998839 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 21:07:19.003785 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998841 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 21:07:19.003785 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998844 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 21:07:19.003785 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998847 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 21:07:19.003785 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998849 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 21:07:19.003785 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998852 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 21:07:19.003785 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998854 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 21:07:19.003785 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998857 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 21:07:19.003785 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998859 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 21:07:19.003785 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998862 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 21:07:19.003785 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998865 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 21:07:19.003785 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998868 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 21:07:19.003785 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998872 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 21:07:19.003785 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998875 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 21:07:19.003785 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998877 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 21:07:19.004248 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998881 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 21:07:19.004248 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998883 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 21:07:19.004248 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998886 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 21:07:19.004248 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998889 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 21:07:19.004248 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998891 2564 feature_gate.go:328] unrecognized feature gate: Example Jun 08 21:07:19.004248 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998894 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 21:07:19.004248 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998897 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 21:07:19.004248 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998900 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 21:07:19.004248 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998902 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 21:07:19.004248 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998905 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 21:07:19.004248 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998907 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 21:07:19.004248 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998910 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 21:07:19.004248 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998913 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 21:07:19.004248 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998915 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 21:07:19.004248 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998918 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 21:07:19.004248 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998921 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 21:07:19.004248 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998923 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 21:07:19.004248 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998926 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 21:07:19.004248 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998929 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 21:07:19.004248 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998932 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 21:07:19.004248 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998935 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 21:07:19.004786 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998937 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 21:07:19.004786 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998940 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 21:07:19.004786 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998942 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 21:07:19.004786 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998944 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 21:07:19.004786 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998947 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 21:07:19.004786 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998950 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 21:07:19.004786 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998952 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 21:07:19.004786 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998955 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 21:07:19.004786 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998957 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 21:07:19.004786 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998960 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 21:07:19.004786 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998962 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 21:07:19.004786 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998965 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 21:07:19.004786 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998968 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 21:07:19.004786 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998971 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 21:07:19.004786 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998973 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 21:07:19.004786 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998976 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 21:07:19.004786 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998979 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 21:07:19.004786 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998982 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 21:07:19.004786 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998984 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 21:07:19.004786 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998987 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 21:07:19.005329 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998990 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 21:07:19.005329 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998993 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 21:07:19.005329 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998995 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 21:07:19.005329 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.998998 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 21:07:19.005329 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999000 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 21:07:19.005329 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999003 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 21:07:19.005329 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999005 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 21:07:19.005329 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999008 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 21:07:19.005329 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999011 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 21:07:19.005329 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999015 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 21:07:19.005329 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999018 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 21:07:19.005329 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999021 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 21:07:19.005329 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999024 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 21:07:19.005329 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.999029 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 21:07:19.005329 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999141 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 21:07:19.005707 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999147 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 21:07:19.005707 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999150 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 21:07:19.005707 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999152 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 21:07:19.005707 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999155 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 21:07:19.005707 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999158 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 21:07:19.005707 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999162 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 21:07:19.005707 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999166 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 21:07:19.005707 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999169 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 21:07:19.005707 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999171 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 21:07:19.005707 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999174 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 21:07:19.005707 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999177 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 21:07:19.005707 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999179 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 21:07:19.005707 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999182 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 21:07:19.005707 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999184 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 21:07:19.005707 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999187 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 21:07:19.005707 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999189 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 21:07:19.005707 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999192 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 21:07:19.005707 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999195 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 21:07:19.005707 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999197 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 21:07:19.006172 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999200 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 21:07:19.006172 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999205 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 21:07:19.006172 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999208 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 21:07:19.006172 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999211 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 21:07:19.006172 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999214 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 21:07:19.006172 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999217 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 21:07:19.006172 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999220 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 21:07:19.006172 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999223 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 21:07:19.006172 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999226 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 21:07:19.006172 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999229 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 21:07:19.006172 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999231 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 21:07:19.006172 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999234 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 21:07:19.006172 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999237 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 21:07:19.006172 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999239 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 21:07:19.006172 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999241 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 21:07:19.006172 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999244 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 21:07:19.006172 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999246 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 21:07:19.006172 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999249 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 21:07:19.006172 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999251 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 21:07:19.006652 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999254 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 21:07:19.006652 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999256 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 21:07:19.006652 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999259 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 21:07:19.006652 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999261 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 21:07:19.006652 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999279 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 21:07:19.006652 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999282 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 21:07:19.006652 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999284 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 21:07:19.006652 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999287 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 21:07:19.006652 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999290 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 21:07:19.006652 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999293 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 21:07:19.006652 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999295 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 21:07:19.006652 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999298 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 21:07:19.006652 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999301 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 21:07:19.006652 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999303 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 21:07:19.006652 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999306 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 21:07:19.006652 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999309 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 21:07:19.006652 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999311 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 21:07:19.006652 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999314 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 21:07:19.006652 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999316 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 21:07:19.006652 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999319 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 21:07:19.007252 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999321 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 21:07:19.007252 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999324 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 21:07:19.007252 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999327 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 21:07:19.007252 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999329 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 21:07:19.007252 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999332 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 21:07:19.007252 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999335 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 21:07:19.007252 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999337 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 21:07:19.007252 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999340 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 21:07:19.007252 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999342 2564 feature_gate.go:328] unrecognized feature gate: Example Jun 08 21:07:19.007252 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999346 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 21:07:19.007252 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999350 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 21:07:19.007252 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999353 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 21:07:19.007252 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999356 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 21:07:19.007252 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999358 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 21:07:19.007252 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999368 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 21:07:19.007252 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999372 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 21:07:19.007252 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999375 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 21:07:19.007252 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999378 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 21:07:19.007252 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999381 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 21:07:19.007252 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999384 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 21:07:19.008011 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999386 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 21:07:19.008011 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999389 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 21:07:19.008011 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999392 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 21:07:19.008011 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999395 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 21:07:19.008011 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999398 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 21:07:19.008011 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999401 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 21:07:19.008011 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999404 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 21:07:19.008011 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999407 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 21:07:19.008011 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999410 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 21:07:19.008011 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999412 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 21:07:19.008011 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999415 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 21:07:19.008011 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999417 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 21:07:19.008011 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999420 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 21:07:19.008011 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999423 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 21:07:19.008011 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999425 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 21:07:19.008011 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999429 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 21:07:19.008011 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999431 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 21:07:19.008011 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999434 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 21:07:19.008011 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999437 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 21:07:19.008011 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:18.999439 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 21:07:19.008586 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.999444 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 21:07:19.008586 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:18.999567 2564 server.go:962] "Client rotation is on, will bootstrap in background" Jun 08 21:07:19.008586 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.001632 2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 08 21:07:19.008586 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.002928 2564 server.go:1019] "Starting client certificate rotation" Jun 08 21:07:19.008586 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.003023 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 08 21:07:19.008586 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.003058 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 08 21:07:19.008586 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.005204 2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 08 21:07:19.008586 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.007123 2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 08 21:07:19.017874 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.017856 2564 log.go:25] "Validated CRI v1 runtime API" Jun 08 21:07:19.020671 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.020656 2564 log.go:25] "Validated CRI v1 image API" Jun 08 21:07:19.022116 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.022092 2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 08 21:07:19.024441 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.024418 2564 fs.go:135] Filesystem UUIDs: map[43049196-a138-465f-8024-3db4000ad78f:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 f6e21344-c8ed-47fe-ac0a-110bf9970736:/dev/nvme0n1p3] Jun 08 21:07:19.024493 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.024441 2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 08 21:07:19.030045 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.029936 2564 manager.go:216] Machine: {Timestamp:2026-06-08 21:07:19.028771517 +0000 UTC m=+0.286447882 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3104682 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2402e1608cc7921aef4270e68412d0 SystemUUID:ec2402e1-608c-c792-1aef-4270e68412d0 BootID:ae9b36a9-75c9-493d-aa4c-76ad9a655323 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b4:b2:61:32:55 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b4:b2:61:32:55 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:62:ba:ae:39:16:e5 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 08 21:07:19.030045 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.030034 2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 08 21:07:19.030184 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.030167 2564 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 08 21:07:19.032513 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.032496 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 08 21:07:19.033167 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.033139 2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 08 21:07:19.033339 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.033173 2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-247.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 08 21:07:19.033920 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.033911 2564 topology_manager.go:138] "Creating topology manager with none policy" Jun 08 21:07:19.033953 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.033923 2564 container_manager_linux.go:309] "Creating device plugin manager" Jun 08 21:07:19.033953 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.033930 2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 08 21:07:19.034474 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.034464 2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 08 21:07:19.035503 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.035493 2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 08 21:07:19.038387 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.038375 2564 state_mem.go:36] "Initialized new in-memory state store" Jun 08 21:07:19.038532 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.038522 2564 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 08 21:07:19.038564 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.038559 2564 kubelet.go:486] "Attempting to sync node with API server" Jun 08 21:07:19.038593 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.038571 2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 08 21:07:19.038623 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.038592 2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 08 21:07:19.038623 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.038605 2564 kubelet.go:398] "Adding apiserver pod source" Jun 08 21:07:19.038623 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.038614 2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 08 21:07:19.039401 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.039385 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 08 21:07:19.039484 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.039410 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 08 21:07:19.041404 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.041369 2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 08 21:07:19.042959 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.042940 2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 08 21:07:19.043043 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.042982 2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 08 21:07:19.044182 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.044160 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 08 21:07:19.044256 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.044189 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 08 21:07:19.044256 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.044198 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 08 21:07:19.044256 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.044207 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 08 21:07:19.044256 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.044220 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 08 21:07:19.044256 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.044230 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 08 21:07:19.044256 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.044243 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 08 21:07:19.044256 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.044251 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 08 21:07:19.044497 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.044283 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 08 21:07:19.044497 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.044293 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 08 21:07:19.044497 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.044307 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 08 21:07:19.044497 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.044316 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 08 21:07:19.044958 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.044948 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 08 21:07:19.045004 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.044961 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 08 21:07:19.048247 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.048234 2564 server.go:1268] "Started kubelet" Jun 08 21:07:19.048368 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.048338 2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 08 21:07:19.048462 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.048371 2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 08 21:07:19.048651 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.048637 2564 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 08 21:07:19.051985 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.051947 2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-247.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 08 21:07:19.052200 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:19.052176 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 08 21:07:19.052865 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:19.052340 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-247.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 08 21:07:19.052838 ip-10-0-133-247 systemd[1]: Started Kubernetes Kubelet. Jun 08 21:07:19.053444 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.053313 2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 08 21:07:19.054427 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.054245 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-k7x6c" Jun 08 21:07:19.054641 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.054609 2564 server.go:310] "Adding debug handlers to kubelet server" Jun 08 21:07:19.057799 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:19.056669 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-247.ec2.internal.18b7372bd53008c4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-247.ec2.internal,UID:ip-10-0-133-247.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-247.ec2.internal,},FirstTimestamp:2026-06-08 21:07:19.0481369 +0000 UTC m=+0.305813266,LastTimestamp:2026-06-08 21:07:19.0481369 +0000 UTC m=+0.305813266,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-247.ec2.internal,}" Jun 08 21:07:19.059211 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:19.059192 2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 08 21:07:19.059922 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.059908 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-k7x6c" Jun 08 21:07:19.066122 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.065975 2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 08 21:07:19.066285 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.065980 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 08 21:07:19.066362 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:19.066318 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-247.ec2.internal\" not found" Jun 08 21:07:19.066786 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.066771 2564 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 08 21:07:19.066786 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.066788 2564 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 08 21:07:19.066924 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.066798 2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 08 21:07:19.066924 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.066905 2564 reconstruct.go:97] "Volume reconstruction finished" Jun 08 21:07:19.066924 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.066913 2564 reconciler.go:29] "Reconciler: start to sync state" Jun 08 21:07:19.068785 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.068767 2564 factory.go:55] Registering systemd factory Jun 08 21:07:19.068785 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.068787 2564 factory.go:223] Registration of the systemd container factory successfully Jun 08 21:07:19.069909 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.069809 2564 factory.go:153] Registering CRI-O factory Jun 08 21:07:19.069909 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.069824 2564 factory.go:223] Registration of the crio container factory successfully Jun 08 21:07:19.069909 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.069897 2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 08 21:07:19.070023 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.069925 2564 factory.go:103] Registering Raw factory Jun 08 21:07:19.070023 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.069940 2564 manager.go:1196] Started watching for new ooms in manager Jun 08 21:07:19.070365 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.070354 2564 manager.go:349] Starting recovery of all containers Jun 08 21:07:19.073759 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.073718 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 08 21:07:19.078881 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.078862 2564 manager.go:354] Recovery completed Jun 08 21:07:19.080143 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.080127 2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 21:07:19.083546 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.083532 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 21:07:19.085422 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:19.085404 2564 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-133-247.ec2.internal\" not found" node="ip-10-0-133-247.ec2.internal" Jun 08 21:07:19.086737 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.086722 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-247.ec2.internal" event="NodeHasSufficientMemory" Jun 08 21:07:19.086782 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.086754 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-247.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 21:07:19.086782 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.086764 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-247.ec2.internal" event="NodeHasSufficientPID" Jun 08 21:07:19.087393 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.087376 2564 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 08 21:07:19.087393 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.087392 2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 08 21:07:19.087504 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.087397 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 21:07:19.087504 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.087413 2564 state_mem.go:36] "Initialized new in-memory state store" Jun 08 21:07:19.088165 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.088149 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-247.ec2.internal" event="NodeHasSufficientMemory" Jun 08 21:07:19.088220 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.088179 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-247.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 21:07:19.088220 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.088189 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-247.ec2.internal" event="NodeHasSufficientPID" Jun 08 21:07:19.088520 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.088508 2564 policy_none.go:49] "None policy: Start" Jun 08 21:07:19.088576 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.088527 2564 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 08 21:07:19.088576 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.088541 2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 08 21:07:19.089636 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.089623 2564 policy_none.go:47] "Start" Jun 08 21:07:19.126856 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.126837 2564 manager.go:337] "Starting Device Plugin manager" Jun 08 21:07:19.137374 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:19.126916 2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 08 21:07:19.137374 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.126930 2564 server.go:87] "Starting device plugin registration server" Jun 08 21:07:19.137374 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.127212 2564 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 08 21:07:19.137374 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.127225 2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 08 21:07:19.137374 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.127343 2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 08 21:07:19.137374 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.127433 2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 08 21:07:19.137374 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.127443 2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 08 21:07:19.137374 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:19.127978 2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 08 21:07:19.137374 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:19.128029 2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-247.ec2.internal\" not found" Jun 08 21:07:19.137374 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.135143 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 08 21:07:19.137374 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.135178 2564 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 08 21:07:19.137374 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.135196 2564 kubelet.go:2448] "Starting kubelet main sync loop" Jun 08 21:07:19.137374 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:19.135226 2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 08 21:07:19.137872 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.137704 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 21:07:19.227866 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.227829 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 21:07:19.229405 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.229387 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-247.ec2.internal" event="NodeHasSufficientMemory" Jun 08 21:07:19.229506 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.229419 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-247.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 21:07:19.229506 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.229430 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-247.ec2.internal" event="NodeHasSufficientPID" Jun 08 21:07:19.229506 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.229453 2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-247.ec2.internal" Jun 08 21:07:19.236344 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.236297 2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-247.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-247.ec2.internal"] Jun 08 21:07:19.236402 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.236359 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 21:07:19.237769 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.237755 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-247.ec2.internal" event="NodeHasSufficientMemory" Jun 08 21:07:19.237819 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.237783 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-247.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 21:07:19.237819 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.237793 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-247.ec2.internal" event="NodeHasSufficientPID" Jun 08 21:07:19.238326 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.238313 2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-247.ec2.internal" Jun 08 21:07:19.238365 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:19.238333 2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-247.ec2.internal\": node \"ip-10-0-133-247.ec2.internal\" not found" Jun 08 21:07:19.238953 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.238942 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 21:07:19.239075 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.239061 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-247.ec2.internal" Jun 08 21:07:19.239113 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.239098 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 21:07:19.239640 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.239623 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-247.ec2.internal" event="NodeHasSufficientMemory" Jun 08 21:07:19.239720 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.239623 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-247.ec2.internal" event="NodeHasSufficientMemory" Jun 08 21:07:19.239720 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.239650 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-247.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 21:07:19.239720 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.239660 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-247.ec2.internal" event="NodeHasSufficientPID" Jun 08 21:07:19.239720 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.239672 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-247.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 21:07:19.239720 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.239684 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-247.ec2.internal" event="NodeHasSufficientPID" Jun 08 21:07:19.240722 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.240702 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-247.ec2.internal" Jun 08 21:07:19.240722 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.240726 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 21:07:19.241472 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.241456 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-247.ec2.internal" event="NodeHasSufficientMemory" Jun 08 21:07:19.241548 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.241482 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-247.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 21:07:19.241548 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.241492 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-247.ec2.internal" event="NodeHasSufficientPID" Jun 08 21:07:19.254117 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:19.254093 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-247.ec2.internal\" not found" Jun 08 21:07:19.268340 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.268314 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0313b76425dedbbdaa2ce42744a43bc4-config\") pod \"kube-apiserver-proxy-ip-10-0-133-247.ec2.internal\" (UID: \"0313b76425dedbbdaa2ce42744a43bc4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-247.ec2.internal" Jun 08 21:07:19.268435 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.268344 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6682056a4304d1a35505f115402ac6d2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-247.ec2.internal\" (UID: \"6682056a4304d1a35505f115402ac6d2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-247.ec2.internal" Jun 08 21:07:19.268435 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.268363 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6682056a4304d1a35505f115402ac6d2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-247.ec2.internal\" (UID: \"6682056a4304d1a35505f115402ac6d2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-247.ec2.internal" Jun 08 21:07:19.276111 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:19.276093 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-247.ec2.internal\" not found" node="ip-10-0-133-247.ec2.internal" Jun 08 21:07:19.280777 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:19.280760 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-247.ec2.internal\" not found" node="ip-10-0-133-247.ec2.internal" Jun 08 21:07:19.354195 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:19.354167 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-247.ec2.internal\" not found" Jun 08 21:07:19.368543 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.368522 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0313b76425dedbbdaa2ce42744a43bc4-config\") pod \"kube-apiserver-proxy-ip-10-0-133-247.ec2.internal\" (UID: \"0313b76425dedbbdaa2ce42744a43bc4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-247.ec2.internal" Jun 08 21:07:19.368617 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.368547 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6682056a4304d1a35505f115402ac6d2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-247.ec2.internal\" (UID: \"6682056a4304d1a35505f115402ac6d2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-247.ec2.internal" Jun 08 21:07:19.368617 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.368564 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6682056a4304d1a35505f115402ac6d2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-247.ec2.internal\" (UID: \"6682056a4304d1a35505f115402ac6d2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-247.ec2.internal" Jun 08 21:07:19.368617 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.368602 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6682056a4304d1a35505f115402ac6d2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-247.ec2.internal\" (UID: \"6682056a4304d1a35505f115402ac6d2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-247.ec2.internal" Jun 08 21:07:19.368738 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.368623 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0313b76425dedbbdaa2ce42744a43bc4-config\") pod \"kube-apiserver-proxy-ip-10-0-133-247.ec2.internal\" (UID: \"0313b76425dedbbdaa2ce42744a43bc4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-247.ec2.internal" Jun 08 21:07:19.368738 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.368658 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6682056a4304d1a35505f115402ac6d2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-247.ec2.internal\" (UID: \"6682056a4304d1a35505f115402ac6d2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-247.ec2.internal" Jun 08 21:07:19.455250 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:19.455214 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-247.ec2.internal\" not found" Jun 08 21:07:19.555543 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:19.555451 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-247.ec2.internal\" not found" Jun 08 21:07:19.580882 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.580857 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-247.ec2.internal" Jun 08 21:07:19.585402 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.585386 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-247.ec2.internal" Jun 08 21:07:19.656104 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:19.656062 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-247.ec2.internal\" not found" Jun 08 21:07:19.756603 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:19.756571 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-247.ec2.internal\" not found" Jun 08 21:07:19.857162 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:19.857078 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-247.ec2.internal\" not found" Jun 08 21:07:19.957609 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:19.957573 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-247.ec2.internal\" not found" Jun 08 21:07:19.970361 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.970328 2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 21:07:19.973874 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:19.973855 2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 21:07:20.002832 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.002807 2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 08 21:07:20.003455 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.002970 2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 08 21:07:20.003455 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.002978 2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 08 21:07:20.003455 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.002980 2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 08 21:07:20.003455 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.002973 2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 08 21:07:20.039124 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.039093 2564 apiserver.go:52] "Watching apiserver" Jun 08 21:07:20.058136 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.058102 2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 08 21:07:20.060008 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.059980 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-pt842","kube-system/global-pull-secret-syncer-9pzqb","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85cpv","openshift-cluster-node-tuning-operator/tuned-h6khk","openshift-dns/node-resolver-zhdb2","openshift-image-registry/node-ca-ls8lw","openshift-multus/multus-additional-cni-plugins-6fp8f","openshift-multus/multus-sljxg","openshift-multus/network-metrics-daemon-xx978","kube-system/konnectivity-agent-s5gwn","openshift-network-diagnostics/network-check-target-qlnlp","openshift-network-operator/iptables-alerter-lvhwv"] Jun 08 21:07:20.061932 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.061914 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pt842" Jun 08 21:07:20.062229 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.062178 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-07 21:02:19 +0000 UTC" deadline="2027-11-07 04:27:11.947046206 +0000 UTC" Jun 08 21:07:20.062229 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.062217 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12391h19m51.884832427s" Jun 08 21:07:20.063184 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.063163 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9pzqb" Jun 08 21:07:20.063379 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:20.063243 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9pzqb" podUID="502a6cc3-183a-4d9d-833d-2f14f5e1c946" Jun 08 21:07:20.064408 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.064379 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 08 21:07:20.065410 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.064760 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85cpv" Jun 08 21:07:20.065536 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.065424 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 08 21:07:20.065623 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.065600 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 08 21:07:20.065716 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.065689 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9njw2\"" Jun 08 21:07:20.065788 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.065770 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 08 21:07:20.066042 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.066025 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 08 21:07:20.066099 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.066025 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 08 21:07:20.066244 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.066224 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-h6khk" Jun 08 21:07:20.066418 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.066404 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 08 21:07:20.066575 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.066517 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-247.ec2.internal" Jun 08 21:07:20.066889 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.066866 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 08 21:07:20.067110 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.067094 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 08 21:07:20.067173 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.067096 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 08 21:07:20.067415 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.067397 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-88qsg\"" Jun 08 21:07:20.067823 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.067805 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zhdb2" Jun 08 21:07:20.068526 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.068511 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 08 21:07:20.068621 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.068600 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9g8jw\"" Jun 08 21:07:20.068827 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.068813 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 08 21:07:20.069529 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.069511 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ls8lw" Jun 08 21:07:20.070091 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.070072 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 08 21:07:20.070165 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.070139 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 08 21:07:20.070207 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.070144 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-d5sjf\"" Jun 08 21:07:20.070601 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.070584 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/acabf8ac-1b36-4532-ada1-7eb8e9b8d71f-etc-tuned\") pod \"tuned-h6khk\" (UID: \"acabf8ac-1b36-4532-ada1-7eb8e9b8d71f\") " pod="openshift-cluster-node-tuning-operator/tuned-h6khk" Jun 08 21:07:20.070656 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.070609 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/85a49d6e-acdf-43ce-b9c9-1c2d7773a948-host-cni-bin\") pod \"ovnkube-node-pt842\" (UID: \"85a49d6e-acdf-43ce-b9c9-1c2d7773a948\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt842" Jun 08 21:07:20.070656 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.070625 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/85a49d6e-acdf-43ce-b9c9-1c2d7773a948-env-overrides\") pod \"ovnkube-node-pt842\" (UID: \"85a49d6e-acdf-43ce-b9c9-1c2d7773a948\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt842" Jun 08 21:07:20.070656 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.070646 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0314c4c2-0ef6-404e-bc48-b4862d0c6ab4-etc-selinux\") pod \"aws-ebs-csi-driver-node-85cpv\" (UID: \"0314c4c2-0ef6-404e-bc48-b4862d0c6ab4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85cpv" Jun 08 21:07:20.070796 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.070675 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/acabf8ac-1b36-4532-ada1-7eb8e9b8d71f-etc-kubernetes\") pod \"tuned-h6khk\" (UID: \"acabf8ac-1b36-4532-ada1-7eb8e9b8d71f\") " pod="openshift-cluster-node-tuning-operator/tuned-h6khk" Jun 08 21:07:20.070796 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.070719 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/acabf8ac-1b36-4532-ada1-7eb8e9b8d71f-tmp\") pod \"tuned-h6khk\" (UID: \"acabf8ac-1b36-4532-ada1-7eb8e9b8d71f\") " pod="openshift-cluster-node-tuning-operator/tuned-h6khk" Jun 08 21:07:20.070796 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.070752 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4fcb5113-dc25-491d-b570-2c2818b90ea9-hosts-file\") pod \"node-resolver-zhdb2\" (UID: \"4fcb5113-dc25-491d-b570-2c2818b90ea9\") " pod="openshift-dns/node-resolver-zhdb2" Jun 08 21:07:20.070796 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.070777 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnl7f\" (UniqueName: \"kubernetes.io/projected/4fcb5113-dc25-491d-b570-2c2818b90ea9-kube-api-access-wnl7f\") pod \"node-resolver-zhdb2\" (UID: \"4fcb5113-dc25-491d-b570-2c2818b90ea9\") " pod="openshift-dns/node-resolver-zhdb2" Jun 08 21:07:20.070987 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.070802 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/85a49d6e-acdf-43ce-b9c9-1c2d7773a948-host-kubelet\") pod \"ovnkube-node-pt842\" (UID: \"85a49d6e-acdf-43ce-b9c9-1c2d7773a948\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt842" Jun 08 21:07:20.070987 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.070826 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/85a49d6e-acdf-43ce-b9c9-1c2d7773a948-ovnkube-script-lib\") pod \"ovnkube-node-pt842\" (UID: \"85a49d6e-acdf-43ce-b9c9-1c2d7773a948\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt842" Jun 08 21:07:20.070987 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.070869 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/502a6cc3-183a-4d9d-833d-2f14f5e1c946-original-pull-secret\") pod \"global-pull-secret-syncer-9pzqb\" (UID: \"502a6cc3-183a-4d9d-833d-2f14f5e1c946\") " pod="kube-system/global-pull-secret-syncer-9pzqb" Jun 08 21:07:20.070987 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.070900 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/85a49d6e-acdf-43ce-b9c9-1c2d7773a948-run-systemd\") pod \"ovnkube-node-pt842\" (UID: \"85a49d6e-acdf-43ce-b9c9-1c2d7773a948\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt842" Jun 08 21:07:20.070987 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.070937 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/502a6cc3-183a-4d9d-833d-2f14f5e1c946-kubelet-config\") pod \"global-pull-secret-syncer-9pzqb\" (UID: \"502a6cc3-183a-4d9d-833d-2f14f5e1c946\") " pod="kube-system/global-pull-secret-syncer-9pzqb" Jun 08 21:07:20.070987 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.070961 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s76cf\" (UniqueName: \"kubernetes.io/projected/0314c4c2-0ef6-404e-bc48-b4862d0c6ab4-kube-api-access-s76cf\") pod \"aws-ebs-csi-driver-node-85cpv\" (UID: \"0314c4c2-0ef6-404e-bc48-b4862d0c6ab4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85cpv" Jun 08 21:07:20.071226 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.071017 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/85a49d6e-acdf-43ce-b9c9-1c2d7773a948-node-log\") pod \"ovnkube-node-pt842\" (UID: \"85a49d6e-acdf-43ce-b9c9-1c2d7773a948\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt842" Jun 08 21:07:20.071226 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.071042 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/85a49d6e-acdf-43ce-b9c9-1c2d7773a948-host-run-ovn-kubernetes\") pod \"ovnkube-node-pt842\" (UID: \"85a49d6e-acdf-43ce-b9c9-1c2d7773a948\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt842" Jun 08 21:07:20.071226 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.071081 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/85a49d6e-acdf-43ce-b9c9-1c2d7773a948-ovnkube-config\") pod \"ovnkube-node-pt842\" (UID: \"85a49d6e-acdf-43ce-b9c9-1c2d7773a948\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt842" Jun 08 21:07:20.071226 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.071106 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/85a49d6e-acdf-43ce-b9c9-1c2d7773a948-ovn-node-metrics-cert\") pod \"ovnkube-node-pt842\" (UID: \"85a49d6e-acdf-43ce-b9c9-1c2d7773a948\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt842" Jun 08 21:07:20.071226 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.071124 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0314c4c2-0ef6-404e-bc48-b4862d0c6ab4-socket-dir\") pod \"aws-ebs-csi-driver-node-85cpv\" (UID: \"0314c4c2-0ef6-404e-bc48-b4862d0c6ab4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85cpv" Jun 08 21:07:20.071226 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.071143 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/acabf8ac-1b36-4532-ada1-7eb8e9b8d71f-sys\") pod \"tuned-h6khk\" (UID: \"acabf8ac-1b36-4532-ada1-7eb8e9b8d71f\") " pod="openshift-cluster-node-tuning-operator/tuned-h6khk" Jun 08 21:07:20.071226 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.071169 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/502a6cc3-183a-4d9d-833d-2f14f5e1c946-dbus\") pod \"global-pull-secret-syncer-9pzqb\" (UID: \"502a6cc3-183a-4d9d-833d-2f14f5e1c946\") " pod="kube-system/global-pull-secret-syncer-9pzqb" Jun 08 21:07:20.071226 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.071183 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0314c4c2-0ef6-404e-bc48-b4862d0c6ab4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-85cpv\" (UID: \"0314c4c2-0ef6-404e-bc48-b4862d0c6ab4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85cpv" Jun 08 21:07:20.071226 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.071198 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/acabf8ac-1b36-4532-ada1-7eb8e9b8d71f-etc-sysctl-conf\") pod \"tuned-h6khk\" (UID: \"acabf8ac-1b36-4532-ada1-7eb8e9b8d71f\") " pod="openshift-cluster-node-tuning-operator/tuned-h6khk" Jun 08 21:07:20.071226 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.071220 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/acabf8ac-1b36-4532-ada1-7eb8e9b8d71f-etc-systemd\") pod \"tuned-h6khk\" (UID: \"acabf8ac-1b36-4532-ada1-7eb8e9b8d71f\") " pod="openshift-cluster-node-tuning-operator/tuned-h6khk" Jun 08 21:07:20.071691 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.071237 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/acabf8ac-1b36-4532-ada1-7eb8e9b8d71f-run\") pod \"tuned-h6khk\" (UID: \"acabf8ac-1b36-4532-ada1-7eb8e9b8d71f\") " pod="openshift-cluster-node-tuning-operator/tuned-h6khk" Jun 08 21:07:20.071691 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.071262 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4fcb5113-dc25-491d-b570-2c2818b90ea9-tmp-dir\") pod \"node-resolver-zhdb2\" (UID: \"4fcb5113-dc25-491d-b570-2c2818b90ea9\") " pod="openshift-dns/node-resolver-zhdb2" Jun 08 21:07:20.071691 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.071320 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/85a49d6e-acdf-43ce-b9c9-1c2d7773a948-systemd-units\") pod \"ovnkube-node-pt842\" (UID: \"85a49d6e-acdf-43ce-b9c9-1c2d7773a948\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt842" Jun 08 21:07:20.071691 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.071342 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/85a49d6e-acdf-43ce-b9c9-1c2d7773a948-host-slash\") pod \"ovnkube-node-pt842\" (UID: \"85a49d6e-acdf-43ce-b9c9-1c2d7773a948\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt842" Jun 08 21:07:20.071691 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.071386 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/85a49d6e-acdf-43ce-b9c9-1c2d7773a948-var-lib-openvswitch\") pod \"ovnkube-node-pt842\" (UID: \"85a49d6e-acdf-43ce-b9c9-1c2d7773a948\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt842" Jun 08 21:07:20.071691 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.071447 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/85a49d6e-acdf-43ce-b9c9-1c2d7773a948-run-openvswitch\") pod \"ovnkube-node-pt842\" (UID: \"85a49d6e-acdf-43ce-b9c9-1c2d7773a948\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt842" Jun 08 21:07:20.071691 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.071482 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/85a49d6e-acdf-43ce-b9c9-1c2d7773a948-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pt842\" (UID: \"85a49d6e-acdf-43ce-b9c9-1c2d7773a948\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt842" Jun 08 21:07:20.071691 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.071526 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0314c4c2-0ef6-404e-bc48-b4862d0c6ab4-sys-fs\") pod \"aws-ebs-csi-driver-node-85cpv\" (UID: \"0314c4c2-0ef6-404e-bc48-b4862d0c6ab4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85cpv" Jun 08 21:07:20.071691 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.071548 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/acabf8ac-1b36-4532-ada1-7eb8e9b8d71f-etc-sysconfig\") pod \"tuned-h6khk\" (UID: \"acabf8ac-1b36-4532-ada1-7eb8e9b8d71f\") " pod="openshift-cluster-node-tuning-operator/tuned-h6khk" Jun 08 21:07:20.071691 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.071575 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/acabf8ac-1b36-4532-ada1-7eb8e9b8d71f-var-lib-kubelet\") pod \"tuned-h6khk\" (UID: \"acabf8ac-1b36-4532-ada1-7eb8e9b8d71f\") " pod="openshift-cluster-node-tuning-operator/tuned-h6khk" Jun 08 21:07:20.071691 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.071596 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/85a49d6e-acdf-43ce-b9c9-1c2d7773a948-host-run-netns\") pod \"ovnkube-node-pt842\" (UID: \"85a49d6e-acdf-43ce-b9c9-1c2d7773a948\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt842" Jun 08 21:07:20.071691 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.071630 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/85a49d6e-acdf-43ce-b9c9-1c2d7773a948-etc-openvswitch\") pod \"ovnkube-node-pt842\" (UID: \"85a49d6e-acdf-43ce-b9c9-1c2d7773a948\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt842" Jun 08 21:07:20.071691 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.071669 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/85a49d6e-acdf-43ce-b9c9-1c2d7773a948-log-socket\") pod \"ovnkube-node-pt842\" (UID: \"85a49d6e-acdf-43ce-b9c9-1c2d7773a948\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt842" Jun 08 21:07:20.071691 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.071644 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6fp8f" Jun 08 21:07:20.071691 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.071692 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/acabf8ac-1b36-4532-ada1-7eb8e9b8d71f-etc-sysctl-d\") pod \"tuned-h6khk\" (UID: \"acabf8ac-1b36-4532-ada1-7eb8e9b8d71f\") " pod="openshift-cluster-node-tuning-operator/tuned-h6khk" Jun 08 21:07:20.072227 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.071713 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/acabf8ac-1b36-4532-ada1-7eb8e9b8d71f-lib-modules\") pod \"tuned-h6khk\" (UID: \"acabf8ac-1b36-4532-ada1-7eb8e9b8d71f\") " pod="openshift-cluster-node-tuning-operator/tuned-h6khk" Jun 08 21:07:20.072227 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.071744 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/acabf8ac-1b36-4532-ada1-7eb8e9b8d71f-host\") pod \"tuned-h6khk\" (UID: \"acabf8ac-1b36-4532-ada1-7eb8e9b8d71f\") " pod="openshift-cluster-node-tuning-operator/tuned-h6khk" Jun 08 21:07:20.072227 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.071766 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zz82z\" (UniqueName: \"kubernetes.io/projected/acabf8ac-1b36-4532-ada1-7eb8e9b8d71f-kube-api-access-zz82z\") pod \"tuned-h6khk\" (UID: \"acabf8ac-1b36-4532-ada1-7eb8e9b8d71f\") " pod="openshift-cluster-node-tuning-operator/tuned-h6khk" Jun 08 21:07:20.072227 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.071789 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/85a49d6e-acdf-43ce-b9c9-1c2d7773a948-run-ovn\") pod \"ovnkube-node-pt842\" (UID: \"85a49d6e-acdf-43ce-b9c9-1c2d7773a948\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt842" Jun 08 21:07:20.072227 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.071824 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/85a49d6e-acdf-43ce-b9c9-1c2d7773a948-host-cni-netd\") pod \"ovnkube-node-pt842\" (UID: \"85a49d6e-acdf-43ce-b9c9-1c2d7773a948\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt842" Jun 08 21:07:20.072227 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.071855 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbknj\" (UniqueName: \"kubernetes.io/projected/85a49d6e-acdf-43ce-b9c9-1c2d7773a948-kube-api-access-hbknj\") pod \"ovnkube-node-pt842\" (UID: \"85a49d6e-acdf-43ce-b9c9-1c2d7773a948\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt842" Jun 08 21:07:20.072227 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.071881 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0314c4c2-0ef6-404e-bc48-b4862d0c6ab4-registration-dir\") pod \"aws-ebs-csi-driver-node-85cpv\" (UID: \"0314c4c2-0ef6-404e-bc48-b4862d0c6ab4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85cpv" Jun 08 21:07:20.072227 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.071916 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0314c4c2-0ef6-404e-bc48-b4862d0c6ab4-device-dir\") pod \"aws-ebs-csi-driver-node-85cpv\" (UID: \"0314c4c2-0ef6-404e-bc48-b4862d0c6ab4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85cpv" Jun 08 21:07:20.072227 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.071944 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/acabf8ac-1b36-4532-ada1-7eb8e9b8d71f-etc-modprobe-d\") pod \"tuned-h6khk\" (UID: \"acabf8ac-1b36-4532-ada1-7eb8e9b8d71f\") " pod="openshift-cluster-node-tuning-operator/tuned-h6khk" Jun 08 21:07:20.072639 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.072293 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 08 21:07:20.072639 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.072308 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-26wgg\"" Jun 08 21:07:20.072639 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.072610 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 08 21:07:20.072778 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.072644 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 08 21:07:20.073419 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.073405 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sljxg" Jun 08 21:07:20.074067 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.074051 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 08 21:07:20.074316 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.074299 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 08 21:07:20.074393 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.074368 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 08 21:07:20.074519 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.074504 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-pnbd5\"" Jun 08 21:07:20.074615 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.074601 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 08 21:07:20.074834 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.074819 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 08 21:07:20.075397 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.075382 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xx978" Jun 08 21:07:20.075483 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:20.075463 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xx978" podUID="2d7e9360-16e4-4a37-a3e1-b734efbc6292" Jun 08 21:07:20.076399 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.076384 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 08 21:07:20.076528 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.076514 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-nzzlq\"" Jun 08 21:07:20.077375 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.077358 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-s5gwn" Jun 08 21:07:20.079481 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.079431 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 08 21:07:20.079633 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.079617 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-247.ec2.internal" Jun 08 21:07:20.080360 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.080338 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 08 21:07:20.080530 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.080513 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hrp99\"" Jun 08 21:07:20.080653 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.080636 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 08 21:07:20.080887 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.080863 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qlnlp" Jun 08 21:07:20.080975 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:20.080955 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qlnlp" podUID="d8842123-0e24-491b-83eb-0e30814d1c3a" Jun 08 21:07:20.082998 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.082978 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-133-247.ec2.internal"] Jun 08 21:07:20.083083 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.083054 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lvhwv" Jun 08 21:07:20.084137 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.084119 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 08 21:07:20.085341 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.085327 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 08 21:07:20.085548 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.085518 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 08 21:07:20.085664 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.085646 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 08 21:07:20.085790 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.085777 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-zwb56\"" Jun 08 21:07:20.092652 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.092632 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 08 21:07:20.092869 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.092854 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-247.ec2.internal"] Jun 08 21:07:20.103608 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.103583 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-tdhx9" Jun 08 21:07:20.111313 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.111232 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-tdhx9" Jun 08 21:07:20.149420 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:20.149386 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6682056a4304d1a35505f115402ac6d2.slice/crio-0b275fdcca0767eadf8249705a76c6b8cd5ae0e447ea8a11586a51ee27f43c86 WatchSource:0}: Error finding container 0b275fdcca0767eadf8249705a76c6b8cd5ae0e447ea8a11586a51ee27f43c86: Status 404 returned error can't find the container with id 0b275fdcca0767eadf8249705a76c6b8cd5ae0e447ea8a11586a51ee27f43c86 Jun 08 21:07:20.150032 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:20.150009 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0313b76425dedbbdaa2ce42744a43bc4.slice/crio-b741ec06a16a2aae46fb123ee8ac6e23bd4244b8efc0acb1abe009e128bdb894 WatchSource:0}: Error finding container b741ec06a16a2aae46fb123ee8ac6e23bd4244b8efc0acb1abe009e128bdb894: Status 404 returned error can't find the container with id b741ec06a16a2aae46fb123ee8ac6e23bd4244b8efc0acb1abe009e128bdb894 Jun 08 21:07:20.154826 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.154809 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 21:07:20.167675 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.167653 2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 08 21:07:20.172605 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.172582 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/85a49d6e-acdf-43ce-b9c9-1c2d7773a948-run-ovn\") pod \"ovnkube-node-pt842\" (UID: \"85a49d6e-acdf-43ce-b9c9-1c2d7773a948\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt842" Jun 08 21:07:20.172739 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.172609 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/85a49d6e-acdf-43ce-b9c9-1c2d7773a948-host-cni-netd\") pod \"ovnkube-node-pt842\" (UID: \"85a49d6e-acdf-43ce-b9c9-1c2d7773a948\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt842" Jun 08 21:07:20.172739 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.172626 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0314c4c2-0ef6-404e-bc48-b4862d0c6ab4-registration-dir\") pod \"aws-ebs-csi-driver-node-85cpv\" (UID: \"0314c4c2-0ef6-404e-bc48-b4862d0c6ab4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85cpv" Jun 08 21:07:20.172739 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.172643 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0314c4c2-0ef6-404e-bc48-b4862d0c6ab4-device-dir\") pod \"aws-ebs-csi-driver-node-85cpv\" (UID: \"0314c4c2-0ef6-404e-bc48-b4862d0c6ab4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85cpv" Jun 08 21:07:20.172739 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.172666 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/acabf8ac-1b36-4532-ada1-7eb8e9b8d71f-etc-modprobe-d\") pod \"tuned-h6khk\" (UID: \"acabf8ac-1b36-4532-ada1-7eb8e9b8d71f\") " pod="openshift-cluster-node-tuning-operator/tuned-h6khk" Jun 08 21:07:20.172739 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.172685 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/85a49d6e-acdf-43ce-b9c9-1c2d7773a948-run-ovn\") pod \"ovnkube-node-pt842\" (UID: \"85a49d6e-acdf-43ce-b9c9-1c2d7773a948\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt842" Jun 08 21:07:20.172739 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.172693 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/85a49d6e-acdf-43ce-b9c9-1c2d7773a948-host-cni-netd\") pod \"ovnkube-node-pt842\" (UID: \"85a49d6e-acdf-43ce-b9c9-1c2d7773a948\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt842" Jun 08 21:07:20.172739 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.172689 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/acabf8ac-1b36-4532-ada1-7eb8e9b8d71f-etc-tuned\") pod \"tuned-h6khk\" (UID: \"acabf8ac-1b36-4532-ada1-7eb8e9b8d71f\") " pod="openshift-cluster-node-tuning-operator/tuned-h6khk" Jun 08 21:07:20.172739 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.172724 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0314c4c2-0ef6-404e-bc48-b4862d0c6ab4-device-dir\") pod \"aws-ebs-csi-driver-node-85cpv\" (UID: \"0314c4c2-0ef6-404e-bc48-b4862d0c6ab4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85cpv" Jun 08 21:07:20.172739 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.172739 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/85a49d6e-acdf-43ce-b9c9-1c2d7773a948-host-cni-bin\") pod \"ovnkube-node-pt842\" (UID: \"85a49d6e-acdf-43ce-b9c9-1c2d7773a948\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt842" Jun 08 21:07:20.173066 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.172730 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0314c4c2-0ef6-404e-bc48-b4862d0c6ab4-registration-dir\") pod \"aws-ebs-csi-driver-node-85cpv\" (UID: \"0314c4c2-0ef6-404e-bc48-b4862d0c6ab4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85cpv" Jun 08 21:07:20.173066 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.172769 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/85a49d6e-acdf-43ce-b9c9-1c2d7773a948-env-overrides\") pod \"ovnkube-node-pt842\" (UID: \"85a49d6e-acdf-43ce-b9c9-1c2d7773a948\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt842" Jun 08 21:07:20.173066 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.172803 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0314c4c2-0ef6-404e-bc48-b4862d0c6ab4-etc-selinux\") pod \"aws-ebs-csi-driver-node-85cpv\" (UID: \"0314c4c2-0ef6-404e-bc48-b4862d0c6ab4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85cpv" Jun 08 21:07:20.173066 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.172814 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/acabf8ac-1b36-4532-ada1-7eb8e9b8d71f-etc-modprobe-d\") pod \"tuned-h6khk\" (UID: \"acabf8ac-1b36-4532-ada1-7eb8e9b8d71f\") " pod="openshift-cluster-node-tuning-operator/tuned-h6khk" Jun 08 21:07:20.173066 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.172840 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/acabf8ac-1b36-4532-ada1-7eb8e9b8d71f-etc-kubernetes\") pod \"tuned-h6khk\" (UID: \"acabf8ac-1b36-4532-ada1-7eb8e9b8d71f\") " pod="openshift-cluster-node-tuning-operator/tuned-h6khk" Jun 08 21:07:20.173066 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.172852 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0314c4c2-0ef6-404e-bc48-b4862d0c6ab4-etc-selinux\") pod \"aws-ebs-csi-driver-node-85cpv\" (UID: \"0314c4c2-0ef6-404e-bc48-b4862d0c6ab4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85cpv" Jun 08 21:07:20.173066 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.172869 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/85a49d6e-acdf-43ce-b9c9-1c2d7773a948-host-cni-bin\") pod \"ovnkube-node-pt842\" (UID: \"85a49d6e-acdf-43ce-b9c9-1c2d7773a948\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt842" Jun 08 21:07:20.173066 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.172872 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/acabf8ac-1b36-4532-ada1-7eb8e9b8d71f-tmp\") pod \"tuned-h6khk\" (UID: \"acabf8ac-1b36-4532-ada1-7eb8e9b8d71f\") " pod="openshift-cluster-node-tuning-operator/tuned-h6khk" Jun 08 21:07:20.173066 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.172893 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/acabf8ac-1b36-4532-ada1-7eb8e9b8d71f-etc-kubernetes\") pod \"tuned-h6khk\" (UID: \"acabf8ac-1b36-4532-ada1-7eb8e9b8d71f\") " pod="openshift-cluster-node-tuning-operator/tuned-h6khk" Jun 08 21:07:20.173066 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.172982 2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 08 21:07:20.173489 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.173370 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/85a49d6e-acdf-43ce-b9c9-1c2d7773a948-env-overrides\") pod \"ovnkube-node-pt842\" (UID: \"85a49d6e-acdf-43ce-b9c9-1c2d7773a948\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt842" Jun 08 21:07:20.173489 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.172914 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/78668bcc-29d2-42c0-9b9e-4e356590bb96-os-release\") pod \"multus-additional-cni-plugins-6fp8f\" (UID: \"78668bcc-29d2-42c0-9b9e-4e356590bb96\") " pod="openshift-multus/multus-additional-cni-plugins-6fp8f" Jun 08 21:07:20.173489 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.173418 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/751418cf-8061-45fc-b69f-8e45f348cd88-host-var-lib-cni-bin\") pod \"multus-sljxg\" (UID: \"751418cf-8061-45fc-b69f-8e45f348cd88\") " pod="openshift-multus/multus-sljxg" Jun 08 21:07:20.173489 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.173437 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/751418cf-8061-45fc-b69f-8e45f348cd88-host-var-lib-kubelet\") pod \"multus-sljxg\" (UID: \"751418cf-8061-45fc-b69f-8e45f348cd88\") " pod="openshift-multus/multus-sljxg" Jun 08 21:07:20.173489 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.173462 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/85a49d6e-acdf-43ce-b9c9-1c2d7773a948-host-kubelet\") pod \"ovnkube-node-pt842\" (UID: \"85a49d6e-acdf-43ce-b9c9-1c2d7773a948\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt842" Jun 08 21:07:20.173489 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.173480 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/85a49d6e-acdf-43ce-b9c9-1c2d7773a948-ovnkube-script-lib\") pod \"ovnkube-node-pt842\" (UID: \"85a49d6e-acdf-43ce-b9c9-1c2d7773a948\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt842" Jun 08 21:07:20.173728 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.173503 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/78668bcc-29d2-42c0-9b9e-4e356590bb96-cni-binary-copy\") pod \"multus-additional-cni-plugins-6fp8f\" (UID: \"78668bcc-29d2-42c0-9b9e-4e356590bb96\") " pod="openshift-multus/multus-additional-cni-plugins-6fp8f" Jun 08 21:07:20.173728 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.173525 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/751418cf-8061-45fc-b69f-8e45f348cd88-hostroot\") pod \"multus-sljxg\" (UID: \"751418cf-8061-45fc-b69f-8e45f348cd88\") " pod="openshift-multus/multus-sljxg" Jun 08 21:07:20.173728 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.173547 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xw9mk\" (UniqueName: \"kubernetes.io/projected/751418cf-8061-45fc-b69f-8e45f348cd88-kube-api-access-xw9mk\") pod \"multus-sljxg\" (UID: \"751418cf-8061-45fc-b69f-8e45f348cd88\") " pod="openshift-multus/multus-sljxg" Jun 08 21:07:20.173728 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.173629 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/502a6cc3-183a-4d9d-833d-2f14f5e1c946-kubelet-config\") pod \"global-pull-secret-syncer-9pzqb\" (UID: \"502a6cc3-183a-4d9d-833d-2f14f5e1c946\") " pod="kube-system/global-pull-secret-syncer-9pzqb" Jun 08 21:07:20.173728 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.173675 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dc019e92-af44-4184-8277-e14ccbbe377a-konnectivity-ca\") pod \"konnectivity-agent-s5gwn\" (UID: \"dc019e92-af44-4184-8277-e14ccbbe377a\") " pod="kube-system/konnectivity-agent-s5gwn" Jun 08 21:07:20.173728 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.173691 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/502a6cc3-183a-4d9d-833d-2f14f5e1c946-kubelet-config\") pod \"global-pull-secret-syncer-9pzqb\" (UID: \"502a6cc3-183a-4d9d-833d-2f14f5e1c946\") " pod="kube-system/global-pull-secret-syncer-9pzqb" Jun 08 21:07:20.173728 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.173700 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/751418cf-8061-45fc-b69f-8e45f348cd88-host-run-k8s-cni-cncf-io\") pod \"multus-sljxg\" (UID: \"751418cf-8061-45fc-b69f-8e45f348cd88\") " pod="openshift-multus/multus-sljxg" Jun 08 21:07:20.174040 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.173762 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/751418cf-8061-45fc-b69f-8e45f348cd88-host-run-netns\") pod \"multus-sljxg\" (UID: \"751418cf-8061-45fc-b69f-8e45f348cd88\") " pod="openshift-multus/multus-sljxg" Jun 08 21:07:20.174847 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.173808 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/85a49d6e-acdf-43ce-b9c9-1c2d7773a948-node-log\") pod \"ovnkube-node-pt842\" (UID: \"85a49d6e-acdf-43ce-b9c9-1c2d7773a948\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt842" Jun 08 21:07:20.174949 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.174925 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/85a49d6e-acdf-43ce-b9c9-1c2d7773a948-ovnkube-script-lib\") pod \"ovnkube-node-pt842\" (UID: \"85a49d6e-acdf-43ce-b9c9-1c2d7773a948\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt842" Jun 08 21:07:20.176219 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.176092 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/85a49d6e-acdf-43ce-b9c9-1c2d7773a948-node-log\") pod \"ovnkube-node-pt842\" (UID: \"85a49d6e-acdf-43ce-b9c9-1c2d7773a948\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt842" Jun 08 21:07:20.176219 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.176158 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/85a49d6e-acdf-43ce-b9c9-1c2d7773a948-host-kubelet\") pod \"ovnkube-node-pt842\" (UID: \"85a49d6e-acdf-43ce-b9c9-1c2d7773a948\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt842" Jun 08 21:07:20.176219 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.176210 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/85a49d6e-acdf-43ce-b9c9-1c2d7773a948-ovnkube-config\") pod \"ovnkube-node-pt842\" (UID: \"85a49d6e-acdf-43ce-b9c9-1c2d7773a948\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt842" Jun 08 21:07:20.176434 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.176244 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0314c4c2-0ef6-404e-bc48-b4862d0c6ab4-socket-dir\") pod \"aws-ebs-csi-driver-node-85cpv\" (UID: \"0314c4c2-0ef6-404e-bc48-b4862d0c6ab4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85cpv" Jun 08 21:07:20.176434 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.176292 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/78668bcc-29d2-42c0-9b9e-4e356590bb96-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6fp8f\" (UID: \"78668bcc-29d2-42c0-9b9e-4e356590bb96\") " pod="openshift-multus/multus-additional-cni-plugins-6fp8f" Jun 08 21:07:20.176434 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.176326 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/751418cf-8061-45fc-b69f-8e45f348cd88-multus-socket-dir-parent\") pod \"multus-sljxg\" (UID: \"751418cf-8061-45fc-b69f-8e45f348cd88\") " pod="openshift-multus/multus-sljxg" Jun 08 21:07:20.176434 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.176375 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/502a6cc3-183a-4d9d-833d-2f14f5e1c946-dbus\") pod \"global-pull-secret-syncer-9pzqb\" (UID: \"502a6cc3-183a-4d9d-833d-2f14f5e1c946\") " pod="kube-system/global-pull-secret-syncer-9pzqb" Jun 08 21:07:20.176434 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.176411 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/acabf8ac-1b36-4532-ada1-7eb8e9b8d71f-etc-sysctl-conf\") pod \"tuned-h6khk\" (UID: \"acabf8ac-1b36-4532-ada1-7eb8e9b8d71f\") " pod="openshift-cluster-node-tuning-operator/tuned-h6khk" Jun 08 21:07:20.176677 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.176441 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/acabf8ac-1b36-4532-ada1-7eb8e9b8d71f-etc-systemd\") pod \"tuned-h6khk\" (UID: \"acabf8ac-1b36-4532-ada1-7eb8e9b8d71f\") " pod="openshift-cluster-node-tuning-operator/tuned-h6khk" Jun 08 21:07:20.176677 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.176468 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/acabf8ac-1b36-4532-ada1-7eb8e9b8d71f-run\") pod \"tuned-h6khk\" (UID: \"acabf8ac-1b36-4532-ada1-7eb8e9b8d71f\") " pod="openshift-cluster-node-tuning-operator/tuned-h6khk" Jun 08 21:07:20.176677 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.176480 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/acabf8ac-1b36-4532-ada1-7eb8e9b8d71f-tmp\") pod \"tuned-h6khk\" (UID: \"acabf8ac-1b36-4532-ada1-7eb8e9b8d71f\") " pod="openshift-cluster-node-tuning-operator/tuned-h6khk" Jun 08 21:07:20.176677 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.176506 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4fcb5113-dc25-491d-b570-2c2818b90ea9-tmp-dir\") pod \"node-resolver-zhdb2\" (UID: \"4fcb5113-dc25-491d-b570-2c2818b90ea9\") " pod="openshift-dns/node-resolver-zhdb2" Jun 08 21:07:20.176677 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.176558 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/767ccdbc-66e2-441f-932d-4ae6885b6411-serviceca\") pod \"node-ca-ls8lw\" (UID: \"767ccdbc-66e2-441f-932d-4ae6885b6411\") " pod="openshift-image-registry/node-ca-ls8lw" Jun 08 21:07:20.176677 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.176594 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dc019e92-af44-4184-8277-e14ccbbe377a-agent-certs\") pod \"konnectivity-agent-s5gwn\" (UID: \"dc019e92-af44-4184-8277-e14ccbbe377a\") " pod="kube-system/konnectivity-agent-s5gwn" Jun 08 21:07:20.176677 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.176622 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/751418cf-8061-45fc-b69f-8e45f348cd88-etc-kubernetes\") pod \"multus-sljxg\" (UID: \"751418cf-8061-45fc-b69f-8e45f348cd88\") " pod="openshift-multus/multus-sljxg" Jun 08 21:07:20.176677 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.176649 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/85a49d6e-acdf-43ce-b9c9-1c2d7773a948-systemd-units\") pod \"ovnkube-node-pt842\" (UID: \"85a49d6e-acdf-43ce-b9c9-1c2d7773a948\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt842" Jun 08 21:07:20.176677 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.176680 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/85a49d6e-acdf-43ce-b9c9-1c2d7773a948-host-slash\") pod \"ovnkube-node-pt842\" (UID: \"85a49d6e-acdf-43ce-b9c9-1c2d7773a948\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt842" Jun 08 21:07:20.177112 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.176708 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/85a49d6e-acdf-43ce-b9c9-1c2d7773a948-var-lib-openvswitch\") pod \"ovnkube-node-pt842\" (UID: \"85a49d6e-acdf-43ce-b9c9-1c2d7773a948\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt842" Jun 08 21:07:20.177112 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.176743 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/85a49d6e-acdf-43ce-b9c9-1c2d7773a948-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pt842\" (UID: \"85a49d6e-acdf-43ce-b9c9-1c2d7773a948\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt842" Jun 08 21:07:20.177112 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.176775 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0314c4c2-0ef6-404e-bc48-b4862d0c6ab4-sys-fs\") pod \"aws-ebs-csi-driver-node-85cpv\" (UID: \"0314c4c2-0ef6-404e-bc48-b4862d0c6ab4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85cpv" Jun 08 21:07:20.177112 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.176792 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4fcb5113-dc25-491d-b570-2c2818b90ea9-tmp-dir\") pod \"node-resolver-zhdb2\" (UID: \"4fcb5113-dc25-491d-b570-2c2818b90ea9\") " pod="openshift-dns/node-resolver-zhdb2" Jun 08 21:07:20.177112 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.176803 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rqz5\" (UniqueName: \"kubernetes.io/projected/767ccdbc-66e2-441f-932d-4ae6885b6411-kube-api-access-7rqz5\") pod \"node-ca-ls8lw\" (UID: \"767ccdbc-66e2-441f-932d-4ae6885b6411\") " pod="openshift-image-registry/node-ca-ls8lw" Jun 08 21:07:20.177112 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.176827 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/751418cf-8061-45fc-b69f-8e45f348cd88-host-var-lib-cni-multus\") pod \"multus-sljxg\" (UID: \"751418cf-8061-45fc-b69f-8e45f348cd88\") " pod="openshift-multus/multus-sljxg" Jun 08 21:07:20.177112 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.176856 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e7727ebf-2eaa-4bdc-b573-3ed8a8a5bb9d-iptables-alerter-script\") pod \"iptables-alerter-lvhwv\" (UID: \"e7727ebf-2eaa-4bdc-b573-3ed8a8a5bb9d\") " pod="openshift-network-operator/iptables-alerter-lvhwv" Jun 08 21:07:20.177112 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.176886 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/acabf8ac-1b36-4532-ada1-7eb8e9b8d71f-etc-sysctl-d\") pod \"tuned-h6khk\" (UID: \"acabf8ac-1b36-4532-ada1-7eb8e9b8d71f\") " pod="openshift-cluster-node-tuning-operator/tuned-h6khk" Jun 08 21:07:20.177112 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.176917 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/85a49d6e-acdf-43ce-b9c9-1c2d7773a948-host-slash\") pod \"ovnkube-node-pt842\" (UID: \"85a49d6e-acdf-43ce-b9c9-1c2d7773a948\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt842" Jun 08 21:07:20.177112 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.176937 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/acabf8ac-1b36-4532-ada1-7eb8e9b8d71f-lib-modules\") pod \"tuned-h6khk\" (UID: \"acabf8ac-1b36-4532-ada1-7eb8e9b8d71f\") " pod="openshift-cluster-node-tuning-operator/tuned-h6khk" Jun 08 21:07:20.177112 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.176982 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5vsp\" (UniqueName: \"kubernetes.io/projected/e7727ebf-2eaa-4bdc-b573-3ed8a8a5bb9d-kube-api-access-b5vsp\") pod \"iptables-alerter-lvhwv\" (UID: \"e7727ebf-2eaa-4bdc-b573-3ed8a8a5bb9d\") " pod="openshift-network-operator/iptables-alerter-lvhwv" Jun 08 21:07:20.177112 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.177049 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/85a49d6e-acdf-43ce-b9c9-1c2d7773a948-var-lib-openvswitch\") pod \"ovnkube-node-pt842\" (UID: \"85a49d6e-acdf-43ce-b9c9-1c2d7773a948\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt842" Jun 08 21:07:20.177112 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.177098 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/85a49d6e-acdf-43ce-b9c9-1c2d7773a948-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pt842\" (UID: \"85a49d6e-acdf-43ce-b9c9-1c2d7773a948\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt842" Jun 08 21:07:20.177717 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.177107 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/502a6cc3-183a-4d9d-833d-2f14f5e1c946-dbus\") pod \"global-pull-secret-syncer-9pzqb\" (UID: \"502a6cc3-183a-4d9d-833d-2f14f5e1c946\") " pod="kube-system/global-pull-secret-syncer-9pzqb" Jun 08 21:07:20.177717 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.177152 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0314c4c2-0ef6-404e-bc48-b4862d0c6ab4-sys-fs\") pod \"aws-ebs-csi-driver-node-85cpv\" (UID: \"0314c4c2-0ef6-404e-bc48-b4862d0c6ab4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85cpv" Jun 08 21:07:20.177717 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.177180 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/acabf8ac-1b36-4532-ada1-7eb8e9b8d71f-etc-systemd\") pod \"tuned-h6khk\" (UID: \"acabf8ac-1b36-4532-ada1-7eb8e9b8d71f\") " pod="openshift-cluster-node-tuning-operator/tuned-h6khk" Jun 08 21:07:20.177717 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.177192 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbknj\" (UniqueName: \"kubernetes.io/projected/85a49d6e-acdf-43ce-b9c9-1c2d7773a948-kube-api-access-hbknj\") pod \"ovnkube-node-pt842\" (UID: \"85a49d6e-acdf-43ce-b9c9-1c2d7773a948\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt842" Jun 08 21:07:20.177717 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.177287 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/acabf8ac-1b36-4532-ada1-7eb8e9b8d71f-etc-sysctl-d\") pod \"tuned-h6khk\" (UID: \"acabf8ac-1b36-4532-ada1-7eb8e9b8d71f\") " pod="openshift-cluster-node-tuning-operator/tuned-h6khk" Jun 08 21:07:20.177717 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.177295 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/85a49d6e-acdf-43ce-b9c9-1c2d7773a948-systemd-units\") pod \"ovnkube-node-pt842\" (UID: \"85a49d6e-acdf-43ce-b9c9-1c2d7773a948\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt842" Jun 08 21:07:20.177717 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.177304 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/acabf8ac-1b36-4532-ada1-7eb8e9b8d71f-lib-modules\") pod \"tuned-h6khk\" (UID: \"acabf8ac-1b36-4532-ada1-7eb8e9b8d71f\") " pod="openshift-cluster-node-tuning-operator/tuned-h6khk" Jun 08 21:07:20.177717 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.177343 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4fcb5113-dc25-491d-b570-2c2818b90ea9-hosts-file\") pod \"node-resolver-zhdb2\" (UID: \"4fcb5113-dc25-491d-b570-2c2818b90ea9\") " pod="openshift-dns/node-resolver-zhdb2" Jun 08 21:07:20.177717 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.177378 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnl7f\" (UniqueName: \"kubernetes.io/projected/4fcb5113-dc25-491d-b570-2c2818b90ea9-kube-api-access-wnl7f\") pod \"node-resolver-zhdb2\" (UID: \"4fcb5113-dc25-491d-b570-2c2818b90ea9\") " pod="openshift-dns/node-resolver-zhdb2" Jun 08 21:07:20.177717 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.177396 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/85a49d6e-acdf-43ce-b9c9-1c2d7773a948-ovnkube-config\") pod \"ovnkube-node-pt842\" (UID: \"85a49d6e-acdf-43ce-b9c9-1c2d7773a948\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt842" Jun 08 21:07:20.177717 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.177404 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0314c4c2-0ef6-404e-bc48-b4862d0c6ab4-socket-dir\") pod \"aws-ebs-csi-driver-node-85cpv\" (UID: \"0314c4c2-0ef6-404e-bc48-b4862d0c6ab4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85cpv" Jun 08 21:07:20.177717 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.177437 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/acabf8ac-1b36-4532-ada1-7eb8e9b8d71f-etc-sysctl-conf\") pod \"tuned-h6khk\" (UID: \"acabf8ac-1b36-4532-ada1-7eb8e9b8d71f\") " pod="openshift-cluster-node-tuning-operator/tuned-h6khk" Jun 08 21:07:20.177717 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.177443 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/751418cf-8061-45fc-b69f-8e45f348cd88-cni-binary-copy\") pod \"multus-sljxg\" (UID: \"751418cf-8061-45fc-b69f-8e45f348cd88\") " pod="openshift-multus/multus-sljxg" Jun 08 21:07:20.177717 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.177504 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e7727ebf-2eaa-4bdc-b573-3ed8a8a5bb9d-host-slash\") pod \"iptables-alerter-lvhwv\" (UID: \"e7727ebf-2eaa-4bdc-b573-3ed8a8a5bb9d\") " pod="openshift-network-operator/iptables-alerter-lvhwv" Jun 08 21:07:20.177717 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.177579 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/502a6cc3-183a-4d9d-833d-2f14f5e1c946-original-pull-secret\") pod \"global-pull-secret-syncer-9pzqb\" (UID: \"502a6cc3-183a-4d9d-833d-2f14f5e1c946\") " pod="kube-system/global-pull-secret-syncer-9pzqb" Jun 08 21:07:20.177717 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.177639 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sg7hl\" (UniqueName: \"kubernetes.io/projected/78668bcc-29d2-42c0-9b9e-4e356590bb96-kube-api-access-sg7hl\") pod \"multus-additional-cni-plugins-6fp8f\" (UID: \"78668bcc-29d2-42c0-9b9e-4e356590bb96\") " pod="openshift-multus/multus-additional-cni-plugins-6fp8f" Jun 08 21:07:20.177717 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.177710 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/751418cf-8061-45fc-b69f-8e45f348cd88-cnibin\") pod \"multus-sljxg\" (UID: \"751418cf-8061-45fc-b69f-8e45f348cd88\") " pod="openshift-multus/multus-sljxg" Jun 08 21:07:20.178494 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.177753 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/751418cf-8061-45fc-b69f-8e45f348cd88-multus-conf-dir\") pod \"multus-sljxg\" (UID: \"751418cf-8061-45fc-b69f-8e45f348cd88\") " pod="openshift-multus/multus-sljxg" Jun 08 21:07:20.178494 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:20.177774 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 21:07:20.178494 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.177815 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/acabf8ac-1b36-4532-ada1-7eb8e9b8d71f-run\") pod \"tuned-h6khk\" (UID: \"acabf8ac-1b36-4532-ada1-7eb8e9b8d71f\") " pod="openshift-cluster-node-tuning-operator/tuned-h6khk" Jun 08 21:07:20.178494 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:20.177871 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/502a6cc3-183a-4d9d-833d-2f14f5e1c946-original-pull-secret podName:502a6cc3-183a-4d9d-833d-2f14f5e1c946 nodeName:}" failed. No retries permitted until 2026-06-08 21:07:20.677827669 +0000 UTC m=+1.935504028 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/502a6cc3-183a-4d9d-833d-2f14f5e1c946-original-pull-secret") pod "global-pull-secret-syncer-9pzqb" (UID: "502a6cc3-183a-4d9d-833d-2f14f5e1c946") : object "kube-system"/"original-pull-secret" not registered Jun 08 21:07:20.178494 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.177875 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4fcb5113-dc25-491d-b570-2c2818b90ea9-hosts-file\") pod \"node-resolver-zhdb2\" (UID: \"4fcb5113-dc25-491d-b570-2c2818b90ea9\") " pod="openshift-dns/node-resolver-zhdb2" Jun 08 21:07:20.178494 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.177919 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/85a49d6e-acdf-43ce-b9c9-1c2d7773a948-run-systemd\") pod \"ovnkube-node-pt842\" (UID: \"85a49d6e-acdf-43ce-b9c9-1c2d7773a948\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt842" Jun 08 21:07:20.178494 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.177979 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s76cf\" (UniqueName: \"kubernetes.io/projected/0314c4c2-0ef6-404e-bc48-b4862d0c6ab4-kube-api-access-s76cf\") pod \"aws-ebs-csi-driver-node-85cpv\" (UID: \"0314c4c2-0ef6-404e-bc48-b4862d0c6ab4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85cpv" Jun 08 21:07:20.178494 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.178012 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/78668bcc-29d2-42c0-9b9e-4e356590bb96-system-cni-dir\") pod \"multus-additional-cni-plugins-6fp8f\" (UID: \"78668bcc-29d2-42c0-9b9e-4e356590bb96\") " pod="openshift-multus/multus-additional-cni-plugins-6fp8f" Jun 08 21:07:20.178494 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.178017 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/85a49d6e-acdf-43ce-b9c9-1c2d7773a948-run-systemd\") pod \"ovnkube-node-pt842\" (UID: \"85a49d6e-acdf-43ce-b9c9-1c2d7773a948\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt842" Jun 08 21:07:20.178494 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.178074 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2mkp\" (UniqueName: \"kubernetes.io/projected/2d7e9360-16e4-4a37-a3e1-b734efbc6292-kube-api-access-v2mkp\") pod \"network-metrics-daemon-xx978\" (UID: \"2d7e9360-16e4-4a37-a3e1-b734efbc6292\") " pod="openshift-multus/network-metrics-daemon-xx978" Jun 08 21:07:20.178494 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.178195 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/85a49d6e-acdf-43ce-b9c9-1c2d7773a948-host-run-ovn-kubernetes\") pod \"ovnkube-node-pt842\" (UID: \"85a49d6e-acdf-43ce-b9c9-1c2d7773a948\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt842" Jun 08 21:07:20.178494 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.178225 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/85a49d6e-acdf-43ce-b9c9-1c2d7773a948-ovn-node-metrics-cert\") pod \"ovnkube-node-pt842\" (UID: \"85a49d6e-acdf-43ce-b9c9-1c2d7773a948\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt842" Jun 08 21:07:20.178494 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.178305 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/acabf8ac-1b36-4532-ada1-7eb8e9b8d71f-sys\") pod \"tuned-h6khk\" (UID: \"acabf8ac-1b36-4532-ada1-7eb8e9b8d71f\") " pod="openshift-cluster-node-tuning-operator/tuned-h6khk" Jun 08 21:07:20.178494 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.178333 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/78668bcc-29d2-42c0-9b9e-4e356590bb96-cnibin\") pod \"multus-additional-cni-plugins-6fp8f\" (UID: \"78668bcc-29d2-42c0-9b9e-4e356590bb96\") " pod="openshift-multus/multus-additional-cni-plugins-6fp8f" Jun 08 21:07:20.178494 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.178365 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/78668bcc-29d2-42c0-9b9e-4e356590bb96-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6fp8f\" (UID: \"78668bcc-29d2-42c0-9b9e-4e356590bb96\") " pod="openshift-multus/multus-additional-cni-plugins-6fp8f" Jun 08 21:07:20.178494 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.178400 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvh4v\" (UniqueName: \"kubernetes.io/projected/d8842123-0e24-491b-83eb-0e30814d1c3a-kube-api-access-pvh4v\") pod \"network-check-target-qlnlp\" (UID: \"d8842123-0e24-491b-83eb-0e30814d1c3a\") " pod="openshift-network-diagnostics/network-check-target-qlnlp" Jun 08 21:07:20.179210 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.178407 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/acabf8ac-1b36-4532-ada1-7eb8e9b8d71f-etc-tuned\") pod \"tuned-h6khk\" (UID: \"acabf8ac-1b36-4532-ada1-7eb8e9b8d71f\") " pod="openshift-cluster-node-tuning-operator/tuned-h6khk" Jun 08 21:07:20.179210 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.178474 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0314c4c2-0ef6-404e-bc48-b4862d0c6ab4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-85cpv\" (UID: \"0314c4c2-0ef6-404e-bc48-b4862d0c6ab4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85cpv" Jun 08 21:07:20.179210 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.178514 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/78668bcc-29d2-42c0-9b9e-4e356590bb96-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6fp8f\" (UID: \"78668bcc-29d2-42c0-9b9e-4e356590bb96\") " pod="openshift-multus/multus-additional-cni-plugins-6fp8f" Jun 08 21:07:20.179210 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.178546 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d7e9360-16e4-4a37-a3e1-b734efbc6292-metrics-certs\") pod \"network-metrics-daemon-xx978\" (UID: \"2d7e9360-16e4-4a37-a3e1-b734efbc6292\") " pod="openshift-multus/network-metrics-daemon-xx978" Jun 08 21:07:20.179210 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.178578 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/751418cf-8061-45fc-b69f-8e45f348cd88-system-cni-dir\") pod \"multus-sljxg\" (UID: \"751418cf-8061-45fc-b69f-8e45f348cd88\") " pod="openshift-multus/multus-sljxg" Jun 08 21:07:20.179210 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.178604 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/751418cf-8061-45fc-b69f-8e45f348cd88-multus-cni-dir\") pod \"multus-sljxg\" (UID: \"751418cf-8061-45fc-b69f-8e45f348cd88\") " pod="openshift-multus/multus-sljxg" Jun 08 21:07:20.179210 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.178661 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/85a49d6e-acdf-43ce-b9c9-1c2d7773a948-run-openvswitch\") pod \"ovnkube-node-pt842\" (UID: \"85a49d6e-acdf-43ce-b9c9-1c2d7773a948\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt842" Jun 08 21:07:20.179210 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.178675 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/85a49d6e-acdf-43ce-b9c9-1c2d7773a948-host-run-ovn-kubernetes\") pod \"ovnkube-node-pt842\" (UID: \"85a49d6e-acdf-43ce-b9c9-1c2d7773a948\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt842" Jun 08 21:07:20.179210 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.178753 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/acabf8ac-1b36-4532-ada1-7eb8e9b8d71f-etc-sysconfig\") pod \"tuned-h6khk\" (UID: \"acabf8ac-1b36-4532-ada1-7eb8e9b8d71f\") " pod="openshift-cluster-node-tuning-operator/tuned-h6khk" Jun 08 21:07:20.179210 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.178793 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/acabf8ac-1b36-4532-ada1-7eb8e9b8d71f-var-lib-kubelet\") pod \"tuned-h6khk\" (UID: \"acabf8ac-1b36-4532-ada1-7eb8e9b8d71f\") " pod="openshift-cluster-node-tuning-operator/tuned-h6khk" Jun 08 21:07:20.179210 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.178869 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/acabf8ac-1b36-4532-ada1-7eb8e9b8d71f-host\") pod \"tuned-h6khk\" (UID: \"acabf8ac-1b36-4532-ada1-7eb8e9b8d71f\") " pod="openshift-cluster-node-tuning-operator/tuned-h6khk" Jun 08 21:07:20.179210 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.178888 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/acabf8ac-1b36-4532-ada1-7eb8e9b8d71f-etc-sysconfig\") pod \"tuned-h6khk\" (UID: \"acabf8ac-1b36-4532-ada1-7eb8e9b8d71f\") " pod="openshift-cluster-node-tuning-operator/tuned-h6khk" Jun 08 21:07:20.179210 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.178941 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zz82z\" (UniqueName: \"kubernetes.io/projected/acabf8ac-1b36-4532-ada1-7eb8e9b8d71f-kube-api-access-zz82z\") pod \"tuned-h6khk\" (UID: \"acabf8ac-1b36-4532-ada1-7eb8e9b8d71f\") " pod="openshift-cluster-node-tuning-operator/tuned-h6khk" Jun 08 21:07:20.179210 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.178948 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/acabf8ac-1b36-4532-ada1-7eb8e9b8d71f-var-lib-kubelet\") pod \"tuned-h6khk\" (UID: \"acabf8ac-1b36-4532-ada1-7eb8e9b8d71f\") " pod="openshift-cluster-node-tuning-operator/tuned-h6khk" Jun 08 21:07:20.179210 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.179000 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/767ccdbc-66e2-441f-932d-4ae6885b6411-host\") pod \"node-ca-ls8lw\" (UID: \"767ccdbc-66e2-441f-932d-4ae6885b6411\") " pod="openshift-image-registry/node-ca-ls8lw" Jun 08 21:07:20.179210 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.179009 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/85a49d6e-acdf-43ce-b9c9-1c2d7773a948-run-openvswitch\") pod \"ovnkube-node-pt842\" (UID: \"85a49d6e-acdf-43ce-b9c9-1c2d7773a948\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt842" Jun 08 21:07:20.179210 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.179066 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/acabf8ac-1b36-4532-ada1-7eb8e9b8d71f-host\") pod \"tuned-h6khk\" (UID: \"acabf8ac-1b36-4532-ada1-7eb8e9b8d71f\") " pod="openshift-cluster-node-tuning-operator/tuned-h6khk" Jun 08 21:07:20.179984 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.179105 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/751418cf-8061-45fc-b69f-8e45f348cd88-host-run-multus-certs\") pod \"multus-sljxg\" (UID: \"751418cf-8061-45fc-b69f-8e45f348cd88\") " pod="openshift-multus/multus-sljxg" Jun 08 21:07:20.179984 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.179120 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/acabf8ac-1b36-4532-ada1-7eb8e9b8d71f-sys\") pod \"tuned-h6khk\" (UID: \"acabf8ac-1b36-4532-ada1-7eb8e9b8d71f\") " pod="openshift-cluster-node-tuning-operator/tuned-h6khk" Jun 08 21:07:20.179984 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.179163 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/85a49d6e-acdf-43ce-b9c9-1c2d7773a948-host-run-netns\") pod \"ovnkube-node-pt842\" (UID: \"85a49d6e-acdf-43ce-b9c9-1c2d7773a948\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt842" Jun 08 21:07:20.179984 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.179209 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/85a49d6e-acdf-43ce-b9c9-1c2d7773a948-host-run-netns\") pod \"ovnkube-node-pt842\" (UID: \"85a49d6e-acdf-43ce-b9c9-1c2d7773a948\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt842" Jun 08 21:07:20.179984 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.179218 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/85a49d6e-acdf-43ce-b9c9-1c2d7773a948-etc-openvswitch\") pod \"ovnkube-node-pt842\" (UID: \"85a49d6e-acdf-43ce-b9c9-1c2d7773a948\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt842" Jun 08 21:07:20.179984 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.179303 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/85a49d6e-acdf-43ce-b9c9-1c2d7773a948-etc-openvswitch\") pod \"ovnkube-node-pt842\" (UID: \"85a49d6e-acdf-43ce-b9c9-1c2d7773a948\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt842" Jun 08 21:07:20.179984 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.179309 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/85a49d6e-acdf-43ce-b9c9-1c2d7773a948-log-socket\") pod \"ovnkube-node-pt842\" (UID: \"85a49d6e-acdf-43ce-b9c9-1c2d7773a948\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt842" Jun 08 21:07:20.179984 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.179259 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0314c4c2-0ef6-404e-bc48-b4862d0c6ab4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-85cpv\" (UID: \"0314c4c2-0ef6-404e-bc48-b4862d0c6ab4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85cpv" Jun 08 21:07:20.179984 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.179382 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/85a49d6e-acdf-43ce-b9c9-1c2d7773a948-log-socket\") pod \"ovnkube-node-pt842\" (UID: \"85a49d6e-acdf-43ce-b9c9-1c2d7773a948\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt842" Jun 08 21:07:20.179984 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.179423 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/751418cf-8061-45fc-b69f-8e45f348cd88-os-release\") pod \"multus-sljxg\" (UID: \"751418cf-8061-45fc-b69f-8e45f348cd88\") " pod="openshift-multus/multus-sljxg" Jun 08 21:07:20.179984 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.179461 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/751418cf-8061-45fc-b69f-8e45f348cd88-multus-daemon-config\") pod \"multus-sljxg\" (UID: \"751418cf-8061-45fc-b69f-8e45f348cd88\") " pod="openshift-multus/multus-sljxg" Jun 08 21:07:20.181048 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.181029 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/85a49d6e-acdf-43ce-b9c9-1c2d7773a948-ovn-node-metrics-cert\") pod \"ovnkube-node-pt842\" (UID: \"85a49d6e-acdf-43ce-b9c9-1c2d7773a948\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt842" Jun 08 21:07:20.186579 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.186560 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnl7f\" (UniqueName: \"kubernetes.io/projected/4fcb5113-dc25-491d-b570-2c2818b90ea9-kube-api-access-wnl7f\") pod \"node-resolver-zhdb2\" (UID: \"4fcb5113-dc25-491d-b570-2c2818b90ea9\") " pod="openshift-dns/node-resolver-zhdb2" Jun 08 21:07:20.186579 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.186569 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s76cf\" (UniqueName: \"kubernetes.io/projected/0314c4c2-0ef6-404e-bc48-b4862d0c6ab4-kube-api-access-s76cf\") pod \"aws-ebs-csi-driver-node-85cpv\" (UID: \"0314c4c2-0ef6-404e-bc48-b4862d0c6ab4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85cpv" Jun 08 21:07:20.186684 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.186619 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zz82z\" (UniqueName: \"kubernetes.io/projected/acabf8ac-1b36-4532-ada1-7eb8e9b8d71f-kube-api-access-zz82z\") pod \"tuned-h6khk\" (UID: \"acabf8ac-1b36-4532-ada1-7eb8e9b8d71f\") " pod="openshift-cluster-node-tuning-operator/tuned-h6khk" Jun 08 21:07:20.186684 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.186619 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbknj\" (UniqueName: \"kubernetes.io/projected/85a49d6e-acdf-43ce-b9c9-1c2d7773a948-kube-api-access-hbknj\") pod \"ovnkube-node-pt842\" (UID: \"85a49d6e-acdf-43ce-b9c9-1c2d7773a948\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt842" Jun 08 21:07:20.280437 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.280404 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/767ccdbc-66e2-441f-932d-4ae6885b6411-serviceca\") pod \"node-ca-ls8lw\" (UID: \"767ccdbc-66e2-441f-932d-4ae6885b6411\") " pod="openshift-image-registry/node-ca-ls8lw" Jun 08 21:07:20.280437 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.280438 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dc019e92-af44-4184-8277-e14ccbbe377a-agent-certs\") pod \"konnectivity-agent-s5gwn\" (UID: \"dc019e92-af44-4184-8277-e14ccbbe377a\") " pod="kube-system/konnectivity-agent-s5gwn" Jun 08 21:07:20.280660 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.280456 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/751418cf-8061-45fc-b69f-8e45f348cd88-etc-kubernetes\") pod \"multus-sljxg\" (UID: \"751418cf-8061-45fc-b69f-8e45f348cd88\") " pod="openshift-multus/multus-sljxg" Jun 08 21:07:20.280660 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.280498 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rqz5\" (UniqueName: \"kubernetes.io/projected/767ccdbc-66e2-441f-932d-4ae6885b6411-kube-api-access-7rqz5\") pod \"node-ca-ls8lw\" (UID: \"767ccdbc-66e2-441f-932d-4ae6885b6411\") " pod="openshift-image-registry/node-ca-ls8lw" Jun 08 21:07:20.280660 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.280514 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/751418cf-8061-45fc-b69f-8e45f348cd88-host-var-lib-cni-multus\") pod \"multus-sljxg\" (UID: \"751418cf-8061-45fc-b69f-8e45f348cd88\") " pod="openshift-multus/multus-sljxg" Jun 08 21:07:20.280660 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.280529 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e7727ebf-2eaa-4bdc-b573-3ed8a8a5bb9d-iptables-alerter-script\") pod \"iptables-alerter-lvhwv\" (UID: \"e7727ebf-2eaa-4bdc-b573-3ed8a8a5bb9d\") " pod="openshift-network-operator/iptables-alerter-lvhwv" Jun 08 21:07:20.280660 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.280546 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5vsp\" (UniqueName: \"kubernetes.io/projected/e7727ebf-2eaa-4bdc-b573-3ed8a8a5bb9d-kube-api-access-b5vsp\") pod \"iptables-alerter-lvhwv\" (UID: \"e7727ebf-2eaa-4bdc-b573-3ed8a8a5bb9d\") " pod="openshift-network-operator/iptables-alerter-lvhwv" Jun 08 21:07:20.280660 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.280605 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/751418cf-8061-45fc-b69f-8e45f348cd88-cni-binary-copy\") pod \"multus-sljxg\" (UID: \"751418cf-8061-45fc-b69f-8e45f348cd88\") " pod="openshift-multus/multus-sljxg" Jun 08 21:07:20.280660 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.280615 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/751418cf-8061-45fc-b69f-8e45f348cd88-host-var-lib-cni-multus\") pod \"multus-sljxg\" (UID: \"751418cf-8061-45fc-b69f-8e45f348cd88\") " pod="openshift-multus/multus-sljxg" Jun 08 21:07:20.280660 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.280640 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e7727ebf-2eaa-4bdc-b573-3ed8a8a5bb9d-host-slash\") pod \"iptables-alerter-lvhwv\" (UID: \"e7727ebf-2eaa-4bdc-b573-3ed8a8a5bb9d\") " pod="openshift-network-operator/iptables-alerter-lvhwv" Jun 08 21:07:20.281009 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.280680 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sg7hl\" (UniqueName: \"kubernetes.io/projected/78668bcc-29d2-42c0-9b9e-4e356590bb96-kube-api-access-sg7hl\") pod \"multus-additional-cni-plugins-6fp8f\" (UID: \"78668bcc-29d2-42c0-9b9e-4e356590bb96\") " pod="openshift-multus/multus-additional-cni-plugins-6fp8f" Jun 08 21:07:20.281009 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.280729 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/751418cf-8061-45fc-b69f-8e45f348cd88-cnibin\") pod \"multus-sljxg\" (UID: \"751418cf-8061-45fc-b69f-8e45f348cd88\") " pod="openshift-multus/multus-sljxg" Jun 08 21:07:20.281009 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.280731 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e7727ebf-2eaa-4bdc-b573-3ed8a8a5bb9d-host-slash\") pod \"iptables-alerter-lvhwv\" (UID: \"e7727ebf-2eaa-4bdc-b573-3ed8a8a5bb9d\") " pod="openshift-network-operator/iptables-alerter-lvhwv" Jun 08 21:07:20.281009 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.280751 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/751418cf-8061-45fc-b69f-8e45f348cd88-multus-conf-dir\") pod \"multus-sljxg\" (UID: \"751418cf-8061-45fc-b69f-8e45f348cd88\") " pod="openshift-multus/multus-sljxg" Jun 08 21:07:20.281009 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.280798 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/78668bcc-29d2-42c0-9b9e-4e356590bb96-system-cni-dir\") pod \"multus-additional-cni-plugins-6fp8f\" (UID: \"78668bcc-29d2-42c0-9b9e-4e356590bb96\") " pod="openshift-multus/multus-additional-cni-plugins-6fp8f" Jun 08 21:07:20.281009 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.280823 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2mkp\" (UniqueName: \"kubernetes.io/projected/2d7e9360-16e4-4a37-a3e1-b734efbc6292-kube-api-access-v2mkp\") pod \"network-metrics-daemon-xx978\" (UID: \"2d7e9360-16e4-4a37-a3e1-b734efbc6292\") " pod="openshift-multus/network-metrics-daemon-xx978" Jun 08 21:07:20.281009 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.280850 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/78668bcc-29d2-42c0-9b9e-4e356590bb96-cnibin\") pod \"multus-additional-cni-plugins-6fp8f\" (UID: \"78668bcc-29d2-42c0-9b9e-4e356590bb96\") " pod="openshift-multus/multus-additional-cni-plugins-6fp8f" Jun 08 21:07:20.281009 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.280874 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/78668bcc-29d2-42c0-9b9e-4e356590bb96-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6fp8f\" (UID: \"78668bcc-29d2-42c0-9b9e-4e356590bb96\") " pod="openshift-multus/multus-additional-cni-plugins-6fp8f" Jun 08 21:07:20.281009 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.280884 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/751418cf-8061-45fc-b69f-8e45f348cd88-etc-kubernetes\") pod \"multus-sljxg\" (UID: \"751418cf-8061-45fc-b69f-8e45f348cd88\") " pod="openshift-multus/multus-sljxg" Jun 08 21:07:20.281009 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.280899 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvh4v\" (UniqueName: \"kubernetes.io/projected/d8842123-0e24-491b-83eb-0e30814d1c3a-kube-api-access-pvh4v\") pod \"network-check-target-qlnlp\" (UID: \"d8842123-0e24-491b-83eb-0e30814d1c3a\") " pod="openshift-network-diagnostics/network-check-target-qlnlp" Jun 08 21:07:20.281009 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.280930 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/78668bcc-29d2-42c0-9b9e-4e356590bb96-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6fp8f\" (UID: \"78668bcc-29d2-42c0-9b9e-4e356590bb96\") " pod="openshift-multus/multus-additional-cni-plugins-6fp8f" Jun 08 21:07:20.281009 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.280931 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/751418cf-8061-45fc-b69f-8e45f348cd88-cnibin\") pod \"multus-sljxg\" (UID: \"751418cf-8061-45fc-b69f-8e45f348cd88\") " pod="openshift-multus/multus-sljxg" Jun 08 21:07:20.281009 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.280948 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/767ccdbc-66e2-441f-932d-4ae6885b6411-serviceca\") pod \"node-ca-ls8lw\" (UID: \"767ccdbc-66e2-441f-932d-4ae6885b6411\") " pod="openshift-image-registry/node-ca-ls8lw" Jun 08 21:07:20.281009 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.280939 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/751418cf-8061-45fc-b69f-8e45f348cd88-multus-conf-dir\") pod \"multus-sljxg\" (UID: \"751418cf-8061-45fc-b69f-8e45f348cd88\") " pod="openshift-multus/multus-sljxg" Jun 08 21:07:20.281009 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.280955 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d7e9360-16e4-4a37-a3e1-b734efbc6292-metrics-certs\") pod \"network-metrics-daemon-xx978\" (UID: \"2d7e9360-16e4-4a37-a3e1-b734efbc6292\") " pod="openshift-multus/network-metrics-daemon-xx978" Jun 08 21:07:20.281009 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.280995 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/78668bcc-29d2-42c0-9b9e-4e356590bb96-cnibin\") pod \"multus-additional-cni-plugins-6fp8f\" (UID: \"78668bcc-29d2-42c0-9b9e-4e356590bb96\") " pod="openshift-multus/multus-additional-cni-plugins-6fp8f" Jun 08 21:07:20.281009 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.281010 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/751418cf-8061-45fc-b69f-8e45f348cd88-system-cni-dir\") pod \"multus-sljxg\" (UID: \"751418cf-8061-45fc-b69f-8e45f348cd88\") " pod="openshift-multus/multus-sljxg" Jun 08 21:07:20.281600 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.281038 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/751418cf-8061-45fc-b69f-8e45f348cd88-multus-cni-dir\") pod \"multus-sljxg\" (UID: \"751418cf-8061-45fc-b69f-8e45f348cd88\") " pod="openshift-multus/multus-sljxg" Jun 08 21:07:20.281600 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.281039 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/78668bcc-29d2-42c0-9b9e-4e356590bb96-system-cni-dir\") pod \"multus-additional-cni-plugins-6fp8f\" (UID: \"78668bcc-29d2-42c0-9b9e-4e356590bb96\") " pod="openshift-multus/multus-additional-cni-plugins-6fp8f" Jun 08 21:07:20.281600 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.281067 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/767ccdbc-66e2-441f-932d-4ae6885b6411-host\") pod \"node-ca-ls8lw\" (UID: \"767ccdbc-66e2-441f-932d-4ae6885b6411\") " pod="openshift-image-registry/node-ca-ls8lw" Jun 08 21:07:20.281600 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.281096 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/751418cf-8061-45fc-b69f-8e45f348cd88-host-run-multus-certs\") pod \"multus-sljxg\" (UID: \"751418cf-8061-45fc-b69f-8e45f348cd88\") " pod="openshift-multus/multus-sljxg" Jun 08 21:07:20.281600 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:20.281124 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 21:07:20.281600 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.281133 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/751418cf-8061-45fc-b69f-8e45f348cd88-os-release\") pod \"multus-sljxg\" (UID: \"751418cf-8061-45fc-b69f-8e45f348cd88\") " pod="openshift-multus/multus-sljxg" Jun 08 21:07:20.281600 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.281133 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/78668bcc-29d2-42c0-9b9e-4e356590bb96-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6fp8f\" (UID: \"78668bcc-29d2-42c0-9b9e-4e356590bb96\") " pod="openshift-multus/multus-additional-cni-plugins-6fp8f" Jun 08 21:07:20.281600 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.281165 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/751418cf-8061-45fc-b69f-8e45f348cd88-cni-binary-copy\") pod \"multus-sljxg\" (UID: \"751418cf-8061-45fc-b69f-8e45f348cd88\") " pod="openshift-multus/multus-sljxg" Jun 08 21:07:20.281600 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:20.281178 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d7e9360-16e4-4a37-a3e1-b734efbc6292-metrics-certs podName:2d7e9360-16e4-4a37-a3e1-b734efbc6292 nodeName:}" failed. No retries permitted until 2026-06-08 21:07:20.781160329 +0000 UTC m=+2.038836695 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2d7e9360-16e4-4a37-a3e1-b734efbc6292-metrics-certs") pod "network-metrics-daemon-xx978" (UID: "2d7e9360-16e4-4a37-a3e1-b734efbc6292") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 21:07:20.281600 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.281190 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/751418cf-8061-45fc-b69f-8e45f348cd88-host-run-multus-certs\") pod \"multus-sljxg\" (UID: \"751418cf-8061-45fc-b69f-8e45f348cd88\") " pod="openshift-multus/multus-sljxg" Jun 08 21:07:20.281600 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.281207 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/751418cf-8061-45fc-b69f-8e45f348cd88-multus-cni-dir\") pod \"multus-sljxg\" (UID: \"751418cf-8061-45fc-b69f-8e45f348cd88\") " pod="openshift-multus/multus-sljxg" Jun 08 21:07:20.281600 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.281205 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/751418cf-8061-45fc-b69f-8e45f348cd88-system-cni-dir\") pod \"multus-sljxg\" (UID: \"751418cf-8061-45fc-b69f-8e45f348cd88\") " pod="openshift-multus/multus-sljxg" Jun 08 21:07:20.281600 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.281242 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/751418cf-8061-45fc-b69f-8e45f348cd88-multus-daemon-config\") pod \"multus-sljxg\" (UID: \"751418cf-8061-45fc-b69f-8e45f348cd88\") " pod="openshift-multus/multus-sljxg" Jun 08 21:07:20.281600 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.281249 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/751418cf-8061-45fc-b69f-8e45f348cd88-os-release\") pod \"multus-sljxg\" (UID: \"751418cf-8061-45fc-b69f-8e45f348cd88\") " pod="openshift-multus/multus-sljxg" Jun 08 21:07:20.281600 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.281281 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/767ccdbc-66e2-441f-932d-4ae6885b6411-host\") pod \"node-ca-ls8lw\" (UID: \"767ccdbc-66e2-441f-932d-4ae6885b6411\") " pod="openshift-image-registry/node-ca-ls8lw" Jun 08 21:07:20.281600 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.281318 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/78668bcc-29d2-42c0-9b9e-4e356590bb96-os-release\") pod \"multus-additional-cni-plugins-6fp8f\" (UID: \"78668bcc-29d2-42c0-9b9e-4e356590bb96\") " pod="openshift-multus/multus-additional-cni-plugins-6fp8f" Jun 08 21:07:20.281600 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.281338 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/751418cf-8061-45fc-b69f-8e45f348cd88-host-var-lib-cni-bin\") pod \"multus-sljxg\" (UID: \"751418cf-8061-45fc-b69f-8e45f348cd88\") " pod="openshift-multus/multus-sljxg" Jun 08 21:07:20.281600 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.281356 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/751418cf-8061-45fc-b69f-8e45f348cd88-host-var-lib-kubelet\") pod \"multus-sljxg\" (UID: \"751418cf-8061-45fc-b69f-8e45f348cd88\") " pod="openshift-multus/multus-sljxg" Jun 08 21:07:20.282261 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.281383 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/78668bcc-29d2-42c0-9b9e-4e356590bb96-cni-binary-copy\") pod \"multus-additional-cni-plugins-6fp8f\" (UID: \"78668bcc-29d2-42c0-9b9e-4e356590bb96\") " pod="openshift-multus/multus-additional-cni-plugins-6fp8f" Jun 08 21:07:20.282261 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.281403 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/78668bcc-29d2-42c0-9b9e-4e356590bb96-os-release\") pod \"multus-additional-cni-plugins-6fp8f\" (UID: \"78668bcc-29d2-42c0-9b9e-4e356590bb96\") " pod="openshift-multus/multus-additional-cni-plugins-6fp8f" Jun 08 21:07:20.282261 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.281407 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/751418cf-8061-45fc-b69f-8e45f348cd88-hostroot\") pod \"multus-sljxg\" (UID: \"751418cf-8061-45fc-b69f-8e45f348cd88\") " pod="openshift-multus/multus-sljxg" Jun 08 21:07:20.282261 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.281420 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/751418cf-8061-45fc-b69f-8e45f348cd88-host-var-lib-cni-bin\") pod \"multus-sljxg\" (UID: \"751418cf-8061-45fc-b69f-8e45f348cd88\") " pod="openshift-multus/multus-sljxg" Jun 08 21:07:20.282261 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.281443 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/751418cf-8061-45fc-b69f-8e45f348cd88-hostroot\") pod \"multus-sljxg\" (UID: \"751418cf-8061-45fc-b69f-8e45f348cd88\") " pod="openshift-multus/multus-sljxg" Jun 08 21:07:20.282261 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.281441 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/751418cf-8061-45fc-b69f-8e45f348cd88-host-var-lib-kubelet\") pod \"multus-sljxg\" (UID: \"751418cf-8061-45fc-b69f-8e45f348cd88\") " pod="openshift-multus/multus-sljxg" Jun 08 21:07:20.282261 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.281464 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xw9mk\" (UniqueName: \"kubernetes.io/projected/751418cf-8061-45fc-b69f-8e45f348cd88-kube-api-access-xw9mk\") pod \"multus-sljxg\" (UID: \"751418cf-8061-45fc-b69f-8e45f348cd88\") " pod="openshift-multus/multus-sljxg" Jun 08 21:07:20.282261 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.281489 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dc019e92-af44-4184-8277-e14ccbbe377a-konnectivity-ca\") pod \"konnectivity-agent-s5gwn\" (UID: \"dc019e92-af44-4184-8277-e14ccbbe377a\") " pod="kube-system/konnectivity-agent-s5gwn" Jun 08 21:07:20.282261 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.281506 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/751418cf-8061-45fc-b69f-8e45f348cd88-host-run-k8s-cni-cncf-io\") pod \"multus-sljxg\" (UID: \"751418cf-8061-45fc-b69f-8e45f348cd88\") " pod="openshift-multus/multus-sljxg" Jun 08 21:07:20.282261 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.281531 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/751418cf-8061-45fc-b69f-8e45f348cd88-host-run-netns\") pod \"multus-sljxg\" (UID: \"751418cf-8061-45fc-b69f-8e45f348cd88\") " pod="openshift-multus/multus-sljxg" Jun 08 21:07:20.282261 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.281538 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/78668bcc-29d2-42c0-9b9e-4e356590bb96-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6fp8f\" (UID: \"78668bcc-29d2-42c0-9b9e-4e356590bb96\") " pod="openshift-multus/multus-additional-cni-plugins-6fp8f" Jun 08 21:07:20.282261 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.281560 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/78668bcc-29d2-42c0-9b9e-4e356590bb96-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6fp8f\" (UID: \"78668bcc-29d2-42c0-9b9e-4e356590bb96\") " pod="openshift-multus/multus-additional-cni-plugins-6fp8f" Jun 08 21:07:20.282261 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.281568 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/751418cf-8061-45fc-b69f-8e45f348cd88-host-run-k8s-cni-cncf-io\") pod \"multus-sljxg\" (UID: \"751418cf-8061-45fc-b69f-8e45f348cd88\") " pod="openshift-multus/multus-sljxg" Jun 08 21:07:20.282261 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.281588 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/751418cf-8061-45fc-b69f-8e45f348cd88-multus-socket-dir-parent\") pod \"multus-sljxg\" (UID: \"751418cf-8061-45fc-b69f-8e45f348cd88\") " pod="openshift-multus/multus-sljxg" Jun 08 21:07:20.282261 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.281631 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/751418cf-8061-45fc-b69f-8e45f348cd88-host-run-netns\") pod \"multus-sljxg\" (UID: \"751418cf-8061-45fc-b69f-8e45f348cd88\") " pod="openshift-multus/multus-sljxg" Jun 08 21:07:20.282261 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.281658 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/751418cf-8061-45fc-b69f-8e45f348cd88-multus-socket-dir-parent\") pod \"multus-sljxg\" (UID: \"751418cf-8061-45fc-b69f-8e45f348cd88\") " pod="openshift-multus/multus-sljxg" Jun 08 21:07:20.282261 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.281813 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/751418cf-8061-45fc-b69f-8e45f348cd88-multus-daemon-config\") pod \"multus-sljxg\" (UID: \"751418cf-8061-45fc-b69f-8e45f348cd88\") " pod="openshift-multus/multus-sljxg" Jun 08 21:07:20.282772 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.281956 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/78668bcc-29d2-42c0-9b9e-4e356590bb96-cni-binary-copy\") pod \"multus-additional-cni-plugins-6fp8f\" (UID: \"78668bcc-29d2-42c0-9b9e-4e356590bb96\") " pod="openshift-multus/multus-additional-cni-plugins-6fp8f" Jun 08 21:07:20.282772 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.281975 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dc019e92-af44-4184-8277-e14ccbbe377a-konnectivity-ca\") pod \"konnectivity-agent-s5gwn\" (UID: \"dc019e92-af44-4184-8277-e14ccbbe377a\") " pod="kube-system/konnectivity-agent-s5gwn" Jun 08 21:07:20.282772 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.282084 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/78668bcc-29d2-42c0-9b9e-4e356590bb96-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6fp8f\" (UID: \"78668bcc-29d2-42c0-9b9e-4e356590bb96\") " pod="openshift-multus/multus-additional-cni-plugins-6fp8f" Jun 08 21:07:20.282772 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.282175 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e7727ebf-2eaa-4bdc-b573-3ed8a8a5bb9d-iptables-alerter-script\") pod \"iptables-alerter-lvhwv\" (UID: \"e7727ebf-2eaa-4bdc-b573-3ed8a8a5bb9d\") " pod="openshift-network-operator/iptables-alerter-lvhwv" Jun 08 21:07:20.283437 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.283418 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dc019e92-af44-4184-8277-e14ccbbe377a-agent-certs\") pod \"konnectivity-agent-s5gwn\" (UID: \"dc019e92-af44-4184-8277-e14ccbbe377a\") " pod="kube-system/konnectivity-agent-s5gwn" Jun 08 21:07:20.287161 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:20.287147 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 21:07:20.287199 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:20.287166 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 21:07:20.287199 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:20.287175 2564 projected.go:196] Error preparing data for projected volume kube-api-access-pvh4v for pod openshift-network-diagnostics/network-check-target-qlnlp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 21:07:20.287261 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:20.287217 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d8842123-0e24-491b-83eb-0e30814d1c3a-kube-api-access-pvh4v podName:d8842123-0e24-491b-83eb-0e30814d1c3a nodeName:}" failed. No retries permitted until 2026-06-08 21:07:20.787204262 +0000 UTC m=+2.044880614 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-pvh4v" (UniqueName: "kubernetes.io/projected/d8842123-0e24-491b-83eb-0e30814d1c3a-kube-api-access-pvh4v") pod "network-check-target-qlnlp" (UID: "d8842123-0e24-491b-83eb-0e30814d1c3a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 21:07:20.289510 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.289479 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5vsp\" (UniqueName: \"kubernetes.io/projected/e7727ebf-2eaa-4bdc-b573-3ed8a8a5bb9d-kube-api-access-b5vsp\") pod \"iptables-alerter-lvhwv\" (UID: \"e7727ebf-2eaa-4bdc-b573-3ed8a8a5bb9d\") " pod="openshift-network-operator/iptables-alerter-lvhwv" Jun 08 21:07:20.289820 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.289800 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rqz5\" (UniqueName: \"kubernetes.io/projected/767ccdbc-66e2-441f-932d-4ae6885b6411-kube-api-access-7rqz5\") pod \"node-ca-ls8lw\" (UID: \"767ccdbc-66e2-441f-932d-4ae6885b6411\") " pod="openshift-image-registry/node-ca-ls8lw" Jun 08 21:07:20.289966 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.289945 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2mkp\" (UniqueName: \"kubernetes.io/projected/2d7e9360-16e4-4a37-a3e1-b734efbc6292-kube-api-access-v2mkp\") pod \"network-metrics-daemon-xx978\" (UID: \"2d7e9360-16e4-4a37-a3e1-b734efbc6292\") " pod="openshift-multus/network-metrics-daemon-xx978" Jun 08 21:07:20.290136 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.290121 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sg7hl\" (UniqueName: \"kubernetes.io/projected/78668bcc-29d2-42c0-9b9e-4e356590bb96-kube-api-access-sg7hl\") pod \"multus-additional-cni-plugins-6fp8f\" (UID: \"78668bcc-29d2-42c0-9b9e-4e356590bb96\") " pod="openshift-multus/multus-additional-cni-plugins-6fp8f" Jun 08 21:07:20.291571 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.291551 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xw9mk\" (UniqueName: \"kubernetes.io/projected/751418cf-8061-45fc-b69f-8e45f348cd88-kube-api-access-xw9mk\") pod \"multus-sljxg\" (UID: \"751418cf-8061-45fc-b69f-8e45f348cd88\") " pod="openshift-multus/multus-sljxg" Jun 08 21:07:20.392373 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.392281 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pt842" Jun 08 21:07:20.402108 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:20.402077 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85a49d6e_acdf_43ce_b9c9_1c2d7773a948.slice/crio-ba9d2a622c9c28197b6080f63ec88a8d3b4295a8229e3100b2d9c53454951528 WatchSource:0}: Error finding container ba9d2a622c9c28197b6080f63ec88a8d3b4295a8229e3100b2d9c53454951528: Status 404 returned error can't find the container with id ba9d2a622c9c28197b6080f63ec88a8d3b4295a8229e3100b2d9c53454951528 Jun 08 21:07:20.408374 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.408353 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85cpv" Jun 08 21:07:20.416820 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:20.416797 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0314c4c2_0ef6_404e_bc48_b4862d0c6ab4.slice/crio-be7bbb16571516af9336a02357fe36b8e6b45c3e6cc4a352713f5b5b454628e0 WatchSource:0}: Error finding container be7bbb16571516af9336a02357fe36b8e6b45c3e6cc4a352713f5b5b454628e0: Status 404 returned error can't find the container with id be7bbb16571516af9336a02357fe36b8e6b45c3e6cc4a352713f5b5b454628e0 Jun 08 21:07:20.427225 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.427206 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-h6khk" Jun 08 21:07:20.435130 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:20.435107 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacabf8ac_1b36_4532_ada1_7eb8e9b8d71f.slice/crio-7dea682525fd242e6f10b52c2f66d0a92caaa9a19f945eee24f08a57933f468d WatchSource:0}: Error finding container 7dea682525fd242e6f10b52c2f66d0a92caaa9a19f945eee24f08a57933f468d: Status 404 returned error can't find the container with id 7dea682525fd242e6f10b52c2f66d0a92caaa9a19f945eee24f08a57933f468d Jun 08 21:07:20.446649 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.446627 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zhdb2" Jun 08 21:07:20.453603 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.453581 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ls8lw" Jun 08 21:07:20.455098 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:20.455075 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fcb5113_dc25_491d_b570_2c2818b90ea9.slice/crio-7c56ae8fced30af37a9c8c8f881f7ed10976f3913335527ba48c70490ac31bb2 WatchSource:0}: Error finding container 7c56ae8fced30af37a9c8c8f881f7ed10976f3913335527ba48c70490ac31bb2: Status 404 returned error can't find the container with id 7c56ae8fced30af37a9c8c8f881f7ed10976f3913335527ba48c70490ac31bb2 Jun 08 21:07:20.460279 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.460251 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6fp8f" Jun 08 21:07:20.462391 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:20.462367 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod767ccdbc_66e2_441f_932d_4ae6885b6411.slice/crio-e574aef1ffa17123d714571cdce60c7f5f2c4b1ad0dd62d9bf4da845a6f4cda9 WatchSource:0}: Error finding container e574aef1ffa17123d714571cdce60c7f5f2c4b1ad0dd62d9bf4da845a6f4cda9: Status 404 returned error can't find the container with id e574aef1ffa17123d714571cdce60c7f5f2c4b1ad0dd62d9bf4da845a6f4cda9 Jun 08 21:07:20.466429 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.466408 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sljxg" Jun 08 21:07:20.470334 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:20.470310 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78668bcc_29d2_42c0_9b9e_4e356590bb96.slice/crio-845e978a2e36c977906b318198579cdb3b75df9557de686817750eff76e102d3 WatchSource:0}: Error finding container 845e978a2e36c977906b318198579cdb3b75df9557de686817750eff76e102d3: Status 404 returned error can't find the container with id 845e978a2e36c977906b318198579cdb3b75df9557de686817750eff76e102d3 Jun 08 21:07:20.471933 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.471915 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-s5gwn" Jun 08 21:07:20.480828 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:20.480580 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod751418cf_8061_45fc_b69f_8e45f348cd88.slice/crio-6a502df499fcd02a14b929c720f325cd03d6b297680fface250d6a35550f22bb WatchSource:0}: Error finding container 6a502df499fcd02a14b929c720f325cd03d6b297680fface250d6a35550f22bb: Status 404 returned error can't find the container with id 6a502df499fcd02a14b929c720f325cd03d6b297680fface250d6a35550f22bb Jun 08 21:07:20.480942 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.480889 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lvhwv" Jun 08 21:07:20.485872 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:20.485658 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc019e92_af44_4184_8277_e14ccbbe377a.slice/crio-4993add1716b5dd6c5ce3190433525c0c2b318336994da9d017a3492178deac3 WatchSource:0}: Error finding container 4993add1716b5dd6c5ce3190433525c0c2b318336994da9d017a3492178deac3: Status 404 returned error can't find the container with id 4993add1716b5dd6c5ce3190433525c0c2b318336994da9d017a3492178deac3 Jun 08 21:07:20.492295 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:20.492249 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7727ebf_2eaa_4bdc_b573_3ed8a8a5bb9d.slice/crio-8fec1d22c6711c541319e10401f0e9b654b04981cedb79084620bbccdb69857f WatchSource:0}: Error finding container 8fec1d22c6711c541319e10401f0e9b654b04981cedb79084620bbccdb69857f: Status 404 returned error can't find the container with id 8fec1d22c6711c541319e10401f0e9b654b04981cedb79084620bbccdb69857f Jun 08 21:07:20.684464 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.684384 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/502a6cc3-183a-4d9d-833d-2f14f5e1c946-original-pull-secret\") pod \"global-pull-secret-syncer-9pzqb\" (UID: \"502a6cc3-183a-4d9d-833d-2f14f5e1c946\") " pod="kube-system/global-pull-secret-syncer-9pzqb" Jun 08 21:07:20.684615 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:20.684571 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 21:07:20.684678 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:20.684644 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/502a6cc3-183a-4d9d-833d-2f14f5e1c946-original-pull-secret podName:502a6cc3-183a-4d9d-833d-2f14f5e1c946 nodeName:}" failed. No retries permitted until 2026-06-08 21:07:21.684624477 +0000 UTC m=+2.942300840 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/502a6cc3-183a-4d9d-833d-2f14f5e1c946-original-pull-secret") pod "global-pull-secret-syncer-9pzqb" (UID: "502a6cc3-183a-4d9d-833d-2f14f5e1c946") : object "kube-system"/"original-pull-secret" not registered Jun 08 21:07:20.785643 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.785608 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d7e9360-16e4-4a37-a3e1-b734efbc6292-metrics-certs\") pod \"network-metrics-daemon-xx978\" (UID: \"2d7e9360-16e4-4a37-a3e1-b734efbc6292\") " pod="openshift-multus/network-metrics-daemon-xx978" Jun 08 21:07:20.785821 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:20.785774 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 21:07:20.785891 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:20.785844 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d7e9360-16e4-4a37-a3e1-b734efbc6292-metrics-certs podName:2d7e9360-16e4-4a37-a3e1-b734efbc6292 nodeName:}" failed. No retries permitted until 2026-06-08 21:07:21.785825879 +0000 UTC m=+3.043502256 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2d7e9360-16e4-4a37-a3e1-b734efbc6292-metrics-certs") pod "network-metrics-daemon-xx978" (UID: "2d7e9360-16e4-4a37-a3e1-b734efbc6292") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 21:07:20.886007 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:20.885974 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvh4v\" (UniqueName: \"kubernetes.io/projected/d8842123-0e24-491b-83eb-0e30814d1c3a-kube-api-access-pvh4v\") pod \"network-check-target-qlnlp\" (UID: \"d8842123-0e24-491b-83eb-0e30814d1c3a\") " pod="openshift-network-diagnostics/network-check-target-qlnlp" Jun 08 21:07:20.886213 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:20.886156 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 21:07:20.886213 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:20.886177 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 21:07:20.886213 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:20.886189 2564 projected.go:196] Error preparing data for projected volume kube-api-access-pvh4v for pod openshift-network-diagnostics/network-check-target-qlnlp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 21:07:20.886417 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:20.886366 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d8842123-0e24-491b-83eb-0e30814d1c3a-kube-api-access-pvh4v podName:d8842123-0e24-491b-83eb-0e30814d1c3a nodeName:}" failed. No retries permitted until 2026-06-08 21:07:21.886341862 +0000 UTC m=+3.144018236 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-pvh4v" (UniqueName: "kubernetes.io/projected/d8842123-0e24-491b-83eb-0e30814d1c3a-kube-api-access-pvh4v") pod "network-check-target-qlnlp" (UID: "d8842123-0e24-491b-83eb-0e30814d1c3a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 21:07:21.114175 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:21.114071 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-07 21:02:20 +0000 UTC" deadline="2028-03-04 17:38:19.818055338 +0000 UTC" Jun 08 21:07:21.114175 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:21.114111 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15236h30m58.703949632s" Jun 08 21:07:21.144664 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:21.143837 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xx978" Jun 08 21:07:21.144664 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:21.143971 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xx978" podUID="2d7e9360-16e4-4a37-a3e1-b734efbc6292" Jun 08 21:07:21.144664 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:21.144059 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9pzqb" Jun 08 21:07:21.144664 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:21.144144 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9pzqb" podUID="502a6cc3-183a-4d9d-833d-2f14f5e1c946" Jun 08 21:07:21.154587 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:21.154517 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-247.ec2.internal" event={"ID":"0313b76425dedbbdaa2ce42744a43bc4","Type":"ContainerStarted","Data":"b741ec06a16a2aae46fb123ee8ac6e23bd4244b8efc0acb1abe009e128bdb894"} Jun 08 21:07:21.165571 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:21.165535 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lvhwv" event={"ID":"e7727ebf-2eaa-4bdc-b573-3ed8a8a5bb9d","Type":"ContainerStarted","Data":"8fec1d22c6711c541319e10401f0e9b654b04981cedb79084620bbccdb69857f"} Jun 08 21:07:21.176958 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:21.176870 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-s5gwn" event={"ID":"dc019e92-af44-4184-8277-e14ccbbe377a","Type":"ContainerStarted","Data":"4993add1716b5dd6c5ce3190433525c0c2b318336994da9d017a3492178deac3"} Jun 08 21:07:21.195803 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:21.195699 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6fp8f" event={"ID":"78668bcc-29d2-42c0-9b9e-4e356590bb96","Type":"ContainerStarted","Data":"845e978a2e36c977906b318198579cdb3b75df9557de686817750eff76e102d3"} Jun 08 21:07:21.219130 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:21.218945 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ls8lw" event={"ID":"767ccdbc-66e2-441f-932d-4ae6885b6411","Type":"ContainerStarted","Data":"e574aef1ffa17123d714571cdce60c7f5f2c4b1ad0dd62d9bf4da845a6f4cda9"} Jun 08 21:07:21.227156 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:21.226981 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zhdb2" event={"ID":"4fcb5113-dc25-491d-b570-2c2818b90ea9","Type":"ContainerStarted","Data":"7c56ae8fced30af37a9c8c8f881f7ed10976f3913335527ba48c70490ac31bb2"} Jun 08 21:07:21.237004 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:21.236953 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pt842" event={"ID":"85a49d6e-acdf-43ce-b9c9-1c2d7773a948","Type":"ContainerStarted","Data":"ba9d2a622c9c28197b6080f63ec88a8d3b4295a8229e3100b2d9c53454951528"} Jun 08 21:07:21.252546 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:21.252506 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sljxg" event={"ID":"751418cf-8061-45fc-b69f-8e45f348cd88","Type":"ContainerStarted","Data":"6a502df499fcd02a14b929c720f325cd03d6b297680fface250d6a35550f22bb"} Jun 08 21:07:21.278214 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:21.278103 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-h6khk" event={"ID":"acabf8ac-1b36-4532-ada1-7eb8e9b8d71f","Type":"ContainerStarted","Data":"7dea682525fd242e6f10b52c2f66d0a92caaa9a19f945eee24f08a57933f468d"} Jun 08 21:07:21.285443 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:21.285410 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85cpv" event={"ID":"0314c4c2-0ef6-404e-bc48-b4862d0c6ab4","Type":"ContainerStarted","Data":"be7bbb16571516af9336a02357fe36b8e6b45c3e6cc4a352713f5b5b454628e0"} Jun 08 21:07:21.303116 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:21.303081 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-247.ec2.internal" event={"ID":"6682056a4304d1a35505f115402ac6d2","Type":"ContainerStarted","Data":"0b275fdcca0767eadf8249705a76c6b8cd5ae0e447ea8a11586a51ee27f43c86"} Jun 08 21:07:21.460983 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:21.460702 2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 21:07:21.485678 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:21.485583 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 21:07:21.694880 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:21.694253 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/502a6cc3-183a-4d9d-833d-2f14f5e1c946-original-pull-secret\") pod \"global-pull-secret-syncer-9pzqb\" (UID: \"502a6cc3-183a-4d9d-833d-2f14f5e1c946\") " pod="kube-system/global-pull-secret-syncer-9pzqb" Jun 08 21:07:21.694880 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:21.694416 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 21:07:21.694880 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:21.694482 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/502a6cc3-183a-4d9d-833d-2f14f5e1c946-original-pull-secret podName:502a6cc3-183a-4d9d-833d-2f14f5e1c946 nodeName:}" failed. No retries permitted until 2026-06-08 21:07:23.694461871 +0000 UTC m=+4.952138230 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/502a6cc3-183a-4d9d-833d-2f14f5e1c946-original-pull-secret") pod "global-pull-secret-syncer-9pzqb" (UID: "502a6cc3-183a-4d9d-833d-2f14f5e1c946") : object "kube-system"/"original-pull-secret" not registered Jun 08 21:07:21.795290 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:21.795183 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d7e9360-16e4-4a37-a3e1-b734efbc6292-metrics-certs\") pod \"network-metrics-daemon-xx978\" (UID: \"2d7e9360-16e4-4a37-a3e1-b734efbc6292\") " pod="openshift-multus/network-metrics-daemon-xx978" Jun 08 21:07:21.795454 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:21.795350 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 21:07:21.795454 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:21.795436 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d7e9360-16e4-4a37-a3e1-b734efbc6292-metrics-certs podName:2d7e9360-16e4-4a37-a3e1-b734efbc6292 nodeName:}" failed. No retries permitted until 2026-06-08 21:07:23.795405377 +0000 UTC m=+5.053081734 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2d7e9360-16e4-4a37-a3e1-b734efbc6292-metrics-certs") pod "network-metrics-daemon-xx978" (UID: "2d7e9360-16e4-4a37-a3e1-b734efbc6292") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 21:07:21.891075 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:21.890743 2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 21:07:21.896081 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:21.896052 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvh4v\" (UniqueName: \"kubernetes.io/projected/d8842123-0e24-491b-83eb-0e30814d1c3a-kube-api-access-pvh4v\") pod \"network-check-target-qlnlp\" (UID: \"d8842123-0e24-491b-83eb-0e30814d1c3a\") " pod="openshift-network-diagnostics/network-check-target-qlnlp" Jun 08 21:07:21.896301 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:21.896283 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 21:07:21.896395 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:21.896312 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 21:07:21.896395 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:21.896325 2564 projected.go:196] Error preparing data for projected volume kube-api-access-pvh4v for pod openshift-network-diagnostics/network-check-target-qlnlp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 21:07:21.896395 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:21.896379 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d8842123-0e24-491b-83eb-0e30814d1c3a-kube-api-access-pvh4v podName:d8842123-0e24-491b-83eb-0e30814d1c3a nodeName:}" failed. No retries permitted until 2026-06-08 21:07:23.896360652 +0000 UTC m=+5.154037020 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-pvh4v" (UniqueName: "kubernetes.io/projected/d8842123-0e24-491b-83eb-0e30814d1c3a-kube-api-access-pvh4v") pod "network-check-target-qlnlp" (UID: "d8842123-0e24-491b-83eb-0e30814d1c3a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 21:07:22.114664 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:22.114537 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-07 21:02:20 +0000 UTC" deadline="2027-12-08 23:06:59.293879456 +0000 UTC" Jun 08 21:07:22.114664 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:22.114605 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13153h59m37.179277977s" Jun 08 21:07:22.136281 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:22.136237 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qlnlp" Jun 08 21:07:22.136471 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:22.136383 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qlnlp" podUID="d8842123-0e24-491b-83eb-0e30814d1c3a" Jun 08 21:07:22.748472 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:22.748439 2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 21:07:23.157416 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:23.157340 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xx978" Jun 08 21:07:23.157850 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:23.157489 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xx978" podUID="2d7e9360-16e4-4a37-a3e1-b734efbc6292" Jun 08 21:07:23.157921 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:23.157874 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9pzqb" Jun 08 21:07:23.158147 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:23.157970 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9pzqb" podUID="502a6cc3-183a-4d9d-833d-2f14f5e1c946" Jun 08 21:07:23.714232 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:23.714190 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/502a6cc3-183a-4d9d-833d-2f14f5e1c946-original-pull-secret\") pod \"global-pull-secret-syncer-9pzqb\" (UID: \"502a6cc3-183a-4d9d-833d-2f14f5e1c946\") " pod="kube-system/global-pull-secret-syncer-9pzqb" Jun 08 21:07:23.714445 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:23.714400 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 21:07:23.714507 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:23.714467 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/502a6cc3-183a-4d9d-833d-2f14f5e1c946-original-pull-secret podName:502a6cc3-183a-4d9d-833d-2f14f5e1c946 nodeName:}" failed. No retries permitted until 2026-06-08 21:07:27.714447284 +0000 UTC m=+8.972123650 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/502a6cc3-183a-4d9d-833d-2f14f5e1c946-original-pull-secret") pod "global-pull-secret-syncer-9pzqb" (UID: "502a6cc3-183a-4d9d-833d-2f14f5e1c946") : object "kube-system"/"original-pull-secret" not registered Jun 08 21:07:23.815537 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:23.815478 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d7e9360-16e4-4a37-a3e1-b734efbc6292-metrics-certs\") pod \"network-metrics-daemon-xx978\" (UID: \"2d7e9360-16e4-4a37-a3e1-b734efbc6292\") " pod="openshift-multus/network-metrics-daemon-xx978" Jun 08 21:07:23.816222 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:23.815708 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 21:07:23.816222 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:23.815803 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d7e9360-16e4-4a37-a3e1-b734efbc6292-metrics-certs podName:2d7e9360-16e4-4a37-a3e1-b734efbc6292 nodeName:}" failed. No retries permitted until 2026-06-08 21:07:27.815781016 +0000 UTC m=+9.073457372 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2d7e9360-16e4-4a37-a3e1-b734efbc6292-metrics-certs") pod "network-metrics-daemon-xx978" (UID: "2d7e9360-16e4-4a37-a3e1-b734efbc6292") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 21:07:23.917585 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:23.916901 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvh4v\" (UniqueName: \"kubernetes.io/projected/d8842123-0e24-491b-83eb-0e30814d1c3a-kube-api-access-pvh4v\") pod \"network-check-target-qlnlp\" (UID: \"d8842123-0e24-491b-83eb-0e30814d1c3a\") " pod="openshift-network-diagnostics/network-check-target-qlnlp" Jun 08 21:07:23.917585 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:23.917115 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 21:07:23.917585 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:23.917140 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 21:07:23.917585 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:23.917153 2564 projected.go:196] Error preparing data for projected volume kube-api-access-pvh4v for pod openshift-network-diagnostics/network-check-target-qlnlp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 21:07:23.917585 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:23.917213 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d8842123-0e24-491b-83eb-0e30814d1c3a-kube-api-access-pvh4v podName:d8842123-0e24-491b-83eb-0e30814d1c3a nodeName:}" failed. No retries permitted until 2026-06-08 21:07:27.917194101 +0000 UTC m=+9.174870470 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-pvh4v" (UniqueName: "kubernetes.io/projected/d8842123-0e24-491b-83eb-0e30814d1c3a-kube-api-access-pvh4v") pod "network-check-target-qlnlp" (UID: "d8842123-0e24-491b-83eb-0e30814d1c3a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 21:07:24.136790 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:24.136244 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qlnlp" Jun 08 21:07:24.136790 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:24.136389 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qlnlp" podUID="d8842123-0e24-491b-83eb-0e30814d1c3a" Jun 08 21:07:25.139292 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:25.139110 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9pzqb" Jun 08 21:07:25.139292 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:25.139232 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9pzqb" podUID="502a6cc3-183a-4d9d-833d-2f14f5e1c946" Jun 08 21:07:25.139881 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:25.139614 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xx978" Jun 08 21:07:25.139881 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:25.139734 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xx978" podUID="2d7e9360-16e4-4a37-a3e1-b734efbc6292" Jun 08 21:07:26.136405 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:26.136169 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qlnlp" Jun 08 21:07:26.136405 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:26.136367 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qlnlp" podUID="d8842123-0e24-491b-83eb-0e30814d1c3a" Jun 08 21:07:27.136252 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:27.136216 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9pzqb" Jun 08 21:07:27.136252 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:27.136254 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xx978" Jun 08 21:07:27.136765 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:27.136381 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9pzqb" podUID="502a6cc3-183a-4d9d-833d-2f14f5e1c946" Jun 08 21:07:27.136765 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:27.136497 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xx978" podUID="2d7e9360-16e4-4a37-a3e1-b734efbc6292" Jun 08 21:07:27.748793 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:27.748149 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/502a6cc3-183a-4d9d-833d-2f14f5e1c946-original-pull-secret\") pod \"global-pull-secret-syncer-9pzqb\" (UID: \"502a6cc3-183a-4d9d-833d-2f14f5e1c946\") " pod="kube-system/global-pull-secret-syncer-9pzqb" Jun 08 21:07:27.748793 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:27.748394 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 21:07:27.748793 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:27.748460 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/502a6cc3-183a-4d9d-833d-2f14f5e1c946-original-pull-secret podName:502a6cc3-183a-4d9d-833d-2f14f5e1c946 nodeName:}" failed. No retries permitted until 2026-06-08 21:07:35.748440506 +0000 UTC m=+17.006116861 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/502a6cc3-183a-4d9d-833d-2f14f5e1c946-original-pull-secret") pod "global-pull-secret-syncer-9pzqb" (UID: "502a6cc3-183a-4d9d-833d-2f14f5e1c946") : object "kube-system"/"original-pull-secret" not registered Jun 08 21:07:27.848646 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:27.848612 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d7e9360-16e4-4a37-a3e1-b734efbc6292-metrics-certs\") pod \"network-metrics-daemon-xx978\" (UID: \"2d7e9360-16e4-4a37-a3e1-b734efbc6292\") " pod="openshift-multus/network-metrics-daemon-xx978" Jun 08 21:07:27.848854 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:27.848795 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 21:07:27.848921 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:27.848890 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d7e9360-16e4-4a37-a3e1-b734efbc6292-metrics-certs podName:2d7e9360-16e4-4a37-a3e1-b734efbc6292 nodeName:}" failed. No retries permitted until 2026-06-08 21:07:35.848859925 +0000 UTC m=+17.106536278 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2d7e9360-16e4-4a37-a3e1-b734efbc6292-metrics-certs") pod "network-metrics-daemon-xx978" (UID: "2d7e9360-16e4-4a37-a3e1-b734efbc6292") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 21:07:27.949855 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:27.949228 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvh4v\" (UniqueName: \"kubernetes.io/projected/d8842123-0e24-491b-83eb-0e30814d1c3a-kube-api-access-pvh4v\") pod \"network-check-target-qlnlp\" (UID: \"d8842123-0e24-491b-83eb-0e30814d1c3a\") " pod="openshift-network-diagnostics/network-check-target-qlnlp" Jun 08 21:07:27.949855 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:27.949439 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 21:07:27.949855 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:27.949464 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 21:07:27.949855 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:27.949477 2564 projected.go:196] Error preparing data for projected volume kube-api-access-pvh4v for pod openshift-network-diagnostics/network-check-target-qlnlp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 21:07:27.949855 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:27.949538 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d8842123-0e24-491b-83eb-0e30814d1c3a-kube-api-access-pvh4v podName:d8842123-0e24-491b-83eb-0e30814d1c3a nodeName:}" failed. No retries permitted until 2026-06-08 21:07:35.949520565 +0000 UTC m=+17.207196923 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-pvh4v" (UniqueName: "kubernetes.io/projected/d8842123-0e24-491b-83eb-0e30814d1c3a-kube-api-access-pvh4v") pod "network-check-target-qlnlp" (UID: "d8842123-0e24-491b-83eb-0e30814d1c3a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 21:07:28.136500 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:28.136415 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qlnlp" Jun 08 21:07:28.136942 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:28.136556 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qlnlp" podUID="d8842123-0e24-491b-83eb-0e30814d1c3a" Jun 08 21:07:29.135498 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:29.135466 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9pzqb" Jun 08 21:07:29.137186 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:29.136675 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9pzqb" podUID="502a6cc3-183a-4d9d-833d-2f14f5e1c946" Jun 08 21:07:29.137186 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:29.137035 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xx978" Jun 08 21:07:29.137186 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:29.137143 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xx978" podUID="2d7e9360-16e4-4a37-a3e1-b734efbc6292" Jun 08 21:07:30.136092 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:30.136052 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qlnlp" Jun 08 21:07:30.136292 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:30.136162 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qlnlp" podUID="d8842123-0e24-491b-83eb-0e30814d1c3a" Jun 08 21:07:31.135978 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:31.135930 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9pzqb" Jun 08 21:07:31.136521 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:31.136066 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9pzqb" podUID="502a6cc3-183a-4d9d-833d-2f14f5e1c946" Jun 08 21:07:31.136603 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:31.136527 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xx978" Jun 08 21:07:31.136667 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:31.136649 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xx978" podUID="2d7e9360-16e4-4a37-a3e1-b734efbc6292" Jun 08 21:07:32.136359 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:32.136324 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qlnlp" Jun 08 21:07:32.136805 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:32.136461 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qlnlp" podUID="d8842123-0e24-491b-83eb-0e30814d1c3a" Jun 08 21:07:33.136412 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:33.136340 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xx978" Jun 08 21:07:33.136885 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:33.136340 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9pzqb" Jun 08 21:07:33.136885 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:33.136485 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xx978" podUID="2d7e9360-16e4-4a37-a3e1-b734efbc6292" Jun 08 21:07:33.136885 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:33.136542 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9pzqb" podUID="502a6cc3-183a-4d9d-833d-2f14f5e1c946" Jun 08 21:07:34.136415 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:34.136375 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qlnlp" Jun 08 21:07:34.136908 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:34.136506 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qlnlp" podUID="d8842123-0e24-491b-83eb-0e30814d1c3a" Jun 08 21:07:35.136466 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:35.136435 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9pzqb" Jun 08 21:07:35.136904 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:35.136435 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xx978" Jun 08 21:07:35.136904 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:35.136554 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9pzqb" podUID="502a6cc3-183a-4d9d-833d-2f14f5e1c946" Jun 08 21:07:35.136904 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:35.136649 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xx978" podUID="2d7e9360-16e4-4a37-a3e1-b734efbc6292" Jun 08 21:07:35.806964 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:35.806876 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/502a6cc3-183a-4d9d-833d-2f14f5e1c946-original-pull-secret\") pod \"global-pull-secret-syncer-9pzqb\" (UID: \"502a6cc3-183a-4d9d-833d-2f14f5e1c946\") " pod="kube-system/global-pull-secret-syncer-9pzqb" Jun 08 21:07:35.807156 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:35.807046 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 21:07:35.807156 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:35.807129 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/502a6cc3-183a-4d9d-833d-2f14f5e1c946-original-pull-secret podName:502a6cc3-183a-4d9d-833d-2f14f5e1c946 nodeName:}" failed. No retries permitted until 2026-06-08 21:07:51.807106004 +0000 UTC m=+33.064782371 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/502a6cc3-183a-4d9d-833d-2f14f5e1c946-original-pull-secret") pod "global-pull-secret-syncer-9pzqb" (UID: "502a6cc3-183a-4d9d-833d-2f14f5e1c946") : object "kube-system"/"original-pull-secret" not registered Jun 08 21:07:35.907602 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:35.907562 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d7e9360-16e4-4a37-a3e1-b734efbc6292-metrics-certs\") pod \"network-metrics-daemon-xx978\" (UID: \"2d7e9360-16e4-4a37-a3e1-b734efbc6292\") " pod="openshift-multus/network-metrics-daemon-xx978" Jun 08 21:07:35.907810 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:35.907702 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 21:07:35.907810 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:35.907789 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d7e9360-16e4-4a37-a3e1-b734efbc6292-metrics-certs podName:2d7e9360-16e4-4a37-a3e1-b734efbc6292 nodeName:}" failed. No retries permitted until 2026-06-08 21:07:51.907768686 +0000 UTC m=+33.165445044 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2d7e9360-16e4-4a37-a3e1-b734efbc6292-metrics-certs") pod "network-metrics-daemon-xx978" (UID: "2d7e9360-16e4-4a37-a3e1-b734efbc6292") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 21:07:36.008038 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:36.008005 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvh4v\" (UniqueName: \"kubernetes.io/projected/d8842123-0e24-491b-83eb-0e30814d1c3a-kube-api-access-pvh4v\") pod \"network-check-target-qlnlp\" (UID: \"d8842123-0e24-491b-83eb-0e30814d1c3a\") " pod="openshift-network-diagnostics/network-check-target-qlnlp" Jun 08 21:07:36.008196 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:36.008172 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 21:07:36.008253 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:36.008203 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 21:07:36.008253 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:36.008217 2564 projected.go:196] Error preparing data for projected volume kube-api-access-pvh4v for pod openshift-network-diagnostics/network-check-target-qlnlp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 21:07:36.008347 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:36.008284 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d8842123-0e24-491b-83eb-0e30814d1c3a-kube-api-access-pvh4v podName:d8842123-0e24-491b-83eb-0e30814d1c3a nodeName:}" failed. No retries permitted until 2026-06-08 21:07:52.00825408 +0000 UTC m=+33.265930433 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-pvh4v" (UniqueName: "kubernetes.io/projected/d8842123-0e24-491b-83eb-0e30814d1c3a-kube-api-access-pvh4v") pod "network-check-target-qlnlp" (UID: "d8842123-0e24-491b-83eb-0e30814d1c3a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 21:07:36.136305 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:36.136215 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qlnlp" Jun 08 21:07:36.136456 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:36.136353 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qlnlp" podUID="d8842123-0e24-491b-83eb-0e30814d1c3a" Jun 08 21:07:37.135705 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:37.135672 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xx978" Jun 08 21:07:37.135705 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:37.135701 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9pzqb" Jun 08 21:07:37.136306 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:37.135810 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xx978" podUID="2d7e9360-16e4-4a37-a3e1-b734efbc6292" Jun 08 21:07:37.136306 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:37.135941 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9pzqb" podUID="502a6cc3-183a-4d9d-833d-2f14f5e1c946" Jun 08 21:07:38.135878 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:38.135847 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qlnlp" Jun 08 21:07:38.136315 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:38.135973 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qlnlp" podUID="d8842123-0e24-491b-83eb-0e30814d1c3a" Jun 08 21:07:39.136605 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:39.136517 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9pzqb" Jun 08 21:07:39.136605 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:39.136563 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xx978" Jun 08 21:07:39.137120 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:39.136630 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9pzqb" podUID="502a6cc3-183a-4d9d-833d-2f14f5e1c946" Jun 08 21:07:39.137120 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:39.136751 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xx978" podUID="2d7e9360-16e4-4a37-a3e1-b734efbc6292" Jun 08 21:07:40.135950 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:40.135880 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qlnlp" Jun 08 21:07:40.136078 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:40.136004 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qlnlp" podUID="d8842123-0e24-491b-83eb-0e30814d1c3a" Jun 08 21:07:40.351732 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:40.351698 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-h6khk" event={"ID":"acabf8ac-1b36-4532-ada1-7eb8e9b8d71f","Type":"ContainerStarted","Data":"19b28eb2263218661a100f1c6c3500faed3bf2a5d410e88fb32b71ca380765ed"} Jun 08 21:07:40.353802 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:40.353405 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-247.ec2.internal" event={"ID":"0313b76425dedbbdaa2ce42744a43bc4","Type":"ContainerStarted","Data":"a49a6f3a77c9ebc51d34c8a760f52e48a94e53fb37db78e67c00b37b13278fee"} Jun 08 21:07:40.354832 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:40.354811 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pt842" event={"ID":"85a49d6e-acdf-43ce-b9c9-1c2d7773a948","Type":"ContainerStarted","Data":"5c42963a682832b3c2d94e38173973193038975f5be9e8d8e09196be4dbc8a62"} Jun 08 21:07:40.369427 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:40.369376 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-h6khk" podStartSLOduration=1.896478617 podStartE2EDuration="21.369355345s" totalImagesPullingTime="19.472876728s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 21:07:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:07:40.368644101 +0000 UTC m=+21.626320512" watchObservedRunningTime="2026-06-08 21:07:40.369355345 +0000 UTC m=+21.627031722" Jun 08 21:07:40.385181 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:40.385134 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-247.ec2.internal" podStartSLOduration=20.38512094 podStartE2EDuration="20.38512094s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 21:07:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:07:40.384485352 +0000 UTC m=+21.642161737" watchObservedRunningTime="2026-06-08 21:07:40.38512094 +0000 UTC m=+21.642797315" Jun 08 21:07:41.136117 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:41.135943 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9pzqb" Jun 08 21:07:41.136473 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:41.136004 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xx978" Jun 08 21:07:41.136473 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:41.136229 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9pzqb" podUID="502a6cc3-183a-4d9d-833d-2f14f5e1c946" Jun 08 21:07:41.136473 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:41.136258 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xx978" podUID="2d7e9360-16e4-4a37-a3e1-b734efbc6292" Jun 08 21:07:41.357848 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:41.357815 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lvhwv" event={"ID":"e7727ebf-2eaa-4bdc-b573-3ed8a8a5bb9d","Type":"ContainerStarted","Data":"c38fcb30528f67bc22c5b0fc4e0b2e0ab25b2e7eea7f0a7ebe9cc0b5541e70db"} Jun 08 21:07:41.359277 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:41.359231 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-s5gwn" event={"ID":"dc019e92-af44-4184-8277-e14ccbbe377a","Type":"ContainerStarted","Data":"815875e8ba2bb8958adb6fb86be2d50a74740257b7a4abca97cb6e1dacda2d0e"} Jun 08 21:07:41.360749 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:41.360725 2564 generic.go:356] "Generic (PLEG): container finished" podID="78668bcc-29d2-42c0-9b9e-4e356590bb96" containerID="c2490fce39306027525ede1b5be973780d4142be8a8426f6cfde3b09f67cd5ba" exitCode=0 Jun 08 21:07:41.360861 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:41.360794 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6fp8f" event={"ID":"78668bcc-29d2-42c0-9b9e-4e356590bb96","Type":"ContainerDied","Data":"c2490fce39306027525ede1b5be973780d4142be8a8426f6cfde3b09f67cd5ba"} Jun 08 21:07:41.362222 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:41.362196 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ls8lw" event={"ID":"767ccdbc-66e2-441f-932d-4ae6885b6411","Type":"ContainerStarted","Data":"9163fb0b15d545e5a81b9899e5e8c2f6f17b808560d7b084dcc44a0a191b3f5d"} Jun 08 21:07:41.363670 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:41.363648 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zhdb2" event={"ID":"4fcb5113-dc25-491d-b570-2c2818b90ea9","Type":"ContainerStarted","Data":"61d632efdc6c146fe96d4edee9231876a9202487b082fe5d403773ada0875498"} Jun 08 21:07:41.366177 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:41.366159 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pt842_85a49d6e-acdf-43ce-b9c9-1c2d7773a948/ovn-acl-logging/0.log" Jun 08 21:07:41.366531 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:41.366508 2564 generic.go:356] "Generic (PLEG): container finished" podID="85a49d6e-acdf-43ce-b9c9-1c2d7773a948" containerID="c072aaa3c7974b05614669c332d4345dbb87bfc9369b835bfd3bee2f3594e692" exitCode=1 Jun 08 21:07:41.366589 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:41.366571 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pt842" event={"ID":"85a49d6e-acdf-43ce-b9c9-1c2d7773a948","Type":"ContainerStarted","Data":"96be243f789113dcde6dc47713385bf98ba2ba39f2a0582073ddd903bec27f54"} Jun 08 21:07:41.366642 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:41.366623 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pt842" event={"ID":"85a49d6e-acdf-43ce-b9c9-1c2d7773a948","Type":"ContainerStarted","Data":"73b5e69c7462a644b90a3bb9c9e9a078b6d0c35e27fd20302afcb299efdd1f6d"} Jun 08 21:07:41.366698 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:41.366654 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pt842" event={"ID":"85a49d6e-acdf-43ce-b9c9-1c2d7773a948","Type":"ContainerStarted","Data":"504c7611d8fefd3fb0daa7d306002fa58e6371d00f2cc8be46709c7f7adb7e9a"} Jun 08 21:07:41.366698 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:41.366684 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pt842" event={"ID":"85a49d6e-acdf-43ce-b9c9-1c2d7773a948","Type":"ContainerStarted","Data":"9fb36e908b6ca7185631c16f4f075399c5632572e1b81b053105f2c65ca0aae4"} Jun 08 21:07:41.366794 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:41.366711 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pt842" event={"ID":"85a49d6e-acdf-43ce-b9c9-1c2d7773a948","Type":"ContainerDied","Data":"c072aaa3c7974b05614669c332d4345dbb87bfc9369b835bfd3bee2f3594e692"} Jun 08 21:07:41.367924 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:41.367901 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sljxg" event={"ID":"751418cf-8061-45fc-b69f-8e45f348cd88","Type":"ContainerStarted","Data":"7ebc9107fa8be34c58c0255d32071a0a37b1446bb32f95879083a2e574b85152"} Jun 08 21:07:41.369179 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:41.369151 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85cpv" event={"ID":"0314c4c2-0ef6-404e-bc48-b4862d0c6ab4","Type":"ContainerStarted","Data":"77efc65d1b13975ba8233d3713d6fd299b953cfa56a1bd4bd10ec58199003235"} Jun 08 21:07:41.370533 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:41.370513 2564 generic.go:356] "Generic (PLEG): container finished" podID="6682056a4304d1a35505f115402ac6d2" containerID="067999d0b9168e046d666af46a05619a02542e0fbe913890e42e0d38e3a45cb0" exitCode=0 Jun 08 21:07:41.370613 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:41.370595 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-247.ec2.internal" event={"ID":"6682056a4304d1a35505f115402ac6d2","Type":"ContainerDied","Data":"067999d0b9168e046d666af46a05619a02542e0fbe913890e42e0d38e3a45cb0"} Jun 08 21:07:41.371587 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:41.371551 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-lvhwv" podStartSLOduration=2.958809975 podStartE2EDuration="22.371538874s" totalImagesPullingTime="19.412728899s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 21:07:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:07:41.371205361 +0000 UTC m=+22.628881737" watchObservedRunningTime="2026-06-08 21:07:41.371538874 +0000 UTC m=+22.629215249" Jun 08 21:07:41.402788 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:41.402654 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-zhdb2" podStartSLOduration=2.951328289 podStartE2EDuration="22.402642459s" totalImagesPullingTime="19.45131417s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 21:07:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:07:41.402427648 +0000 UTC m=+22.660104026" watchObservedRunningTime="2026-06-08 21:07:41.402642459 +0000 UTC m=+22.660318834" Jun 08 21:07:41.416555 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:41.416517 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-ls8lw" podStartSLOduration=3.01378031 podStartE2EDuration="22.416503322s" totalImagesPullingTime="19.402723012s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 21:07:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:07:41.416339605 +0000 UTC m=+22.674015980" watchObservedRunningTime="2026-06-08 21:07:41.416503322 +0000 UTC m=+22.674179724" Jun 08 21:07:41.439484 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:41.439443 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-sljxg" podStartSLOduration=2.4952532720000002 podStartE2EDuration="22.439427901s" totalImagesPullingTime="19.944174629s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 21:07:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:07:41.438921066 +0000 UTC m=+22.696597441" watchObservedRunningTime="2026-06-08 21:07:41.439427901 +0000 UTC m=+22.697104276" Jun 08 21:07:41.473700 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:41.473653 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-s5gwn" podStartSLOduration=3.054175899 podStartE2EDuration="22.47363812s" totalImagesPullingTime="19.419462221s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:07:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:07:41.473220762 +0000 UTC m=+22.730897137" watchObservedRunningTime="2026-06-08 21:07:41.47363812 +0000 UTC m=+22.731314494" Jun 08 21:07:42.136511 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:42.136478 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qlnlp" Jun 08 21:07:42.136795 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:42.136609 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qlnlp" podUID="d8842123-0e24-491b-83eb-0e30814d1c3a" Jun 08 21:07:42.375495 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:42.375455 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-247.ec2.internal" event={"ID":"6682056a4304d1a35505f115402ac6d2","Type":"ContainerStarted","Data":"e9db6b8b6066c8b710b7e10768b5d71a8c1a72cb02735c6100f60f4c0c8590d5"} Jun 08 21:07:42.393704 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:42.393623 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-247.ec2.internal" podStartSLOduration=22.393605343 podStartE2EDuration="22.393605343s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 21:07:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:07:42.393428608 +0000 UTC m=+23.651104982" watchObservedRunningTime="2026-06-08 21:07:42.393605343 +0000 UTC m=+23.651281719" Jun 08 21:07:42.582432 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:42.582402 2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 08 21:07:43.135938 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:43.135896 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9pzqb" Jun 08 21:07:43.136123 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:43.136040 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9pzqb" podUID="502a6cc3-183a-4d9d-833d-2f14f5e1c946" Jun 08 21:07:43.136123 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:43.136098 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xx978" Jun 08 21:07:43.136249 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:43.136222 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xx978" podUID="2d7e9360-16e4-4a37-a3e1-b734efbc6292" Jun 08 21:07:43.137900 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:43.137810 2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-08T21:07:42.582427366Z","UUID":"c5c6246d-ab6d-484a-9e80-a2a7aa6fb379","Handler":null,"Name":"","Endpoint":""} Jun 08 21:07:43.139621 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:43.139503 2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 08 21:07:43.139621 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:43.139546 2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 08 21:07:43.382844 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:43.382812 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pt842_85a49d6e-acdf-43ce-b9c9-1c2d7773a948/ovn-acl-logging/0.log" Jun 08 21:07:43.383573 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:43.383360 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pt842" event={"ID":"85a49d6e-acdf-43ce-b9c9-1c2d7773a948","Type":"ContainerStarted","Data":"77ba15e223bab7a4f59ba88d81182920f6b69362f82c03aab4f3c1c1bc6bcc1f"} Jun 08 21:07:43.385738 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:43.385674 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85cpv" event={"ID":"0314c4c2-0ef6-404e-bc48-b4862d0c6ab4","Type":"ContainerStarted","Data":"145a1a26c33a469c97fa97267e9b63d5ab9f983ce83ff4e1e277fa5d75d4e065"} Jun 08 21:07:43.954310 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:43.954258 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-s5gwn" Jun 08 21:07:43.955008 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:43.954985 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-s5gwn" Jun 08 21:07:44.136202 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:44.136169 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qlnlp" Jun 08 21:07:44.136389 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:44.136295 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qlnlp" podUID="d8842123-0e24-491b-83eb-0e30814d1c3a" Jun 08 21:07:44.390348 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:44.390312 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85cpv" event={"ID":"0314c4c2-0ef6-404e-bc48-b4862d0c6ab4","Type":"ContainerStarted","Data":"175e7fc8e38570a28e56aa67b23b0755aa6aec05ec6682c4f7a7e3ae5e0fe886"} Jun 08 21:07:44.391106 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:44.390627 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-s5gwn" Jun 08 21:07:44.391106 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:44.391061 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-s5gwn" Jun 08 21:07:44.406513 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:44.406460 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85cpv" podStartSLOduration=3.363278681 podStartE2EDuration="25.406442789s" totalImagesPullingTime="22.043164108s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 21:07:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:07:44.406390771 +0000 UTC m=+25.664067146" watchObservedRunningTime="2026-06-08 21:07:44.406442789 +0000 UTC m=+25.664119209" Jun 08 21:07:45.135779 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:45.135743 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9pzqb" Jun 08 21:07:45.135950 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:45.135875 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9pzqb" podUID="502a6cc3-183a-4d9d-833d-2f14f5e1c946" Jun 08 21:07:45.135950 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:45.135906 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xx978" Jun 08 21:07:45.136069 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:45.136025 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xx978" podUID="2d7e9360-16e4-4a37-a3e1-b734efbc6292" Jun 08 21:07:45.396240 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:45.396085 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pt842_85a49d6e-acdf-43ce-b9c9-1c2d7773a948/ovn-acl-logging/0.log" Jun 08 21:07:45.397330 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:45.396462 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pt842" event={"ID":"85a49d6e-acdf-43ce-b9c9-1c2d7773a948","Type":"ContainerStarted","Data":"bf6628ad227cdc02a91745477feac644345a9f764a144b4f4b6cda10cd579a2a"} Jun 08 21:07:45.397330 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:45.396993 2564 scope.go:117] "RemoveContainer" containerID="c072aaa3c7974b05614669c332d4345dbb87bfc9369b835bfd3bee2f3594e692" Jun 08 21:07:46.136128 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:46.136094 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qlnlp" Jun 08 21:07:46.136318 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:46.136206 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qlnlp" podUID="d8842123-0e24-491b-83eb-0e30814d1c3a" Jun 08 21:07:46.402560 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:46.402489 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pt842_85a49d6e-acdf-43ce-b9c9-1c2d7773a948/ovn-acl-logging/0.log" Jun 08 21:07:46.403018 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:46.402908 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pt842" event={"ID":"85a49d6e-acdf-43ce-b9c9-1c2d7773a948","Type":"ContainerStarted","Data":"444d4634718a1bee0ea575f374c7c2077b3dbd2da6c1bb9d6ee088b39ab741d9"} Jun 08 21:07:46.403226 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:46.403161 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pt842" Jun 08 21:07:46.403365 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:46.403233 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pt842" Jun 08 21:07:46.403365 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:46.403304 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pt842" Jun 08 21:07:46.404967 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:46.404940 2564 generic.go:356] "Generic (PLEG): container finished" podID="78668bcc-29d2-42c0-9b9e-4e356590bb96" containerID="6798031f4a654a2dfe53a705c10dd153eecebec1b32a743edeb7cc80e9a2eeb9" exitCode=0 Jun 08 21:07:46.405102 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:46.405037 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6fp8f" event={"ID":"78668bcc-29d2-42c0-9b9e-4e356590bb96","Type":"ContainerDied","Data":"6798031f4a654a2dfe53a705c10dd153eecebec1b32a743edeb7cc80e9a2eeb9"} Jun 08 21:07:46.418648 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:46.418628 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pt842" Jun 08 21:07:46.418752 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:46.418726 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pt842" Jun 08 21:07:46.430282 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:46.430233 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-pt842" podStartSLOduration=7.620129258 podStartE2EDuration="27.430220594s" totalImagesPullingTime="19.810091336s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 21:07:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:07:46.428569773 +0000 UTC m=+27.686246149" watchObservedRunningTime="2026-06-08 21:07:46.430220594 +0000 UTC m=+27.687897004" Jun 08 21:07:47.135893 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:47.135862 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9pzqb" Jun 08 21:07:47.136046 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:47.135905 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xx978" Jun 08 21:07:47.136046 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:47.136017 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9pzqb" podUID="502a6cc3-183a-4d9d-833d-2f14f5e1c946" Jun 08 21:07:47.136146 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:47.136122 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xx978" podUID="2d7e9360-16e4-4a37-a3e1-b734efbc6292" Jun 08 21:07:47.317289 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:47.316897 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qlnlp"] Jun 08 21:07:47.317289 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:47.317027 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qlnlp" Jun 08 21:07:47.317289 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:47.317131 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qlnlp" podUID="d8842123-0e24-491b-83eb-0e30814d1c3a" Jun 08 21:07:47.324810 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:47.323737 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9pzqb"] Jun 08 21:07:47.324810 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:47.324569 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xx978"] Jun 08 21:07:47.408576 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:47.408287 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xx978" Jun 08 21:07:47.408576 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:47.408289 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9pzqb" Jun 08 21:07:47.408576 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:47.408436 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xx978" podUID="2d7e9360-16e4-4a37-a3e1-b734efbc6292" Jun 08 21:07:47.408576 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:47.408519 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9pzqb" podUID="502a6cc3-183a-4d9d-833d-2f14f5e1c946" Jun 08 21:07:48.411931 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:48.411897 2564 generic.go:356] "Generic (PLEG): container finished" podID="78668bcc-29d2-42c0-9b9e-4e356590bb96" containerID="3a2b3f4d31c14894f3283b4e3a9057104faa208670f705bde7c520855117ee33" exitCode=0 Jun 08 21:07:48.412467 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:48.411991 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6fp8f" event={"ID":"78668bcc-29d2-42c0-9b9e-4e356590bb96","Type":"ContainerDied","Data":"3a2b3f4d31c14894f3283b4e3a9057104faa208670f705bde7c520855117ee33"} Jun 08 21:07:49.136403 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:49.136365 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xx978" Jun 08 21:07:49.136575 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:49.136466 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qlnlp" Jun 08 21:07:49.136575 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:49.136483 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9pzqb" Jun 08 21:07:49.136575 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:49.136478 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xx978" podUID="2d7e9360-16e4-4a37-a3e1-b734efbc6292" Jun 08 21:07:49.136575 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:49.136554 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qlnlp" podUID="d8842123-0e24-491b-83eb-0e30814d1c3a" Jun 08 21:07:49.136737 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:49.136642 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9pzqb" podUID="502a6cc3-183a-4d9d-833d-2f14f5e1c946" Jun 08 21:07:50.418947 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:50.418908 2564 generic.go:356] "Generic (PLEG): container finished" podID="78668bcc-29d2-42c0-9b9e-4e356590bb96" containerID="3f0cda8b8139dc032188e0df4daff95905069f7cb100c95362b66e0a9e1ead44" exitCode=0 Jun 08 21:07:50.419833 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:50.418966 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6fp8f" event={"ID":"78668bcc-29d2-42c0-9b9e-4e356590bb96","Type":"ContainerDied","Data":"3f0cda8b8139dc032188e0df4daff95905069f7cb100c95362b66e0a9e1ead44"} Jun 08 21:07:51.136313 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:51.136279 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9pzqb" Jun 08 21:07:51.136512 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:51.136399 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xx978" Jun 08 21:07:51.136512 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:51.136411 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9pzqb" podUID="502a6cc3-183a-4d9d-833d-2f14f5e1c946" Jun 08 21:07:51.136630 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:51.136516 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xx978" podUID="2d7e9360-16e4-4a37-a3e1-b734efbc6292" Jun 08 21:07:51.136630 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:51.136597 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qlnlp" Jun 08 21:07:51.136732 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:51.136671 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qlnlp" podUID="d8842123-0e24-491b-83eb-0e30814d1c3a" Jun 08 21:07:51.823847 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:51.823764 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/502a6cc3-183a-4d9d-833d-2f14f5e1c946-original-pull-secret\") pod \"global-pull-secret-syncer-9pzqb\" (UID: \"502a6cc3-183a-4d9d-833d-2f14f5e1c946\") " pod="kube-system/global-pull-secret-syncer-9pzqb" Jun 08 21:07:51.824219 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:51.823929 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 21:07:51.824219 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:51.824001 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/502a6cc3-183a-4d9d-833d-2f14f5e1c946-original-pull-secret podName:502a6cc3-183a-4d9d-833d-2f14f5e1c946 nodeName:}" failed. No retries permitted until 2026-06-08 21:08:23.823982128 +0000 UTC m=+65.081658502 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/502a6cc3-183a-4d9d-833d-2f14f5e1c946-original-pull-secret") pod "global-pull-secret-syncer-9pzqb" (UID: "502a6cc3-183a-4d9d-833d-2f14f5e1c946") : object "kube-system"/"original-pull-secret" not registered Jun 08 21:07:51.924335 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:51.924298 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d7e9360-16e4-4a37-a3e1-b734efbc6292-metrics-certs\") pod \"network-metrics-daemon-xx978\" (UID: \"2d7e9360-16e4-4a37-a3e1-b734efbc6292\") " pod="openshift-multus/network-metrics-daemon-xx978" Jun 08 21:07:51.924492 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:51.924425 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 21:07:51.924492 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:51.924482 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d7e9360-16e4-4a37-a3e1-b734efbc6292-metrics-certs podName:2d7e9360-16e4-4a37-a3e1-b734efbc6292 nodeName:}" failed. No retries permitted until 2026-06-08 21:08:23.924467134 +0000 UTC m=+65.182143487 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2d7e9360-16e4-4a37-a3e1-b734efbc6292-metrics-certs") pod "network-metrics-daemon-xx978" (UID: "2d7e9360-16e4-4a37-a3e1-b734efbc6292") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 21:07:52.024940 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:52.024899 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvh4v\" (UniqueName: \"kubernetes.io/projected/d8842123-0e24-491b-83eb-0e30814d1c3a-kube-api-access-pvh4v\") pod \"network-check-target-qlnlp\" (UID: \"d8842123-0e24-491b-83eb-0e30814d1c3a\") " pod="openshift-network-diagnostics/network-check-target-qlnlp" Jun 08 21:07:52.025109 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:52.025091 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 21:07:52.025173 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:52.025118 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 21:07:52.025173 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:52.025134 2564 projected.go:196] Error preparing data for projected volume kube-api-access-pvh4v for pod openshift-network-diagnostics/network-check-target-qlnlp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 21:07:52.025258 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:52.025204 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d8842123-0e24-491b-83eb-0e30814d1c3a-kube-api-access-pvh4v podName:d8842123-0e24-491b-83eb-0e30814d1c3a nodeName:}" failed. No retries permitted until 2026-06-08 21:08:24.025185459 +0000 UTC m=+65.282861835 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-pvh4v" (UniqueName: "kubernetes.io/projected/d8842123-0e24-491b-83eb-0e30814d1c3a-kube-api-access-pvh4v") pod "network-check-target-qlnlp" (UID: "d8842123-0e24-491b-83eb-0e30814d1c3a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 21:07:53.049183 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:53.049153 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-247.ec2.internal" event="NodeReady" Jun 08 21:07:53.049852 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:53.049338 2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 08 21:07:53.090217 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:53.090184 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-t8nlh"] Jun 08 21:07:53.094654 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:53.094632 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-9s24h"] Jun 08 21:07:53.094781 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:53.094761 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-t8nlh" Jun 08 21:07:53.097340 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:53.097313 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 08 21:07:53.097340 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:53.097317 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 08 21:07:53.097519 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:53.097353 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-r7ngx\"" Jun 08 21:07:53.098723 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:53.098701 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9s24h" Jun 08 21:07:53.101359 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:53.101041 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 08 21:07:53.101359 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:53.101077 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 08 21:07:53.101359 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:53.101118 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 08 21:07:53.101359 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:53.101119 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-k9xh6\"" Jun 08 21:07:53.103001 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:53.102977 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-t8nlh"] Jun 08 21:07:53.110772 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:53.110481 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9s24h"] Jun 08 21:07:53.135576 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:53.135486 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9pzqb" Jun 08 21:07:53.135576 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:53.135524 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qlnlp" Jun 08 21:07:53.135576 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:53.135489 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xx978" Jun 08 21:07:53.138390 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:53.138222 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 08 21:07:53.138390 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:53.138284 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 08 21:07:53.138390 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:53.138292 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 08 21:07:53.138390 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:53.138331 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-m779s\"" Jun 08 21:07:53.138688 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:53.138672 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-x8cvr\"" Jun 08 21:07:53.138769 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:53.138736 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 08 21:07:53.235160 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:53.235128 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqvtm\" (UniqueName: \"kubernetes.io/projected/9df91842-6892-4958-8620-329df65f8afc-kube-api-access-wqvtm\") pod \"ingress-canary-9s24h\" (UID: \"9df91842-6892-4958-8620-329df65f8afc\") " pod="openshift-ingress-canary/ingress-canary-9s24h" Jun 08 21:07:53.235160 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:53.235159 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvcbf\" (UniqueName: \"kubernetes.io/projected/0ca98eeb-ce9d-438c-857a-15126a9b53d9-kube-api-access-gvcbf\") pod \"dns-default-t8nlh\" (UID: \"0ca98eeb-ce9d-438c-857a-15126a9b53d9\") " pod="openshift-dns/dns-default-t8nlh" Jun 08 21:07:53.235396 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:53.235187 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9df91842-6892-4958-8620-329df65f8afc-cert\") pod \"ingress-canary-9s24h\" (UID: \"9df91842-6892-4958-8620-329df65f8afc\") " pod="openshift-ingress-canary/ingress-canary-9s24h" Jun 08 21:07:53.235396 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:53.235204 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ca98eeb-ce9d-438c-857a-15126a9b53d9-tmp-dir\") pod \"dns-default-t8nlh\" (UID: \"0ca98eeb-ce9d-438c-857a-15126a9b53d9\") " pod="openshift-dns/dns-default-t8nlh" Jun 08 21:07:53.235396 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:53.235324 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ca98eeb-ce9d-438c-857a-15126a9b53d9-metrics-tls\") pod \"dns-default-t8nlh\" (UID: \"0ca98eeb-ce9d-438c-857a-15126a9b53d9\") " pod="openshift-dns/dns-default-t8nlh" Jun 08 21:07:53.235396 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:53.235368 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0ca98eeb-ce9d-438c-857a-15126a9b53d9-config-volume\") pod \"dns-default-t8nlh\" (UID: \"0ca98eeb-ce9d-438c-857a-15126a9b53d9\") " pod="openshift-dns/dns-default-t8nlh" Jun 08 21:07:53.336042 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:53.336006 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0ca98eeb-ce9d-438c-857a-15126a9b53d9-config-volume\") pod \"dns-default-t8nlh\" (UID: \"0ca98eeb-ce9d-438c-857a-15126a9b53d9\") " pod="openshift-dns/dns-default-t8nlh" Jun 08 21:07:53.336222 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:53.336090 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqvtm\" (UniqueName: \"kubernetes.io/projected/9df91842-6892-4958-8620-329df65f8afc-kube-api-access-wqvtm\") pod \"ingress-canary-9s24h\" (UID: \"9df91842-6892-4958-8620-329df65f8afc\") " pod="openshift-ingress-canary/ingress-canary-9s24h" Jun 08 21:07:53.336222 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:53.336114 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvcbf\" (UniqueName: \"kubernetes.io/projected/0ca98eeb-ce9d-438c-857a-15126a9b53d9-kube-api-access-gvcbf\") pod \"dns-default-t8nlh\" (UID: \"0ca98eeb-ce9d-438c-857a-15126a9b53d9\") " pod="openshift-dns/dns-default-t8nlh" Jun 08 21:07:53.336222 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:53.336141 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9df91842-6892-4958-8620-329df65f8afc-cert\") pod \"ingress-canary-9s24h\" (UID: \"9df91842-6892-4958-8620-329df65f8afc\") " pod="openshift-ingress-canary/ingress-canary-9s24h" Jun 08 21:07:53.336222 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:53.336170 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ca98eeb-ce9d-438c-857a-15126a9b53d9-tmp-dir\") pod \"dns-default-t8nlh\" (UID: \"0ca98eeb-ce9d-438c-857a-15126a9b53d9\") " pod="openshift-dns/dns-default-t8nlh" Jun 08 21:07:53.336494 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:53.336319 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ca98eeb-ce9d-438c-857a-15126a9b53d9-metrics-tls\") pod \"dns-default-t8nlh\" (UID: \"0ca98eeb-ce9d-438c-857a-15126a9b53d9\") " pod="openshift-dns/dns-default-t8nlh" Jun 08 21:07:53.336494 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:53.336440 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 21:07:53.336606 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:53.336499 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ca98eeb-ce9d-438c-857a-15126a9b53d9-metrics-tls podName:0ca98eeb-ce9d-438c-857a-15126a9b53d9 nodeName:}" failed. No retries permitted until 2026-06-08 21:07:53.8364799 +0000 UTC m=+35.094156268 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0ca98eeb-ce9d-438c-857a-15126a9b53d9-metrics-tls") pod "dns-default-t8nlh" (UID: "0ca98eeb-ce9d-438c-857a-15126a9b53d9") : secret "dns-default-metrics-tls" not found Jun 08 21:07:53.336606 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:53.336513 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ca98eeb-ce9d-438c-857a-15126a9b53d9-tmp-dir\") pod \"dns-default-t8nlh\" (UID: \"0ca98eeb-ce9d-438c-857a-15126a9b53d9\") " pod="openshift-dns/dns-default-t8nlh" Jun 08 21:07:53.336781 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:53.336760 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0ca98eeb-ce9d-438c-857a-15126a9b53d9-config-volume\") pod \"dns-default-t8nlh\" (UID: \"0ca98eeb-ce9d-438c-857a-15126a9b53d9\") " pod="openshift-dns/dns-default-t8nlh" Jun 08 21:07:53.340726 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:53.340587 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9df91842-6892-4958-8620-329df65f8afc-cert\") pod \"ingress-canary-9s24h\" (UID: \"9df91842-6892-4958-8620-329df65f8afc\") " pod="openshift-ingress-canary/ingress-canary-9s24h" Jun 08 21:07:53.359295 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:53.359193 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvcbf\" (UniqueName: \"kubernetes.io/projected/0ca98eeb-ce9d-438c-857a-15126a9b53d9-kube-api-access-gvcbf\") pod \"dns-default-t8nlh\" (UID: \"0ca98eeb-ce9d-438c-857a-15126a9b53d9\") " pod="openshift-dns/dns-default-t8nlh" Jun 08 21:07:53.359406 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:53.359343 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqvtm\" (UniqueName: \"kubernetes.io/projected/9df91842-6892-4958-8620-329df65f8afc-kube-api-access-wqvtm\") pod \"ingress-canary-9s24h\" (UID: \"9df91842-6892-4958-8620-329df65f8afc\") " pod="openshift-ingress-canary/ingress-canary-9s24h" Jun 08 21:07:53.417387 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:53.417349 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9s24h" Jun 08 21:07:53.557646 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:53.557539 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9s24h"] Jun 08 21:07:53.562858 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:53.562829 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9df91842_6892_4958_8620_329df65f8afc.slice/crio-61021a449aade533cc39927144651ae308856d0d6cfa3b0efc6898b4b297db7e WatchSource:0}: Error finding container 61021a449aade533cc39927144651ae308856d0d6cfa3b0efc6898b4b297db7e: Status 404 returned error can't find the container with id 61021a449aade533cc39927144651ae308856d0d6cfa3b0efc6898b4b297db7e Jun 08 21:07:53.840537 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:53.840452 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ca98eeb-ce9d-438c-857a-15126a9b53d9-metrics-tls\") pod \"dns-default-t8nlh\" (UID: \"0ca98eeb-ce9d-438c-857a-15126a9b53d9\") " pod="openshift-dns/dns-default-t8nlh" Jun 08 21:07:53.840685 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:53.840569 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 21:07:53.840685 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:53.840623 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ca98eeb-ce9d-438c-857a-15126a9b53d9-metrics-tls podName:0ca98eeb-ce9d-438c-857a-15126a9b53d9 nodeName:}" failed. No retries permitted until 2026-06-08 21:07:54.840608684 +0000 UTC m=+36.098285037 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0ca98eeb-ce9d-438c-857a-15126a9b53d9-metrics-tls") pod "dns-default-t8nlh" (UID: "0ca98eeb-ce9d-438c-857a-15126a9b53d9") : secret "dns-default-metrics-tls" not found Jun 08 21:07:54.431276 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:54.431220 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9s24h" event={"ID":"9df91842-6892-4958-8620-329df65f8afc","Type":"ContainerStarted","Data":"61021a449aade533cc39927144651ae308856d0d6cfa3b0efc6898b4b297db7e"} Jun 08 21:07:54.846863 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:54.846831 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ca98eeb-ce9d-438c-857a-15126a9b53d9-metrics-tls\") pod \"dns-default-t8nlh\" (UID: \"0ca98eeb-ce9d-438c-857a-15126a9b53d9\") " pod="openshift-dns/dns-default-t8nlh" Jun 08 21:07:54.847035 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:54.847003 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 21:07:54.847098 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:54.847087 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ca98eeb-ce9d-438c-857a-15126a9b53d9-metrics-tls podName:0ca98eeb-ce9d-438c-857a-15126a9b53d9 nodeName:}" failed. No retries permitted until 2026-06-08 21:07:56.847064043 +0000 UTC m=+38.104740419 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0ca98eeb-ce9d-438c-857a-15126a9b53d9-metrics-tls") pod "dns-default-t8nlh" (UID: "0ca98eeb-ce9d-438c-857a-15126a9b53d9") : secret "dns-default-metrics-tls" not found Jun 08 21:07:56.861682 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:56.861643 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ca98eeb-ce9d-438c-857a-15126a9b53d9-metrics-tls\") pod \"dns-default-t8nlh\" (UID: \"0ca98eeb-ce9d-438c-857a-15126a9b53d9\") " pod="openshift-dns/dns-default-t8nlh" Jun 08 21:07:56.862036 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:56.861799 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 21:07:56.862036 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:07:56.861868 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ca98eeb-ce9d-438c-857a-15126a9b53d9-metrics-tls podName:0ca98eeb-ce9d-438c-857a-15126a9b53d9 nodeName:}" failed. No retries permitted until 2026-06-08 21:08:00.861852813 +0000 UTC m=+42.119529166 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0ca98eeb-ce9d-438c-857a-15126a9b53d9-metrics-tls") pod "dns-default-t8nlh" (UID: "0ca98eeb-ce9d-438c-857a-15126a9b53d9") : secret "dns-default-metrics-tls" not found Jun 08 21:07:57.312897 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:57.312862 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-869c6946f9-8j5qm"] Jun 08 21:07:57.332255 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:57.332222 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65c64495c4-lncnv"] Jun 08 21:07:57.332920 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:57.332894 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-869c6946f9-8j5qm" Jun 08 21:07:57.335805 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:57.335613 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 08 21:07:57.335805 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:57.335668 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 08 21:07:57.335805 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:57.335684 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 08 21:07:57.335805 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:57.335672 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 08 21:07:57.355495 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:57.355470 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5448f465cd-xmm6j"] Jun 08 21:07:57.355664 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:57.355646 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65c64495c4-lncnv" Jun 08 21:07:57.358534 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:57.358223 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-pn2f7\"" Jun 08 21:07:57.358534 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:57.358383 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 08 21:07:57.391469 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:57.391302 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65c64495c4-lncnv"] Jun 08 21:07:57.391587 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:57.391488 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-869c6946f9-8j5qm"] Jun 08 21:07:57.391587 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:57.391512 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5448f465cd-xmm6j"] Jun 08 21:07:57.391587 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:57.391455 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5448f465cd-xmm6j" Jun 08 21:07:57.394828 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:57.394573 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 08 21:07:57.394828 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:57.394574 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 08 21:07:57.394828 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:57.394573 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 08 21:07:57.394828 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:57.394629 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 08 21:07:57.440832 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:57.440805 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9s24h" event={"ID":"9df91842-6892-4958-8620-329df65f8afc","Type":"ContainerStarted","Data":"86cbd68ce9afd9793337f96838e09ee06ff0c8a5576e93b992d5a8816dd4b6e6"} Jun 08 21:07:57.465850 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:57.465808 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zj5d\" (UniqueName: \"kubernetes.io/projected/1a7da038-4c3b-4c5d-8e0c-264f1e4ae524-kube-api-access-6zj5d\") pod \"klusterlet-addon-workmgr-869c6946f9-8j5qm\" (UID: \"1a7da038-4c3b-4c5d-8e0c-264f1e4ae524\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-869c6946f9-8j5qm" Jun 08 21:07:57.465987 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:57.465866 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtqhm\" (UniqueName: \"kubernetes.io/projected/bdc4cee1-7a29-486d-9d64-6806f3cdc70b-kube-api-access-gtqhm\") pod \"managed-serviceaccount-addon-agent-65c64495c4-lncnv\" (UID: \"bdc4cee1-7a29-486d-9d64-6806f3cdc70b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65c64495c4-lncnv" Jun 08 21:07:57.465987 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:57.465905 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1a7da038-4c3b-4c5d-8e0c-264f1e4ae524-tmp\") pod \"klusterlet-addon-workmgr-869c6946f9-8j5qm\" (UID: \"1a7da038-4c3b-4c5d-8e0c-264f1e4ae524\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-869c6946f9-8j5qm" Jun 08 21:07:57.465987 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:57.465976 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/1a7da038-4c3b-4c5d-8e0c-264f1e4ae524-klusterlet-config\") pod \"klusterlet-addon-workmgr-869c6946f9-8j5qm\" (UID: \"1a7da038-4c3b-4c5d-8e0c-264f1e4ae524\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-869c6946f9-8j5qm" Jun 08 21:07:57.466115 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:57.466009 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bdc4cee1-7a29-486d-9d64-6806f3cdc70b-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-65c64495c4-lncnv\" (UID: \"bdc4cee1-7a29-486d-9d64-6806f3cdc70b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65c64495c4-lncnv" Jun 08 21:07:57.566504 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:57.566471 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/1a7da038-4c3b-4c5d-8e0c-264f1e4ae524-klusterlet-config\") pod \"klusterlet-addon-workmgr-869c6946f9-8j5qm\" (UID: \"1a7da038-4c3b-4c5d-8e0c-264f1e4ae524\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-869c6946f9-8j5qm" Jun 08 21:07:57.566645 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:57.566510 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bdc4cee1-7a29-486d-9d64-6806f3cdc70b-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-65c64495c4-lncnv\" (UID: \"bdc4cee1-7a29-486d-9d64-6806f3cdc70b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65c64495c4-lncnv" Jun 08 21:07:57.566645 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:57.566552 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab4d61d6-d02c-4cd3-a644-d4568f475c96-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5448f465cd-xmm6j\" (UID: \"ab4d61d6-d02c-4cd3-a644-d4568f475c96\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5448f465cd-xmm6j" Jun 08 21:07:57.566844 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:57.566718 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ab4d61d6-d02c-4cd3-a644-d4568f475c96-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5448f465cd-xmm6j\" (UID: \"ab4d61d6-d02c-4cd3-a644-d4568f475c96\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5448f465cd-xmm6j" Jun 08 21:07:57.566844 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:57.566762 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqkg6\" (UniqueName: \"kubernetes.io/projected/ab4d61d6-d02c-4cd3-a644-d4568f475c96-kube-api-access-xqkg6\") pod \"cluster-proxy-proxy-agent-5448f465cd-xmm6j\" (UID: \"ab4d61d6-d02c-4cd3-a644-d4568f475c96\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5448f465cd-xmm6j" Jun 08 21:07:57.567030 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:57.566858 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zj5d\" (UniqueName: \"kubernetes.io/projected/1a7da038-4c3b-4c5d-8e0c-264f1e4ae524-kube-api-access-6zj5d\") pod \"klusterlet-addon-workmgr-869c6946f9-8j5qm\" (UID: \"1a7da038-4c3b-4c5d-8e0c-264f1e4ae524\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-869c6946f9-8j5qm" Jun 08 21:07:57.567030 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:57.566891 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ab4d61d6-d02c-4cd3-a644-d4568f475c96-ca\") pod \"cluster-proxy-proxy-agent-5448f465cd-xmm6j\" (UID: \"ab4d61d6-d02c-4cd3-a644-d4568f475c96\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5448f465cd-xmm6j" Jun 08 21:07:57.567030 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:57.566915 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ab4d61d6-d02c-4cd3-a644-d4568f475c96-hub\") pod \"cluster-proxy-proxy-agent-5448f465cd-xmm6j\" (UID: \"ab4d61d6-d02c-4cd3-a644-d4568f475c96\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5448f465cd-xmm6j" Jun 08 21:07:57.567030 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:57.566939 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ab4d61d6-d02c-4cd3-a644-d4568f475c96-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5448f465cd-xmm6j\" (UID: \"ab4d61d6-d02c-4cd3-a644-d4568f475c96\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5448f465cd-xmm6j" Jun 08 21:07:57.567030 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:57.566975 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtqhm\" (UniqueName: \"kubernetes.io/projected/bdc4cee1-7a29-486d-9d64-6806f3cdc70b-kube-api-access-gtqhm\") pod \"managed-serviceaccount-addon-agent-65c64495c4-lncnv\" (UID: \"bdc4cee1-7a29-486d-9d64-6806f3cdc70b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65c64495c4-lncnv" Jun 08 21:07:57.567332 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:57.567057 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1a7da038-4c3b-4c5d-8e0c-264f1e4ae524-tmp\") pod \"klusterlet-addon-workmgr-869c6946f9-8j5qm\" (UID: \"1a7da038-4c3b-4c5d-8e0c-264f1e4ae524\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-869c6946f9-8j5qm" Jun 08 21:07:57.567545 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:57.567520 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1a7da038-4c3b-4c5d-8e0c-264f1e4ae524-tmp\") pod \"klusterlet-addon-workmgr-869c6946f9-8j5qm\" (UID: \"1a7da038-4c3b-4c5d-8e0c-264f1e4ae524\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-869c6946f9-8j5qm" Jun 08 21:07:57.571387 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:57.571364 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bdc4cee1-7a29-486d-9d64-6806f3cdc70b-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-65c64495c4-lncnv\" (UID: \"bdc4cee1-7a29-486d-9d64-6806f3cdc70b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65c64495c4-lncnv" Jun 08 21:07:57.571497 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:57.571448 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/1a7da038-4c3b-4c5d-8e0c-264f1e4ae524-klusterlet-config\") pod \"klusterlet-addon-workmgr-869c6946f9-8j5qm\" (UID: \"1a7da038-4c3b-4c5d-8e0c-264f1e4ae524\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-869c6946f9-8j5qm" Jun 08 21:07:57.576417 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:57.576391 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtqhm\" (UniqueName: \"kubernetes.io/projected/bdc4cee1-7a29-486d-9d64-6806f3cdc70b-kube-api-access-gtqhm\") pod \"managed-serviceaccount-addon-agent-65c64495c4-lncnv\" (UID: \"bdc4cee1-7a29-486d-9d64-6806f3cdc70b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65c64495c4-lncnv" Jun 08 21:07:57.576531 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:57.576516 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zj5d\" (UniqueName: \"kubernetes.io/projected/1a7da038-4c3b-4c5d-8e0c-264f1e4ae524-kube-api-access-6zj5d\") pod \"klusterlet-addon-workmgr-869c6946f9-8j5qm\" (UID: \"1a7da038-4c3b-4c5d-8e0c-264f1e4ae524\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-869c6946f9-8j5qm" Jun 08 21:07:57.662131 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:57.662093 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-869c6946f9-8j5qm" Jun 08 21:07:57.667409 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:57.667378 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab4d61d6-d02c-4cd3-a644-d4568f475c96-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5448f465cd-xmm6j\" (UID: \"ab4d61d6-d02c-4cd3-a644-d4568f475c96\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5448f465cd-xmm6j" Jun 08 21:07:57.667510 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:57.667419 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ab4d61d6-d02c-4cd3-a644-d4568f475c96-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5448f465cd-xmm6j\" (UID: \"ab4d61d6-d02c-4cd3-a644-d4568f475c96\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5448f465cd-xmm6j" Jun 08 21:07:57.667510 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:57.667438 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqkg6\" (UniqueName: \"kubernetes.io/projected/ab4d61d6-d02c-4cd3-a644-d4568f475c96-kube-api-access-xqkg6\") pod \"cluster-proxy-proxy-agent-5448f465cd-xmm6j\" (UID: \"ab4d61d6-d02c-4cd3-a644-d4568f475c96\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5448f465cd-xmm6j" Jun 08 21:07:57.667612 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:57.667550 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ab4d61d6-d02c-4cd3-a644-d4568f475c96-ca\") pod \"cluster-proxy-proxy-agent-5448f465cd-xmm6j\" (UID: \"ab4d61d6-d02c-4cd3-a644-d4568f475c96\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5448f465cd-xmm6j" Jun 08 21:07:57.667612 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:57.667579 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ab4d61d6-d02c-4cd3-a644-d4568f475c96-hub\") pod \"cluster-proxy-proxy-agent-5448f465cd-xmm6j\" (UID: \"ab4d61d6-d02c-4cd3-a644-d4568f475c96\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5448f465cd-xmm6j" Jun 08 21:07:57.667612 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:57.667594 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ab4d61d6-d02c-4cd3-a644-d4568f475c96-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5448f465cd-xmm6j\" (UID: \"ab4d61d6-d02c-4cd3-a644-d4568f475c96\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5448f465cd-xmm6j" Jun 08 21:07:57.668180 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:57.668154 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab4d61d6-d02c-4cd3-a644-d4568f475c96-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5448f465cd-xmm6j\" (UID: \"ab4d61d6-d02c-4cd3-a644-d4568f475c96\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5448f465cd-xmm6j" Jun 08 21:07:57.669930 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:57.669908 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ab4d61d6-d02c-4cd3-a644-d4568f475c96-ca\") pod \"cluster-proxy-proxy-agent-5448f465cd-xmm6j\" (UID: \"ab4d61d6-d02c-4cd3-a644-d4568f475c96\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5448f465cd-xmm6j" Jun 08 21:07:57.670065 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:57.670046 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ab4d61d6-d02c-4cd3-a644-d4568f475c96-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5448f465cd-xmm6j\" (UID: \"ab4d61d6-d02c-4cd3-a644-d4568f475c96\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5448f465cd-xmm6j" Jun 08 21:07:57.670155 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:57.670133 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ab4d61d6-d02c-4cd3-a644-d4568f475c96-hub\") pod \"cluster-proxy-proxy-agent-5448f465cd-xmm6j\" (UID: \"ab4d61d6-d02c-4cd3-a644-d4568f475c96\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5448f465cd-xmm6j" Jun 08 21:07:57.670290 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:57.670246 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ab4d61d6-d02c-4cd3-a644-d4568f475c96-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5448f465cd-xmm6j\" (UID: \"ab4d61d6-d02c-4cd3-a644-d4568f475c96\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5448f465cd-xmm6j" Jun 08 21:07:57.675164 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:57.675144 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqkg6\" (UniqueName: \"kubernetes.io/projected/ab4d61d6-d02c-4cd3-a644-d4568f475c96-kube-api-access-xqkg6\") pod \"cluster-proxy-proxy-agent-5448f465cd-xmm6j\" (UID: \"ab4d61d6-d02c-4cd3-a644-d4568f475c96\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5448f465cd-xmm6j" Jun 08 21:07:57.691156 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:57.691134 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65c64495c4-lncnv" Jun 08 21:07:57.711374 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:57.711337 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5448f465cd-xmm6j" Jun 08 21:07:57.815261 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:57.815185 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-869c6946f9-8j5qm"] Jun 08 21:07:57.819437 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:57.819404 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a7da038_4c3b_4c5d_8e0c_264f1e4ae524.slice/crio-416440cfcffe7cb6186d5a166b1cde587f16e8a687a6697065ee70e40e5ea36a WatchSource:0}: Error finding container 416440cfcffe7cb6186d5a166b1cde587f16e8a687a6697065ee70e40e5ea36a: Status 404 returned error can't find the container with id 416440cfcffe7cb6186d5a166b1cde587f16e8a687a6697065ee70e40e5ea36a Jun 08 21:07:57.887066 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:57.887035 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65c64495c4-lncnv"] Jun 08 21:07:57.890414 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:57.890381 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbdc4cee1_7a29_486d_9d64_6806f3cdc70b.slice/crio-3a9e75d352133893cd3cbdd2dd0489e2e14bf43d854b3d240fddba7dbdb6a80c WatchSource:0}: Error finding container 3a9e75d352133893cd3cbdd2dd0489e2e14bf43d854b3d240fddba7dbdb6a80c: Status 404 returned error can't find the container with id 3a9e75d352133893cd3cbdd2dd0489e2e14bf43d854b3d240fddba7dbdb6a80c Jun 08 21:07:57.892571 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:57.892552 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5448f465cd-xmm6j"] Jun 08 21:07:57.895828 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:07:57.895801 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podab4d61d6_d02c_4cd3_a644_d4568f475c96.slice/crio-7eac45a2721777690995d6d0a872277873798706ac6143d64aef1e56b0f1e630 WatchSource:0}: Error finding container 7eac45a2721777690995d6d0a872277873798706ac6143d64aef1e56b0f1e630: Status 404 returned error can't find the container with id 7eac45a2721777690995d6d0a872277873798706ac6143d64aef1e56b0f1e630 Jun 08 21:07:58.444735 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:58.444698 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5448f465cd-xmm6j" event={"ID":"ab4d61d6-d02c-4cd3-a644-d4568f475c96","Type":"ContainerStarted","Data":"7eac45a2721777690995d6d0a872277873798706ac6143d64aef1e56b0f1e630"} Jun 08 21:07:58.445751 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:58.445726 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65c64495c4-lncnv" event={"ID":"bdc4cee1-7a29-486d-9d64-6806f3cdc70b","Type":"ContainerStarted","Data":"3a9e75d352133893cd3cbdd2dd0489e2e14bf43d854b3d240fddba7dbdb6a80c"} Jun 08 21:07:58.446700 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:58.446680 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-869c6946f9-8j5qm" event={"ID":"1a7da038-4c3b-4c5d-8e0c-264f1e4ae524","Type":"ContainerStarted","Data":"416440cfcffe7cb6186d5a166b1cde587f16e8a687a6697065ee70e40e5ea36a"} Jun 08 21:07:58.449101 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:58.449074 2564 generic.go:356] "Generic (PLEG): container finished" podID="78668bcc-29d2-42c0-9b9e-4e356590bb96" containerID="c62ccd16cefe7a4b53a32c9b3b5a7c6377be3e3223fff477c7331f1f992f2209" exitCode=0 Jun 08 21:07:58.449207 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:58.449162 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6fp8f" event={"ID":"78668bcc-29d2-42c0-9b9e-4e356590bb96","Type":"ContainerDied","Data":"c62ccd16cefe7a4b53a32c9b3b5a7c6377be3e3223fff477c7331f1f992f2209"} Jun 08 21:07:58.491182 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:58.491119 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-9s24h" podStartSLOduration=1.755734001 podStartE2EDuration="5.491097828s" totalImagesPullingTime="3.735363827s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:07:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:07:58.4650009 +0000 UTC m=+39.722677274" watchObservedRunningTime="2026-06-08 21:07:58.491097828 +0000 UTC m=+39.748774199" Jun 08 21:07:59.462255 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:59.461363 2564 generic.go:356] "Generic (PLEG): container finished" podID="78668bcc-29d2-42c0-9b9e-4e356590bb96" containerID="cefc5ed1d960d35ae7077ebd8f2468fc355c9785356848011c02ded57564019d" exitCode=0 Jun 08 21:07:59.462255 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:07:59.461450 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6fp8f" event={"ID":"78668bcc-29d2-42c0-9b9e-4e356590bb96","Type":"ContainerDied","Data":"cefc5ed1d960d35ae7077ebd8f2468fc355c9785356848011c02ded57564019d"} Jun 08 21:08:00.470667 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:08:00.470597 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6fp8f" event={"ID":"78668bcc-29d2-42c0-9b9e-4e356590bb96","Type":"ContainerStarted","Data":"a82210441d94215dd3e0ae0c56993c762bd1d2d2494dc65c3009781e98588cae"} Jun 08 21:08:00.496050 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:08:00.495983 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-6fp8f" podStartSLOduration=13.607176508 podStartE2EDuration="41.495960968s" totalImagesPullingTime="27.88878446s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 21:07:19 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:08:00.494378316 +0000 UTC m=+41.752054692" watchObservedRunningTime="2026-06-08 21:08:00.495960968 +0000 UTC m=+41.753637345" Jun 08 21:08:00.897813 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:08:00.897741 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ca98eeb-ce9d-438c-857a-15126a9b53d9-metrics-tls\") pod \"dns-default-t8nlh\" (UID: \"0ca98eeb-ce9d-438c-857a-15126a9b53d9\") " pod="openshift-dns/dns-default-t8nlh" Jun 08 21:08:00.897984 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:08:00.897916 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 21:08:00.898118 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:08:00.897987 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ca98eeb-ce9d-438c-857a-15126a9b53d9-metrics-tls podName:0ca98eeb-ce9d-438c-857a-15126a9b53d9 nodeName:}" failed. No retries permitted until 2026-06-08 21:08:08.897967503 +0000 UTC m=+50.155643871 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0ca98eeb-ce9d-438c-857a-15126a9b53d9-metrics-tls") pod "dns-default-t8nlh" (UID: "0ca98eeb-ce9d-438c-857a-15126a9b53d9") : secret "dns-default-metrics-tls" not found Jun 08 21:08:05.485805 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:08:05.485771 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-869c6946f9-8j5qm" event={"ID":"1a7da038-4c3b-4c5d-8e0c-264f1e4ae524","Type":"ContainerStarted","Data":"7a761708d257f6a6006ca3c6093e788d9ca71f67d1308bc36037e9b1eb50da88"} Jun 08 21:08:05.486201 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:08:05.485838 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-869c6946f9-8j5qm" Jun 08 21:08:05.487404 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:08:05.487384 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-869c6946f9-8j5qm" Jun 08 21:08:05.487718 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:08:05.487698 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5448f465cd-xmm6j" event={"ID":"ab4d61d6-d02c-4cd3-a644-d4568f475c96","Type":"ContainerStarted","Data":"ec3e829363ff9d76c1d0853554021bdb5f6aed14545fa12271d9223c7192991e"} Jun 08 21:08:05.487764 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:08:05.487731 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5448f465cd-xmm6j" event={"ID":"ab4d61d6-d02c-4cd3-a644-d4568f475c96","Type":"ContainerStarted","Data":"e8991fa367c1a8f17a64590fe8fa7ee702faca829208e16c404fe0317a6ae5cc"} Jun 08 21:08:05.489213 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:08:05.489173 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65c64495c4-lncnv" event={"ID":"bdc4cee1-7a29-486d-9d64-6806f3cdc70b","Type":"ContainerStarted","Data":"9a26d7cf1b58e304edf0cacd4f5aecee21e360646ba599e43160bcc27b3e37e2"} Jun 08 21:08:05.501515 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:08:05.501352 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-869c6946f9-8j5qm" podStartSLOduration=1.099174527 podStartE2EDuration="8.501335949s" totalImagesPullingTime="7.402161422s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:07:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:08:05.500948873 +0000 UTC m=+46.758625248" watchObservedRunningTime="2026-06-08 21:08:05.501335949 +0000 UTC m=+46.759012326" Jun 08 21:08:05.537236 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:08:05.537190 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65c64495c4-lncnv" podStartSLOduration=1.215893274 podStartE2EDuration="8.537175454s" totalImagesPullingTime="7.32128218s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:07:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:08:05.536241373 +0000 UTC m=+46.793917748" watchObservedRunningTime="2026-06-08 21:08:05.537175454 +0000 UTC m=+46.794851829" Jun 08 21:08:06.494430 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:08:06.494390 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5448f465cd-xmm6j" event={"ID":"ab4d61d6-d02c-4cd3-a644-d4568f475c96","Type":"ContainerStarted","Data":"03ca5b8633247d85f897c2229b2a154c26c51309f08138bcd1fccc0747617a11"} Jun 08 21:08:06.511396 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:08:06.511347 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5448f465cd-xmm6j" podStartSLOduration=2.195552932 podStartE2EDuration="9.511332016s" totalImagesPullingTime="7.315779084s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:07:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:08:06.510709809 +0000 UTC m=+47.768386184" watchObservedRunningTime="2026-06-08 21:08:06.511332016 +0000 UTC m=+47.769008391" Jun 08 21:08:08.961713 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:08:08.961672 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ca98eeb-ce9d-438c-857a-15126a9b53d9-metrics-tls\") pod \"dns-default-t8nlh\" (UID: \"0ca98eeb-ce9d-438c-857a-15126a9b53d9\") " pod="openshift-dns/dns-default-t8nlh" Jun 08 21:08:08.962169 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:08:08.961822 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 21:08:08.962169 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:08:08.961889 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ca98eeb-ce9d-438c-857a-15126a9b53d9-metrics-tls podName:0ca98eeb-ce9d-438c-857a-15126a9b53d9 nodeName:}" failed. No retries permitted until 2026-06-08 21:08:24.961873715 +0000 UTC m=+66.219550069 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0ca98eeb-ce9d-438c-857a-15126a9b53d9-metrics-tls") pod "dns-default-t8nlh" (UID: "0ca98eeb-ce9d-438c-857a-15126a9b53d9") : secret "dns-default-metrics-tls" not found Jun 08 21:08:18.422295 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:08:18.422255 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pt842" Jun 08 21:08:23.872237 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:08:23.872185 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/502a6cc3-183a-4d9d-833d-2f14f5e1c946-original-pull-secret\") pod \"global-pull-secret-syncer-9pzqb\" (UID: \"502a6cc3-183a-4d9d-833d-2f14f5e1c946\") " pod="kube-system/global-pull-secret-syncer-9pzqb" Jun 08 21:08:23.874980 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:08:23.874959 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 08 21:08:23.885330 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:08:23.885300 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/502a6cc3-183a-4d9d-833d-2f14f5e1c946-original-pull-secret\") pod \"global-pull-secret-syncer-9pzqb\" (UID: \"502a6cc3-183a-4d9d-833d-2f14f5e1c946\") " pod="kube-system/global-pull-secret-syncer-9pzqb" Jun 08 21:08:23.972797 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:08:23.972745 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d7e9360-16e4-4a37-a3e1-b734efbc6292-metrics-certs\") pod \"network-metrics-daemon-xx978\" (UID: \"2d7e9360-16e4-4a37-a3e1-b734efbc6292\") " pod="openshift-multus/network-metrics-daemon-xx978" Jun 08 21:08:23.976957 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:08:23.976938 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 08 21:08:23.983114 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:08:23.983091 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 08 21:08:23.983183 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:08:23.983164 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d7e9360-16e4-4a37-a3e1-b734efbc6292-metrics-certs podName:2d7e9360-16e4-4a37-a3e1-b734efbc6292 nodeName:}" failed. No retries permitted until 2026-06-08 21:09:27.983142743 +0000 UTC m=+129.240819096 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2d7e9360-16e4-4a37-a3e1-b734efbc6292-metrics-certs") pod "network-metrics-daemon-xx978" (UID: "2d7e9360-16e4-4a37-a3e1-b734efbc6292") : secret "metrics-daemon-secret" not found Jun 08 21:08:24.047181 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:08:24.047155 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9pzqb" Jun 08 21:08:24.073494 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:08:24.073464 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvh4v\" (UniqueName: \"kubernetes.io/projected/d8842123-0e24-491b-83eb-0e30814d1c3a-kube-api-access-pvh4v\") pod \"network-check-target-qlnlp\" (UID: \"d8842123-0e24-491b-83eb-0e30814d1c3a\") " pod="openshift-network-diagnostics/network-check-target-qlnlp" Jun 08 21:08:24.076437 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:08:24.076417 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 08 21:08:24.087296 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:08:24.087045 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 08 21:08:24.098665 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:08:24.098636 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvh4v\" (UniqueName: \"kubernetes.io/projected/d8842123-0e24-491b-83eb-0e30814d1c3a-kube-api-access-pvh4v\") pod \"network-check-target-qlnlp\" (UID: \"d8842123-0e24-491b-83eb-0e30814d1c3a\") " pod="openshift-network-diagnostics/network-check-target-qlnlp" Jun 08 21:08:24.169641 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:08:24.169612 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9pzqb"] Jun 08 21:08:24.172897 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:08:24.172868 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod502a6cc3_183a_4d9d_833d_2f14f5e1c946.slice/crio-f894d305800b83497c9897a0505e7ee78f4d80d1e17cd357c2c6db2ea27eae31 WatchSource:0}: Error finding container f894d305800b83497c9897a0505e7ee78f4d80d1e17cd357c2c6db2ea27eae31: Status 404 returned error can't find the container with id f894d305800b83497c9897a0505e7ee78f4d80d1e17cd357c2c6db2ea27eae31 Jun 08 21:08:24.361658 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:08:24.361627 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-x8cvr\"" Jun 08 21:08:24.369847 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:08:24.369822 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qlnlp" Jun 08 21:08:24.491231 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:08:24.491198 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qlnlp"] Jun 08 21:08:24.494362 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:08:24.494330 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8842123_0e24_491b_83eb_0e30814d1c3a.slice/crio-1db6756358db0c4f60f7af8d4edc9c76ee3deadbf515e1a6fdd8e4d3f745656e WatchSource:0}: Error finding container 1db6756358db0c4f60f7af8d4edc9c76ee3deadbf515e1a6fdd8e4d3f745656e: Status 404 returned error can't find the container with id 1db6756358db0c4f60f7af8d4edc9c76ee3deadbf515e1a6fdd8e4d3f745656e Jun 08 21:08:24.549447 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:08:24.549414 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9pzqb" event={"ID":"502a6cc3-183a-4d9d-833d-2f14f5e1c946","Type":"ContainerStarted","Data":"f894d305800b83497c9897a0505e7ee78f4d80d1e17cd357c2c6db2ea27eae31"} Jun 08 21:08:24.550480 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:08:24.550457 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qlnlp" event={"ID":"d8842123-0e24-491b-83eb-0e30814d1c3a","Type":"ContainerStarted","Data":"1db6756358db0c4f60f7af8d4edc9c76ee3deadbf515e1a6fdd8e4d3f745656e"} Jun 08 21:08:24.980070 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:08:24.980034 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ca98eeb-ce9d-438c-857a-15126a9b53d9-metrics-tls\") pod \"dns-default-t8nlh\" (UID: \"0ca98eeb-ce9d-438c-857a-15126a9b53d9\") " pod="openshift-dns/dns-default-t8nlh" Jun 08 21:08:24.980569 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:08:24.980217 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 21:08:24.980569 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:08:24.980319 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ca98eeb-ce9d-438c-857a-15126a9b53d9-metrics-tls podName:0ca98eeb-ce9d-438c-857a-15126a9b53d9 nodeName:}" failed. No retries permitted until 2026-06-08 21:08:56.980297048 +0000 UTC m=+98.237973403 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0ca98eeb-ce9d-438c-857a-15126a9b53d9-metrics-tls") pod "dns-default-t8nlh" (UID: "0ca98eeb-ce9d-438c-857a-15126a9b53d9") : secret "dns-default-metrics-tls" not found Jun 08 21:08:29.570687 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:08:29.570647 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qlnlp" event={"ID":"d8842123-0e24-491b-83eb-0e30814d1c3a","Type":"ContainerStarted","Data":"8603b19b1b73b48afc6196edc5aa09be94f844d6b6811f7c11adf58938a6da57"} Jun 08 21:08:29.571226 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:08:29.570761 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-qlnlp" Jun 08 21:08:29.572075 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:08:29.572050 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9pzqb" event={"ID":"502a6cc3-183a-4d9d-833d-2f14f5e1c946","Type":"ContainerStarted","Data":"edd607c7aabab6e186c65b9d1de34730fda06c513ef8f02727a93458f16c11a2"} Jun 08 21:08:29.587144 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:08:29.587096 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-qlnlp" podStartSLOduration=66.226669349 podStartE2EDuration="1m10.587084424s" totalImagesPullingTime="4.360415075s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:07:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:08:29.586104963 +0000 UTC m=+70.843781340" watchObservedRunningTime="2026-06-08 21:08:29.587084424 +0000 UTC m=+70.844760859" Jun 08 21:08:29.599835 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:08:29.599791 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9pzqb" podStartSLOduration=65.912002242 podStartE2EDuration="1m10.59977631s" totalImagesPullingTime="4.687774068s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 21:07:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:08:29.599087538 +0000 UTC m=+70.856763913" watchObservedRunningTime="2026-06-08 21:08:29.59977631 +0000 UTC m=+70.857452684" Jun 08 21:08:57.016492 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:08:57.016449 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ca98eeb-ce9d-438c-857a-15126a9b53d9-metrics-tls\") pod \"dns-default-t8nlh\" (UID: \"0ca98eeb-ce9d-438c-857a-15126a9b53d9\") " pod="openshift-dns/dns-default-t8nlh" Jun 08 21:08:57.016907 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:08:57.016573 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 21:08:57.016907 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:08:57.016634 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ca98eeb-ce9d-438c-857a-15126a9b53d9-metrics-tls podName:0ca98eeb-ce9d-438c-857a-15126a9b53d9 nodeName:}" failed. No retries permitted until 2026-06-08 21:10:01.016620413 +0000 UTC m=+162.274296767 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0ca98eeb-ce9d-438c-857a-15126a9b53d9-metrics-tls") pod "dns-default-t8nlh" (UID: "0ca98eeb-ce9d-438c-857a-15126a9b53d9") : secret "dns-default-metrics-tls" not found Jun 08 21:09:00.577284 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:09:00.577229 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-qlnlp" Jun 08 21:09:28.038775 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:09:28.038728 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d7e9360-16e4-4a37-a3e1-b734efbc6292-metrics-certs\") pod \"network-metrics-daemon-xx978\" (UID: \"2d7e9360-16e4-4a37-a3e1-b734efbc6292\") " pod="openshift-multus/network-metrics-daemon-xx978" Jun 08 21:09:28.039249 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:09:28.038884 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 08 21:09:28.039249 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:09:28.038953 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d7e9360-16e4-4a37-a3e1-b734efbc6292-metrics-certs podName:2d7e9360-16e4-4a37-a3e1-b734efbc6292 nodeName:}" failed. No retries permitted until 2026-06-08 21:11:30.038937821 +0000 UTC m=+251.296614187 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2d7e9360-16e4-4a37-a3e1-b734efbc6292-metrics-certs") pod "network-metrics-daemon-xx978" (UID: "2d7e9360-16e4-4a37-a3e1-b734efbc6292") : secret "metrics-daemon-secret" not found Jun 08 21:09:56.109745 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:09:56.109704 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-t8nlh" podUID="0ca98eeb-ce9d-438c-857a-15126a9b53d9" Jun 08 21:09:56.154496 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:09:56.154450 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-xx978" podUID="2d7e9360-16e4-4a37-a3e1-b734efbc6292" Jun 08 21:09:56.825540 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:09:56.825507 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-t8nlh" Jun 08 21:10:01.073975 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:01.073930 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ca98eeb-ce9d-438c-857a-15126a9b53d9-metrics-tls\") pod \"dns-default-t8nlh\" (UID: \"0ca98eeb-ce9d-438c-857a-15126a9b53d9\") " pod="openshift-dns/dns-default-t8nlh" Jun 08 21:10:01.074408 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:10:01.074042 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 21:10:01.074408 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:10:01.074103 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ca98eeb-ce9d-438c-857a-15126a9b53d9-metrics-tls podName:0ca98eeb-ce9d-438c-857a-15126a9b53d9 nodeName:}" failed. No retries permitted until 2026-06-08 21:12:03.074087453 +0000 UTC m=+284.331763806 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0ca98eeb-ce9d-438c-857a-15126a9b53d9-metrics-tls") pod "dns-default-t8nlh" (UID: "0ca98eeb-ce9d-438c-857a-15126a9b53d9") : secret "dns-default-metrics-tls" not found Jun 08 21:10:05.486462 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:05.486411 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-869c6946f9-8j5qm" podUID="1a7da038-4c3b-4c5d-8e0c-264f1e4ae524" containerName="acm-agent" probeResult="failure" output="Get \"http://10.133.0.9:8000/readyz\": dial tcp 10.133.0.9:8000: connect: connection refused" Jun 08 21:10:05.853089 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:05.853053 2564 generic.go:356] "Generic (PLEG): container finished" podID="bdc4cee1-7a29-486d-9d64-6806f3cdc70b" containerID="9a26d7cf1b58e304edf0cacd4f5aecee21e360646ba599e43160bcc27b3e37e2" exitCode=255 Jun 08 21:10:05.853261 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:05.853125 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65c64495c4-lncnv" event={"ID":"bdc4cee1-7a29-486d-9d64-6806f3cdc70b","Type":"ContainerDied","Data":"9a26d7cf1b58e304edf0cacd4f5aecee21e360646ba599e43160bcc27b3e37e2"} Jun 08 21:10:05.853506 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:05.853491 2564 scope.go:117] "RemoveContainer" containerID="9a26d7cf1b58e304edf0cacd4f5aecee21e360646ba599e43160bcc27b3e37e2" Jun 08 21:10:05.854718 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:05.854700 2564 generic.go:356] "Generic (PLEG): container finished" podID="1a7da038-4c3b-4c5d-8e0c-264f1e4ae524" containerID="7a761708d257f6a6006ca3c6093e788d9ca71f67d1308bc36037e9b1eb50da88" exitCode=1 Jun 08 21:10:05.854771 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:05.854740 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-869c6946f9-8j5qm" event={"ID":"1a7da038-4c3b-4c5d-8e0c-264f1e4ae524","Type":"ContainerDied","Data":"7a761708d257f6a6006ca3c6093e788d9ca71f67d1308bc36037e9b1eb50da88"} Jun 08 21:10:05.855010 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:05.854998 2564 scope.go:117] "RemoveContainer" containerID="7a761708d257f6a6006ca3c6093e788d9ca71f67d1308bc36037e9b1eb50da88" Jun 08 21:10:06.859707 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:06.859669 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-869c6946f9-8j5qm" event={"ID":"1a7da038-4c3b-4c5d-8e0c-264f1e4ae524","Type":"ContainerStarted","Data":"6a3e881a3513bd83ff20ef50f94bbade42d994c9cab9c53990949fc7a679f9f9"} Jun 08 21:10:06.860172 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:06.860027 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-869c6946f9-8j5qm" Jun 08 21:10:06.860703 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:06.860680 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-869c6946f9-8j5qm" Jun 08 21:10:06.861450 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:06.861432 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65c64495c4-lncnv" event={"ID":"bdc4cee1-7a29-486d-9d64-6806f3cdc70b","Type":"ContainerStarted","Data":"f5176409d79879b40bf0885bc2894aa94e890d54f571f3ed59bd7ea697be9fa8"} Jun 08 21:10:07.136147 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:07.136049 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xx978" Jun 08 21:10:20.789477 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:20.789450 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zhdb2_4fcb5113-dc25-491d-b570-2c2818b90ea9/dns-node-resolver/0.log" Jun 08 21:10:21.394611 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:21.394575 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ls8lw_767ccdbc-66e2-441f-932d-4ae6885b6411/node-ca/0.log" Jun 08 21:10:22.191444 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:22.191418 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9s24h_9df91842-6892-4958-8620-329df65f8afc/serve-healthcheck-canary/0.log" Jun 08 21:10:43.724551 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:43.724518 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-qtdwj"] Jun 08 21:10:43.727302 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:43.727286 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qtdwj" Jun 08 21:10:43.730090 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:43.730067 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 08 21:10:43.730228 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:43.730089 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 08 21:10:43.730228 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:43.730095 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zbqgp\"" Jun 08 21:10:43.730228 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:43.730133 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 08 21:10:43.730228 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:43.730095 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 08 21:10:43.741464 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:43.741440 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qtdwj"] Jun 08 21:10:43.885575 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:43.885544 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwwlp\" (UniqueName: \"kubernetes.io/projected/67ba959e-bffc-4172-b5e6-7c644b28e9ed-kube-api-access-pwwlp\") pod \"insights-runtime-extractor-qtdwj\" (UID: \"67ba959e-bffc-4172-b5e6-7c644b28e9ed\") " pod="openshift-insights/insights-runtime-extractor-qtdwj" Jun 08 21:10:43.885756 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:43.885593 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/67ba959e-bffc-4172-b5e6-7c644b28e9ed-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qtdwj\" (UID: \"67ba959e-bffc-4172-b5e6-7c644b28e9ed\") " pod="openshift-insights/insights-runtime-extractor-qtdwj" Jun 08 21:10:43.885756 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:43.885621 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/67ba959e-bffc-4172-b5e6-7c644b28e9ed-crio-socket\") pod \"insights-runtime-extractor-qtdwj\" (UID: \"67ba959e-bffc-4172-b5e6-7c644b28e9ed\") " pod="openshift-insights/insights-runtime-extractor-qtdwj" Jun 08 21:10:43.885756 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:43.885657 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/67ba959e-bffc-4172-b5e6-7c644b28e9ed-data-volume\") pod \"insights-runtime-extractor-qtdwj\" (UID: \"67ba959e-bffc-4172-b5e6-7c644b28e9ed\") " pod="openshift-insights/insights-runtime-extractor-qtdwj" Jun 08 21:10:43.885756 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:43.885675 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/67ba959e-bffc-4172-b5e6-7c644b28e9ed-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qtdwj\" (UID: \"67ba959e-bffc-4172-b5e6-7c644b28e9ed\") " pod="openshift-insights/insights-runtime-extractor-qtdwj" Jun 08 21:10:43.986138 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:43.986048 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwwlp\" (UniqueName: \"kubernetes.io/projected/67ba959e-bffc-4172-b5e6-7c644b28e9ed-kube-api-access-pwwlp\") pod \"insights-runtime-extractor-qtdwj\" (UID: \"67ba959e-bffc-4172-b5e6-7c644b28e9ed\") " pod="openshift-insights/insights-runtime-extractor-qtdwj" Jun 08 21:10:43.986138 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:43.986100 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/67ba959e-bffc-4172-b5e6-7c644b28e9ed-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qtdwj\" (UID: \"67ba959e-bffc-4172-b5e6-7c644b28e9ed\") " pod="openshift-insights/insights-runtime-extractor-qtdwj" Jun 08 21:10:43.986394 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:43.986149 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/67ba959e-bffc-4172-b5e6-7c644b28e9ed-crio-socket\") pod \"insights-runtime-extractor-qtdwj\" (UID: \"67ba959e-bffc-4172-b5e6-7c644b28e9ed\") " pod="openshift-insights/insights-runtime-extractor-qtdwj" Jun 08 21:10:43.986394 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:43.986201 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/67ba959e-bffc-4172-b5e6-7c644b28e9ed-data-volume\") pod \"insights-runtime-extractor-qtdwj\" (UID: \"67ba959e-bffc-4172-b5e6-7c644b28e9ed\") " pod="openshift-insights/insights-runtime-extractor-qtdwj" Jun 08 21:10:43.986394 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:43.986227 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/67ba959e-bffc-4172-b5e6-7c644b28e9ed-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qtdwj\" (UID: \"67ba959e-bffc-4172-b5e6-7c644b28e9ed\") " pod="openshift-insights/insights-runtime-extractor-qtdwj" Jun 08 21:10:43.986394 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:43.986318 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/67ba959e-bffc-4172-b5e6-7c644b28e9ed-crio-socket\") pod \"insights-runtime-extractor-qtdwj\" (UID: \"67ba959e-bffc-4172-b5e6-7c644b28e9ed\") " pod="openshift-insights/insights-runtime-extractor-qtdwj" Jun 08 21:10:43.986595 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:43.986584 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/67ba959e-bffc-4172-b5e6-7c644b28e9ed-data-volume\") pod \"insights-runtime-extractor-qtdwj\" (UID: \"67ba959e-bffc-4172-b5e6-7c644b28e9ed\") " pod="openshift-insights/insights-runtime-extractor-qtdwj" Jun 08 21:10:43.986701 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:43.986681 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/67ba959e-bffc-4172-b5e6-7c644b28e9ed-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qtdwj\" (UID: \"67ba959e-bffc-4172-b5e6-7c644b28e9ed\") " pod="openshift-insights/insights-runtime-extractor-qtdwj" Jun 08 21:10:43.988654 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:43.988625 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/67ba959e-bffc-4172-b5e6-7c644b28e9ed-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qtdwj\" (UID: \"67ba959e-bffc-4172-b5e6-7c644b28e9ed\") " pod="openshift-insights/insights-runtime-extractor-qtdwj" Jun 08 21:10:43.996201 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:43.996181 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwwlp\" (UniqueName: \"kubernetes.io/projected/67ba959e-bffc-4172-b5e6-7c644b28e9ed-kube-api-access-pwwlp\") pod \"insights-runtime-extractor-qtdwj\" (UID: \"67ba959e-bffc-4172-b5e6-7c644b28e9ed\") " pod="openshift-insights/insights-runtime-extractor-qtdwj" Jun 08 21:10:44.035314 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:44.035291 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qtdwj" Jun 08 21:10:44.156166 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:44.156135 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qtdwj"] Jun 08 21:10:44.159215 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:10:44.159187 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67ba959e_bffc_4172_b5e6_7c644b28e9ed.slice/crio-c43b1c91395aed4cb676108a7345c557dd49d7af486399786e2d81efabcbd991 WatchSource:0}: Error finding container c43b1c91395aed4cb676108a7345c557dd49d7af486399786e2d81efabcbd991: Status 404 returned error can't find the container with id c43b1c91395aed4cb676108a7345c557dd49d7af486399786e2d81efabcbd991 Jun 08 21:10:44.970837 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:44.970809 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qtdwj" event={"ID":"67ba959e-bffc-4172-b5e6-7c644b28e9ed","Type":"ContainerStarted","Data":"736ee9328ab4777c599c0748300db1df6412ae99fe95189c37086bad5d206b6d"} Jun 08 21:10:44.971133 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:44.970864 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qtdwj" event={"ID":"67ba959e-bffc-4172-b5e6-7c644b28e9ed","Type":"ContainerStarted","Data":"c43b1c91395aed4cb676108a7345c557dd49d7af486399786e2d81efabcbd991"} Jun 08 21:10:45.976382 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:45.976342 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qtdwj" event={"ID":"67ba959e-bffc-4172-b5e6-7c644b28e9ed","Type":"ContainerStarted","Data":"b7543b5d98a02f93bbce2d00d46f0a252c678cb83fcfcb008720ffbff42436ad"} Jun 08 21:10:46.981169 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:46.981135 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qtdwj" event={"ID":"67ba959e-bffc-4172-b5e6-7c644b28e9ed","Type":"ContainerStarted","Data":"18542c27ad7eb7491cb5e41dbd3a53343bfd18573fd7c45e3527606d1a62b4ba"} Jun 08 21:10:47.000788 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:47.000743 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-qtdwj" podStartSLOduration=1.511784754 podStartE2EDuration="4.000729624s" totalImagesPullingTime="2.48894487s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 21:10:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:10:46.99974736 +0000 UTC m=+208.257423736" watchObservedRunningTime="2026-06-08 21:10:47.000729624 +0000 UTC m=+208.258405998" Jun 08 21:10:47.712966 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:47.712924 2564 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5448f465cd-xmm6j" podUID="ab4d61d6-d02c-4cd3-a644-d4568f475c96" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 08 21:10:51.879066 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:51.879035 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-2vzws"] Jun 08 21:10:51.882316 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:51.882299 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2vzws" Jun 08 21:10:51.885092 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:51.885065 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 08 21:10:51.885092 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:51.885099 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 08 21:10:51.885299 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:51.885099 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 08 21:10:51.885299 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:51.885065 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 08 21:10:51.885299 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:51.885126 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 08 21:10:51.886021 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:51.886003 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 08 21:10:51.886021 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:51.886013 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-rmmpg\"" Jun 08 21:10:52.044151 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:52.044115 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ce9991a2-3c1a-4e14-b155-131273415f12-sys\") pod \"node-exporter-2vzws\" (UID: \"ce9991a2-3c1a-4e14-b155-131273415f12\") " pod="openshift-monitoring/node-exporter-2vzws" Jun 08 21:10:52.044151 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:52.044160 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ce9991a2-3c1a-4e14-b155-131273415f12-node-exporter-wtmp\") pod \"node-exporter-2vzws\" (UID: \"ce9991a2-3c1a-4e14-b155-131273415f12\") " pod="openshift-monitoring/node-exporter-2vzws" Jun 08 21:10:52.044400 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:52.044179 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cg77x\" (UniqueName: \"kubernetes.io/projected/ce9991a2-3c1a-4e14-b155-131273415f12-kube-api-access-cg77x\") pod \"node-exporter-2vzws\" (UID: \"ce9991a2-3c1a-4e14-b155-131273415f12\") " pod="openshift-monitoring/node-exporter-2vzws" Jun 08 21:10:52.044400 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:52.044233 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ce9991a2-3c1a-4e14-b155-131273415f12-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2vzws\" (UID: \"ce9991a2-3c1a-4e14-b155-131273415f12\") " pod="openshift-monitoring/node-exporter-2vzws" Jun 08 21:10:52.044400 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:52.044298 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ce9991a2-3c1a-4e14-b155-131273415f12-root\") pod \"node-exporter-2vzws\" (UID: \"ce9991a2-3c1a-4e14-b155-131273415f12\") " pod="openshift-monitoring/node-exporter-2vzws" Jun 08 21:10:52.044400 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:52.044334 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ce9991a2-3c1a-4e14-b155-131273415f12-node-exporter-textfile\") pod \"node-exporter-2vzws\" (UID: \"ce9991a2-3c1a-4e14-b155-131273415f12\") " pod="openshift-monitoring/node-exporter-2vzws" Jun 08 21:10:52.044400 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:52.044350 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ce9991a2-3c1a-4e14-b155-131273415f12-node-exporter-tls\") pod \"node-exporter-2vzws\" (UID: \"ce9991a2-3c1a-4e14-b155-131273415f12\") " pod="openshift-monitoring/node-exporter-2vzws" Jun 08 21:10:52.044400 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:52.044365 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ce9991a2-3c1a-4e14-b155-131273415f12-metrics-client-ca\") pod \"node-exporter-2vzws\" (UID: \"ce9991a2-3c1a-4e14-b155-131273415f12\") " pod="openshift-monitoring/node-exporter-2vzws" Jun 08 21:10:52.044580 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:52.044452 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ce9991a2-3c1a-4e14-b155-131273415f12-node-exporter-accelerators-collector-config\") pod \"node-exporter-2vzws\" (UID: \"ce9991a2-3c1a-4e14-b155-131273415f12\") " pod="openshift-monitoring/node-exporter-2vzws" Jun 08 21:10:52.145751 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:52.145654 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ce9991a2-3c1a-4e14-b155-131273415f12-sys\") pod \"node-exporter-2vzws\" (UID: \"ce9991a2-3c1a-4e14-b155-131273415f12\") " pod="openshift-monitoring/node-exporter-2vzws" Jun 08 21:10:52.145751 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:52.145696 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ce9991a2-3c1a-4e14-b155-131273415f12-node-exporter-wtmp\") pod \"node-exporter-2vzws\" (UID: \"ce9991a2-3c1a-4e14-b155-131273415f12\") " pod="openshift-monitoring/node-exporter-2vzws" Jun 08 21:10:52.145751 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:52.145714 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cg77x\" (UniqueName: \"kubernetes.io/projected/ce9991a2-3c1a-4e14-b155-131273415f12-kube-api-access-cg77x\") pod \"node-exporter-2vzws\" (UID: \"ce9991a2-3c1a-4e14-b155-131273415f12\") " pod="openshift-monitoring/node-exporter-2vzws" Jun 08 21:10:52.145751 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:52.145737 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ce9991a2-3c1a-4e14-b155-131273415f12-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2vzws\" (UID: \"ce9991a2-3c1a-4e14-b155-131273415f12\") " pod="openshift-monitoring/node-exporter-2vzws" Jun 08 21:10:52.146089 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:52.145778 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ce9991a2-3c1a-4e14-b155-131273415f12-root\") pod \"node-exporter-2vzws\" (UID: \"ce9991a2-3c1a-4e14-b155-131273415f12\") " pod="openshift-monitoring/node-exporter-2vzws" Jun 08 21:10:52.146089 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:52.145781 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ce9991a2-3c1a-4e14-b155-131273415f12-sys\") pod \"node-exporter-2vzws\" (UID: \"ce9991a2-3c1a-4e14-b155-131273415f12\") " pod="openshift-monitoring/node-exporter-2vzws" Jun 08 21:10:52.146089 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:52.145816 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ce9991a2-3c1a-4e14-b155-131273415f12-node-exporter-textfile\") pod \"node-exporter-2vzws\" (UID: \"ce9991a2-3c1a-4e14-b155-131273415f12\") " pod="openshift-monitoring/node-exporter-2vzws" Jun 08 21:10:52.146089 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:52.145837 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ce9991a2-3c1a-4e14-b155-131273415f12-node-exporter-tls\") pod \"node-exporter-2vzws\" (UID: \"ce9991a2-3c1a-4e14-b155-131273415f12\") " pod="openshift-monitoring/node-exporter-2vzws" Jun 08 21:10:52.146089 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:52.145858 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ce9991a2-3c1a-4e14-b155-131273415f12-metrics-client-ca\") pod \"node-exporter-2vzws\" (UID: \"ce9991a2-3c1a-4e14-b155-131273415f12\") " pod="openshift-monitoring/node-exporter-2vzws" Jun 08 21:10:52.146089 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:52.145881 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ce9991a2-3c1a-4e14-b155-131273415f12-node-exporter-wtmp\") pod \"node-exporter-2vzws\" (UID: \"ce9991a2-3c1a-4e14-b155-131273415f12\") " pod="openshift-monitoring/node-exporter-2vzws" Jun 08 21:10:52.146089 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:52.145933 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ce9991a2-3c1a-4e14-b155-131273415f12-node-exporter-accelerators-collector-config\") pod \"node-exporter-2vzws\" (UID: \"ce9991a2-3c1a-4e14-b155-131273415f12\") " pod="openshift-monitoring/node-exporter-2vzws" Jun 08 21:10:52.146089 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:52.145987 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ce9991a2-3c1a-4e14-b155-131273415f12-root\") pod \"node-exporter-2vzws\" (UID: \"ce9991a2-3c1a-4e14-b155-131273415f12\") " pod="openshift-monitoring/node-exporter-2vzws" Jun 08 21:10:52.146430 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:52.146311 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ce9991a2-3c1a-4e14-b155-131273415f12-node-exporter-textfile\") pod \"node-exporter-2vzws\" (UID: \"ce9991a2-3c1a-4e14-b155-131273415f12\") " pod="openshift-monitoring/node-exporter-2vzws" Jun 08 21:10:52.146531 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:52.146515 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ce9991a2-3c1a-4e14-b155-131273415f12-metrics-client-ca\") pod \"node-exporter-2vzws\" (UID: \"ce9991a2-3c1a-4e14-b155-131273415f12\") " pod="openshift-monitoring/node-exporter-2vzws" Jun 08 21:10:52.146633 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:52.146612 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ce9991a2-3c1a-4e14-b155-131273415f12-node-exporter-accelerators-collector-config\") pod \"node-exporter-2vzws\" (UID: \"ce9991a2-3c1a-4e14-b155-131273415f12\") " pod="openshift-monitoring/node-exporter-2vzws" Jun 08 21:10:52.148110 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:52.148079 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ce9991a2-3c1a-4e14-b155-131273415f12-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2vzws\" (UID: \"ce9991a2-3c1a-4e14-b155-131273415f12\") " pod="openshift-monitoring/node-exporter-2vzws" Jun 08 21:10:52.148223 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:52.148167 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ce9991a2-3c1a-4e14-b155-131273415f12-node-exporter-tls\") pod \"node-exporter-2vzws\" (UID: \"ce9991a2-3c1a-4e14-b155-131273415f12\") " pod="openshift-monitoring/node-exporter-2vzws" Jun 08 21:10:52.154478 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:52.154453 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cg77x\" (UniqueName: \"kubernetes.io/projected/ce9991a2-3c1a-4e14-b155-131273415f12-kube-api-access-cg77x\") pod \"node-exporter-2vzws\" (UID: \"ce9991a2-3c1a-4e14-b155-131273415f12\") " pod="openshift-monitoring/node-exporter-2vzws" Jun 08 21:10:52.191301 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:52.191253 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2vzws" Jun 08 21:10:52.202193 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:10:52.202166 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce9991a2_3c1a_4e14_b155_131273415f12.slice/crio-b91cff200b16a201875157484ab2732b1973935de8998ca1662bd48560387f8c WatchSource:0}: Error finding container b91cff200b16a201875157484ab2732b1973935de8998ca1662bd48560387f8c: Status 404 returned error can't find the container with id b91cff200b16a201875157484ab2732b1973935de8998ca1662bd48560387f8c Jun 08 21:10:53.003425 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:53.003389 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2vzws" event={"ID":"ce9991a2-3c1a-4e14-b155-131273415f12","Type":"ContainerStarted","Data":"b91cff200b16a201875157484ab2732b1973935de8998ca1662bd48560387f8c"} Jun 08 21:10:54.012746 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:54.012710 2564 generic.go:356] "Generic (PLEG): container finished" podID="ce9991a2-3c1a-4e14-b155-131273415f12" containerID="b076a0233b2b23dc26c945b78a42e8003e23461df184d1e4cdf69dcc505ac78b" exitCode=0 Jun 08 21:10:54.013130 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:54.012772 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2vzws" event={"ID":"ce9991a2-3c1a-4e14-b155-131273415f12","Type":"ContainerDied","Data":"b076a0233b2b23dc26c945b78a42e8003e23461df184d1e4cdf69dcc505ac78b"} Jun 08 21:10:55.017585 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:55.017548 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2vzws" event={"ID":"ce9991a2-3c1a-4e14-b155-131273415f12","Type":"ContainerStarted","Data":"5ae7b21b85098af7088aad4f0e89044219910b50c857b1220c0845c1303b5616"} Jun 08 21:10:55.018066 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:55.017602 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2vzws" event={"ID":"ce9991a2-3c1a-4e14-b155-131273415f12","Type":"ContainerStarted","Data":"791cc0bf78921c5a78d7996668963c3f436a552151ce66eb95aa1d03040adac9"} Jun 08 21:10:55.037385 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:55.037339 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-2vzws" podStartSLOduration=3.110928402 podStartE2EDuration="4.037323304s" totalImagesPullingTime="860.070614ms" totalInitContainerRuntime="66.324288ms" isStatefulPod=true podCreationTimestamp="2026-06-08 21:10:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:10:55.036915094 +0000 UTC m=+216.294591469" watchObservedRunningTime="2026-06-08 21:10:55.037323304 +0000 UTC m=+216.294999678" Jun 08 21:10:57.078996 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:57.078964 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7bd7945487-rc87h"] Jun 08 21:10:57.082004 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:57.081986 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7bd7945487-rc87h" Jun 08 21:10:57.084808 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:57.084784 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 08 21:10:57.084808 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:57.084800 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 08 21:10:57.084989 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:57.084873 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 08 21:10:57.084989 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:57.084888 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-shqbd\"" Jun 08 21:10:57.084989 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:57.084928 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 08 21:10:57.085133 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:57.085101 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 08 21:10:57.090041 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:57.090025 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 08 21:10:57.093787 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:57.093760 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7bd7945487-rc87h"] Jun 08 21:10:57.182108 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:57.182030 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c1f6da7d-d86d-4c7f-a2c3-0043b8f6194f-telemeter-client-tls\") pod \"telemeter-client-7bd7945487-rc87h\" (UID: \"c1f6da7d-d86d-4c7f-a2c3-0043b8f6194f\") " pod="openshift-monitoring/telemeter-client-7bd7945487-rc87h" Jun 08 21:10:57.182108 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:57.182061 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c1f6da7d-d86d-4c7f-a2c3-0043b8f6194f-federate-client-tls\") pod \"telemeter-client-7bd7945487-rc87h\" (UID: \"c1f6da7d-d86d-4c7f-a2c3-0043b8f6194f\") " pod="openshift-monitoring/telemeter-client-7bd7945487-rc87h" Jun 08 21:10:57.182108 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:57.182085 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52ccv\" (UniqueName: \"kubernetes.io/projected/c1f6da7d-d86d-4c7f-a2c3-0043b8f6194f-kube-api-access-52ccv\") pod \"telemeter-client-7bd7945487-rc87h\" (UID: \"c1f6da7d-d86d-4c7f-a2c3-0043b8f6194f\") " pod="openshift-monitoring/telemeter-client-7bd7945487-rc87h" Jun 08 21:10:57.182108 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:57.182108 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1f6da7d-d86d-4c7f-a2c3-0043b8f6194f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7bd7945487-rc87h\" (UID: \"c1f6da7d-d86d-4c7f-a2c3-0043b8f6194f\") " pod="openshift-monitoring/telemeter-client-7bd7945487-rc87h" Jun 08 21:10:57.182471 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:57.182151 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c1f6da7d-d86d-4c7f-a2c3-0043b8f6194f-metrics-client-ca\") pod \"telemeter-client-7bd7945487-rc87h\" (UID: \"c1f6da7d-d86d-4c7f-a2c3-0043b8f6194f\") " pod="openshift-monitoring/telemeter-client-7bd7945487-rc87h" Jun 08 21:10:57.182471 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:57.182201 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c1f6da7d-d86d-4c7f-a2c3-0043b8f6194f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7bd7945487-rc87h\" (UID: \"c1f6da7d-d86d-4c7f-a2c3-0043b8f6194f\") " pod="openshift-monitoring/telemeter-client-7bd7945487-rc87h" Jun 08 21:10:57.182471 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:57.182247 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1f6da7d-d86d-4c7f-a2c3-0043b8f6194f-serving-certs-ca-bundle\") pod \"telemeter-client-7bd7945487-rc87h\" (UID: \"c1f6da7d-d86d-4c7f-a2c3-0043b8f6194f\") " pod="openshift-monitoring/telemeter-client-7bd7945487-rc87h" Jun 08 21:10:57.182471 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:57.182281 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c1f6da7d-d86d-4c7f-a2c3-0043b8f6194f-secret-telemeter-client\") pod \"telemeter-client-7bd7945487-rc87h\" (UID: \"c1f6da7d-d86d-4c7f-a2c3-0043b8f6194f\") " pod="openshift-monitoring/telemeter-client-7bd7945487-rc87h" Jun 08 21:10:57.282933 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:57.282905 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c1f6da7d-d86d-4c7f-a2c3-0043b8f6194f-telemeter-client-tls\") pod \"telemeter-client-7bd7945487-rc87h\" (UID: \"c1f6da7d-d86d-4c7f-a2c3-0043b8f6194f\") " pod="openshift-monitoring/telemeter-client-7bd7945487-rc87h" Jun 08 21:10:57.283064 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:57.282938 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c1f6da7d-d86d-4c7f-a2c3-0043b8f6194f-federate-client-tls\") pod \"telemeter-client-7bd7945487-rc87h\" (UID: \"c1f6da7d-d86d-4c7f-a2c3-0043b8f6194f\") " pod="openshift-monitoring/telemeter-client-7bd7945487-rc87h" Jun 08 21:10:57.283064 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:57.282963 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52ccv\" (UniqueName: \"kubernetes.io/projected/c1f6da7d-d86d-4c7f-a2c3-0043b8f6194f-kube-api-access-52ccv\") pod \"telemeter-client-7bd7945487-rc87h\" (UID: \"c1f6da7d-d86d-4c7f-a2c3-0043b8f6194f\") " pod="openshift-monitoring/telemeter-client-7bd7945487-rc87h" Jun 08 21:10:57.283064 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:57.282984 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1f6da7d-d86d-4c7f-a2c3-0043b8f6194f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7bd7945487-rc87h\" (UID: \"c1f6da7d-d86d-4c7f-a2c3-0043b8f6194f\") " pod="openshift-monitoring/telemeter-client-7bd7945487-rc87h" Jun 08 21:10:57.283064 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:57.283003 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c1f6da7d-d86d-4c7f-a2c3-0043b8f6194f-metrics-client-ca\") pod \"telemeter-client-7bd7945487-rc87h\" (UID: \"c1f6da7d-d86d-4c7f-a2c3-0043b8f6194f\") " pod="openshift-monitoring/telemeter-client-7bd7945487-rc87h" Jun 08 21:10:57.283256 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:57.283188 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c1f6da7d-d86d-4c7f-a2c3-0043b8f6194f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7bd7945487-rc87h\" (UID: \"c1f6da7d-d86d-4c7f-a2c3-0043b8f6194f\") " pod="openshift-monitoring/telemeter-client-7bd7945487-rc87h" Jun 08 21:10:57.283329 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:57.283258 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1f6da7d-d86d-4c7f-a2c3-0043b8f6194f-serving-certs-ca-bundle\") pod \"telemeter-client-7bd7945487-rc87h\" (UID: \"c1f6da7d-d86d-4c7f-a2c3-0043b8f6194f\") " pod="openshift-monitoring/telemeter-client-7bd7945487-rc87h" Jun 08 21:10:57.283329 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:57.283307 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c1f6da7d-d86d-4c7f-a2c3-0043b8f6194f-secret-telemeter-client\") pod \"telemeter-client-7bd7945487-rc87h\" (UID: \"c1f6da7d-d86d-4c7f-a2c3-0043b8f6194f\") " pod="openshift-monitoring/telemeter-client-7bd7945487-rc87h" Jun 08 21:10:57.283868 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:57.283844 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c1f6da7d-d86d-4c7f-a2c3-0043b8f6194f-metrics-client-ca\") pod \"telemeter-client-7bd7945487-rc87h\" (UID: \"c1f6da7d-d86d-4c7f-a2c3-0043b8f6194f\") " pod="openshift-monitoring/telemeter-client-7bd7945487-rc87h" Jun 08 21:10:57.284035 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:57.283921 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1f6da7d-d86d-4c7f-a2c3-0043b8f6194f-serving-certs-ca-bundle\") pod \"telemeter-client-7bd7945487-rc87h\" (UID: \"c1f6da7d-d86d-4c7f-a2c3-0043b8f6194f\") " pod="openshift-monitoring/telemeter-client-7bd7945487-rc87h" Jun 08 21:10:57.284035 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:57.283942 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1f6da7d-d86d-4c7f-a2c3-0043b8f6194f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7bd7945487-rc87h\" (UID: \"c1f6da7d-d86d-4c7f-a2c3-0043b8f6194f\") " pod="openshift-monitoring/telemeter-client-7bd7945487-rc87h" Jun 08 21:10:57.285669 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:57.285647 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c1f6da7d-d86d-4c7f-a2c3-0043b8f6194f-telemeter-client-tls\") pod \"telemeter-client-7bd7945487-rc87h\" (UID: \"c1f6da7d-d86d-4c7f-a2c3-0043b8f6194f\") " pod="openshift-monitoring/telemeter-client-7bd7945487-rc87h" Jun 08 21:10:57.285754 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:57.285741 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c1f6da7d-d86d-4c7f-a2c3-0043b8f6194f-secret-telemeter-client\") pod \"telemeter-client-7bd7945487-rc87h\" (UID: \"c1f6da7d-d86d-4c7f-a2c3-0043b8f6194f\") " pod="openshift-monitoring/telemeter-client-7bd7945487-rc87h" Jun 08 21:10:57.285796 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:57.285748 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c1f6da7d-d86d-4c7f-a2c3-0043b8f6194f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7bd7945487-rc87h\" (UID: \"c1f6da7d-d86d-4c7f-a2c3-0043b8f6194f\") " pod="openshift-monitoring/telemeter-client-7bd7945487-rc87h" Jun 08 21:10:57.285862 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:57.285847 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c1f6da7d-d86d-4c7f-a2c3-0043b8f6194f-federate-client-tls\") pod \"telemeter-client-7bd7945487-rc87h\" (UID: \"c1f6da7d-d86d-4c7f-a2c3-0043b8f6194f\") " pod="openshift-monitoring/telemeter-client-7bd7945487-rc87h" Jun 08 21:10:57.290318 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:57.290298 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-52ccv\" (UniqueName: \"kubernetes.io/projected/c1f6da7d-d86d-4c7f-a2c3-0043b8f6194f-kube-api-access-52ccv\") pod \"telemeter-client-7bd7945487-rc87h\" (UID: \"c1f6da7d-d86d-4c7f-a2c3-0043b8f6194f\") " pod="openshift-monitoring/telemeter-client-7bd7945487-rc87h" Jun 08 21:10:57.391191 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:57.391148 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7bd7945487-rc87h" Jun 08 21:10:57.517697 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:57.517657 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7bd7945487-rc87h"] Jun 08 21:10:57.521895 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:10:57.521868 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1f6da7d_d86d_4c7f_a2c3_0043b8f6194f.slice/crio-7254ccda8b66579722bf8331fd6fa0747cdbfd8c3ab1af0e3d2c4314afe99a43 WatchSource:0}: Error finding container 7254ccda8b66579722bf8331fd6fa0747cdbfd8c3ab1af0e3d2c4314afe99a43: Status 404 returned error can't find the container with id 7254ccda8b66579722bf8331fd6fa0747cdbfd8c3ab1af0e3d2c4314afe99a43 Jun 08 21:10:57.712605 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:57.712521 2564 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5448f465cd-xmm6j" podUID="ab4d61d6-d02c-4cd3-a644-d4568f475c96" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 08 21:10:58.027533 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.027453 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7bd7945487-rc87h" event={"ID":"c1f6da7d-d86d-4c7f-a2c3-0043b8f6194f","Type":"ContainerStarted","Data":"7254ccda8b66579722bf8331fd6fa0747cdbfd8c3ab1af0e3d2c4314afe99a43"} Jun 08 21:10:58.065408 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.061974 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 21:10:58.067592 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.067569 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:10:58.070144 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.070118 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 08 21:10:58.070612 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.070400 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 08 21:10:58.070612 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.070434 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 08 21:10:58.070612 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.070490 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 08 21:10:58.070846 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.070626 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 08 21:10:58.070846 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.070675 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 08 21:10:58.070957 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.070882 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 08 21:10:58.070957 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.070892 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 08 21:10:58.072135 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.072116 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 08 21:10:58.072250 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.072222 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 08 21:10:58.072346 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.072251 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 08 21:10:58.072948 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.072927 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-a7e87d2m06nm0\"" Jun 08 21:10:58.073064 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.072967 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 08 21:10:58.073478 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.073301 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 08 21:10:58.073478 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.073313 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-6vfg4\"" Jun 08 21:10:58.073478 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.073366 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 08 21:10:58.074397 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.074374 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 08 21:10:58.081166 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.081149 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 21:10:58.090731 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.090707 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/06e97739-e035-48bc-8e8e-dd4fbf506403-config-out\") pod \"prometheus-k8s-0\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:10:58.090826 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.090745 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/06e97739-e035-48bc-8e8e-dd4fbf506403-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:10:58.090826 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.090776 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/06e97739-e035-48bc-8e8e-dd4fbf506403-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:10:58.090924 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.090853 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/06e97739-e035-48bc-8e8e-dd4fbf506403-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:10:58.090924 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.090889 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06e97739-e035-48bc-8e8e-dd4fbf506403-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:10:58.090924 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.090911 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06e97739-e035-48bc-8e8e-dd4fbf506403-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:10:58.091029 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.090926 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/06e97739-e035-48bc-8e8e-dd4fbf506403-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:10:58.091029 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.090957 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06e97739-e035-48bc-8e8e-dd4fbf506403-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:10:58.091029 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.091027 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbgkk\" (UniqueName: \"kubernetes.io/projected/06e97739-e035-48bc-8e8e-dd4fbf506403-kube-api-access-jbgkk\") pod \"prometheus-k8s-0\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:10:58.091148 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.091058 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/06e97739-e035-48bc-8e8e-dd4fbf506403-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:10:58.091148 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.091086 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/06e97739-e035-48bc-8e8e-dd4fbf506403-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:10:58.091148 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.091112 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/06e97739-e035-48bc-8e8e-dd4fbf506403-config\") pod \"prometheus-k8s-0\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:10:58.091321 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.091168 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/06e97739-e035-48bc-8e8e-dd4fbf506403-web-config\") pod \"prometheus-k8s-0\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:10:58.091321 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.091217 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/06e97739-e035-48bc-8e8e-dd4fbf506403-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:10:58.091321 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.091309 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/06e97739-e035-48bc-8e8e-dd4fbf506403-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:10:58.091430 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.091336 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/06e97739-e035-48bc-8e8e-dd4fbf506403-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:10:58.091430 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.091367 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/06e97739-e035-48bc-8e8e-dd4fbf506403-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:10:58.091510 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.091425 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/06e97739-e035-48bc-8e8e-dd4fbf506403-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:10:58.091510 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.091475 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06e97739-e035-48bc-8e8e-dd4fbf506403-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:10:58.091510 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.091496 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/06e97739-e035-48bc-8e8e-dd4fbf506403-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:10:58.192335 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.192304 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06e97739-e035-48bc-8e8e-dd4fbf506403-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:10:58.192335 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.192338 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/06e97739-e035-48bc-8e8e-dd4fbf506403-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:10:58.192605 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.192357 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/06e97739-e035-48bc-8e8e-dd4fbf506403-config-out\") pod \"prometheus-k8s-0\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:10:58.192605 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.192372 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/06e97739-e035-48bc-8e8e-dd4fbf506403-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:10:58.192605 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.192394 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/06e97739-e035-48bc-8e8e-dd4fbf506403-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:10:58.192798 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.192600 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/06e97739-e035-48bc-8e8e-dd4fbf506403-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:10:58.192798 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.192638 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06e97739-e035-48bc-8e8e-dd4fbf506403-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:10:58.192798 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.192667 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06e97739-e035-48bc-8e8e-dd4fbf506403-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:10:58.192798 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.192694 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/06e97739-e035-48bc-8e8e-dd4fbf506403-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:10:58.192798 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.192733 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06e97739-e035-48bc-8e8e-dd4fbf506403-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:10:58.192798 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.192764 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbgkk\" (UniqueName: \"kubernetes.io/projected/06e97739-e035-48bc-8e8e-dd4fbf506403-kube-api-access-jbgkk\") pod \"prometheus-k8s-0\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:10:58.192798 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.192798 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/06e97739-e035-48bc-8e8e-dd4fbf506403-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:10:58.193155 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.192814 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/06e97739-e035-48bc-8e8e-dd4fbf506403-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:10:58.193155 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.192828 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/06e97739-e035-48bc-8e8e-dd4fbf506403-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:10:58.193155 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.193064 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/06e97739-e035-48bc-8e8e-dd4fbf506403-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:10:58.193155 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.193087 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06e97739-e035-48bc-8e8e-dd4fbf506403-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:10:58.193376 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.193330 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/06e97739-e035-48bc-8e8e-dd4fbf506403-config\") pod \"prometheus-k8s-0\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:10:58.193376 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.193361 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06e97739-e035-48bc-8e8e-dd4fbf506403-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:10:58.193491 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.193377 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/06e97739-e035-48bc-8e8e-dd4fbf506403-web-config\") pod \"prometheus-k8s-0\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:10:58.193491 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.193420 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/06e97739-e035-48bc-8e8e-dd4fbf506403-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:10:58.193598 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.193489 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/06e97739-e035-48bc-8e8e-dd4fbf506403-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:10:58.193598 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.193521 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/06e97739-e035-48bc-8e8e-dd4fbf506403-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:10:58.193598 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.193556 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/06e97739-e035-48bc-8e8e-dd4fbf506403-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:10:58.193735 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.193594 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/06e97739-e035-48bc-8e8e-dd4fbf506403-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:10:58.193735 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.193622 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/06e97739-e035-48bc-8e8e-dd4fbf506403-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:10:58.194223 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.193889 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06e97739-e035-48bc-8e8e-dd4fbf506403-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:10:58.194223 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.194109 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06e97739-e035-48bc-8e8e-dd4fbf506403-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:10:58.196743 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.196691 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/06e97739-e035-48bc-8e8e-dd4fbf506403-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:10:58.196743 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.196728 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/06e97739-e035-48bc-8e8e-dd4fbf506403-config-out\") pod \"prometheus-k8s-0\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:10:58.196897 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.196781 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/06e97739-e035-48bc-8e8e-dd4fbf506403-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:10:58.197027 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.196994 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/06e97739-e035-48bc-8e8e-dd4fbf506403-web-config\") pod \"prometheus-k8s-0\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:10:58.197157 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.197129 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/06e97739-e035-48bc-8e8e-dd4fbf506403-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:10:58.197262 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.197243 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/06e97739-e035-48bc-8e8e-dd4fbf506403-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:10:58.197354 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.197295 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/06e97739-e035-48bc-8e8e-dd4fbf506403-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:10:58.197481 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.197460 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/06e97739-e035-48bc-8e8e-dd4fbf506403-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:10:58.197675 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.197654 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/06e97739-e035-48bc-8e8e-dd4fbf506403-config\") pod \"prometheus-k8s-0\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:10:58.198234 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.198215 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/06e97739-e035-48bc-8e8e-dd4fbf506403-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:10:58.198473 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.198450 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/06e97739-e035-48bc-8e8e-dd4fbf506403-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:10:58.198537 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.198521 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/06e97739-e035-48bc-8e8e-dd4fbf506403-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:10:58.203100 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.203077 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbgkk\" (UniqueName: \"kubernetes.io/projected/06e97739-e035-48bc-8e8e-dd4fbf506403-kube-api-access-jbgkk\") pod \"prometheus-k8s-0\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:10:58.379386 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.379350 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:10:58.530778 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:58.530755 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 21:10:58.532943 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:10:58.532915 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06e97739_e035_48bc_8e8e_dd4fbf506403.slice/crio-6454626a66548e140166873435e75027a0f76b5f57fd3a5992cb7ded958cb348 WatchSource:0}: Error finding container 6454626a66548e140166873435e75027a0f76b5f57fd3a5992cb7ded958cb348: Status 404 returned error can't find the container with id 6454626a66548e140166873435e75027a0f76b5f57fd3a5992cb7ded958cb348 Jun 08 21:10:59.033152 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:10:59.033110 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06e97739-e035-48bc-8e8e-dd4fbf506403","Type":"ContainerStarted","Data":"6454626a66548e140166873435e75027a0f76b5f57fd3a5992cb7ded958cb348"} Jun 08 21:11:00.038293 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:11:00.038242 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7bd7945487-rc87h" event={"ID":"c1f6da7d-d86d-4c7f-a2c3-0043b8f6194f","Type":"ContainerStarted","Data":"450f437e98b610f00f89eb05b209256bad95380642f0af55d9eff848a9884c7f"} Jun 08 21:11:00.038620 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:11:00.038329 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7bd7945487-rc87h" event={"ID":"c1f6da7d-d86d-4c7f-a2c3-0043b8f6194f","Type":"ContainerStarted","Data":"8e1007e7cd0181a1fd8284425b8e4a83745c9dde7e8386c8f5b1aab0f2f3c0f3"} Jun 08 21:11:00.038620 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:11:00.038358 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7bd7945487-rc87h" event={"ID":"c1f6da7d-d86d-4c7f-a2c3-0043b8f6194f","Type":"ContainerStarted","Data":"cd683a560359b0e2b240b4f425d0c6db11fdfe95bc339f1e8ea33ca140b8895f"} Jun 08 21:11:00.042420 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:11:00.042386 2564 generic.go:356] "Generic (PLEG): container finished" podID="06e97739-e035-48bc-8e8e-dd4fbf506403" containerID="c4ec296dee7f528ffabc76f3cdbc0880edbcaddc6965a5c61e06f844ab79bdc9" exitCode=0 Jun 08 21:11:00.042584 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:11:00.042493 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06e97739-e035-48bc-8e8e-dd4fbf506403","Type":"ContainerDied","Data":"c4ec296dee7f528ffabc76f3cdbc0880edbcaddc6965a5c61e06f844ab79bdc9"} Jun 08 21:11:00.061691 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:11:00.061472 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7bd7945487-rc87h" podStartSLOduration=0.776341931 podStartE2EDuration="3.061452837s" totalImagesPullingTime="2.285110906s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:10:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:11:00.059292934 +0000 UTC m=+221.316969309" watchObservedRunningTime="2026-06-08 21:11:00.061452837 +0000 UTC m=+221.319129213" Jun 08 21:11:04.060167 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:11:04.060089 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06e97739-e035-48bc-8e8e-dd4fbf506403","Type":"ContainerStarted","Data":"3284d2efd8f1af535180057e110053e605b26c476a409e7ee7c8a2c5ce70b5a6"} Jun 08 21:11:04.060618 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:11:04.060184 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06e97739-e035-48bc-8e8e-dd4fbf506403","Type":"ContainerStarted","Data":"ae26ae19a78399830dfb448134ed0f48ceb80ed6c454afd8b06c3f77cca37346"} Jun 08 21:11:06.069862 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:11:06.069826 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06e97739-e035-48bc-8e8e-dd4fbf506403","Type":"ContainerStarted","Data":"01d65b503a324001c0b4017a237ccb92e556e83b8868ee2c225395b6d6597d9c"} Jun 08 21:11:06.070361 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:11:06.069892 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06e97739-e035-48bc-8e8e-dd4fbf506403","Type":"ContainerStarted","Data":"75ddb5df47a964535ef7d2b9d34e2d8ff63535d7d906dc62caae607e7eb72bf2"} Jun 08 21:11:06.070361 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:11:06.069919 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06e97739-e035-48bc-8e8e-dd4fbf506403","Type":"ContainerStarted","Data":"25a24b13b8658a1ce9977f547747d5f8da97cddf069ab8d58e0a2278ffc226ba"} Jun 08 21:11:06.070361 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:11:06.069943 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06e97739-e035-48bc-8e8e-dd4fbf506403","Type":"ContainerStarted","Data":"8cf584ebcc53ab70b7f8eeed29d268bc1b7cc59a84f9f123e2ecd0fe517bdd81"} Jun 08 21:11:06.098798 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:11:06.098752 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.619785606 podStartE2EDuration="8.098736583s" totalImagesPullingTime="6.459230551s" totalInitContainerRuntime="19.720426ms" isStatefulPod=false podCreationTimestamp="2026-06-08 21:10:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:11:06.096996857 +0000 UTC m=+227.354673255" watchObservedRunningTime="2026-06-08 21:11:06.098736583 +0000 UTC m=+227.356412957" Jun 08 21:11:07.712665 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:11:07.712624 2564 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5448f465cd-xmm6j" podUID="ab4d61d6-d02c-4cd3-a644-d4568f475c96" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 08 21:11:07.713117 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:11:07.712706 2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5448f465cd-xmm6j" Jun 08 21:11:07.713199 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:11:07.713161 2564 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"03ca5b8633247d85f897c2229b2a154c26c51309f08138bcd1fccc0747617a11"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5448f465cd-xmm6j" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 08 21:11:07.713235 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:11:07.713221 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5448f465cd-xmm6j" podUID="ab4d61d6-d02c-4cd3-a644-d4568f475c96" containerName="service-proxy" containerID="cri-o://03ca5b8633247d85f897c2229b2a154c26c51309f08138bcd1fccc0747617a11" gracePeriod=30 Jun 08 21:11:08.079636 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:11:08.079542 2564 generic.go:356] "Generic (PLEG): container finished" podID="ab4d61d6-d02c-4cd3-a644-d4568f475c96" containerID="03ca5b8633247d85f897c2229b2a154c26c51309f08138bcd1fccc0747617a11" exitCode=2 Jun 08 21:11:08.079636 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:11:08.079600 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5448f465cd-xmm6j" event={"ID":"ab4d61d6-d02c-4cd3-a644-d4568f475c96","Type":"ContainerDied","Data":"03ca5b8633247d85f897c2229b2a154c26c51309f08138bcd1fccc0747617a11"} Jun 08 21:11:08.079636 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:11:08.079632 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5448f465cd-xmm6j" event={"ID":"ab4d61d6-d02c-4cd3-a644-d4568f475c96","Type":"ContainerStarted","Data":"1b5014f45ec4baf36e10fdd28435412e143ae8cc1d9cbdf7990b497bcdd34e80"} Jun 08 21:11:08.379468 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:11:08.379434 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:11:30.056461 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:11:30.056423 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d7e9360-16e4-4a37-a3e1-b734efbc6292-metrics-certs\") pod \"network-metrics-daemon-xx978\" (UID: \"2d7e9360-16e4-4a37-a3e1-b734efbc6292\") " pod="openshift-multus/network-metrics-daemon-xx978" Jun 08 21:11:30.058953 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:11:30.058919 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d7e9360-16e4-4a37-a3e1-b734efbc6292-metrics-certs\") pod \"network-metrics-daemon-xx978\" (UID: \"2d7e9360-16e4-4a37-a3e1-b734efbc6292\") " pod="openshift-multus/network-metrics-daemon-xx978" Jun 08 21:11:30.239555 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:11:30.239523 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-m779s\"" Jun 08 21:11:30.247919 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:11:30.247893 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xx978" Jun 08 21:11:30.388420 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:11:30.388390 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xx978"] Jun 08 21:11:30.391663 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:11:30.391636 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d7e9360_16e4_4a37_a3e1_b734efbc6292.slice/crio-054a3bceb8ce69aa7f94f40edf02c25415a5563120f494e07547731f8b6af39b WatchSource:0}: Error finding container 054a3bceb8ce69aa7f94f40edf02c25415a5563120f494e07547731f8b6af39b: Status 404 returned error can't find the container with id 054a3bceb8ce69aa7f94f40edf02c25415a5563120f494e07547731f8b6af39b Jun 08 21:11:31.158577 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:11:31.158540 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xx978" event={"ID":"2d7e9360-16e4-4a37-a3e1-b734efbc6292","Type":"ContainerStarted","Data":"054a3bceb8ce69aa7f94f40edf02c25415a5563120f494e07547731f8b6af39b"} Jun 08 21:11:32.163181 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:11:32.163137 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xx978" event={"ID":"2d7e9360-16e4-4a37-a3e1-b734efbc6292","Type":"ContainerStarted","Data":"5103ae14a83ef689bf7d5fd6cc84c41fcad2d84e48b61b4efd7eba667d4a7d48"} Jun 08 21:11:32.163589 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:11:32.163244 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xx978" event={"ID":"2d7e9360-16e4-4a37-a3e1-b734efbc6292","Type":"ContainerStarted","Data":"f0e7d335be077999bcc579c37950b799f8aef3bac9233c339be43297c92ec452"} Jun 08 21:11:32.179453 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:11:32.179400 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-xx978" podStartSLOduration=252.310092356 podStartE2EDuration="4m13.179384267s" totalImagesPullingTime="869.291911ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:07:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:11:32.17756233 +0000 UTC m=+253.435238716" watchObservedRunningTime="2026-06-08 21:11:32.179384267 +0000 UTC m=+253.437060642" Jun 08 21:11:53.927089 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:11:53.927056 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2vzws_ce9991a2-3c1a-4e14-b155-131273415f12/init-textfile/0.log" Jun 08 21:11:54.114322 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:11:54.114293 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2vzws_ce9991a2-3c1a-4e14-b155-131273415f12/node-exporter/0.log" Jun 08 21:11:54.313521 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:11:54.313438 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2vzws_ce9991a2-3c1a-4e14-b155-131273415f12/kube-rbac-proxy/0.log" Jun 08 21:11:56.314595 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:11:56.314564 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_06e97739-e035-48bc-8e8e-dd4fbf506403/init-config-reloader/0.log" Jun 08 21:11:56.514467 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:11:56.514442 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_06e97739-e035-48bc-8e8e-dd4fbf506403/prometheus/0.log" Jun 08 21:11:56.714638 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:11:56.714612 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_06e97739-e035-48bc-8e8e-dd4fbf506403/config-reloader/0.log" Jun 08 21:11:56.914108 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:11:56.914087 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_06e97739-e035-48bc-8e8e-dd4fbf506403/thanos-sidecar/0.log" Jun 08 21:11:57.113818 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:11:57.113792 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_06e97739-e035-48bc-8e8e-dd4fbf506403/kube-rbac-proxy-web/0.log" Jun 08 21:11:57.314229 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:11:57.314204 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_06e97739-e035-48bc-8e8e-dd4fbf506403/kube-rbac-proxy/0.log" Jun 08 21:11:57.514136 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:11:57.514068 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_06e97739-e035-48bc-8e8e-dd4fbf506403/kube-rbac-proxy-thanos/0.log" Jun 08 21:11:58.314376 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:11:58.314352 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7bd7945487-rc87h_c1f6da7d-d86d-4c7f-a2c3-0043b8f6194f/telemeter-client/0.log" Jun 08 21:11:58.380546 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:11:58.380515 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:11:58.400833 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:11:58.400806 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:11:58.513582 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:11:58.513557 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7bd7945487-rc87h_c1f6da7d-d86d-4c7f-a2c3-0043b8f6194f/reload/0.log" Jun 08 21:11:58.714082 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:11:58.714051 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7bd7945487-rc87h_c1f6da7d-d86d-4c7f-a2c3-0043b8f6194f/kube-rbac-proxy/0.log" Jun 08 21:11:59.272162 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:11:59.272134 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:11:59.826994 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:11:59.826951 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-t8nlh" podUID="0ca98eeb-ce9d-438c-857a-15126a9b53d9" Jun 08 21:12:00.260124 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:00.260095 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-t8nlh" Jun 08 21:12:02.914019 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:02.913990 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zhdb2_4fcb5113-dc25-491d-b570-2c2818b90ea9/dns-node-resolver/0.log" Jun 08 21:12:03.125027 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:03.124991 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ca98eeb-ce9d-438c-857a-15126a9b53d9-metrics-tls\") pod \"dns-default-t8nlh\" (UID: \"0ca98eeb-ce9d-438c-857a-15126a9b53d9\") " pod="openshift-dns/dns-default-t8nlh" Jun 08 21:12:03.127283 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:03.127251 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ca98eeb-ce9d-438c-857a-15126a9b53d9-metrics-tls\") pod \"dns-default-t8nlh\" (UID: \"0ca98eeb-ce9d-438c-857a-15126a9b53d9\") " pod="openshift-dns/dns-default-t8nlh" Jun 08 21:12:03.264330 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:03.264247 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-r7ngx\"" Jun 08 21:12:03.272369 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:03.272347 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-t8nlh" Jun 08 21:12:03.399873 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:03.399849 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-t8nlh"] Jun 08 21:12:03.402060 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:12:03.402034 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ca98eeb_ce9d_438c_857a_15126a9b53d9.slice/crio-ab99ef90644347cdad8cc2e14e0a503e931ad2ac5920d7923f37eabbc4aac39c WatchSource:0}: Error finding container ab99ef90644347cdad8cc2e14e0a503e931ad2ac5920d7923f37eabbc4aac39c: Status 404 returned error can't find the container with id ab99ef90644347cdad8cc2e14e0a503e931ad2ac5920d7923f37eabbc4aac39c Jun 08 21:12:03.514578 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:03.514493 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ls8lw_767ccdbc-66e2-441f-932d-4ae6885b6411/node-ca/0.log" Jun 08 21:12:04.273768 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:04.273708 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-t8nlh" event={"ID":"0ca98eeb-ce9d-438c-857a-15126a9b53d9","Type":"ContainerStarted","Data":"ab99ef90644347cdad8cc2e14e0a503e931ad2ac5920d7923f37eabbc4aac39c"} Jun 08 21:12:04.314958 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:04.314920 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9s24h_9df91842-6892-4958-8620-329df65f8afc/serve-healthcheck-canary/0.log" Jun 08 21:12:05.280839 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:05.280752 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-t8nlh" event={"ID":"0ca98eeb-ce9d-438c-857a-15126a9b53d9","Type":"ContainerStarted","Data":"466c8c140fee630cf62de7a6b3c6d4e6e15e50fd0ceac0edf0b70b15c0e593de"} Jun 08 21:12:05.280839 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:05.280808 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-t8nlh" event={"ID":"0ca98eeb-ce9d-438c-857a-15126a9b53d9","Type":"ContainerStarted","Data":"45955c802af23c21e68b4f8a69a0a92dd3ee79c8892bab24d66567772bcc3647"} Jun 08 21:12:05.281364 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:05.280852 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-t8nlh" Jun 08 21:12:05.296456 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:05.296412 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-t8nlh" podStartSLOduration=250.794044159 podStartE2EDuration="4m12.296396121s" totalImagesPullingTime="1.502351962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:07:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:12:05.295506047 +0000 UTC m=+286.553182424" watchObservedRunningTime="2026-06-08 21:12:05.296396121 +0000 UTC m=+286.554072490" Jun 08 21:12:06.287160 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:06.287063 2564 generic.go:356] "Generic (PLEG): container finished" podID="bdc4cee1-7a29-486d-9d64-6806f3cdc70b" containerID="f5176409d79879b40bf0885bc2894aa94e890d54f571f3ed59bd7ea697be9fa8" exitCode=255 Jun 08 21:12:06.287160 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:06.287132 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65c64495c4-lncnv" event={"ID":"bdc4cee1-7a29-486d-9d64-6806f3cdc70b","Type":"ContainerDied","Data":"f5176409d79879b40bf0885bc2894aa94e890d54f571f3ed59bd7ea697be9fa8"} Jun 08 21:12:06.287674 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:06.287207 2564 scope.go:117] "RemoveContainer" containerID="9a26d7cf1b58e304edf0cacd4f5aecee21e360646ba599e43160bcc27b3e37e2" Jun 08 21:12:06.287674 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:06.287570 2564 scope.go:117] "RemoveContainer" containerID="f5176409d79879b40bf0885bc2894aa94e890d54f571f3ed59bd7ea697be9fa8" Jun 08 21:12:06.287807 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:12:06.287785 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-65c64495c4-lncnv_open-cluster-management-agent-addon(bdc4cee1-7a29-486d-9d64-6806f3cdc70b)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65c64495c4-lncnv" podUID="bdc4cee1-7a29-486d-9d64-6806f3cdc70b" Jun 08 21:12:06.289074 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:06.289054 2564 generic.go:356] "Generic (PLEG): container finished" podID="1a7da038-4c3b-4c5d-8e0c-264f1e4ae524" containerID="6a3e881a3513bd83ff20ef50f94bbade42d994c9cab9c53990949fc7a679f9f9" exitCode=1 Jun 08 21:12:06.289215 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:06.289185 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-869c6946f9-8j5qm" event={"ID":"1a7da038-4c3b-4c5d-8e0c-264f1e4ae524","Type":"ContainerDied","Data":"6a3e881a3513bd83ff20ef50f94bbade42d994c9cab9c53990949fc7a679f9f9"} Jun 08 21:12:06.289585 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:06.289569 2564 scope.go:117] "RemoveContainer" containerID="6a3e881a3513bd83ff20ef50f94bbade42d994c9cab9c53990949fc7a679f9f9" Jun 08 21:12:06.289749 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:12:06.289728 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-869c6946f9-8j5qm_open-cluster-management-agent-addon(1a7da038-4c3b-4c5d-8e0c-264f1e4ae524)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-869c6946f9-8j5qm" podUID="1a7da038-4c3b-4c5d-8e0c-264f1e4ae524" Jun 08 21:12:06.301088 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:06.300995 2564 scope.go:117] "RemoveContainer" containerID="7a761708d257f6a6006ca3c6093e788d9ca71f67d1308bc36037e9b1eb50da88" Jun 08 21:12:06.859993 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:06.859960 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-869c6946f9-8j5qm" Jun 08 21:12:07.295071 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:07.294990 2564 scope.go:117] "RemoveContainer" containerID="6a3e881a3513bd83ff20ef50f94bbade42d994c9cab9c53990949fc7a679f9f9" Jun 08 21:12:07.295547 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:12:07.295221 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-869c6946f9-8j5qm_open-cluster-management-agent-addon(1a7da038-4c3b-4c5d-8e0c-264f1e4ae524)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-869c6946f9-8j5qm" podUID="1a7da038-4c3b-4c5d-8e0c-264f1e4ae524" Jun 08 21:12:07.662962 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:07.662931 2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-869c6946f9-8j5qm" Jun 08 21:12:07.692282 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:07.692237 2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65c64495c4-lncnv" Jun 08 21:12:07.692647 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:07.692631 2564 scope.go:117] "RemoveContainer" containerID="f5176409d79879b40bf0885bc2894aa94e890d54f571f3ed59bd7ea697be9fa8" Jun 08 21:12:07.692841 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:12:07.692819 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-65c64495c4-lncnv_open-cluster-management-agent-addon(bdc4cee1-7a29-486d-9d64-6806f3cdc70b)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65c64495c4-lncnv" podUID="bdc4cee1-7a29-486d-9d64-6806f3cdc70b" Jun 08 21:12:08.300386 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:08.300350 2564 scope.go:117] "RemoveContainer" containerID="6a3e881a3513bd83ff20ef50f94bbade42d994c9cab9c53990949fc7a679f9f9" Jun 08 21:12:08.300744 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:12:08.300535 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-869c6946f9-8j5qm_open-cluster-management-agent-addon(1a7da038-4c3b-4c5d-8e0c-264f1e4ae524)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-869c6946f9-8j5qm" podUID="1a7da038-4c3b-4c5d-8e0c-264f1e4ae524" Jun 08 21:12:15.291174 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:15.291148 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-t8nlh" Jun 08 21:12:16.403147 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:16.403100 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 21:12:16.403634 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:16.403501 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="06e97739-e035-48bc-8e8e-dd4fbf506403" containerName="prometheus" containerID="cri-o://ae26ae19a78399830dfb448134ed0f48ceb80ed6c454afd8b06c3f77cca37346" gracePeriod=600 Jun 08 21:12:16.403634 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:16.403532 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="06e97739-e035-48bc-8e8e-dd4fbf506403" containerName="kube-rbac-proxy" containerID="cri-o://75ddb5df47a964535ef7d2b9d34e2d8ff63535d7d906dc62caae607e7eb72bf2" gracePeriod=600 Jun 08 21:12:16.403634 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:16.403555 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="06e97739-e035-48bc-8e8e-dd4fbf506403" containerName="thanos-sidecar" containerID="cri-o://8cf584ebcc53ab70b7f8eeed29d268bc1b7cc59a84f9f123e2ecd0fe517bdd81" gracePeriod=600 Jun 08 21:12:16.403634 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:16.403587 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="06e97739-e035-48bc-8e8e-dd4fbf506403" containerName="config-reloader" containerID="cri-o://3284d2efd8f1af535180057e110053e605b26c476a409e7ee7c8a2c5ce70b5a6" gracePeriod=600 Jun 08 21:12:16.403935 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:16.403702 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="06e97739-e035-48bc-8e8e-dd4fbf506403" containerName="kube-rbac-proxy-thanos" containerID="cri-o://01d65b503a324001c0b4017a237ccb92e556e83b8868ee2c225395b6d6597d9c" gracePeriod=600 Jun 08 21:12:16.403935 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:16.403811 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="06e97739-e035-48bc-8e8e-dd4fbf506403" containerName="kube-rbac-proxy-web" containerID="cri-o://25a24b13b8658a1ce9977f547747d5f8da97cddf069ab8d58e0a2278ffc226ba" gracePeriod=600 Jun 08 21:12:16.640241 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:16.640214 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:12:16.735750 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:16.735664 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/06e97739-e035-48bc-8e8e-dd4fbf506403-web-config\") pod \"06e97739-e035-48bc-8e8e-dd4fbf506403\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " Jun 08 21:12:16.735750 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:16.735702 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06e97739-e035-48bc-8e8e-dd4fbf506403-configmap-kubelet-serving-ca-bundle\") pod \"06e97739-e035-48bc-8e8e-dd4fbf506403\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " Jun 08 21:12:16.735750 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:16.735737 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jbgkk\" (UniqueName: \"kubernetes.io/projected/06e97739-e035-48bc-8e8e-dd4fbf506403-kube-api-access-jbgkk\") pod \"06e97739-e035-48bc-8e8e-dd4fbf506403\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " Jun 08 21:12:16.736021 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:16.735778 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/06e97739-e035-48bc-8e8e-dd4fbf506403-secret-grpc-tls\") pod \"06e97739-e035-48bc-8e8e-dd4fbf506403\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " Jun 08 21:12:16.736021 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:16.735856 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06e97739-e035-48bc-8e8e-dd4fbf506403-configmap-serving-certs-ca-bundle\") pod \"06e97739-e035-48bc-8e8e-dd4fbf506403\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " Jun 08 21:12:16.736021 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:16.735890 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06e97739-e035-48bc-8e8e-dd4fbf506403-prometheus-trusted-ca-bundle\") pod \"06e97739-e035-48bc-8e8e-dd4fbf506403\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " Jun 08 21:12:16.736021 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:16.735926 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/06e97739-e035-48bc-8e8e-dd4fbf506403-config-out\") pod \"06e97739-e035-48bc-8e8e-dd4fbf506403\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " Jun 08 21:12:16.736021 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:16.735957 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/06e97739-e035-48bc-8e8e-dd4fbf506403-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"06e97739-e035-48bc-8e8e-dd4fbf506403\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " Jun 08 21:12:16.736021 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:16.735981 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/06e97739-e035-48bc-8e8e-dd4fbf506403-config\") pod \"06e97739-e035-48bc-8e8e-dd4fbf506403\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " Jun 08 21:12:16.736021 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:16.736011 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/06e97739-e035-48bc-8e8e-dd4fbf506403-prometheus-k8s-db\") pod \"06e97739-e035-48bc-8e8e-dd4fbf506403\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " Jun 08 21:12:16.736452 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:16.736050 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/06e97739-e035-48bc-8e8e-dd4fbf506403-prometheus-k8s-rulefiles-2\") pod \"06e97739-e035-48bc-8e8e-dd4fbf506403\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " Jun 08 21:12:16.736452 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:16.736081 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/06e97739-e035-48bc-8e8e-dd4fbf506403-tls-assets\") pod \"06e97739-e035-48bc-8e8e-dd4fbf506403\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " Jun 08 21:12:16.736452 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:16.736110 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/06e97739-e035-48bc-8e8e-dd4fbf506403-secret-metrics-client-certs\") pod \"06e97739-e035-48bc-8e8e-dd4fbf506403\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " Jun 08 21:12:16.736452 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:16.736145 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06e97739-e035-48bc-8e8e-dd4fbf506403-configmap-metrics-client-ca\") pod \"06e97739-e035-48bc-8e8e-dd4fbf506403\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " Jun 08 21:12:16.736452 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:16.736183 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/06e97739-e035-48bc-8e8e-dd4fbf506403-thanos-prometheus-http-client-file\") pod \"06e97739-e035-48bc-8e8e-dd4fbf506403\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " Jun 08 21:12:16.736452 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:16.736212 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/06e97739-e035-48bc-8e8e-dd4fbf506403-prometheus-k8s-rulefiles-1\") pod \"06e97739-e035-48bc-8e8e-dd4fbf506403\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " Jun 08 21:12:16.736452 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:16.736217 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06e97739-e035-48bc-8e8e-dd4fbf506403-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "06e97739-e035-48bc-8e8e-dd4fbf506403" (UID: "06e97739-e035-48bc-8e8e-dd4fbf506403"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 21:12:16.736452 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:16.736247 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/06e97739-e035-48bc-8e8e-dd4fbf506403-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"06e97739-e035-48bc-8e8e-dd4fbf506403\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " Jun 08 21:12:16.736452 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:16.736248 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06e97739-e035-48bc-8e8e-dd4fbf506403-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "06e97739-e035-48bc-8e8e-dd4fbf506403" (UID: "06e97739-e035-48bc-8e8e-dd4fbf506403"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 21:12:16.736452 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:16.736307 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/06e97739-e035-48bc-8e8e-dd4fbf506403-secret-kube-rbac-proxy\") pod \"06e97739-e035-48bc-8e8e-dd4fbf506403\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " Jun 08 21:12:16.736452 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:16.736334 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/06e97739-e035-48bc-8e8e-dd4fbf506403-secret-prometheus-k8s-tls\") pod \"06e97739-e035-48bc-8e8e-dd4fbf506403\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " Jun 08 21:12:16.736452 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:16.736377 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/06e97739-e035-48bc-8e8e-dd4fbf506403-prometheus-k8s-rulefiles-0\") pod \"06e97739-e035-48bc-8e8e-dd4fbf506403\" (UID: \"06e97739-e035-48bc-8e8e-dd4fbf506403\") " Jun 08 21:12:16.737034 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:16.736609 2564 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06e97739-e035-48bc-8e8e-dd4fbf506403-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 08 21:12:16.737034 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:16.736629 2564 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06e97739-e035-48bc-8e8e-dd4fbf506403-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 08 21:12:16.737034 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:16.736678 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06e97739-e035-48bc-8e8e-dd4fbf506403-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "06e97739-e035-48bc-8e8e-dd4fbf506403" (UID: "06e97739-e035-48bc-8e8e-dd4fbf506403"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 21:12:16.737034 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:16.736746 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06e97739-e035-48bc-8e8e-dd4fbf506403-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "06e97739-e035-48bc-8e8e-dd4fbf506403" (UID: "06e97739-e035-48bc-8e8e-dd4fbf506403"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 21:12:16.737034 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:16.737002 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06e97739-e035-48bc-8e8e-dd4fbf506403-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "06e97739-e035-48bc-8e8e-dd4fbf506403" (UID: "06e97739-e035-48bc-8e8e-dd4fbf506403"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 21:12:16.738070 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:16.737767 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06e97739-e035-48bc-8e8e-dd4fbf506403-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "06e97739-e035-48bc-8e8e-dd4fbf506403" (UID: "06e97739-e035-48bc-8e8e-dd4fbf506403"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 21:12:16.738222 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:16.738067 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06e97739-e035-48bc-8e8e-dd4fbf506403-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "06e97739-e035-48bc-8e8e-dd4fbf506403" (UID: "06e97739-e035-48bc-8e8e-dd4fbf506403"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 21:12:16.738754 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:16.738538 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06e97739-e035-48bc-8e8e-dd4fbf506403-kube-api-access-jbgkk" (OuterVolumeSpecName: "kube-api-access-jbgkk") pod "06e97739-e035-48bc-8e8e-dd4fbf506403" (UID: "06e97739-e035-48bc-8e8e-dd4fbf506403"). InnerVolumeSpecName "kube-api-access-jbgkk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 21:12:16.738754 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:16.738695 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06e97739-e035-48bc-8e8e-dd4fbf506403-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "06e97739-e035-48bc-8e8e-dd4fbf506403" (UID: "06e97739-e035-48bc-8e8e-dd4fbf506403"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 21:12:16.739142 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:16.739110 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06e97739-e035-48bc-8e8e-dd4fbf506403-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "06e97739-e035-48bc-8e8e-dd4fbf506403" (UID: "06e97739-e035-48bc-8e8e-dd4fbf506403"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 21:12:16.739614 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:16.739579 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06e97739-e035-48bc-8e8e-dd4fbf506403-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "06e97739-e035-48bc-8e8e-dd4fbf506403" (UID: "06e97739-e035-48bc-8e8e-dd4fbf506403"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 21:12:16.740024 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:16.739975 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06e97739-e035-48bc-8e8e-dd4fbf506403-config-out" (OuterVolumeSpecName: "config-out") pod "06e97739-e035-48bc-8e8e-dd4fbf506403" (UID: "06e97739-e035-48bc-8e8e-dd4fbf506403"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 21:12:16.740593 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:16.740564 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06e97739-e035-48bc-8e8e-dd4fbf506403-config" (OuterVolumeSpecName: "config") pod "06e97739-e035-48bc-8e8e-dd4fbf506403" (UID: "06e97739-e035-48bc-8e8e-dd4fbf506403"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 21:12:16.740752 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:16.740714 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06e97739-e035-48bc-8e8e-dd4fbf506403-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "06e97739-e035-48bc-8e8e-dd4fbf506403" (UID: "06e97739-e035-48bc-8e8e-dd4fbf506403"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 21:12:16.740836 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:16.740810 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06e97739-e035-48bc-8e8e-dd4fbf506403-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "06e97739-e035-48bc-8e8e-dd4fbf506403" (UID: "06e97739-e035-48bc-8e8e-dd4fbf506403"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 21:12:16.740886 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:16.740871 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06e97739-e035-48bc-8e8e-dd4fbf506403-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "06e97739-e035-48bc-8e8e-dd4fbf506403" (UID: "06e97739-e035-48bc-8e8e-dd4fbf506403"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 21:12:16.740923 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:16.740896 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06e97739-e035-48bc-8e8e-dd4fbf506403-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "06e97739-e035-48bc-8e8e-dd4fbf506403" (UID: "06e97739-e035-48bc-8e8e-dd4fbf506403"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 21:12:16.741763 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:16.741739 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06e97739-e035-48bc-8e8e-dd4fbf506403-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "06e97739-e035-48bc-8e8e-dd4fbf506403" (UID: "06e97739-e035-48bc-8e8e-dd4fbf506403"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 21:12:16.742125 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:16.742103 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06e97739-e035-48bc-8e8e-dd4fbf506403-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "06e97739-e035-48bc-8e8e-dd4fbf506403" (UID: "06e97739-e035-48bc-8e8e-dd4fbf506403"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 21:12:16.748712 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:16.748690 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06e97739-e035-48bc-8e8e-dd4fbf506403-web-config" (OuterVolumeSpecName: "web-config") pod "06e97739-e035-48bc-8e8e-dd4fbf506403" (UID: "06e97739-e035-48bc-8e8e-dd4fbf506403"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 21:12:16.837698 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:16.837661 2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/06e97739-e035-48bc-8e8e-dd4fbf506403-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 08 21:12:16.837698 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:16.837694 2564 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/06e97739-e035-48bc-8e8e-dd4fbf506403-config\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 08 21:12:16.837698 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:16.837704 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/06e97739-e035-48bc-8e8e-dd4fbf506403-prometheus-k8s-db\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 08 21:12:16.837896 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:16.837713 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/06e97739-e035-48bc-8e8e-dd4fbf506403-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 08 21:12:16.837896 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:16.837723 2564 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/06e97739-e035-48bc-8e8e-dd4fbf506403-tls-assets\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 08 21:12:16.837896 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:16.837732 2564 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/06e97739-e035-48bc-8e8e-dd4fbf506403-secret-metrics-client-certs\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 08 21:12:16.837896 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:16.837740 2564 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06e97739-e035-48bc-8e8e-dd4fbf506403-configmap-metrics-client-ca\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 08 21:12:16.837896 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:16.837750 2564 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/06e97739-e035-48bc-8e8e-dd4fbf506403-thanos-prometheus-http-client-file\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 08 21:12:16.837896 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:16.837758 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/06e97739-e035-48bc-8e8e-dd4fbf506403-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 08 21:12:16.837896 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:16.837767 2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/06e97739-e035-48bc-8e8e-dd4fbf506403-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 08 21:12:16.837896 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:16.837776 2564 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/06e97739-e035-48bc-8e8e-dd4fbf506403-secret-kube-rbac-proxy\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 08 21:12:16.837896 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:16.837784 2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/06e97739-e035-48bc-8e8e-dd4fbf506403-secret-prometheus-k8s-tls\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 08 21:12:16.837896 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:16.837792 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/06e97739-e035-48bc-8e8e-dd4fbf506403-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 08 21:12:16.837896 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:16.837800 2564 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/06e97739-e035-48bc-8e8e-dd4fbf506403-web-config\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 08 21:12:16.837896 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:16.837809 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jbgkk\" (UniqueName: \"kubernetes.io/projected/06e97739-e035-48bc-8e8e-dd4fbf506403-kube-api-access-jbgkk\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 08 21:12:16.837896 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:16.837816 2564 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/06e97739-e035-48bc-8e8e-dd4fbf506403-secret-grpc-tls\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 08 21:12:16.837896 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:16.837824 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06e97739-e035-48bc-8e8e-dd4fbf506403-prometheus-trusted-ca-bundle\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 08 21:12:16.837896 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:16.837834 2564 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/06e97739-e035-48bc-8e8e-dd4fbf506403-config-out\") on node \"ip-10-0-133-247.ec2.internal\" DevicePath \"\"" Jun 08 21:12:17.335694 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.335648 2564 generic.go:356] "Generic (PLEG): container finished" podID="06e97739-e035-48bc-8e8e-dd4fbf506403" containerID="01d65b503a324001c0b4017a237ccb92e556e83b8868ee2c225395b6d6597d9c" exitCode=0 Jun 08 21:12:17.335694 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.335679 2564 generic.go:356] "Generic (PLEG): container finished" podID="06e97739-e035-48bc-8e8e-dd4fbf506403" containerID="75ddb5df47a964535ef7d2b9d34e2d8ff63535d7d906dc62caae607e7eb72bf2" exitCode=0 Jun 08 21:12:17.335694 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.335688 2564 generic.go:356] "Generic (PLEG): container finished" podID="06e97739-e035-48bc-8e8e-dd4fbf506403" containerID="25a24b13b8658a1ce9977f547747d5f8da97cddf069ab8d58e0a2278ffc226ba" exitCode=0 Jun 08 21:12:17.335694 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.335696 2564 generic.go:356] "Generic (PLEG): container finished" podID="06e97739-e035-48bc-8e8e-dd4fbf506403" containerID="8cf584ebcc53ab70b7f8eeed29d268bc1b7cc59a84f9f123e2ecd0fe517bdd81" exitCode=0 Jun 08 21:12:17.335694 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.335705 2564 generic.go:356] "Generic (PLEG): container finished" podID="06e97739-e035-48bc-8e8e-dd4fbf506403" containerID="3284d2efd8f1af535180057e110053e605b26c476a409e7ee7c8a2c5ce70b5a6" exitCode=0 Jun 08 21:12:17.336095 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.335715 2564 generic.go:356] "Generic (PLEG): container finished" podID="06e97739-e035-48bc-8e8e-dd4fbf506403" containerID="ae26ae19a78399830dfb448134ed0f48ceb80ed6c454afd8b06c3f77cca37346" exitCode=0 Jun 08 21:12:17.336095 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.335730 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06e97739-e035-48bc-8e8e-dd4fbf506403","Type":"ContainerDied","Data":"01d65b503a324001c0b4017a237ccb92e556e83b8868ee2c225395b6d6597d9c"} Jun 08 21:12:17.336095 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.335743 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:12:17.336095 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.335824 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06e97739-e035-48bc-8e8e-dd4fbf506403","Type":"ContainerDied","Data":"75ddb5df47a964535ef7d2b9d34e2d8ff63535d7d906dc62caae607e7eb72bf2"} Jun 08 21:12:17.336095 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.335865 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06e97739-e035-48bc-8e8e-dd4fbf506403","Type":"ContainerDied","Data":"25a24b13b8658a1ce9977f547747d5f8da97cddf069ab8d58e0a2278ffc226ba"} Jun 08 21:12:17.336095 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.335905 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06e97739-e035-48bc-8e8e-dd4fbf506403","Type":"ContainerDied","Data":"8cf584ebcc53ab70b7f8eeed29d268bc1b7cc59a84f9f123e2ecd0fe517bdd81"} Jun 08 21:12:17.336095 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.335920 2564 scope.go:117] "RemoveContainer" containerID="01d65b503a324001c0b4017a237ccb92e556e83b8868ee2c225395b6d6597d9c" Jun 08 21:12:17.336095 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.335947 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06e97739-e035-48bc-8e8e-dd4fbf506403","Type":"ContainerDied","Data":"3284d2efd8f1af535180057e110053e605b26c476a409e7ee7c8a2c5ce70b5a6"} Jun 08 21:12:17.336095 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.335991 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06e97739-e035-48bc-8e8e-dd4fbf506403","Type":"ContainerDied","Data":"ae26ae19a78399830dfb448134ed0f48ceb80ed6c454afd8b06c3f77cca37346"} Jun 08 21:12:17.336095 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.336033 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06e97739-e035-48bc-8e8e-dd4fbf506403","Type":"ContainerDied","Data":"6454626a66548e140166873435e75027a0f76b5f57fd3a5992cb7ded958cb348"} Jun 08 21:12:17.344348 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.344332 2564 scope.go:117] "RemoveContainer" containerID="75ddb5df47a964535ef7d2b9d34e2d8ff63535d7d906dc62caae607e7eb72bf2" Jun 08 21:12:17.351165 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.351148 2564 scope.go:117] "RemoveContainer" containerID="25a24b13b8658a1ce9977f547747d5f8da97cddf069ab8d58e0a2278ffc226ba" Jun 08 21:12:17.357762 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.357737 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 21:12:17.358358 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.358340 2564 scope.go:117] "RemoveContainer" containerID="8cf584ebcc53ab70b7f8eeed29d268bc1b7cc59a84f9f123e2ecd0fe517bdd81" Jun 08 21:12:17.362967 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.362927 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 21:12:17.365695 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.365678 2564 scope.go:117] "RemoveContainer" containerID="3284d2efd8f1af535180057e110053e605b26c476a409e7ee7c8a2c5ce70b5a6" Jun 08 21:12:17.372227 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.372205 2564 scope.go:117] "RemoveContainer" containerID="ae26ae19a78399830dfb448134ed0f48ceb80ed6c454afd8b06c3f77cca37346" Jun 08 21:12:17.380319 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.380294 2564 scope.go:117] "RemoveContainer" containerID="c4ec296dee7f528ffabc76f3cdbc0880edbcaddc6965a5c61e06f844ab79bdc9" Jun 08 21:12:17.387317 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.387293 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 21:12:17.387499 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.387471 2564 scope.go:117] "RemoveContainer" containerID="01d65b503a324001c0b4017a237ccb92e556e83b8868ee2c225395b6d6597d9c" Jun 08 21:12:17.387565 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.387552 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06e97739-e035-48bc-8e8e-dd4fbf506403" containerName="prometheus" Jun 08 21:12:17.387611 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.387566 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="06e97739-e035-48bc-8e8e-dd4fbf506403" containerName="prometheus" Jun 08 21:12:17.387611 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.387577 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06e97739-e035-48bc-8e8e-dd4fbf506403" containerName="kube-rbac-proxy-thanos" Jun 08 21:12:17.387611 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.387583 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="06e97739-e035-48bc-8e8e-dd4fbf506403" containerName="kube-rbac-proxy-thanos" Jun 08 21:12:17.387611 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.387602 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06e97739-e035-48bc-8e8e-dd4fbf506403" containerName="thanos-sidecar" Jun 08 21:12:17.387761 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.387612 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="06e97739-e035-48bc-8e8e-dd4fbf506403" containerName="thanos-sidecar" Jun 08 21:12:17.387761 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.387624 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06e97739-e035-48bc-8e8e-dd4fbf506403" containerName="kube-rbac-proxy-web" Jun 08 21:12:17.387761 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.387633 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="06e97739-e035-48bc-8e8e-dd4fbf506403" containerName="kube-rbac-proxy-web" Jun 08 21:12:17.387761 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.387642 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06e97739-e035-48bc-8e8e-dd4fbf506403" containerName="config-reloader" Jun 08 21:12:17.387761 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.387650 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="06e97739-e035-48bc-8e8e-dd4fbf506403" containerName="config-reloader" Jun 08 21:12:17.387761 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.387666 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06e97739-e035-48bc-8e8e-dd4fbf506403" containerName="kube-rbac-proxy" Jun 08 21:12:17.387761 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.387675 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="06e97739-e035-48bc-8e8e-dd4fbf506403" containerName="kube-rbac-proxy" Jun 08 21:12:17.387761 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.387686 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06e97739-e035-48bc-8e8e-dd4fbf506403" containerName="init-config-reloader" Jun 08 21:12:17.387761 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.387696 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="06e97739-e035-48bc-8e8e-dd4fbf506403" containerName="init-config-reloader" Jun 08 21:12:17.387761 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.387737 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="06e97739-e035-48bc-8e8e-dd4fbf506403" containerName="config-reloader" Jun 08 21:12:17.387761 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.387767 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="06e97739-e035-48bc-8e8e-dd4fbf506403" containerName="kube-rbac-proxy-web" Jun 08 21:12:17.388227 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.387774 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="06e97739-e035-48bc-8e8e-dd4fbf506403" containerName="kube-rbac-proxy" Jun 08 21:12:17.388227 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.387781 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="06e97739-e035-48bc-8e8e-dd4fbf506403" containerName="thanos-sidecar" Jun 08 21:12:17.388227 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.387788 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="06e97739-e035-48bc-8e8e-dd4fbf506403" containerName="kube-rbac-proxy-thanos" Jun 08 21:12:17.388227 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:12:17.387781 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01d65b503a324001c0b4017a237ccb92e556e83b8868ee2c225395b6d6597d9c\": container with ID starting with 01d65b503a324001c0b4017a237ccb92e556e83b8868ee2c225395b6d6597d9c not found: ID does not exist" containerID="01d65b503a324001c0b4017a237ccb92e556e83b8868ee2c225395b6d6597d9c" Jun 08 21:12:17.388227 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.387823 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01d65b503a324001c0b4017a237ccb92e556e83b8868ee2c225395b6d6597d9c"} err="failed to get container status \"01d65b503a324001c0b4017a237ccb92e556e83b8868ee2c225395b6d6597d9c\": rpc error: code = NotFound desc = could not find container \"01d65b503a324001c0b4017a237ccb92e556e83b8868ee2c225395b6d6597d9c\": container with ID starting with 01d65b503a324001c0b4017a237ccb92e556e83b8868ee2c225395b6d6597d9c not found: ID does not exist" Jun 08 21:12:17.388227 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.387852 2564 scope.go:117] "RemoveContainer" containerID="75ddb5df47a964535ef7d2b9d34e2d8ff63535d7d906dc62caae607e7eb72bf2" Jun 08 21:12:17.388227 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.387796 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="06e97739-e035-48bc-8e8e-dd4fbf506403" containerName="prometheus" Jun 08 21:12:17.388227 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:12:17.388102 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75ddb5df47a964535ef7d2b9d34e2d8ff63535d7d906dc62caae607e7eb72bf2\": container with ID starting with 75ddb5df47a964535ef7d2b9d34e2d8ff63535d7d906dc62caae607e7eb72bf2 not found: ID does not exist" containerID="75ddb5df47a964535ef7d2b9d34e2d8ff63535d7d906dc62caae607e7eb72bf2" Jun 08 21:12:17.388227 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.388131 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75ddb5df47a964535ef7d2b9d34e2d8ff63535d7d906dc62caae607e7eb72bf2"} err="failed to get container status \"75ddb5df47a964535ef7d2b9d34e2d8ff63535d7d906dc62caae607e7eb72bf2\": rpc error: code = NotFound desc = could not find container \"75ddb5df47a964535ef7d2b9d34e2d8ff63535d7d906dc62caae607e7eb72bf2\": container with ID starting with 75ddb5df47a964535ef7d2b9d34e2d8ff63535d7d906dc62caae607e7eb72bf2 not found: ID does not exist" Jun 08 21:12:17.388227 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.388154 2564 scope.go:117] "RemoveContainer" containerID="25a24b13b8658a1ce9977f547747d5f8da97cddf069ab8d58e0a2278ffc226ba" Jun 08 21:12:17.388650 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:12:17.388445 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25a24b13b8658a1ce9977f547747d5f8da97cddf069ab8d58e0a2278ffc226ba\": container with ID starting with 25a24b13b8658a1ce9977f547747d5f8da97cddf069ab8d58e0a2278ffc226ba not found: ID does not exist" containerID="25a24b13b8658a1ce9977f547747d5f8da97cddf069ab8d58e0a2278ffc226ba" Jun 08 21:12:17.388650 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.388465 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25a24b13b8658a1ce9977f547747d5f8da97cddf069ab8d58e0a2278ffc226ba"} err="failed to get container status \"25a24b13b8658a1ce9977f547747d5f8da97cddf069ab8d58e0a2278ffc226ba\": rpc error: code = NotFound desc = could not find container \"25a24b13b8658a1ce9977f547747d5f8da97cddf069ab8d58e0a2278ffc226ba\": container with ID starting with 25a24b13b8658a1ce9977f547747d5f8da97cddf069ab8d58e0a2278ffc226ba not found: ID does not exist" Jun 08 21:12:17.388650 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.388481 2564 scope.go:117] "RemoveContainer" containerID="8cf584ebcc53ab70b7f8eeed29d268bc1b7cc59a84f9f123e2ecd0fe517bdd81" Jun 08 21:12:17.388750 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:12:17.388698 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8cf584ebcc53ab70b7f8eeed29d268bc1b7cc59a84f9f123e2ecd0fe517bdd81\": container with ID starting with 8cf584ebcc53ab70b7f8eeed29d268bc1b7cc59a84f9f123e2ecd0fe517bdd81 not found: ID does not exist" containerID="8cf584ebcc53ab70b7f8eeed29d268bc1b7cc59a84f9f123e2ecd0fe517bdd81" Jun 08 21:12:17.388750 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.388728 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8cf584ebcc53ab70b7f8eeed29d268bc1b7cc59a84f9f123e2ecd0fe517bdd81"} err="failed to get container status \"8cf584ebcc53ab70b7f8eeed29d268bc1b7cc59a84f9f123e2ecd0fe517bdd81\": rpc error: code = NotFound desc = could not find container \"8cf584ebcc53ab70b7f8eeed29d268bc1b7cc59a84f9f123e2ecd0fe517bdd81\": container with ID starting with 8cf584ebcc53ab70b7f8eeed29d268bc1b7cc59a84f9f123e2ecd0fe517bdd81 not found: ID does not exist" Jun 08 21:12:17.388750 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.388743 2564 scope.go:117] "RemoveContainer" containerID="3284d2efd8f1af535180057e110053e605b26c476a409e7ee7c8a2c5ce70b5a6" Jun 08 21:12:17.388964 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:12:17.388948 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3284d2efd8f1af535180057e110053e605b26c476a409e7ee7c8a2c5ce70b5a6\": container with ID starting with 3284d2efd8f1af535180057e110053e605b26c476a409e7ee7c8a2c5ce70b5a6 not found: ID does not exist" containerID="3284d2efd8f1af535180057e110053e605b26c476a409e7ee7c8a2c5ce70b5a6" Jun 08 21:12:17.389008 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.388966 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3284d2efd8f1af535180057e110053e605b26c476a409e7ee7c8a2c5ce70b5a6"} err="failed to get container status \"3284d2efd8f1af535180057e110053e605b26c476a409e7ee7c8a2c5ce70b5a6\": rpc error: code = NotFound desc = could not find container \"3284d2efd8f1af535180057e110053e605b26c476a409e7ee7c8a2c5ce70b5a6\": container with ID starting with 3284d2efd8f1af535180057e110053e605b26c476a409e7ee7c8a2c5ce70b5a6 not found: ID does not exist" Jun 08 21:12:17.389008 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.388979 2564 scope.go:117] "RemoveContainer" containerID="ae26ae19a78399830dfb448134ed0f48ceb80ed6c454afd8b06c3f77cca37346" Jun 08 21:12:17.389181 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:12:17.389162 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae26ae19a78399830dfb448134ed0f48ceb80ed6c454afd8b06c3f77cca37346\": container with ID starting with ae26ae19a78399830dfb448134ed0f48ceb80ed6c454afd8b06c3f77cca37346 not found: ID does not exist" containerID="ae26ae19a78399830dfb448134ed0f48ceb80ed6c454afd8b06c3f77cca37346" Jun 08 21:12:17.389221 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.389184 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae26ae19a78399830dfb448134ed0f48ceb80ed6c454afd8b06c3f77cca37346"} err="failed to get container status \"ae26ae19a78399830dfb448134ed0f48ceb80ed6c454afd8b06c3f77cca37346\": rpc error: code = NotFound desc = could not find container \"ae26ae19a78399830dfb448134ed0f48ceb80ed6c454afd8b06c3f77cca37346\": container with ID starting with ae26ae19a78399830dfb448134ed0f48ceb80ed6c454afd8b06c3f77cca37346 not found: ID does not exist" Jun 08 21:12:17.389221 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.389196 2564 scope.go:117] "RemoveContainer" containerID="c4ec296dee7f528ffabc76f3cdbc0880edbcaddc6965a5c61e06f844ab79bdc9" Jun 08 21:12:17.389420 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:12:17.389399 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4ec296dee7f528ffabc76f3cdbc0880edbcaddc6965a5c61e06f844ab79bdc9\": container with ID starting with c4ec296dee7f528ffabc76f3cdbc0880edbcaddc6965a5c61e06f844ab79bdc9 not found: ID does not exist" containerID="c4ec296dee7f528ffabc76f3cdbc0880edbcaddc6965a5c61e06f844ab79bdc9" Jun 08 21:12:17.389467 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.389421 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4ec296dee7f528ffabc76f3cdbc0880edbcaddc6965a5c61e06f844ab79bdc9"} err="failed to get container status \"c4ec296dee7f528ffabc76f3cdbc0880edbcaddc6965a5c61e06f844ab79bdc9\": rpc error: code = NotFound desc = could not find container \"c4ec296dee7f528ffabc76f3cdbc0880edbcaddc6965a5c61e06f844ab79bdc9\": container with ID starting with c4ec296dee7f528ffabc76f3cdbc0880edbcaddc6965a5c61e06f844ab79bdc9 not found: ID does not exist" Jun 08 21:12:17.389467 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.389436 2564 scope.go:117] "RemoveContainer" containerID="01d65b503a324001c0b4017a237ccb92e556e83b8868ee2c225395b6d6597d9c" Jun 08 21:12:17.389641 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.389626 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01d65b503a324001c0b4017a237ccb92e556e83b8868ee2c225395b6d6597d9c"} err="failed to get container status \"01d65b503a324001c0b4017a237ccb92e556e83b8868ee2c225395b6d6597d9c\": rpc error: code = NotFound desc = could not find container \"01d65b503a324001c0b4017a237ccb92e556e83b8868ee2c225395b6d6597d9c\": container with ID starting with 01d65b503a324001c0b4017a237ccb92e556e83b8868ee2c225395b6d6597d9c not found: ID does not exist" Jun 08 21:12:17.389684 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.389641 2564 scope.go:117] "RemoveContainer" containerID="75ddb5df47a964535ef7d2b9d34e2d8ff63535d7d906dc62caae607e7eb72bf2" Jun 08 21:12:17.389824 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.389808 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75ddb5df47a964535ef7d2b9d34e2d8ff63535d7d906dc62caae607e7eb72bf2"} err="failed to get container status \"75ddb5df47a964535ef7d2b9d34e2d8ff63535d7d906dc62caae607e7eb72bf2\": rpc error: code = NotFound desc = could not find container \"75ddb5df47a964535ef7d2b9d34e2d8ff63535d7d906dc62caae607e7eb72bf2\": container with ID starting with 75ddb5df47a964535ef7d2b9d34e2d8ff63535d7d906dc62caae607e7eb72bf2 not found: ID does not exist" Jun 08 21:12:17.389861 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.389825 2564 scope.go:117] "RemoveContainer" containerID="25a24b13b8658a1ce9977f547747d5f8da97cddf069ab8d58e0a2278ffc226ba" Jun 08 21:12:17.390006 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.389990 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25a24b13b8658a1ce9977f547747d5f8da97cddf069ab8d58e0a2278ffc226ba"} err="failed to get container status \"25a24b13b8658a1ce9977f547747d5f8da97cddf069ab8d58e0a2278ffc226ba\": rpc error: code = NotFound desc = could not find container \"25a24b13b8658a1ce9977f547747d5f8da97cddf069ab8d58e0a2278ffc226ba\": container with ID starting with 25a24b13b8658a1ce9977f547747d5f8da97cddf069ab8d58e0a2278ffc226ba not found: ID does not exist" Jun 08 21:12:17.390047 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.390006 2564 scope.go:117] "RemoveContainer" containerID="8cf584ebcc53ab70b7f8eeed29d268bc1b7cc59a84f9f123e2ecd0fe517bdd81" Jun 08 21:12:17.390219 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.390195 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8cf584ebcc53ab70b7f8eeed29d268bc1b7cc59a84f9f123e2ecd0fe517bdd81"} err="failed to get container status \"8cf584ebcc53ab70b7f8eeed29d268bc1b7cc59a84f9f123e2ecd0fe517bdd81\": rpc error: code = NotFound desc = could not find container \"8cf584ebcc53ab70b7f8eeed29d268bc1b7cc59a84f9f123e2ecd0fe517bdd81\": container with ID starting with 8cf584ebcc53ab70b7f8eeed29d268bc1b7cc59a84f9f123e2ecd0fe517bdd81 not found: ID does not exist" Jun 08 21:12:17.390306 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.390219 2564 scope.go:117] "RemoveContainer" containerID="3284d2efd8f1af535180057e110053e605b26c476a409e7ee7c8a2c5ce70b5a6" Jun 08 21:12:17.390407 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.390390 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3284d2efd8f1af535180057e110053e605b26c476a409e7ee7c8a2c5ce70b5a6"} err="failed to get container status \"3284d2efd8f1af535180057e110053e605b26c476a409e7ee7c8a2c5ce70b5a6\": rpc error: code = NotFound desc = could not find container \"3284d2efd8f1af535180057e110053e605b26c476a409e7ee7c8a2c5ce70b5a6\": container with ID starting with 3284d2efd8f1af535180057e110053e605b26c476a409e7ee7c8a2c5ce70b5a6 not found: ID does not exist" Jun 08 21:12:17.390463 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.390406 2564 scope.go:117] "RemoveContainer" containerID="ae26ae19a78399830dfb448134ed0f48ceb80ed6c454afd8b06c3f77cca37346" Jun 08 21:12:17.390630 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.390613 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae26ae19a78399830dfb448134ed0f48ceb80ed6c454afd8b06c3f77cca37346"} err="failed to get container status \"ae26ae19a78399830dfb448134ed0f48ceb80ed6c454afd8b06c3f77cca37346\": rpc error: code = NotFound desc = could not find container \"ae26ae19a78399830dfb448134ed0f48ceb80ed6c454afd8b06c3f77cca37346\": container with ID starting with ae26ae19a78399830dfb448134ed0f48ceb80ed6c454afd8b06c3f77cca37346 not found: ID does not exist" Jun 08 21:12:17.390672 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.390630 2564 scope.go:117] "RemoveContainer" containerID="c4ec296dee7f528ffabc76f3cdbc0880edbcaddc6965a5c61e06f844ab79bdc9" Jun 08 21:12:17.390863 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.390845 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4ec296dee7f528ffabc76f3cdbc0880edbcaddc6965a5c61e06f844ab79bdc9"} err="failed to get container status \"c4ec296dee7f528ffabc76f3cdbc0880edbcaddc6965a5c61e06f844ab79bdc9\": rpc error: code = NotFound desc = could not find container \"c4ec296dee7f528ffabc76f3cdbc0880edbcaddc6965a5c61e06f844ab79bdc9\": container with ID starting with c4ec296dee7f528ffabc76f3cdbc0880edbcaddc6965a5c61e06f844ab79bdc9 not found: ID does not exist" Jun 08 21:12:17.390908 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.390864 2564 scope.go:117] "RemoveContainer" containerID="01d65b503a324001c0b4017a237ccb92e556e83b8868ee2c225395b6d6597d9c" Jun 08 21:12:17.391054 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.391039 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01d65b503a324001c0b4017a237ccb92e556e83b8868ee2c225395b6d6597d9c"} err="failed to get container status \"01d65b503a324001c0b4017a237ccb92e556e83b8868ee2c225395b6d6597d9c\": rpc error: code = NotFound desc = could not find container \"01d65b503a324001c0b4017a237ccb92e556e83b8868ee2c225395b6d6597d9c\": container with ID starting with 01d65b503a324001c0b4017a237ccb92e556e83b8868ee2c225395b6d6597d9c not found: ID does not exist" Jun 08 21:12:17.391054 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.391053 2564 scope.go:117] "RemoveContainer" containerID="75ddb5df47a964535ef7d2b9d34e2d8ff63535d7d906dc62caae607e7eb72bf2" Jun 08 21:12:17.391218 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.391203 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75ddb5df47a964535ef7d2b9d34e2d8ff63535d7d906dc62caae607e7eb72bf2"} err="failed to get container status \"75ddb5df47a964535ef7d2b9d34e2d8ff63535d7d906dc62caae607e7eb72bf2\": rpc error: code = NotFound desc = could not find container \"75ddb5df47a964535ef7d2b9d34e2d8ff63535d7d906dc62caae607e7eb72bf2\": container with ID starting with 75ddb5df47a964535ef7d2b9d34e2d8ff63535d7d906dc62caae607e7eb72bf2 not found: ID does not exist" Jun 08 21:12:17.391218 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.391216 2564 scope.go:117] "RemoveContainer" containerID="25a24b13b8658a1ce9977f547747d5f8da97cddf069ab8d58e0a2278ffc226ba" Jun 08 21:12:17.391407 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.391393 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25a24b13b8658a1ce9977f547747d5f8da97cddf069ab8d58e0a2278ffc226ba"} err="failed to get container status \"25a24b13b8658a1ce9977f547747d5f8da97cddf069ab8d58e0a2278ffc226ba\": rpc error: code = NotFound desc = could not find container \"25a24b13b8658a1ce9977f547747d5f8da97cddf069ab8d58e0a2278ffc226ba\": container with ID starting with 25a24b13b8658a1ce9977f547747d5f8da97cddf069ab8d58e0a2278ffc226ba not found: ID does not exist" Jun 08 21:12:17.391407 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.391406 2564 scope.go:117] "RemoveContainer" containerID="8cf584ebcc53ab70b7f8eeed29d268bc1b7cc59a84f9f123e2ecd0fe517bdd81" Jun 08 21:12:17.391603 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.391586 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8cf584ebcc53ab70b7f8eeed29d268bc1b7cc59a84f9f123e2ecd0fe517bdd81"} err="failed to get container status \"8cf584ebcc53ab70b7f8eeed29d268bc1b7cc59a84f9f123e2ecd0fe517bdd81\": rpc error: code = NotFound desc = could not find container \"8cf584ebcc53ab70b7f8eeed29d268bc1b7cc59a84f9f123e2ecd0fe517bdd81\": container with ID starting with 8cf584ebcc53ab70b7f8eeed29d268bc1b7cc59a84f9f123e2ecd0fe517bdd81 not found: ID does not exist" Jun 08 21:12:17.391642 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.391605 2564 scope.go:117] "RemoveContainer" containerID="3284d2efd8f1af535180057e110053e605b26c476a409e7ee7c8a2c5ce70b5a6" Jun 08 21:12:17.391821 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.391805 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3284d2efd8f1af535180057e110053e605b26c476a409e7ee7c8a2c5ce70b5a6"} err="failed to get container status \"3284d2efd8f1af535180057e110053e605b26c476a409e7ee7c8a2c5ce70b5a6\": rpc error: code = NotFound desc = could not find container \"3284d2efd8f1af535180057e110053e605b26c476a409e7ee7c8a2c5ce70b5a6\": container with ID starting with 3284d2efd8f1af535180057e110053e605b26c476a409e7ee7c8a2c5ce70b5a6 not found: ID does not exist" Jun 08 21:12:17.391865 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.391821 2564 scope.go:117] "RemoveContainer" containerID="ae26ae19a78399830dfb448134ed0f48ceb80ed6c454afd8b06c3f77cca37346" Jun 08 21:12:17.392053 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.392032 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae26ae19a78399830dfb448134ed0f48ceb80ed6c454afd8b06c3f77cca37346"} err="failed to get container status \"ae26ae19a78399830dfb448134ed0f48ceb80ed6c454afd8b06c3f77cca37346\": rpc error: code = NotFound desc = could not find container \"ae26ae19a78399830dfb448134ed0f48ceb80ed6c454afd8b06c3f77cca37346\": container with ID starting with ae26ae19a78399830dfb448134ed0f48ceb80ed6c454afd8b06c3f77cca37346 not found: ID does not exist" Jun 08 21:12:17.392090 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.392055 2564 scope.go:117] "RemoveContainer" containerID="c4ec296dee7f528ffabc76f3cdbc0880edbcaddc6965a5c61e06f844ab79bdc9" Jun 08 21:12:17.392296 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.392260 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4ec296dee7f528ffabc76f3cdbc0880edbcaddc6965a5c61e06f844ab79bdc9"} err="failed to get container status \"c4ec296dee7f528ffabc76f3cdbc0880edbcaddc6965a5c61e06f844ab79bdc9\": rpc error: code = NotFound desc = could not find container \"c4ec296dee7f528ffabc76f3cdbc0880edbcaddc6965a5c61e06f844ab79bdc9\": container with ID starting with c4ec296dee7f528ffabc76f3cdbc0880edbcaddc6965a5c61e06f844ab79bdc9 not found: ID does not exist" Jun 08 21:12:17.392340 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.392297 2564 scope.go:117] "RemoveContainer" containerID="01d65b503a324001c0b4017a237ccb92e556e83b8868ee2c225395b6d6597d9c" Jun 08 21:12:17.392502 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.392485 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01d65b503a324001c0b4017a237ccb92e556e83b8868ee2c225395b6d6597d9c"} err="failed to get container status \"01d65b503a324001c0b4017a237ccb92e556e83b8868ee2c225395b6d6597d9c\": rpc error: code = NotFound desc = could not find container \"01d65b503a324001c0b4017a237ccb92e556e83b8868ee2c225395b6d6597d9c\": container with ID starting with 01d65b503a324001c0b4017a237ccb92e556e83b8868ee2c225395b6d6597d9c not found: ID does not exist" Jun 08 21:12:17.392540 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.392504 2564 scope.go:117] "RemoveContainer" containerID="75ddb5df47a964535ef7d2b9d34e2d8ff63535d7d906dc62caae607e7eb72bf2" Jun 08 21:12:17.392713 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.392696 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75ddb5df47a964535ef7d2b9d34e2d8ff63535d7d906dc62caae607e7eb72bf2"} err="failed to get container status \"75ddb5df47a964535ef7d2b9d34e2d8ff63535d7d906dc62caae607e7eb72bf2\": rpc error: code = NotFound desc = could not find container \"75ddb5df47a964535ef7d2b9d34e2d8ff63535d7d906dc62caae607e7eb72bf2\": container with ID starting with 75ddb5df47a964535ef7d2b9d34e2d8ff63535d7d906dc62caae607e7eb72bf2 not found: ID does not exist" Jun 08 21:12:17.392754 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.392715 2564 scope.go:117] "RemoveContainer" containerID="25a24b13b8658a1ce9977f547747d5f8da97cddf069ab8d58e0a2278ffc226ba" Jun 08 21:12:17.392910 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.392894 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25a24b13b8658a1ce9977f547747d5f8da97cddf069ab8d58e0a2278ffc226ba"} err="failed to get container status \"25a24b13b8658a1ce9977f547747d5f8da97cddf069ab8d58e0a2278ffc226ba\": rpc error: code = NotFound desc = could not find container \"25a24b13b8658a1ce9977f547747d5f8da97cddf069ab8d58e0a2278ffc226ba\": container with ID starting with 25a24b13b8658a1ce9977f547747d5f8da97cddf069ab8d58e0a2278ffc226ba not found: ID does not exist" Jun 08 21:12:17.392950 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.392910 2564 scope.go:117] "RemoveContainer" containerID="8cf584ebcc53ab70b7f8eeed29d268bc1b7cc59a84f9f123e2ecd0fe517bdd81" Jun 08 21:12:17.393115 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.393095 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8cf584ebcc53ab70b7f8eeed29d268bc1b7cc59a84f9f123e2ecd0fe517bdd81"} err="failed to get container status \"8cf584ebcc53ab70b7f8eeed29d268bc1b7cc59a84f9f123e2ecd0fe517bdd81\": rpc error: code = NotFound desc = could not find container \"8cf584ebcc53ab70b7f8eeed29d268bc1b7cc59a84f9f123e2ecd0fe517bdd81\": container with ID starting with 8cf584ebcc53ab70b7f8eeed29d268bc1b7cc59a84f9f123e2ecd0fe517bdd81 not found: ID does not exist" Jun 08 21:12:17.393171 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.393117 2564 scope.go:117] "RemoveContainer" containerID="3284d2efd8f1af535180057e110053e605b26c476a409e7ee7c8a2c5ce70b5a6" Jun 08 21:12:17.393293 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.393260 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:12:17.393374 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.393352 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3284d2efd8f1af535180057e110053e605b26c476a409e7ee7c8a2c5ce70b5a6"} err="failed to get container status \"3284d2efd8f1af535180057e110053e605b26c476a409e7ee7c8a2c5ce70b5a6\": rpc error: code = NotFound desc = could not find container \"3284d2efd8f1af535180057e110053e605b26c476a409e7ee7c8a2c5ce70b5a6\": container with ID starting with 3284d2efd8f1af535180057e110053e605b26c476a409e7ee7c8a2c5ce70b5a6 not found: ID does not exist" Jun 08 21:12:17.393440 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.393379 2564 scope.go:117] "RemoveContainer" containerID="ae26ae19a78399830dfb448134ed0f48ceb80ed6c454afd8b06c3f77cca37346" Jun 08 21:12:17.393756 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.393613 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae26ae19a78399830dfb448134ed0f48ceb80ed6c454afd8b06c3f77cca37346"} err="failed to get container status \"ae26ae19a78399830dfb448134ed0f48ceb80ed6c454afd8b06c3f77cca37346\": rpc error: code = NotFound desc = could not find container \"ae26ae19a78399830dfb448134ed0f48ceb80ed6c454afd8b06c3f77cca37346\": container with ID starting with ae26ae19a78399830dfb448134ed0f48ceb80ed6c454afd8b06c3f77cca37346 not found: ID does not exist" Jun 08 21:12:17.393756 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.393640 2564 scope.go:117] "RemoveContainer" containerID="c4ec296dee7f528ffabc76f3cdbc0880edbcaddc6965a5c61e06f844ab79bdc9" Jun 08 21:12:17.393974 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.393952 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4ec296dee7f528ffabc76f3cdbc0880edbcaddc6965a5c61e06f844ab79bdc9"} err="failed to get container status \"c4ec296dee7f528ffabc76f3cdbc0880edbcaddc6965a5c61e06f844ab79bdc9\": rpc error: code = NotFound desc = could not find container \"c4ec296dee7f528ffabc76f3cdbc0880edbcaddc6965a5c61e06f844ab79bdc9\": container with ID starting with c4ec296dee7f528ffabc76f3cdbc0880edbcaddc6965a5c61e06f844ab79bdc9 not found: ID does not exist" Jun 08 21:12:17.393974 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.393973 2564 scope.go:117] "RemoveContainer" containerID="01d65b503a324001c0b4017a237ccb92e556e83b8868ee2c225395b6d6597d9c" Jun 08 21:12:17.394209 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.394191 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01d65b503a324001c0b4017a237ccb92e556e83b8868ee2c225395b6d6597d9c"} err="failed to get container status \"01d65b503a324001c0b4017a237ccb92e556e83b8868ee2c225395b6d6597d9c\": rpc error: code = NotFound desc = could not find container \"01d65b503a324001c0b4017a237ccb92e556e83b8868ee2c225395b6d6597d9c\": container with ID starting with 01d65b503a324001c0b4017a237ccb92e556e83b8868ee2c225395b6d6597d9c not found: ID does not exist" Jun 08 21:12:17.394209 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.394208 2564 scope.go:117] "RemoveContainer" containerID="75ddb5df47a964535ef7d2b9d34e2d8ff63535d7d906dc62caae607e7eb72bf2" Jun 08 21:12:17.394470 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.394454 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75ddb5df47a964535ef7d2b9d34e2d8ff63535d7d906dc62caae607e7eb72bf2"} err="failed to get container status \"75ddb5df47a964535ef7d2b9d34e2d8ff63535d7d906dc62caae607e7eb72bf2\": rpc error: code = NotFound desc = could not find container \"75ddb5df47a964535ef7d2b9d34e2d8ff63535d7d906dc62caae607e7eb72bf2\": container with ID starting with 75ddb5df47a964535ef7d2b9d34e2d8ff63535d7d906dc62caae607e7eb72bf2 not found: ID does not exist" Jun 08 21:12:17.394522 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.394470 2564 scope.go:117] "RemoveContainer" containerID="25a24b13b8658a1ce9977f547747d5f8da97cddf069ab8d58e0a2278ffc226ba" Jun 08 21:12:17.394679 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.394660 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25a24b13b8658a1ce9977f547747d5f8da97cddf069ab8d58e0a2278ffc226ba"} err="failed to get container status \"25a24b13b8658a1ce9977f547747d5f8da97cddf069ab8d58e0a2278ffc226ba\": rpc error: code = NotFound desc = could not find container \"25a24b13b8658a1ce9977f547747d5f8da97cddf069ab8d58e0a2278ffc226ba\": container with ID starting with 25a24b13b8658a1ce9977f547747d5f8da97cddf069ab8d58e0a2278ffc226ba not found: ID does not exist" Jun 08 21:12:17.394751 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.394685 2564 scope.go:117] "RemoveContainer" containerID="8cf584ebcc53ab70b7f8eeed29d268bc1b7cc59a84f9f123e2ecd0fe517bdd81" Jun 08 21:12:17.394930 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.394908 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8cf584ebcc53ab70b7f8eeed29d268bc1b7cc59a84f9f123e2ecd0fe517bdd81"} err="failed to get container status \"8cf584ebcc53ab70b7f8eeed29d268bc1b7cc59a84f9f123e2ecd0fe517bdd81\": rpc error: code = NotFound desc = could not find container \"8cf584ebcc53ab70b7f8eeed29d268bc1b7cc59a84f9f123e2ecd0fe517bdd81\": container with ID starting with 8cf584ebcc53ab70b7f8eeed29d268bc1b7cc59a84f9f123e2ecd0fe517bdd81 not found: ID does not exist" Jun 08 21:12:17.394971 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.394933 2564 scope.go:117] "RemoveContainer" containerID="3284d2efd8f1af535180057e110053e605b26c476a409e7ee7c8a2c5ce70b5a6" Jun 08 21:12:17.395168 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.395149 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3284d2efd8f1af535180057e110053e605b26c476a409e7ee7c8a2c5ce70b5a6"} err="failed to get container status \"3284d2efd8f1af535180057e110053e605b26c476a409e7ee7c8a2c5ce70b5a6\": rpc error: code = NotFound desc = could not find container \"3284d2efd8f1af535180057e110053e605b26c476a409e7ee7c8a2c5ce70b5a6\": container with ID starting with 3284d2efd8f1af535180057e110053e605b26c476a409e7ee7c8a2c5ce70b5a6 not found: ID does not exist" Jun 08 21:12:17.395227 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.395168 2564 scope.go:117] "RemoveContainer" containerID="ae26ae19a78399830dfb448134ed0f48ceb80ed6c454afd8b06c3f77cca37346" Jun 08 21:12:17.395446 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.395423 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae26ae19a78399830dfb448134ed0f48ceb80ed6c454afd8b06c3f77cca37346"} err="failed to get container status \"ae26ae19a78399830dfb448134ed0f48ceb80ed6c454afd8b06c3f77cca37346\": rpc error: code = NotFound desc = could not find container \"ae26ae19a78399830dfb448134ed0f48ceb80ed6c454afd8b06c3f77cca37346\": container with ID starting with ae26ae19a78399830dfb448134ed0f48ceb80ed6c454afd8b06c3f77cca37346 not found: ID does not exist" Jun 08 21:12:17.395499 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.395448 2564 scope.go:117] "RemoveContainer" containerID="c4ec296dee7f528ffabc76f3cdbc0880edbcaddc6965a5c61e06f844ab79bdc9" Jun 08 21:12:17.395733 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.395703 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4ec296dee7f528ffabc76f3cdbc0880edbcaddc6965a5c61e06f844ab79bdc9"} err="failed to get container status \"c4ec296dee7f528ffabc76f3cdbc0880edbcaddc6965a5c61e06f844ab79bdc9\": rpc error: code = NotFound desc = could not find container \"c4ec296dee7f528ffabc76f3cdbc0880edbcaddc6965a5c61e06f844ab79bdc9\": container with ID starting with c4ec296dee7f528ffabc76f3cdbc0880edbcaddc6965a5c61e06f844ab79bdc9 not found: ID does not exist" Jun 08 21:12:17.395733 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.395730 2564 scope.go:117] "RemoveContainer" containerID="01d65b503a324001c0b4017a237ccb92e556e83b8868ee2c225395b6d6597d9c" Jun 08 21:12:17.395897 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.395765 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 08 21:12:17.396062 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.396032 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01d65b503a324001c0b4017a237ccb92e556e83b8868ee2c225395b6d6597d9c"} err="failed to get container status \"01d65b503a324001c0b4017a237ccb92e556e83b8868ee2c225395b6d6597d9c\": rpc error: code = NotFound desc = could not find container \"01d65b503a324001c0b4017a237ccb92e556e83b8868ee2c225395b6d6597d9c\": container with ID starting with 01d65b503a324001c0b4017a237ccb92e556e83b8868ee2c225395b6d6597d9c not found: ID does not exist" Jun 08 21:12:17.396151 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.396063 2564 scope.go:117] "RemoveContainer" containerID="75ddb5df47a964535ef7d2b9d34e2d8ff63535d7d906dc62caae607e7eb72bf2" Jun 08 21:12:17.396151 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.396062 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 08 21:12:17.396151 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.396119 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 08 21:12:17.396296 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.396154 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-a7e87d2m06nm0\"" Jun 08 21:12:17.396296 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.396170 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 08 21:12:17.396403 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.396372 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-6vfg4\"" Jun 08 21:12:17.396494 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.396475 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75ddb5df47a964535ef7d2b9d34e2d8ff63535d7d906dc62caae607e7eb72bf2"} err="failed to get container status \"75ddb5df47a964535ef7d2b9d34e2d8ff63535d7d906dc62caae607e7eb72bf2\": rpc error: code = NotFound desc = could not find container \"75ddb5df47a964535ef7d2b9d34e2d8ff63535d7d906dc62caae607e7eb72bf2\": container with ID starting with 75ddb5df47a964535ef7d2b9d34e2d8ff63535d7d906dc62caae607e7eb72bf2 not found: ID does not exist" Jun 08 21:12:17.396548 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.396503 2564 scope.go:117] "RemoveContainer" containerID="25a24b13b8658a1ce9977f547747d5f8da97cddf069ab8d58e0a2278ffc226ba" Jun 08 21:12:17.396622 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.396605 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 08 21:12:17.396670 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.396628 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 08 21:12:17.396720 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.396680 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 08 21:12:17.396774 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.396742 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25a24b13b8658a1ce9977f547747d5f8da97cddf069ab8d58e0a2278ffc226ba"} err="failed to get container status \"25a24b13b8658a1ce9977f547747d5f8da97cddf069ab8d58e0a2278ffc226ba\": rpc error: code = NotFound desc = could not find container \"25a24b13b8658a1ce9977f547747d5f8da97cddf069ab8d58e0a2278ffc226ba\": container with ID starting with 25a24b13b8658a1ce9977f547747d5f8da97cddf069ab8d58e0a2278ffc226ba not found: ID does not exist" Jun 08 21:12:17.396774 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.396765 2564 scope.go:117] "RemoveContainer" containerID="8cf584ebcc53ab70b7f8eeed29d268bc1b7cc59a84f9f123e2ecd0fe517bdd81" Jun 08 21:12:17.396883 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.396866 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 08 21:12:17.396963 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.396946 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 08 21:12:17.397030 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.396997 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 08 21:12:17.397101 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.397077 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8cf584ebcc53ab70b7f8eeed29d268bc1b7cc59a84f9f123e2ecd0fe517bdd81"} err="failed to get container status \"8cf584ebcc53ab70b7f8eeed29d268bc1b7cc59a84f9f123e2ecd0fe517bdd81\": rpc error: code = NotFound desc = could not find container \"8cf584ebcc53ab70b7f8eeed29d268bc1b7cc59a84f9f123e2ecd0fe517bdd81\": container with ID starting with 8cf584ebcc53ab70b7f8eeed29d268bc1b7cc59a84f9f123e2ecd0fe517bdd81 not found: ID does not exist" Jun 08 21:12:17.397155 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.397103 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 08 21:12:17.397155 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.397104 2564 scope.go:117] "RemoveContainer" containerID="3284d2efd8f1af535180057e110053e605b26c476a409e7ee7c8a2c5ce70b5a6" Jun 08 21:12:17.397155 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.397131 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 08 21:12:17.397428 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.397404 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3284d2efd8f1af535180057e110053e605b26c476a409e7ee7c8a2c5ce70b5a6"} err="failed to get container status \"3284d2efd8f1af535180057e110053e605b26c476a409e7ee7c8a2c5ce70b5a6\": rpc error: code = NotFound desc = could not find container \"3284d2efd8f1af535180057e110053e605b26c476a409e7ee7c8a2c5ce70b5a6\": container with ID starting with 3284d2efd8f1af535180057e110053e605b26c476a409e7ee7c8a2c5ce70b5a6 not found: ID does not exist" Jun 08 21:12:17.397495 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.397429 2564 scope.go:117] "RemoveContainer" containerID="ae26ae19a78399830dfb448134ed0f48ceb80ed6c454afd8b06c3f77cca37346" Jun 08 21:12:17.397703 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.397614 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 08 21:12:17.397703 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.397658 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae26ae19a78399830dfb448134ed0f48ceb80ed6c454afd8b06c3f77cca37346"} err="failed to get container status \"ae26ae19a78399830dfb448134ed0f48ceb80ed6c454afd8b06c3f77cca37346\": rpc error: code = NotFound desc = could not find container \"ae26ae19a78399830dfb448134ed0f48ceb80ed6c454afd8b06c3f77cca37346\": container with ID starting with ae26ae19a78399830dfb448134ed0f48ceb80ed6c454afd8b06c3f77cca37346 not found: ID does not exist" Jun 08 21:12:17.397703 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.397685 2564 scope.go:117] "RemoveContainer" containerID="c4ec296dee7f528ffabc76f3cdbc0880edbcaddc6965a5c61e06f844ab79bdc9" Jun 08 21:12:17.398031 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.397967 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4ec296dee7f528ffabc76f3cdbc0880edbcaddc6965a5c61e06f844ab79bdc9"} err="failed to get container status \"c4ec296dee7f528ffabc76f3cdbc0880edbcaddc6965a5c61e06f844ab79bdc9\": rpc error: code = NotFound desc = could not find container \"c4ec296dee7f528ffabc76f3cdbc0880edbcaddc6965a5c61e06f844ab79bdc9\": container with ID starting with c4ec296dee7f528ffabc76f3cdbc0880edbcaddc6965a5c61e06f844ab79bdc9 not found: ID does not exist" Jun 08 21:12:17.399414 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.399394 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 08 21:12:17.401239 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.401130 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 08 21:12:17.405736 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.405715 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 21:12:17.442780 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.442751 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c525714-d79a-48df-9957-e907893153bf-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2c525714-d79a-48df-9957-e907893153bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:12:17.442933 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.442783 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2c525714-d79a-48df-9957-e907893153bf-config-out\") pod \"prometheus-k8s-0\" (UID: \"2c525714-d79a-48df-9957-e907893153bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:12:17.442933 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.442802 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2c525714-d79a-48df-9957-e907893153bf-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2c525714-d79a-48df-9957-e907893153bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:12:17.442933 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.442818 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmh9z\" (UniqueName: \"kubernetes.io/projected/2c525714-d79a-48df-9957-e907893153bf-kube-api-access-qmh9z\") pod \"prometheus-k8s-0\" (UID: \"2c525714-d79a-48df-9957-e907893153bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:12:17.442933 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.442835 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2c525714-d79a-48df-9957-e907893153bf-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2c525714-d79a-48df-9957-e907893153bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:12:17.442933 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.442875 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2c525714-d79a-48df-9957-e907893153bf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2c525714-d79a-48df-9957-e907893153bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:12:17.443134 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.442992 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2c525714-d79a-48df-9957-e907893153bf-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2c525714-d79a-48df-9957-e907893153bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:12:17.443134 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.443029 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2c525714-d79a-48df-9957-e907893153bf-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2c525714-d79a-48df-9957-e907893153bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:12:17.443134 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.443053 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2c525714-d79a-48df-9957-e907893153bf-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2c525714-d79a-48df-9957-e907893153bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:12:17.443134 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.443073 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2c525714-d79a-48df-9957-e907893153bf-config\") pod \"prometheus-k8s-0\" (UID: \"2c525714-d79a-48df-9957-e907893153bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:12:17.443134 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.443097 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c525714-d79a-48df-9957-e907893153bf-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2c525714-d79a-48df-9957-e907893153bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:12:17.443134 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.443117 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2c525714-d79a-48df-9957-e907893153bf-web-config\") pod \"prometheus-k8s-0\" (UID: \"2c525714-d79a-48df-9957-e907893153bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:12:17.443366 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.443137 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c525714-d79a-48df-9957-e907893153bf-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2c525714-d79a-48df-9957-e907893153bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:12:17.443366 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.443167 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2c525714-d79a-48df-9957-e907893153bf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2c525714-d79a-48df-9957-e907893153bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:12:17.443366 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.443182 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2c525714-d79a-48df-9957-e907893153bf-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2c525714-d79a-48df-9957-e907893153bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:12:17.443366 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.443212 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2c525714-d79a-48df-9957-e907893153bf-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2c525714-d79a-48df-9957-e907893153bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:12:17.443366 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.443245 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c525714-d79a-48df-9957-e907893153bf-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2c525714-d79a-48df-9957-e907893153bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:12:17.443366 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.443294 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2c525714-d79a-48df-9957-e907893153bf-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2c525714-d79a-48df-9957-e907893153bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:12:17.443366 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.443312 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2c525714-d79a-48df-9957-e907893153bf-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2c525714-d79a-48df-9957-e907893153bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:12:17.443366 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.443338 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2c525714-d79a-48df-9957-e907893153bf-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2c525714-d79a-48df-9957-e907893153bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:12:17.544431 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.544392 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c525714-d79a-48df-9957-e907893153bf-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2c525714-d79a-48df-9957-e907893153bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:12:17.544431 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.544436 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2c525714-d79a-48df-9957-e907893153bf-config-out\") pod \"prometheus-k8s-0\" (UID: \"2c525714-d79a-48df-9957-e907893153bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:12:17.544666 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.544462 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2c525714-d79a-48df-9957-e907893153bf-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2c525714-d79a-48df-9957-e907893153bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:12:17.544666 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.544580 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmh9z\" (UniqueName: \"kubernetes.io/projected/2c525714-d79a-48df-9957-e907893153bf-kube-api-access-qmh9z\") pod \"prometheus-k8s-0\" (UID: \"2c525714-d79a-48df-9957-e907893153bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:12:17.544666 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.544610 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2c525714-d79a-48df-9957-e907893153bf-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2c525714-d79a-48df-9957-e907893153bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:12:17.544666 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.544634 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2c525714-d79a-48df-9957-e907893153bf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2c525714-d79a-48df-9957-e907893153bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:12:17.544858 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.544692 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2c525714-d79a-48df-9957-e907893153bf-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2c525714-d79a-48df-9957-e907893153bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:12:17.544858 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.544723 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2c525714-d79a-48df-9957-e907893153bf-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2c525714-d79a-48df-9957-e907893153bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:12:17.544858 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.544752 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2c525714-d79a-48df-9957-e907893153bf-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2c525714-d79a-48df-9957-e907893153bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:12:17.544858 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.544783 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2c525714-d79a-48df-9957-e907893153bf-config\") pod \"prometheus-k8s-0\" (UID: \"2c525714-d79a-48df-9957-e907893153bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:12:17.544858 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.544838 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c525714-d79a-48df-9957-e907893153bf-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2c525714-d79a-48df-9957-e907893153bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:12:17.545095 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.544868 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2c525714-d79a-48df-9957-e907893153bf-web-config\") pod \"prometheus-k8s-0\" (UID: \"2c525714-d79a-48df-9957-e907893153bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:12:17.545095 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.544890 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c525714-d79a-48df-9957-e907893153bf-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2c525714-d79a-48df-9957-e907893153bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:12:17.545095 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.544945 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2c525714-d79a-48df-9957-e907893153bf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2c525714-d79a-48df-9957-e907893153bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:12:17.545095 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.544971 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2c525714-d79a-48df-9957-e907893153bf-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2c525714-d79a-48df-9957-e907893153bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:12:17.545095 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.544999 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2c525714-d79a-48df-9957-e907893153bf-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2c525714-d79a-48df-9957-e907893153bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:12:17.545095 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.545031 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c525714-d79a-48df-9957-e907893153bf-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2c525714-d79a-48df-9957-e907893153bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:12:17.545095 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.545080 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2c525714-d79a-48df-9957-e907893153bf-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2c525714-d79a-48df-9957-e907893153bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:12:17.545446 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.545110 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2c525714-d79a-48df-9957-e907893153bf-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2c525714-d79a-48df-9957-e907893153bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:12:17.545446 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.545149 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2c525714-d79a-48df-9957-e907893153bf-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2c525714-d79a-48df-9957-e907893153bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:12:17.545446 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.545359 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c525714-d79a-48df-9957-e907893153bf-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2c525714-d79a-48df-9957-e907893153bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:12:17.545709 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.545687 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2c525714-d79a-48df-9957-e907893153bf-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2c525714-d79a-48df-9957-e907893153bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:12:17.549112 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.546349 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c525714-d79a-48df-9957-e907893153bf-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2c525714-d79a-48df-9957-e907893153bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:12:17.549112 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.547300 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2c525714-d79a-48df-9957-e907893153bf-config-out\") pod \"prometheus-k8s-0\" (UID: \"2c525714-d79a-48df-9957-e907893153bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:12:17.549112 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.547845 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2c525714-d79a-48df-9957-e907893153bf-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2c525714-d79a-48df-9957-e907893153bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:12:17.549112 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.547865 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2c525714-d79a-48df-9957-e907893153bf-web-config\") pod \"prometheus-k8s-0\" (UID: \"2c525714-d79a-48df-9957-e907893153bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:12:17.549112 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.548204 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2c525714-d79a-48df-9957-e907893153bf-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2c525714-d79a-48df-9957-e907893153bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:12:17.549112 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.548372 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2c525714-d79a-48df-9957-e907893153bf-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2c525714-d79a-48df-9957-e907893153bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:12:17.549112 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.548408 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2c525714-d79a-48df-9957-e907893153bf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2c525714-d79a-48df-9957-e907893153bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:12:17.549112 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.548637 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2c525714-d79a-48df-9957-e907893153bf-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2c525714-d79a-48df-9957-e907893153bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:12:17.549112 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.548947 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2c525714-d79a-48df-9957-e907893153bf-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2c525714-d79a-48df-9957-e907893153bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:12:17.549112 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.549052 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c525714-d79a-48df-9957-e907893153bf-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2c525714-d79a-48df-9957-e907893153bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:12:17.549112 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.549054 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c525714-d79a-48df-9957-e907893153bf-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2c525714-d79a-48df-9957-e907893153bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:12:17.549741 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.549178 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2c525714-d79a-48df-9957-e907893153bf-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2c525714-d79a-48df-9957-e907893153bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:12:17.549874 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.549853 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2c525714-d79a-48df-9957-e907893153bf-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2c525714-d79a-48df-9957-e907893153bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:12:17.549931 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.549856 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2c525714-d79a-48df-9957-e907893153bf-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2c525714-d79a-48df-9957-e907893153bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:12:17.550307 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.550249 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/2c525714-d79a-48df-9957-e907893153bf-config\") pod \"prometheus-k8s-0\" (UID: \"2c525714-d79a-48df-9957-e907893153bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:12:17.550735 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.550709 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2c525714-d79a-48df-9957-e907893153bf-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2c525714-d79a-48df-9957-e907893153bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:12:17.551007 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.550990 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2c525714-d79a-48df-9957-e907893153bf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2c525714-d79a-48df-9957-e907893153bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:12:17.554190 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.554174 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmh9z\" (UniqueName: \"kubernetes.io/projected/2c525714-d79a-48df-9957-e907893153bf-kube-api-access-qmh9z\") pod \"prometheus-k8s-0\" (UID: \"2c525714-d79a-48df-9957-e907893153bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:12:17.703799 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.703705 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:12:17.841216 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:17.841183 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 21:12:17.844708 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:12:17.844682 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c525714_d79a_48df_9957_e907893153bf.slice/crio-3b297467ee362779ae9300c6f49e31f27c2d4b97739a5c6318ffdb1aaeaab5e5 WatchSource:0}: Error finding container 3b297467ee362779ae9300c6f49e31f27c2d4b97739a5c6318ffdb1aaeaab5e5: Status 404 returned error can't find the container with id 3b297467ee362779ae9300c6f49e31f27c2d4b97739a5c6318ffdb1aaeaab5e5 Jun 08 21:12:18.340602 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:18.340567 2564 generic.go:356] "Generic (PLEG): container finished" podID="2c525714-d79a-48df-9957-e907893153bf" containerID="9e16bb3759916dbaad602cafe7027c7c4491ce1e47a091ec0d6e103a1f5e1cde" exitCode=0 Jun 08 21:12:18.340771 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:18.340659 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2c525714-d79a-48df-9957-e907893153bf","Type":"ContainerDied","Data":"9e16bb3759916dbaad602cafe7027c7c4491ce1e47a091ec0d6e103a1f5e1cde"} Jun 08 21:12:18.340835 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:18.340778 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2c525714-d79a-48df-9957-e907893153bf","Type":"ContainerStarted","Data":"3b297467ee362779ae9300c6f49e31f27c2d4b97739a5c6318ffdb1aaeaab5e5"} Jun 08 21:12:19.081596 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:19.081571 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pt842_85a49d6e-acdf-43ce-b9c9-1c2d7773a948/ovn-acl-logging/0.log" Jun 08 21:12:19.084541 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:19.084522 2564 kubelet.go:1648] "Image garbage collection succeeded" Jun 08 21:12:19.090585 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:19.090565 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pt842_85a49d6e-acdf-43ce-b9c9-1c2d7773a948/ovn-acl-logging/0.log" Jun 08 21:12:19.137299 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:19.137114 2564 scope.go:117] "RemoveContainer" containerID="f5176409d79879b40bf0885bc2894aa94e890d54f571f3ed59bd7ea697be9fa8" Jun 08 21:12:19.137299 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:19.137250 2564 scope.go:117] "RemoveContainer" containerID="6a3e881a3513bd83ff20ef50f94bbade42d994c9cab9c53990949fc7a679f9f9" Jun 08 21:12:19.163102 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:19.141369 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06e97739-e035-48bc-8e8e-dd4fbf506403" path="/var/lib/kubelet/pods/06e97739-e035-48bc-8e8e-dd4fbf506403/volumes" Jun 08 21:12:19.347876 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:19.347841 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-869c6946f9-8j5qm" event={"ID":"1a7da038-4c3b-4c5d-8e0c-264f1e4ae524","Type":"ContainerStarted","Data":"ec505d1e5221b5c757b202fd6212a3036090cc81ea071f49e9606793f27e41bd"} Jun 08 21:12:19.348255 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:19.348228 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-869c6946f9-8j5qm" Jun 08 21:12:19.349988 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:19.349968 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-869c6946f9-8j5qm" Jun 08 21:12:19.351643 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:19.351613 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2c525714-d79a-48df-9957-e907893153bf","Type":"ContainerStarted","Data":"71a18e3a99d6e1c9e799f1445de652d28c56343d86c05463c6347f9520b88783"} Jun 08 21:12:19.351764 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:19.351685 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2c525714-d79a-48df-9957-e907893153bf","Type":"ContainerStarted","Data":"52f6293b333fe24862d96928d208669f7ddd3854d7f49664dfc27e5da8b0af21"} Jun 08 21:12:19.351764 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:19.351735 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2c525714-d79a-48df-9957-e907893153bf","Type":"ContainerStarted","Data":"2313e8c56556ff183e171c582a8b84a7e87b59525ec4a011775949f542f62da9"} Jun 08 21:12:19.351877 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:19.351775 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2c525714-d79a-48df-9957-e907893153bf","Type":"ContainerStarted","Data":"9d2540bb50b592e4e176e222d2bab1204330d589f52d2586a98a7886d991862b"} Jun 08 21:12:19.351877 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:19.351813 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2c525714-d79a-48df-9957-e907893153bf","Type":"ContainerStarted","Data":"a6c7850b7bd8d6e7d932f537e4f3efa553a46a405d966fa05166a7e2de79188d"} Jun 08 21:12:19.351877 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:19.351851 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2c525714-d79a-48df-9957-e907893153bf","Type":"ContainerStarted","Data":"908648d5b0116c7f656170a909db356aafdabd7bda68279d2beb99bbeb42e0bf"} Jun 08 21:12:19.353487 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:19.353460 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65c64495c4-lncnv" event={"ID":"bdc4cee1-7a29-486d-9d64-6806f3cdc70b","Type":"ContainerStarted","Data":"b00c802dde48e42786fb90f2e98cd71b0b6040a484dea1226faa20e7aaea6600"} Jun 08 21:12:19.408024 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:19.407962 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.388411489 podStartE2EDuration="2.407945289s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.5338ms" isStatefulPod=false podCreationTimestamp="2026-06-08 21:12:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:12:19.405760767 +0000 UTC m=+300.663437142" watchObservedRunningTime="2026-06-08 21:12:19.407945289 +0000 UTC m=+300.665621663" Jun 08 21:12:22.704857 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:12:22.704818 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:13:17.704506 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:13:17.704412 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:13:17.720074 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:13:17.720046 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:13:18.572819 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:13:18.572792 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 21:15:43.625111 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:15:43.623189 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-598c8c4df5-pskbn"] Jun 08 21:15:43.628195 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:15:43.628168 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-598c8c4df5-pskbn" Jun 08 21:15:43.631360 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:15:43.631338 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 08 21:15:43.631596 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:15:43.631578 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 08 21:15:43.631705 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:15:43.631687 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 08 21:15:43.631769 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:15:43.631749 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-c2vnm\"" Jun 08 21:15:43.632020 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:15:43.632006 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 08 21:15:43.641144 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:15:43.641123 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-598c8c4df5-pskbn"] Jun 08 21:15:43.754963 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:15:43.754927 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c2ebb161-313b-4e21-8a3f-e8b8c4b33fa4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-598c8c4df5-pskbn\" (UID: \"c2ebb161-313b-4e21-8a3f-e8b8c4b33fa4\") " pod="opendatahub/opendatahub-operator-controller-manager-598c8c4df5-pskbn" Jun 08 21:15:43.755155 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:15:43.754973 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8j9s\" (UniqueName: \"kubernetes.io/projected/c2ebb161-313b-4e21-8a3f-e8b8c4b33fa4-kube-api-access-f8j9s\") pod \"opendatahub-operator-controller-manager-598c8c4df5-pskbn\" (UID: \"c2ebb161-313b-4e21-8a3f-e8b8c4b33fa4\") " pod="opendatahub/opendatahub-operator-controller-manager-598c8c4df5-pskbn" Jun 08 21:15:43.755155 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:15:43.754995 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c2ebb161-313b-4e21-8a3f-e8b8c4b33fa4-manifests\") pod \"opendatahub-operator-controller-manager-598c8c4df5-pskbn\" (UID: \"c2ebb161-313b-4e21-8a3f-e8b8c4b33fa4\") " pod="opendatahub/opendatahub-operator-controller-manager-598c8c4df5-pskbn" Jun 08 21:15:43.755155 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:15:43.755012 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c2ebb161-313b-4e21-8a3f-e8b8c4b33fa4-tmp\") pod \"opendatahub-operator-controller-manager-598c8c4df5-pskbn\" (UID: \"c2ebb161-313b-4e21-8a3f-e8b8c4b33fa4\") " pod="opendatahub/opendatahub-operator-controller-manager-598c8c4df5-pskbn" Jun 08 21:15:43.755155 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:15:43.755083 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c2ebb161-313b-4e21-8a3f-e8b8c4b33fa4-webhook-cert\") pod \"opendatahub-operator-controller-manager-598c8c4df5-pskbn\" (UID: \"c2ebb161-313b-4e21-8a3f-e8b8c4b33fa4\") " pod="opendatahub/opendatahub-operator-controller-manager-598c8c4df5-pskbn" Jun 08 21:15:43.855638 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:15:43.855595 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8j9s\" (UniqueName: \"kubernetes.io/projected/c2ebb161-313b-4e21-8a3f-e8b8c4b33fa4-kube-api-access-f8j9s\") pod \"opendatahub-operator-controller-manager-598c8c4df5-pskbn\" (UID: \"c2ebb161-313b-4e21-8a3f-e8b8c4b33fa4\") " pod="opendatahub/opendatahub-operator-controller-manager-598c8c4df5-pskbn" Jun 08 21:15:43.855638 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:15:43.855638 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c2ebb161-313b-4e21-8a3f-e8b8c4b33fa4-manifests\") pod \"opendatahub-operator-controller-manager-598c8c4df5-pskbn\" (UID: \"c2ebb161-313b-4e21-8a3f-e8b8c4b33fa4\") " pod="opendatahub/opendatahub-operator-controller-manager-598c8c4df5-pskbn" Jun 08 21:15:43.855868 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:15:43.855656 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c2ebb161-313b-4e21-8a3f-e8b8c4b33fa4-tmp\") pod \"opendatahub-operator-controller-manager-598c8c4df5-pskbn\" (UID: \"c2ebb161-313b-4e21-8a3f-e8b8c4b33fa4\") " pod="opendatahub/opendatahub-operator-controller-manager-598c8c4df5-pskbn" Jun 08 21:15:43.855868 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:15:43.855784 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c2ebb161-313b-4e21-8a3f-e8b8c4b33fa4-webhook-cert\") pod \"opendatahub-operator-controller-manager-598c8c4df5-pskbn\" (UID: \"c2ebb161-313b-4e21-8a3f-e8b8c4b33fa4\") " pod="opendatahub/opendatahub-operator-controller-manager-598c8c4df5-pskbn" Jun 08 21:15:43.855973 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:15:43.855916 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c2ebb161-313b-4e21-8a3f-e8b8c4b33fa4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-598c8c4df5-pskbn\" (UID: \"c2ebb161-313b-4e21-8a3f-e8b8c4b33fa4\") " pod="opendatahub/opendatahub-operator-controller-manager-598c8c4df5-pskbn" Jun 08 21:15:43.856093 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:15:43.856069 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c2ebb161-313b-4e21-8a3f-e8b8c4b33fa4-manifests\") pod \"opendatahub-operator-controller-manager-598c8c4df5-pskbn\" (UID: \"c2ebb161-313b-4e21-8a3f-e8b8c4b33fa4\") " pod="opendatahub/opendatahub-operator-controller-manager-598c8c4df5-pskbn" Jun 08 21:15:43.857848 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:15:43.857824 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c2ebb161-313b-4e21-8a3f-e8b8c4b33fa4-tmp\") pod \"opendatahub-operator-controller-manager-598c8c4df5-pskbn\" (UID: \"c2ebb161-313b-4e21-8a3f-e8b8c4b33fa4\") " pod="opendatahub/opendatahub-operator-controller-manager-598c8c4df5-pskbn" Jun 08 21:15:43.858128 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:15:43.858108 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c2ebb161-313b-4e21-8a3f-e8b8c4b33fa4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-598c8c4df5-pskbn\" (UID: \"c2ebb161-313b-4e21-8a3f-e8b8c4b33fa4\") " pod="opendatahub/opendatahub-operator-controller-manager-598c8c4df5-pskbn" Jun 08 21:15:43.858200 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:15:43.858152 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c2ebb161-313b-4e21-8a3f-e8b8c4b33fa4-webhook-cert\") pod \"opendatahub-operator-controller-manager-598c8c4df5-pskbn\" (UID: \"c2ebb161-313b-4e21-8a3f-e8b8c4b33fa4\") " pod="opendatahub/opendatahub-operator-controller-manager-598c8c4df5-pskbn" Jun 08 21:15:43.866889 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:15:43.866866 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8j9s\" (UniqueName: \"kubernetes.io/projected/c2ebb161-313b-4e21-8a3f-e8b8c4b33fa4-kube-api-access-f8j9s\") pod \"opendatahub-operator-controller-manager-598c8c4df5-pskbn\" (UID: \"c2ebb161-313b-4e21-8a3f-e8b8c4b33fa4\") " pod="opendatahub/opendatahub-operator-controller-manager-598c8c4df5-pskbn" Jun 08 21:15:43.937923 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:15:43.937845 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-598c8c4df5-pskbn" Jun 08 21:15:44.072480 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:15:44.072167 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-598c8c4df5-pskbn"] Jun 08 21:15:44.075087 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:15:44.075059 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2ebb161_313b_4e21_8a3f_e8b8c4b33fa4.slice/crio-8184c4dc04bd18bc40a82ec30c7e14e497768652a0b6649f1cafaaf8e334f4d0 WatchSource:0}: Error finding container 8184c4dc04bd18bc40a82ec30c7e14e497768652a0b6649f1cafaaf8e334f4d0: Status 404 returned error can't find the container with id 8184c4dc04bd18bc40a82ec30c7e14e497768652a0b6649f1cafaaf8e334f4d0 Jun 08 21:15:44.076701 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:15:44.076683 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 21:15:45.069340 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:15:45.069243 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-598c8c4df5-pskbn" event={"ID":"c2ebb161-313b-4e21-8a3f-e8b8c4b33fa4","Type":"ContainerStarted","Data":"8184c4dc04bd18bc40a82ec30c7e14e497768652a0b6649f1cafaaf8e334f4d0"} Jun 08 21:15:47.078728 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:15:47.078684 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-598c8c4df5-pskbn" event={"ID":"c2ebb161-313b-4e21-8a3f-e8b8c4b33fa4","Type":"ContainerStarted","Data":"271f0c00d114313406738380b2f1ea09031b3b1f859bb137613a9e414be1122d"} Jun 08 21:15:48.084068 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:15:48.084034 2564 generic.go:356] "Generic (PLEG): container finished" podID="c2ebb161-313b-4e21-8a3f-e8b8c4b33fa4" containerID="271f0c00d114313406738380b2f1ea09031b3b1f859bb137613a9e414be1122d" exitCode=0 Jun 08 21:15:48.084457 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:15:48.084090 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-598c8c4df5-pskbn" event={"ID":"c2ebb161-313b-4e21-8a3f-e8b8c4b33fa4","Type":"ContainerDied","Data":"271f0c00d114313406738380b2f1ea09031b3b1f859bb137613a9e414be1122d"} Jun 08 21:15:49.089900 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:15:49.089867 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-598c8c4df5-pskbn" event={"ID":"c2ebb161-313b-4e21-8a3f-e8b8c4b33fa4","Type":"ContainerStarted","Data":"e0808c54d20a12f400eb6d5bc25a9ec761758f3c12d1495ef7ff4c4579c02297"} Jun 08 21:15:49.090375 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:15:49.089980 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-598c8c4df5-pskbn" Jun 08 21:15:49.111536 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:15:49.111484 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-598c8c4df5-pskbn" podStartSLOduration=2.034608499 podStartE2EDuration="6.111465955s" totalImagesPullingTime="3.082978643s" totalInitContainerRuntime="993.878813ms" isStatefulPod=false podCreationTimestamp="2026-06-08 21:15:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:15:49.110433193 +0000 UTC m=+510.368109581" watchObservedRunningTime="2026-06-08 21:15:49.111465955 +0000 UTC m=+510.369142331" Jun 08 21:16:00.095157 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:00.095121 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-598c8c4df5-pskbn" Jun 08 21:16:05.214904 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:05.214872 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-58c984cbf9-c9thn"] Jun 08 21:16:05.225638 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:05.225608 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-58c984cbf9-c9thn" Jun 08 21:16:05.226209 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:05.226177 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-58c984cbf9-c9thn"] Jun 08 21:16:05.228161 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:05.228131 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 08 21:16:05.228287 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:05.228247 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 08 21:16:05.228394 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:05.228368 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 08 21:16:05.229350 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:05.229328 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-v9z76\"" Jun 08 21:16:05.229350 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:05.229345 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 08 21:16:05.312258 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:05.312223 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-vx7rs"] Jun 08 21:16:05.315769 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:05.315749 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-vx7rs" Jun 08 21:16:05.318356 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:05.318333 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 08 21:16:05.318479 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:05.318333 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-97d2q\"" Jun 08 21:16:05.321902 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:05.321874 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-vx7rs"] Jun 08 21:16:05.342999 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:05.342970 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67s26\" (UniqueName: \"kubernetes.io/projected/639b9953-6cf4-4a88-8528-0591da47579f-kube-api-access-67s26\") pod \"kube-auth-proxy-58c984cbf9-c9thn\" (UID: \"639b9953-6cf4-4a88-8528-0591da47579f\") " pod="openshift-ingress/kube-auth-proxy-58c984cbf9-c9thn" Jun 08 21:16:05.343150 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:05.343027 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/639b9953-6cf4-4a88-8528-0591da47579f-tls-certs\") pod \"kube-auth-proxy-58c984cbf9-c9thn\" (UID: \"639b9953-6cf4-4a88-8528-0591da47579f\") " pod="openshift-ingress/kube-auth-proxy-58c984cbf9-c9thn" Jun 08 21:16:05.343150 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:05.343089 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/639b9953-6cf4-4a88-8528-0591da47579f-tmp\") pod \"kube-auth-proxy-58c984cbf9-c9thn\" (UID: \"639b9953-6cf4-4a88-8528-0591da47579f\") " pod="openshift-ingress/kube-auth-proxy-58c984cbf9-c9thn" Jun 08 21:16:05.444496 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:05.444463 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a77b5ad6-2f5e-490c-8e4a-86bcfee473d0-cert\") pod \"odh-model-controller-6dc94f689f-vx7rs\" (UID: \"a77b5ad6-2f5e-490c-8e4a-86bcfee473d0\") " pod="opendatahub/odh-model-controller-6dc94f689f-vx7rs" Jun 08 21:16:05.444685 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:05.444505 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6hv6\" (UniqueName: \"kubernetes.io/projected/a77b5ad6-2f5e-490c-8e4a-86bcfee473d0-kube-api-access-m6hv6\") pod \"odh-model-controller-6dc94f689f-vx7rs\" (UID: \"a77b5ad6-2f5e-490c-8e4a-86bcfee473d0\") " pod="opendatahub/odh-model-controller-6dc94f689f-vx7rs" Jun 08 21:16:05.444685 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:05.444537 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67s26\" (UniqueName: \"kubernetes.io/projected/639b9953-6cf4-4a88-8528-0591da47579f-kube-api-access-67s26\") pod \"kube-auth-proxy-58c984cbf9-c9thn\" (UID: \"639b9953-6cf4-4a88-8528-0591da47579f\") " pod="openshift-ingress/kube-auth-proxy-58c984cbf9-c9thn" Jun 08 21:16:05.444685 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:05.444587 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/639b9953-6cf4-4a88-8528-0591da47579f-tls-certs\") pod \"kube-auth-proxy-58c984cbf9-c9thn\" (UID: \"639b9953-6cf4-4a88-8528-0591da47579f\") " pod="openshift-ingress/kube-auth-proxy-58c984cbf9-c9thn" Jun 08 21:16:05.444685 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:05.444634 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/639b9953-6cf4-4a88-8528-0591da47579f-tmp\") pod \"kube-auth-proxy-58c984cbf9-c9thn\" (UID: \"639b9953-6cf4-4a88-8528-0591da47579f\") " pod="openshift-ingress/kube-auth-proxy-58c984cbf9-c9thn" Jun 08 21:16:05.447031 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:05.447001 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/639b9953-6cf4-4a88-8528-0591da47579f-tmp\") pod \"kube-auth-proxy-58c984cbf9-c9thn\" (UID: \"639b9953-6cf4-4a88-8528-0591da47579f\") " pod="openshift-ingress/kube-auth-proxy-58c984cbf9-c9thn" Jun 08 21:16:05.447476 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:05.447455 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/639b9953-6cf4-4a88-8528-0591da47579f-tls-certs\") pod \"kube-auth-proxy-58c984cbf9-c9thn\" (UID: \"639b9953-6cf4-4a88-8528-0591da47579f\") " pod="openshift-ingress/kube-auth-proxy-58c984cbf9-c9thn" Jun 08 21:16:05.453283 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:05.453239 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-67s26\" (UniqueName: \"kubernetes.io/projected/639b9953-6cf4-4a88-8528-0591da47579f-kube-api-access-67s26\") pod \"kube-auth-proxy-58c984cbf9-c9thn\" (UID: \"639b9953-6cf4-4a88-8528-0591da47579f\") " pod="openshift-ingress/kube-auth-proxy-58c984cbf9-c9thn" Jun 08 21:16:05.537450 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:05.537370 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-58c984cbf9-c9thn" Jun 08 21:16:05.545821 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:05.545793 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a77b5ad6-2f5e-490c-8e4a-86bcfee473d0-cert\") pod \"odh-model-controller-6dc94f689f-vx7rs\" (UID: \"a77b5ad6-2f5e-490c-8e4a-86bcfee473d0\") " pod="opendatahub/odh-model-controller-6dc94f689f-vx7rs" Jun 08 21:16:05.545945 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:05.545847 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6hv6\" (UniqueName: \"kubernetes.io/projected/a77b5ad6-2f5e-490c-8e4a-86bcfee473d0-kube-api-access-m6hv6\") pod \"odh-model-controller-6dc94f689f-vx7rs\" (UID: \"a77b5ad6-2f5e-490c-8e4a-86bcfee473d0\") " pod="opendatahub/odh-model-controller-6dc94f689f-vx7rs" Jun 08 21:16:05.546012 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:16:05.545962 2564 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 08 21:16:05.546063 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:16:05.546056 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a77b5ad6-2f5e-490c-8e4a-86bcfee473d0-cert podName:a77b5ad6-2f5e-490c-8e4a-86bcfee473d0 nodeName:}" failed. No retries permitted until 2026-06-08 21:16:06.046031731 +0000 UTC m=+527.303708098 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a77b5ad6-2f5e-490c-8e4a-86bcfee473d0-cert") pod "odh-model-controller-6dc94f689f-vx7rs" (UID: "a77b5ad6-2f5e-490c-8e4a-86bcfee473d0") : secret "odh-model-controller-webhook-cert" not found Jun 08 21:16:05.554714 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:05.554669 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6hv6\" (UniqueName: \"kubernetes.io/projected/a77b5ad6-2f5e-490c-8e4a-86bcfee473d0-kube-api-access-m6hv6\") pod \"odh-model-controller-6dc94f689f-vx7rs\" (UID: \"a77b5ad6-2f5e-490c-8e4a-86bcfee473d0\") " pod="opendatahub/odh-model-controller-6dc94f689f-vx7rs" Jun 08 21:16:05.668744 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:05.668710 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-58c984cbf9-c9thn"] Jun 08 21:16:05.671559 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:16:05.671535 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod639b9953_6cf4_4a88_8528_0591da47579f.slice/crio-0696a7d3e6f98388c4d90e3a3b51a7f30555ee052b6e4a8697cc07ba75fcbe17 WatchSource:0}: Error finding container 0696a7d3e6f98388c4d90e3a3b51a7f30555ee052b6e4a8697cc07ba75fcbe17: Status 404 returned error can't find the container with id 0696a7d3e6f98388c4d90e3a3b51a7f30555ee052b6e4a8697cc07ba75fcbe17 Jun 08 21:16:05.966561 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:05.966516 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-6hnmd"] Jun 08 21:16:05.971002 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:05.970980 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-6hnmd" Jun 08 21:16:05.974161 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:05.974138 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 08 21:16:05.974330 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:05.974177 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-ch98f\"" Jun 08 21:16:05.981687 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:05.981649 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-6hnmd"] Jun 08 21:16:06.051628 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:06.051594 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a77b5ad6-2f5e-490c-8e4a-86bcfee473d0-cert\") pod \"odh-model-controller-6dc94f689f-vx7rs\" (UID: \"a77b5ad6-2f5e-490c-8e4a-86bcfee473d0\") " pod="opendatahub/odh-model-controller-6dc94f689f-vx7rs" Jun 08 21:16:06.054298 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:06.054255 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a77b5ad6-2f5e-490c-8e4a-86bcfee473d0-cert\") pod \"odh-model-controller-6dc94f689f-vx7rs\" (UID: \"a77b5ad6-2f5e-490c-8e4a-86bcfee473d0\") " pod="opendatahub/odh-model-controller-6dc94f689f-vx7rs" Jun 08 21:16:06.152013 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:06.151978 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/361593ae-f855-4f44-8481-9fb11492bc51-tls-certs\") pod \"model-serving-api-5dd488fc48-6hnmd\" (UID: \"361593ae-f855-4f44-8481-9fb11492bc51\") " pod="opendatahub/model-serving-api-5dd488fc48-6hnmd" Jun 08 21:16:06.152201 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:06.152032 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cfrc\" (UniqueName: \"kubernetes.io/projected/361593ae-f855-4f44-8481-9fb11492bc51-kube-api-access-9cfrc\") pod \"model-serving-api-5dd488fc48-6hnmd\" (UID: \"361593ae-f855-4f44-8481-9fb11492bc51\") " pod="opendatahub/model-serving-api-5dd488fc48-6hnmd" Jun 08 21:16:06.152841 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:06.152815 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-58c984cbf9-c9thn" event={"ID":"639b9953-6cf4-4a88-8528-0591da47579f","Type":"ContainerStarted","Data":"0696a7d3e6f98388c4d90e3a3b51a7f30555ee052b6e4a8697cc07ba75fcbe17"} Jun 08 21:16:06.229332 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:06.229223 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-vx7rs" Jun 08 21:16:06.253489 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:06.253453 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/361593ae-f855-4f44-8481-9fb11492bc51-tls-certs\") pod \"model-serving-api-5dd488fc48-6hnmd\" (UID: \"361593ae-f855-4f44-8481-9fb11492bc51\") " pod="opendatahub/model-serving-api-5dd488fc48-6hnmd" Jun 08 21:16:06.253622 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:06.253498 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cfrc\" (UniqueName: \"kubernetes.io/projected/361593ae-f855-4f44-8481-9fb11492bc51-kube-api-access-9cfrc\") pod \"model-serving-api-5dd488fc48-6hnmd\" (UID: \"361593ae-f855-4f44-8481-9fb11492bc51\") " pod="opendatahub/model-serving-api-5dd488fc48-6hnmd" Jun 08 21:16:06.253663 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:16:06.253621 2564 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jun 08 21:16:06.253718 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:16:06.253706 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/361593ae-f855-4f44-8481-9fb11492bc51-tls-certs podName:361593ae-f855-4f44-8481-9fb11492bc51 nodeName:}" failed. No retries permitted until 2026-06-08 21:16:06.753682762 +0000 UTC m=+528.011359119 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/361593ae-f855-4f44-8481-9fb11492bc51-tls-certs") pod "model-serving-api-5dd488fc48-6hnmd" (UID: "361593ae-f855-4f44-8481-9fb11492bc51") : secret "model-serving-api-tls" not found Jun 08 21:16:06.264467 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:06.264434 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cfrc\" (UniqueName: \"kubernetes.io/projected/361593ae-f855-4f44-8481-9fb11492bc51-kube-api-access-9cfrc\") pod \"model-serving-api-5dd488fc48-6hnmd\" (UID: \"361593ae-f855-4f44-8481-9fb11492bc51\") " pod="opendatahub/model-serving-api-5dd488fc48-6hnmd" Jun 08 21:16:06.369067 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:06.369034 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-vx7rs"] Jun 08 21:16:06.371855 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:16:06.371827 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda77b5ad6_2f5e_490c_8e4a_86bcfee473d0.slice/crio-68c1a8729e2e79db37ad055a7c1a43a4b825efc9a02756c0d00755513321ad77 WatchSource:0}: Error finding container 68c1a8729e2e79db37ad055a7c1a43a4b825efc9a02756c0d00755513321ad77: Status 404 returned error can't find the container with id 68c1a8729e2e79db37ad055a7c1a43a4b825efc9a02756c0d00755513321ad77 Jun 08 21:16:06.758115 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:06.758079 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/361593ae-f855-4f44-8481-9fb11492bc51-tls-certs\") pod \"model-serving-api-5dd488fc48-6hnmd\" (UID: \"361593ae-f855-4f44-8481-9fb11492bc51\") " pod="opendatahub/model-serving-api-5dd488fc48-6hnmd" Jun 08 21:16:06.761217 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:06.761188 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/361593ae-f855-4f44-8481-9fb11492bc51-tls-certs\") pod \"model-serving-api-5dd488fc48-6hnmd\" (UID: \"361593ae-f855-4f44-8481-9fb11492bc51\") " pod="opendatahub/model-serving-api-5dd488fc48-6hnmd" Jun 08 21:16:06.882566 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:06.882529 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-6hnmd" Jun 08 21:16:07.046420 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:07.046261 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-6hnmd"] Jun 08 21:16:07.055707 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:16:07.055665 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod361593ae_f855_4f44_8481_9fb11492bc51.slice/crio-a9b3a33fe90d1850b351d0900a91d836a5ac11dfb7aed9dc4243d22454647b16 WatchSource:0}: Error finding container a9b3a33fe90d1850b351d0900a91d836a5ac11dfb7aed9dc4243d22454647b16: Status 404 returned error can't find the container with id a9b3a33fe90d1850b351d0900a91d836a5ac11dfb7aed9dc4243d22454647b16 Jun 08 21:16:07.162076 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:07.162035 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-6hnmd" event={"ID":"361593ae-f855-4f44-8481-9fb11492bc51","Type":"ContainerStarted","Data":"a9b3a33fe90d1850b351d0900a91d836a5ac11dfb7aed9dc4243d22454647b16"} Jun 08 21:16:07.164494 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:07.164458 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-vx7rs" event={"ID":"a77b5ad6-2f5e-490c-8e4a-86bcfee473d0","Type":"ContainerStarted","Data":"68c1a8729e2e79db37ad055a7c1a43a4b825efc9a02756c0d00755513321ad77"} Jun 08 21:16:11.184419 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:11.184381 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-58c984cbf9-c9thn" event={"ID":"639b9953-6cf4-4a88-8528-0591da47579f","Type":"ContainerStarted","Data":"8d200766504e3cbbe2897568fde8f4df031617d3b34655776fd4ba0b3fa7ecc1"} Jun 08 21:16:11.185926 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:11.185891 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-6hnmd" event={"ID":"361593ae-f855-4f44-8481-9fb11492bc51","Type":"ContainerStarted","Data":"f64a5e8129ef2a5358d2742757fd7658567f5cc98876fd198b66a8bbdc4ac6ac"} Jun 08 21:16:11.186076 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:11.185975 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-6hnmd" Jun 08 21:16:11.187347 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:11.187314 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-vx7rs" event={"ID":"a77b5ad6-2f5e-490c-8e4a-86bcfee473d0","Type":"ContainerStarted","Data":"2115940f4af8741ecef3e820a2ae00bcab37a8cbd4d4d25809a0a964f76bd95c"} Jun 08 21:16:11.187463 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:11.187436 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-vx7rs" Jun 08 21:16:11.199687 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:11.199638 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-58c984cbf9-c9thn" podStartSLOduration=1.178015592 podStartE2EDuration="6.199619762s" totalImagesPullingTime="5.02160417s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:16:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:16:11.199534175 +0000 UTC m=+532.457210550" watchObservedRunningTime="2026-06-08 21:16:11.199619762 +0000 UTC m=+532.457296137" Jun 08 21:16:11.214386 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:11.214326 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-vx7rs" podStartSLOduration=1.9031908849999999 podStartE2EDuration="6.214257709s" totalImagesPullingTime="4.311066824s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:16:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:16:11.213307211 +0000 UTC m=+532.470983589" watchObservedRunningTime="2026-06-08 21:16:11.214257709 +0000 UTC m=+532.471934084" Jun 08 21:16:11.230700 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:11.230632 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-6hnmd" podStartSLOduration=2.600842584 podStartE2EDuration="6.230608311s" totalImagesPullingTime="3.629765727s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:16:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:16:11.229418256 +0000 UTC m=+532.487094632" watchObservedRunningTime="2026-06-08 21:16:11.230608311 +0000 UTC m=+532.488284687" Jun 08 21:16:15.729389 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:15.729349 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-xk5z2"] Jun 08 21:16:15.732935 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:15.732918 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-xk5z2" Jun 08 21:16:15.738808 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:15.738783 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 08 21:16:15.739030 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:15.739004 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-m6lln"] Jun 08 21:16:15.742368 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:15.742350 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-m6lln" Jun 08 21:16:15.744616 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:15.744596 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-qckvf\"" Jun 08 21:16:15.745749 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:15.745732 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-hctd4\"" Jun 08 21:16:15.745828 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:15.745752 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 08 21:16:15.755681 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:15.755653 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-xk5z2"] Jun 08 21:16:15.757534 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:15.757513 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-m6lln"] Jun 08 21:16:15.831683 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:15.831646 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4tdl\" (UniqueName: \"kubernetes.io/projected/7f105ac5-db47-4a8c-ac59-dbb61e64b4cc-kube-api-access-z4tdl\") pod \"kserve-controller-manager-69fc866d76-xk5z2\" (UID: \"7f105ac5-db47-4a8c-ac59-dbb61e64b4cc\") " pod="opendatahub/kserve-controller-manager-69fc866d76-xk5z2" Jun 08 21:16:15.831855 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:15.831705 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2738d7dc-1fa7-4515-8ab1-0081e0151338-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-m6lln\" (UID: \"2738d7dc-1fa7-4515-8ab1-0081e0151338\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-m6lln" Jun 08 21:16:15.831855 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:15.831788 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f105ac5-db47-4a8c-ac59-dbb61e64b4cc-cert\") pod \"kserve-controller-manager-69fc866d76-xk5z2\" (UID: \"7f105ac5-db47-4a8c-ac59-dbb61e64b4cc\") " pod="opendatahub/kserve-controller-manager-69fc866d76-xk5z2" Jun 08 21:16:15.831855 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:15.831836 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68w6q\" (UniqueName: \"kubernetes.io/projected/2738d7dc-1fa7-4515-8ab1-0081e0151338-kube-api-access-68w6q\") pod \"llmisvc-controller-manager-864bfd7bc9-m6lln\" (UID: \"2738d7dc-1fa7-4515-8ab1-0081e0151338\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-m6lln" Jun 08 21:16:15.932581 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:15.932532 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4tdl\" (UniqueName: \"kubernetes.io/projected/7f105ac5-db47-4a8c-ac59-dbb61e64b4cc-kube-api-access-z4tdl\") pod \"kserve-controller-manager-69fc866d76-xk5z2\" (UID: \"7f105ac5-db47-4a8c-ac59-dbb61e64b4cc\") " pod="opendatahub/kserve-controller-manager-69fc866d76-xk5z2" Jun 08 21:16:15.932766 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:15.932699 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2738d7dc-1fa7-4515-8ab1-0081e0151338-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-m6lln\" (UID: \"2738d7dc-1fa7-4515-8ab1-0081e0151338\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-m6lln" Jun 08 21:16:15.932766 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:15.932762 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f105ac5-db47-4a8c-ac59-dbb61e64b4cc-cert\") pod \"kserve-controller-manager-69fc866d76-xk5z2\" (UID: \"7f105ac5-db47-4a8c-ac59-dbb61e64b4cc\") " pod="opendatahub/kserve-controller-manager-69fc866d76-xk5z2" Jun 08 21:16:15.932879 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:15.932805 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68w6q\" (UniqueName: \"kubernetes.io/projected/2738d7dc-1fa7-4515-8ab1-0081e0151338-kube-api-access-68w6q\") pod \"llmisvc-controller-manager-864bfd7bc9-m6lln\" (UID: \"2738d7dc-1fa7-4515-8ab1-0081e0151338\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-m6lln" Jun 08 21:16:15.935142 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:15.935113 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2738d7dc-1fa7-4515-8ab1-0081e0151338-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-m6lln\" (UID: \"2738d7dc-1fa7-4515-8ab1-0081e0151338\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-m6lln" Jun 08 21:16:15.935261 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:15.935240 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f105ac5-db47-4a8c-ac59-dbb61e64b4cc-cert\") pod \"kserve-controller-manager-69fc866d76-xk5z2\" (UID: \"7f105ac5-db47-4a8c-ac59-dbb61e64b4cc\") " pod="opendatahub/kserve-controller-manager-69fc866d76-xk5z2" Jun 08 21:16:15.956057 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:15.956023 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4tdl\" (UniqueName: \"kubernetes.io/projected/7f105ac5-db47-4a8c-ac59-dbb61e64b4cc-kube-api-access-z4tdl\") pod \"kserve-controller-manager-69fc866d76-xk5z2\" (UID: \"7f105ac5-db47-4a8c-ac59-dbb61e64b4cc\") " pod="opendatahub/kserve-controller-manager-69fc866d76-xk5z2" Jun 08 21:16:15.960214 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:15.960180 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68w6q\" (UniqueName: \"kubernetes.io/projected/2738d7dc-1fa7-4515-8ab1-0081e0151338-kube-api-access-68w6q\") pod \"llmisvc-controller-manager-864bfd7bc9-m6lln\" (UID: \"2738d7dc-1fa7-4515-8ab1-0081e0151338\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-m6lln" Jun 08 21:16:16.043548 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:16.043445 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-xk5z2" Jun 08 21:16:16.051809 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:16.051784 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-m6lln" Jun 08 21:16:16.200392 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:16.200350 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-xk5z2"] Jun 08 21:16:16.202765 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:16:16.202740 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f105ac5_db47_4a8c_ac59_dbb61e64b4cc.slice/crio-40907cda6c7a18eabcd288bbd90a04ad618bcb8b2c7e758308f8ff877aa188de WatchSource:0}: Error finding container 40907cda6c7a18eabcd288bbd90a04ad618bcb8b2c7e758308f8ff877aa188de: Status 404 returned error can't find the container with id 40907cda6c7a18eabcd288bbd90a04ad618bcb8b2c7e758308f8ff877aa188de Jun 08 21:16:16.223169 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:16.223137 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-m6lln"] Jun 08 21:16:16.226521 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:16:16.226492 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2738d7dc_1fa7_4515_8ab1_0081e0151338.slice/crio-ae08a011a288c4ee6fedcf4de66da9ceed0f732bc572530d4727b89836b8541d WatchSource:0}: Error finding container ae08a011a288c4ee6fedcf4de66da9ceed0f732bc572530d4727b89836b8541d: Status 404 returned error can't find the container with id ae08a011a288c4ee6fedcf4de66da9ceed0f732bc572530d4727b89836b8541d Jun 08 21:16:17.217645 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:17.217591 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-xk5z2" event={"ID":"7f105ac5-db47-4a8c-ac59-dbb61e64b4cc","Type":"ContainerStarted","Data":"40907cda6c7a18eabcd288bbd90a04ad618bcb8b2c7e758308f8ff877aa188de"} Jun 08 21:16:17.219414 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:17.219382 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-m6lln" event={"ID":"2738d7dc-1fa7-4515-8ab1-0081e0151338","Type":"ContainerStarted","Data":"ae08a011a288c4ee6fedcf4de66da9ceed0f732bc572530d4727b89836b8541d"} Jun 08 21:16:20.235646 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:20.235607 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-m6lln" event={"ID":"2738d7dc-1fa7-4515-8ab1-0081e0151338","Type":"ContainerStarted","Data":"4a4e43434b998bd3356bdc424e075de4b9168e6701942a70e9e0575a127758d3"} Jun 08 21:16:20.236116 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:20.235677 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-m6lln" Jun 08 21:16:20.237034 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:20.237016 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-xk5z2" event={"ID":"7f105ac5-db47-4a8c-ac59-dbb61e64b4cc","Type":"ContainerStarted","Data":"7106f99fc3f9a4408b21123eb8b1ad1c2340d3a1320516d927a17476bb18e783"} Jun 08 21:16:20.237162 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:20.237146 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-xk5z2" Jun 08 21:16:20.265756 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:20.265705 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-m6lln" podStartSLOduration=1.793936092 podStartE2EDuration="5.265688441s" totalImagesPullingTime="3.471752349s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:16:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:16:20.264786081 +0000 UTC m=+541.522462450" watchObservedRunningTime="2026-06-08 21:16:20.265688441 +0000 UTC m=+541.523364813" Jun 08 21:16:20.303691 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:20.303640 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-xk5z2" podStartSLOduration=1.811545586 podStartE2EDuration="5.303624587s" totalImagesPullingTime="3.492079001s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:16:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:16:20.302466005 +0000 UTC m=+541.560142373" watchObservedRunningTime="2026-06-08 21:16:20.303624587 +0000 UTC m=+541.561300962" Jun 08 21:16:21.309225 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:21.309189 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-vgt65"] Jun 08 21:16:21.312582 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:21.312560 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-vgt65" Jun 08 21:16:21.315595 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:21.315548 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 08 21:16:21.315783 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:21.315689 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 08 21:16:21.315859 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:21.315832 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-6mlv6\"" Jun 08 21:16:21.329500 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:21.329478 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-vgt65"] Jun 08 21:16:21.371179 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:21.371145 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/c32ce703-5c5b-4d8a-98a4-d3ffe71f6608-operator-config\") pod \"servicemesh-operator3-57f65f65fb-vgt65\" (UID: \"c32ce703-5c5b-4d8a-98a4-d3ffe71f6608\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-vgt65" Jun 08 21:16:21.371398 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:21.371211 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7p4jb\" (UniqueName: \"kubernetes.io/projected/c32ce703-5c5b-4d8a-98a4-d3ffe71f6608-kube-api-access-7p4jb\") pod \"servicemesh-operator3-57f65f65fb-vgt65\" (UID: \"c32ce703-5c5b-4d8a-98a4-d3ffe71f6608\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-vgt65" Jun 08 21:16:21.472097 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:21.472067 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/c32ce703-5c5b-4d8a-98a4-d3ffe71f6608-operator-config\") pod \"servicemesh-operator3-57f65f65fb-vgt65\" (UID: \"c32ce703-5c5b-4d8a-98a4-d3ffe71f6608\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-vgt65" Jun 08 21:16:21.472097 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:21.472105 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7p4jb\" (UniqueName: \"kubernetes.io/projected/c32ce703-5c5b-4d8a-98a4-d3ffe71f6608-kube-api-access-7p4jb\") pod \"servicemesh-operator3-57f65f65fb-vgt65\" (UID: \"c32ce703-5c5b-4d8a-98a4-d3ffe71f6608\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-vgt65" Jun 08 21:16:21.474595 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:21.474568 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/c32ce703-5c5b-4d8a-98a4-d3ffe71f6608-operator-config\") pod \"servicemesh-operator3-57f65f65fb-vgt65\" (UID: \"c32ce703-5c5b-4d8a-98a4-d3ffe71f6608\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-vgt65" Jun 08 21:16:21.481647 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:21.481621 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7p4jb\" (UniqueName: \"kubernetes.io/projected/c32ce703-5c5b-4d8a-98a4-d3ffe71f6608-kube-api-access-7p4jb\") pod \"servicemesh-operator3-57f65f65fb-vgt65\" (UID: \"c32ce703-5c5b-4d8a-98a4-d3ffe71f6608\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-vgt65" Jun 08 21:16:21.623179 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:21.623141 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-vgt65" Jun 08 21:16:21.738292 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:21.738238 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-5878f5f596-276nr"] Jun 08 21:16:21.742547 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:21.742521 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5878f5f596-276nr" Jun 08 21:16:21.746193 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:21.746165 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 08 21:16:21.747109 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:21.746986 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-c5ghc\"" Jun 08 21:16:21.753001 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:21.752751 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5878f5f596-276nr"] Jun 08 21:16:21.779675 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:21.779643 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/15b1095d-40aa-41af-a0bc-eb8ac5be1e5f-redirect-config\") pod \"dashboard-redirect-5878f5f596-276nr\" (UID: \"15b1095d-40aa-41af-a0bc-eb8ac5be1e5f\") " pod="opendatahub/dashboard-redirect-5878f5f596-276nr" Jun 08 21:16:21.779826 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:21.779717 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdwd6\" (UniqueName: \"kubernetes.io/projected/15b1095d-40aa-41af-a0bc-eb8ac5be1e5f-kube-api-access-wdwd6\") pod \"dashboard-redirect-5878f5f596-276nr\" (UID: \"15b1095d-40aa-41af-a0bc-eb8ac5be1e5f\") " pod="opendatahub/dashboard-redirect-5878f5f596-276nr" Jun 08 21:16:21.815376 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:21.815343 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-vgt65"] Jun 08 21:16:21.818396 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:16:21.818347 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc32ce703_5c5b_4d8a_98a4_d3ffe71f6608.slice/crio-b177007f8c6ed62718f66d54bf168ab7a5552304162d61e86ee6c4d7e0e3e544 WatchSource:0}: Error finding container b177007f8c6ed62718f66d54bf168ab7a5552304162d61e86ee6c4d7e0e3e544: Status 404 returned error can't find the container with id b177007f8c6ed62718f66d54bf168ab7a5552304162d61e86ee6c4d7e0e3e544 Jun 08 21:16:21.880972 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:21.880882 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdwd6\" (UniqueName: \"kubernetes.io/projected/15b1095d-40aa-41af-a0bc-eb8ac5be1e5f-kube-api-access-wdwd6\") pod \"dashboard-redirect-5878f5f596-276nr\" (UID: \"15b1095d-40aa-41af-a0bc-eb8ac5be1e5f\") " pod="opendatahub/dashboard-redirect-5878f5f596-276nr" Jun 08 21:16:21.880972 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:21.880956 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/15b1095d-40aa-41af-a0bc-eb8ac5be1e5f-redirect-config\") pod \"dashboard-redirect-5878f5f596-276nr\" (UID: \"15b1095d-40aa-41af-a0bc-eb8ac5be1e5f\") " pod="opendatahub/dashboard-redirect-5878f5f596-276nr" Jun 08 21:16:21.881647 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:21.881628 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/15b1095d-40aa-41af-a0bc-eb8ac5be1e5f-redirect-config\") pod \"dashboard-redirect-5878f5f596-276nr\" (UID: \"15b1095d-40aa-41af-a0bc-eb8ac5be1e5f\") " pod="opendatahub/dashboard-redirect-5878f5f596-276nr" Jun 08 21:16:21.895535 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:21.895511 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdwd6\" (UniqueName: \"kubernetes.io/projected/15b1095d-40aa-41af-a0bc-eb8ac5be1e5f-kube-api-access-wdwd6\") pod \"dashboard-redirect-5878f5f596-276nr\" (UID: \"15b1095d-40aa-41af-a0bc-eb8ac5be1e5f\") " pod="opendatahub/dashboard-redirect-5878f5f596-276nr" Jun 08 21:16:22.064533 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:22.064493 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5878f5f596-276nr" Jun 08 21:16:22.193572 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:22.193542 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-vx7rs" Jun 08 21:16:22.195818 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:22.195798 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-6hnmd" Jun 08 21:16:22.200594 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:22.200575 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5878f5f596-276nr"] Jun 08 21:16:22.203070 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:16:22.203040 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15b1095d_40aa_41af_a0bc_eb8ac5be1e5f.slice/crio-537ebdd2805a1f096ae720f0c74bffe10a755437266b4d4349ba9562de578753 WatchSource:0}: Error finding container 537ebdd2805a1f096ae720f0c74bffe10a755437266b4d4349ba9562de578753: Status 404 returned error can't find the container with id 537ebdd2805a1f096ae720f0c74bffe10a755437266b4d4349ba9562de578753 Jun 08 21:16:22.248338 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:22.248300 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5878f5f596-276nr" event={"ID":"15b1095d-40aa-41af-a0bc-eb8ac5be1e5f","Type":"ContainerStarted","Data":"537ebdd2805a1f096ae720f0c74bffe10a755437266b4d4349ba9562de578753"} Jun 08 21:16:22.250706 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:22.250678 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-vgt65" event={"ID":"c32ce703-5c5b-4d8a-98a4-d3ffe71f6608","Type":"ContainerStarted","Data":"b177007f8c6ed62718f66d54bf168ab7a5552304162d61e86ee6c4d7e0e3e544"} Jun 08 21:16:26.275260 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:26.275221 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-vgt65" event={"ID":"c32ce703-5c5b-4d8a-98a4-d3ffe71f6608","Type":"ContainerStarted","Data":"b685c4a7ba8eb1b3e6434f9032a7a5ccdc036bf91cf245a75c3daae1b741579d"} Jun 08 21:16:26.275761 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:26.275301 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-vgt65" Jun 08 21:16:26.276698 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:26.276673 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5878f5f596-276nr" event={"ID":"15b1095d-40aa-41af-a0bc-eb8ac5be1e5f","Type":"ContainerStarted","Data":"0509771dc36ba5131482cbfa6f0680f49841f38e616d09a1745b782734de09e1"} Jun 08 21:16:26.296623 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:26.296570 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-vgt65" podStartSLOduration=1.6840627700000002 podStartE2EDuration="5.296553059s" totalImagesPullingTime="3.612490289s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:16:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:16:26.296510974 +0000 UTC m=+547.554187349" watchObservedRunningTime="2026-06-08 21:16:26.296553059 +0000 UTC m=+547.554229432" Jun 08 21:16:26.312554 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:26.312502 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-5878f5f596-276nr" podStartSLOduration=2.02775134 podStartE2EDuration="5.312486786s" totalImagesPullingTime="3.284735446s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:16:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:16:26.311752206 +0000 UTC m=+547.569428582" watchObservedRunningTime="2026-06-08 21:16:26.312486786 +0000 UTC m=+547.570163168" Jun 08 21:16:36.550614 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:36.550580 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-p9q7f"] Jun 08 21:16:36.554536 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:36.554517 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-p9q7f" Jun 08 21:16:36.557087 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:36.557067 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 08 21:16:36.557453 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:36.557435 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 08 21:16:36.557453 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:36.557446 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 08 21:16:36.557591 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:36.557438 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 08 21:16:36.557591 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:36.557489 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-qpckk\"" Jun 08 21:16:36.565202 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:36.565182 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-p9q7f"] Jun 08 21:16:36.607955 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:36.607915 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/cba49617-3046-41dd-953a-374a4261ab64-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-p9q7f\" (UID: \"cba49617-3046-41dd-953a-374a4261ab64\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-p9q7f" Jun 08 21:16:36.608154 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:36.607976 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/cba49617-3046-41dd-953a-374a4261ab64-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-p9q7f\" (UID: \"cba49617-3046-41dd-953a-374a4261ab64\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-p9q7f" Jun 08 21:16:36.608154 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:36.608051 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cba49617-3046-41dd-953a-374a4261ab64-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-p9q7f\" (UID: \"cba49617-3046-41dd-953a-374a4261ab64\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-p9q7f" Jun 08 21:16:36.608154 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:36.608127 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/cba49617-3046-41dd-953a-374a4261ab64-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-p9q7f\" (UID: \"cba49617-3046-41dd-953a-374a4261ab64\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-p9q7f" Jun 08 21:16:36.608355 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:36.608178 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cba49617-3046-41dd-953a-374a4261ab64-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-p9q7f\" (UID: \"cba49617-3046-41dd-953a-374a4261ab64\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-p9q7f" Jun 08 21:16:36.608355 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:36.608211 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/cba49617-3046-41dd-953a-374a4261ab64-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-p9q7f\" (UID: \"cba49617-3046-41dd-953a-374a4261ab64\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-p9q7f" Jun 08 21:16:36.608355 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:36.608249 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-625s6\" (UniqueName: \"kubernetes.io/projected/cba49617-3046-41dd-953a-374a4261ab64-kube-api-access-625s6\") pod \"istiod-openshift-gateway-75c67f8887-p9q7f\" (UID: \"cba49617-3046-41dd-953a-374a4261ab64\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-p9q7f" Jun 08 21:16:36.708913 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:36.708882 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/cba49617-3046-41dd-953a-374a4261ab64-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-p9q7f\" (UID: \"cba49617-3046-41dd-953a-374a4261ab64\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-p9q7f" Jun 08 21:16:36.709112 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:36.708922 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cba49617-3046-41dd-953a-374a4261ab64-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-p9q7f\" (UID: \"cba49617-3046-41dd-953a-374a4261ab64\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-p9q7f" Jun 08 21:16:36.709112 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:36.708949 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/cba49617-3046-41dd-953a-374a4261ab64-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-p9q7f\" (UID: \"cba49617-3046-41dd-953a-374a4261ab64\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-p9q7f" Jun 08 21:16:36.709112 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:36.708982 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-625s6\" (UniqueName: \"kubernetes.io/projected/cba49617-3046-41dd-953a-374a4261ab64-kube-api-access-625s6\") pod \"istiod-openshift-gateway-75c67f8887-p9q7f\" (UID: \"cba49617-3046-41dd-953a-374a4261ab64\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-p9q7f" Jun 08 21:16:36.709112 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:36.709047 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/cba49617-3046-41dd-953a-374a4261ab64-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-p9q7f\" (UID: \"cba49617-3046-41dd-953a-374a4261ab64\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-p9q7f" Jun 08 21:16:36.709112 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:36.709082 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/cba49617-3046-41dd-953a-374a4261ab64-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-p9q7f\" (UID: \"cba49617-3046-41dd-953a-374a4261ab64\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-p9q7f" Jun 08 21:16:36.709416 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:36.709115 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cba49617-3046-41dd-953a-374a4261ab64-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-p9q7f\" (UID: \"cba49617-3046-41dd-953a-374a4261ab64\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-p9q7f" Jun 08 21:16:36.710019 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:36.709994 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/cba49617-3046-41dd-953a-374a4261ab64-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-p9q7f\" (UID: \"cba49617-3046-41dd-953a-374a4261ab64\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-p9q7f" Jun 08 21:16:36.712198 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:36.712168 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/cba49617-3046-41dd-953a-374a4261ab64-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-p9q7f\" (UID: \"cba49617-3046-41dd-953a-374a4261ab64\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-p9q7f" Jun 08 21:16:36.712430 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:36.712410 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/cba49617-3046-41dd-953a-374a4261ab64-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-p9q7f\" (UID: \"cba49617-3046-41dd-953a-374a4261ab64\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-p9q7f" Jun 08 21:16:36.712719 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:36.712699 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cba49617-3046-41dd-953a-374a4261ab64-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-p9q7f\" (UID: \"cba49617-3046-41dd-953a-374a4261ab64\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-p9q7f" Jun 08 21:16:36.714973 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:36.714945 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/cba49617-3046-41dd-953a-374a4261ab64-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-p9q7f\" (UID: \"cba49617-3046-41dd-953a-374a4261ab64\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-p9q7f" Jun 08 21:16:36.717797 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:36.717773 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cba49617-3046-41dd-953a-374a4261ab64-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-p9q7f\" (UID: \"cba49617-3046-41dd-953a-374a4261ab64\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-p9q7f" Jun 08 21:16:36.718562 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:36.718539 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-625s6\" (UniqueName: \"kubernetes.io/projected/cba49617-3046-41dd-953a-374a4261ab64-kube-api-access-625s6\") pod \"istiod-openshift-gateway-75c67f8887-p9q7f\" (UID: \"cba49617-3046-41dd-953a-374a4261ab64\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-p9q7f" Jun 08 21:16:36.863305 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:36.863255 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-p9q7f" Jun 08 21:16:37.000239 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:37.000211 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-p9q7f"] Jun 08 21:16:37.002760 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:16:37.002731 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcba49617_3046_41dd_953a_374a4261ab64.slice/crio-aa7fafb7ef10d4035f2b2bf892b453bb67797f4206e57f00fe483139f6256b2d WatchSource:0}: Error finding container aa7fafb7ef10d4035f2b2bf892b453bb67797f4206e57f00fe483139f6256b2d: Status 404 returned error can't find the container with id aa7fafb7ef10d4035f2b2bf892b453bb67797f4206e57f00fe483139f6256b2d Jun 08 21:16:37.282849 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:37.282766 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-vgt65" Jun 08 21:16:37.323594 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:37.323552 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-p9q7f" event={"ID":"cba49617-3046-41dd-953a-374a4261ab64","Type":"ContainerStarted","Data":"aa7fafb7ef10d4035f2b2bf892b453bb67797f4206e57f00fe483139f6256b2d"} Jun 08 21:16:39.480801 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:39.480754 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 08 21:16:39.481055 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:39.480847 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 08 21:16:40.339547 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:40.339511 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-p9q7f" event={"ID":"cba49617-3046-41dd-953a-374a4261ab64","Type":"ContainerStarted","Data":"fbf418710fc47f709b4a211a8ec902fcc85a3504ac38caafd847de14468eb672"} Jun 08 21:16:40.339745 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:40.339657 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-p9q7f" Jun 08 21:16:40.343397 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:40.343249 2564 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-p9q7f container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 08 21:16:40.343397 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:40.343326 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-p9q7f" podUID="cba49617-3046-41dd-953a-374a4261ab64" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 21:16:40.359799 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:40.359746 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-p9q7f" podStartSLOduration=1.884329724 podStartE2EDuration="4.359728765s" totalImagesPullingTime="2.475399041s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:16:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:16:40.358848853 +0000 UTC m=+561.616525228" watchObservedRunningTime="2026-06-08 21:16:40.359728765 +0000 UTC m=+561.617405141" Jun 08 21:16:41.344407 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:41.344370 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-p9q7f" Jun 08 21:16:51.243647 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:51.243609 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-m6lln" Jun 08 21:16:51.247022 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:16:51.247001 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-xk5z2" Jun 08 21:17:19.114445 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:17:19.114414 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pt842_85a49d6e-acdf-43ce-b9c9-1c2d7773a948/ovn-acl-logging/0.log" Jun 08 21:17:19.118029 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:17:19.118007 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pt842_85a49d6e-acdf-43ce-b9c9-1c2d7773a948/ovn-acl-logging/0.log" Jun 08 21:17:40.270991 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:17:40.270955 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-nbflx"] Jun 08 21:17:40.274398 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:17:40.274373 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nbflx" Jun 08 21:17:40.277032 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:17:40.277007 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-5ss4b\"" Jun 08 21:17:40.277032 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:17:40.277024 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 08 21:17:40.277225 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:17:40.277021 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 08 21:17:40.288219 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:17:40.288196 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-nbflx"] Jun 08 21:17:40.392381 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:17:40.392339 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2n4tw\" (UniqueName: \"kubernetes.io/projected/11729911-6017-4c07-8230-05989b9d0c40-kube-api-access-2n4tw\") pod \"authorino-operator-75cc8d5cb7-nbflx\" (UID: \"11729911-6017-4c07-8230-05989b9d0c40\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-nbflx" Jun 08 21:17:40.493859 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:17:40.493822 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2n4tw\" (UniqueName: \"kubernetes.io/projected/11729911-6017-4c07-8230-05989b9d0c40-kube-api-access-2n4tw\") pod \"authorino-operator-75cc8d5cb7-nbflx\" (UID: \"11729911-6017-4c07-8230-05989b9d0c40\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-nbflx" Jun 08 21:17:40.502567 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:17:40.502542 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2n4tw\" (UniqueName: \"kubernetes.io/projected/11729911-6017-4c07-8230-05989b9d0c40-kube-api-access-2n4tw\") pod \"authorino-operator-75cc8d5cb7-nbflx\" (UID: \"11729911-6017-4c07-8230-05989b9d0c40\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-nbflx" Jun 08 21:17:40.586238 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:17:40.586161 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nbflx" Jun 08 21:17:40.719509 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:17:40.719483 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-nbflx"] Jun 08 21:17:40.722054 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:17:40.722033 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11729911_6017_4c07_8230_05989b9d0c40.slice/crio-895e498c032d0ead76cb8ba2170b37f4a43d3b3ed2593c56befff3d8ab52d511 WatchSource:0}: Error finding container 895e498c032d0ead76cb8ba2170b37f4a43d3b3ed2593c56befff3d8ab52d511: Status 404 returned error can't find the container with id 895e498c032d0ead76cb8ba2170b37f4a43d3b3ed2593c56befff3d8ab52d511 Jun 08 21:17:41.604856 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:17:41.604819 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nbflx" event={"ID":"11729911-6017-4c07-8230-05989b9d0c40","Type":"ContainerStarted","Data":"895e498c032d0ead76cb8ba2170b37f4a43d3b3ed2593c56befff3d8ab52d511"} Jun 08 21:17:43.617973 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:17:43.617940 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nbflx" event={"ID":"11729911-6017-4c07-8230-05989b9d0c40","Type":"ContainerStarted","Data":"b7446057515f33add83a0b9cc9f6fcf60b54164fb7ff40c7bf71a8917f4d4b5b"} Jun 08 21:17:43.618506 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:17:43.618010 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nbflx" Jun 08 21:17:43.634939 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:17:43.634885 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nbflx" podStartSLOduration=1.277084156 podStartE2EDuration="3.634867022s" totalImagesPullingTime="2.357782866s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:17:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:17:43.633042963 +0000 UTC m=+624.890719338" watchObservedRunningTime="2026-06-08 21:17:43.634867022 +0000 UTC m=+624.892543396" Jun 08 21:17:54.626185 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:17:54.626153 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nbflx" Jun 08 21:18:45.531188 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:18:45.531157 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqjds"] Jun 08 21:18:45.534477 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:18:45.534459 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-pqjds" Jun 08 21:18:45.537166 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:18:45.537142 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 08 21:18:45.537524 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:18:45.537504 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-ggf4g\"" Jun 08 21:18:45.541321 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:18:45.541296 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqjds"] Jun 08 21:18:45.553955 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:18:45.553926 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lj4mx\" (UniqueName: \"kubernetes.io/projected/d7c4068f-2b40-4640-b4df-b2afb131ea41-kube-api-access-lj4mx\") pod \"limitador-limitador-54d6d988d5-pqjds\" (UID: \"d7c4068f-2b40-4640-b4df-b2afb131ea41\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pqjds" Jun 08 21:18:45.554083 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:18:45.554002 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d7c4068f-2b40-4640-b4df-b2afb131ea41-config-file\") pod \"limitador-limitador-54d6d988d5-pqjds\" (UID: \"d7c4068f-2b40-4640-b4df-b2afb131ea41\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pqjds" Jun 08 21:18:45.568223 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:18:45.568196 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqjds"] Jun 08 21:18:45.654902 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:18:45.654869 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d7c4068f-2b40-4640-b4df-b2afb131ea41-config-file\") pod \"limitador-limitador-54d6d988d5-pqjds\" (UID: \"d7c4068f-2b40-4640-b4df-b2afb131ea41\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pqjds" Jun 08 21:18:45.655049 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:18:45.654929 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lj4mx\" (UniqueName: \"kubernetes.io/projected/d7c4068f-2b40-4640-b4df-b2afb131ea41-kube-api-access-lj4mx\") pod \"limitador-limitador-54d6d988d5-pqjds\" (UID: \"d7c4068f-2b40-4640-b4df-b2afb131ea41\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pqjds" Jun 08 21:18:45.655587 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:18:45.655569 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d7c4068f-2b40-4640-b4df-b2afb131ea41-config-file\") pod \"limitador-limitador-54d6d988d5-pqjds\" (UID: \"d7c4068f-2b40-4640-b4df-b2afb131ea41\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pqjds" Jun 08 21:18:45.662625 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:18:45.662600 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lj4mx\" (UniqueName: \"kubernetes.io/projected/d7c4068f-2b40-4640-b4df-b2afb131ea41-kube-api-access-lj4mx\") pod \"limitador-limitador-54d6d988d5-pqjds\" (UID: \"d7c4068f-2b40-4640-b4df-b2afb131ea41\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pqjds" Jun 08 21:18:45.845743 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:18:45.845715 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-pqjds" Jun 08 21:18:45.976465 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:18:45.976406 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqjds"] Jun 08 21:18:45.978789 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:18:45.978750 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7c4068f_2b40_4640_b4df_b2afb131ea41.slice/crio-50bf2d3ab3023e4aced71dccbdccbc959bcf2b18d84a0d6c1a7137fbf51a9ecd WatchSource:0}: Error finding container 50bf2d3ab3023e4aced71dccbdccbc959bcf2b18d84a0d6c1a7137fbf51a9ecd: Status 404 returned error can't find the container with id 50bf2d3ab3023e4aced71dccbdccbc959bcf2b18d84a0d6c1a7137fbf51a9ecd Jun 08 21:18:46.907193 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:18:46.907149 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-pqjds" event={"ID":"d7c4068f-2b40-4640-b4df-b2afb131ea41","Type":"ContainerStarted","Data":"50bf2d3ab3023e4aced71dccbdccbc959bcf2b18d84a0d6c1a7137fbf51a9ecd"} Jun 08 21:18:48.917572 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:18:48.917538 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-pqjds" event={"ID":"d7c4068f-2b40-4640-b4df-b2afb131ea41","Type":"ContainerStarted","Data":"2919f0cf623e4695bafb43ce97c5012d2810e8613d3d7e970ff8ac54550bee6a"} Jun 08 21:18:48.917949 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:18:48.917682 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-pqjds" Jun 08 21:18:48.932999 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:18:48.932942 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-pqjds" podStartSLOduration=1.4449459230000001 podStartE2EDuration="3.932923761s" totalImagesPullingTime="2.487977838s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:18:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:18:48.932322957 +0000 UTC m=+690.189999346" watchObservedRunningTime="2026-06-08 21:18:48.932923761 +0000 UTC m=+690.190600138" Jun 08 21:18:59.923217 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:18:59.923187 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-pqjds" Jun 08 21:20:48.021148 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:20:48.021109 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqjds"] Jun 08 21:20:48.028593 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:20:48.028566 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-xcgxn"] Jun 08 21:20:48.031590 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:20:48.031575 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-xcgxn" Jun 08 21:20:48.034360 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:20:48.034339 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-b956r\"" Jun 08 21:20:48.034474 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:20:48.034383 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 08 21:20:48.040829 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:20:48.040807 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-xcgxn"] Jun 08 21:20:48.134867 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:20:48.134831 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dh8xf\" (UniqueName: \"kubernetes.io/projected/26614403-75fb-4ea3-8fdd-e4c8f9650c8e-kube-api-access-dh8xf\") pod \"payload-processing-7c6c859784-xcgxn\" (UID: \"26614403-75fb-4ea3-8fdd-e4c8f9650c8e\") " pod="openshift-ingress/payload-processing-7c6c859784-xcgxn" Jun 08 21:20:48.235552 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:20:48.235521 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dh8xf\" (UniqueName: \"kubernetes.io/projected/26614403-75fb-4ea3-8fdd-e4c8f9650c8e-kube-api-access-dh8xf\") pod \"payload-processing-7c6c859784-xcgxn\" (UID: \"26614403-75fb-4ea3-8fdd-e4c8f9650c8e\") " pod="openshift-ingress/payload-processing-7c6c859784-xcgxn" Jun 08 21:20:48.243906 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:20:48.243873 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dh8xf\" (UniqueName: \"kubernetes.io/projected/26614403-75fb-4ea3-8fdd-e4c8f9650c8e-kube-api-access-dh8xf\") pod \"payload-processing-7c6c859784-xcgxn\" (UID: \"26614403-75fb-4ea3-8fdd-e4c8f9650c8e\") " pod="openshift-ingress/payload-processing-7c6c859784-xcgxn" Jun 08 21:20:48.342779 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:20:48.342745 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-xcgxn" Jun 08 21:20:48.475924 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:20:48.475888 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-xcgxn"] Jun 08 21:20:48.478253 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:20:48.478218 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26614403_75fb_4ea3_8fdd_e4c8f9650c8e.slice/crio-d10a50667d527df378d189dd87186d8b0a41f100368bd31c4878fe7bb0b57eb5 WatchSource:0}: Error finding container d10a50667d527df378d189dd87186d8b0a41f100368bd31c4878fe7bb0b57eb5: Status 404 returned error can't find the container with id d10a50667d527df378d189dd87186d8b0a41f100368bd31c4878fe7bb0b57eb5 Jun 08 21:20:48.480243 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:20:48.480223 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 21:20:49.451916 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:20:49.451877 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-xcgxn" event={"ID":"26614403-75fb-4ea3-8fdd-e4c8f9650c8e","Type":"ContainerStarted","Data":"d10a50667d527df378d189dd87186d8b0a41f100368bd31c4878fe7bb0b57eb5"} Jun 08 21:20:51.469092 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:20:51.469050 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-xcgxn" event={"ID":"26614403-75fb-4ea3-8fdd-e4c8f9650c8e","Type":"ContainerStarted","Data":"4c02070bd669ac05331a4bcd7ac0ff5bf5161e0d48b9ebaa2117e6723ae651d3"} Jun 08 21:20:51.469574 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:20:51.469156 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-xcgxn" Jun 08 21:20:51.486753 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:20:51.486703 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-7c6c859784-xcgxn" podStartSLOduration=1.379439873 podStartE2EDuration="3.486686117s" totalImagesPullingTime="2.107246244s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:20:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:20:51.484868902 +0000 UTC m=+812.742545269" watchObservedRunningTime="2026-06-08 21:20:51.486686117 +0000 UTC m=+812.744362524" Jun 08 21:21:02.476047 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:21:02.476015 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-xcgxn" Jun 08 21:22:00.203149 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:00.203110 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqjds"] Jun 08 21:22:04.000427 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:04.000388 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqjds"] Jun 08 21:22:14.783948 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:14.783915 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-898xx"] Jun 08 21:22:14.787630 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:14.787609 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-898xx" Jun 08 21:22:14.790483 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:14.790461 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-6t2zd\"" Jun 08 21:22:14.791895 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:14.791873 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 08 21:22:14.792001 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:14.791907 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 08 21:22:14.792001 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:14.791907 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 08 21:22:14.798557 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:14.798534 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-898xx"] Jun 08 21:22:14.892842 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:14.892809 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/07a25526-8939-412b-8c5e-7f216b076a32-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-898xx\" (UID: \"07a25526-8939-412b-8c5e-7f216b076a32\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-898xx" Jun 08 21:22:14.893038 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:14.892848 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-284w6\" (UniqueName: \"kubernetes.io/projected/07a25526-8939-412b-8c5e-7f216b076a32-kube-api-access-284w6\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-898xx\" (UID: \"07a25526-8939-412b-8c5e-7f216b076a32\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-898xx" Jun 08 21:22:14.893038 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:14.892878 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07a25526-8939-412b-8c5e-7f216b076a32-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-898xx\" (UID: \"07a25526-8939-412b-8c5e-7f216b076a32\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-898xx" Jun 08 21:22:14.893038 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:14.892978 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/07a25526-8939-412b-8c5e-7f216b076a32-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-898xx\" (UID: \"07a25526-8939-412b-8c5e-7f216b076a32\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-898xx" Jun 08 21:22:14.893200 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:14.893053 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/07a25526-8939-412b-8c5e-7f216b076a32-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-898xx\" (UID: \"07a25526-8939-412b-8c5e-7f216b076a32\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-898xx" Jun 08 21:22:14.893200 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:14.893103 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/07a25526-8939-412b-8c5e-7f216b076a32-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-898xx\" (UID: \"07a25526-8939-412b-8c5e-7f216b076a32\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-898xx" Jun 08 21:22:14.993869 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:14.993823 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/07a25526-8939-412b-8c5e-7f216b076a32-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-898xx\" (UID: \"07a25526-8939-412b-8c5e-7f216b076a32\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-898xx" Jun 08 21:22:14.994062 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:14.993881 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/07a25526-8939-412b-8c5e-7f216b076a32-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-898xx\" (UID: \"07a25526-8939-412b-8c5e-7f216b076a32\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-898xx" Jun 08 21:22:14.994062 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:14.993930 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/07a25526-8939-412b-8c5e-7f216b076a32-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-898xx\" (UID: \"07a25526-8939-412b-8c5e-7f216b076a32\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-898xx" Jun 08 21:22:14.994062 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:14.993961 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-284w6\" (UniqueName: \"kubernetes.io/projected/07a25526-8939-412b-8c5e-7f216b076a32-kube-api-access-284w6\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-898xx\" (UID: \"07a25526-8939-412b-8c5e-7f216b076a32\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-898xx" Jun 08 21:22:14.994062 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:14.993991 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07a25526-8939-412b-8c5e-7f216b076a32-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-898xx\" (UID: \"07a25526-8939-412b-8c5e-7f216b076a32\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-898xx" Jun 08 21:22:14.994062 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:14.994033 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/07a25526-8939-412b-8c5e-7f216b076a32-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-898xx\" (UID: \"07a25526-8939-412b-8c5e-7f216b076a32\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-898xx" Jun 08 21:22:14.994362 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:14.994324 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/07a25526-8939-412b-8c5e-7f216b076a32-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-898xx\" (UID: \"07a25526-8939-412b-8c5e-7f216b076a32\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-898xx" Jun 08 21:22:14.994362 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:14.994355 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/07a25526-8939-412b-8c5e-7f216b076a32-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-898xx\" (UID: \"07a25526-8939-412b-8c5e-7f216b076a32\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-898xx" Jun 08 21:22:14.994475 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:14.994426 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/07a25526-8939-412b-8c5e-7f216b076a32-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-898xx\" (UID: \"07a25526-8939-412b-8c5e-7f216b076a32\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-898xx" Jun 08 21:22:14.996233 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:14.996204 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/07a25526-8939-412b-8c5e-7f216b076a32-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-898xx\" (UID: \"07a25526-8939-412b-8c5e-7f216b076a32\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-898xx" Jun 08 21:22:14.996638 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:14.996615 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07a25526-8939-412b-8c5e-7f216b076a32-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-898xx\" (UID: \"07a25526-8939-412b-8c5e-7f216b076a32\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-898xx" Jun 08 21:22:15.003541 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:15.003509 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-284w6\" (UniqueName: \"kubernetes.io/projected/07a25526-8939-412b-8c5e-7f216b076a32-kube-api-access-284w6\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-898xx\" (UID: \"07a25526-8939-412b-8c5e-7f216b076a32\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-898xx" Jun 08 21:22:15.098313 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:15.098282 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-898xx" Jun 08 21:22:15.235509 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:15.235408 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-898xx"] Jun 08 21:22:15.237755 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:22:15.237729 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07a25526_8939_412b_8c5e_7f216b076a32.slice/crio-525f3ca755eaec98c6e89acbfe3211a4f44d3b8db4043c8425782957779e83be WatchSource:0}: Error finding container 525f3ca755eaec98c6e89acbfe3211a4f44d3b8db4043c8425782957779e83be: Status 404 returned error can't find the container with id 525f3ca755eaec98c6e89acbfe3211a4f44d3b8db4043c8425782957779e83be Jun 08 21:22:15.399023 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:15.398938 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqjds"] Jun 08 21:22:15.860244 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:15.860210 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-898xx" event={"ID":"07a25526-8939-412b-8c5e-7f216b076a32","Type":"ContainerStarted","Data":"525f3ca755eaec98c6e89acbfe3211a4f44d3b8db4043c8425782957779e83be"} Jun 08 21:22:18.878032 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:18.877993 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-898xx" event={"ID":"07a25526-8939-412b-8c5e-7f216b076a32","Type":"ContainerStarted","Data":"7a1faeeb232c87149f918adb6325089b3912b789d490c3aa3e3dfdb3dbfb1768"} Jun 08 21:22:19.147775 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:19.147691 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pt842_85a49d6e-acdf-43ce-b9c9-1c2d7773a948/ovn-acl-logging/0.log" Jun 08 21:22:19.148291 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:19.148246 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pt842_85a49d6e-acdf-43ce-b9c9-1c2d7773a948/ovn-acl-logging/0.log" Jun 08 21:22:28.496412 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:28.496371 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqjds"] Jun 08 21:22:47.373001 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:47.372965 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-cc7z4"] Jun 08 21:22:47.390589 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:47.390555 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-cc7z4"] Jun 08 21:22:47.390705 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:47.390683 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cc7z4" Jun 08 21:22:47.393558 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:47.393538 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 08 21:22:47.483649 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:47.483606 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bdc7cb4f-7e99-4acb-bf59-dcc0b742bd84-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-cc7z4\" (UID: \"bdc7cb4f-7e99-4acb-bf59-dcc0b742bd84\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cc7z4" Jun 08 21:22:47.483649 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:47.483653 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bdc7cb4f-7e99-4acb-bf59-dcc0b742bd84-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-cc7z4\" (UID: \"bdc7cb4f-7e99-4acb-bf59-dcc0b742bd84\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cc7z4" Jun 08 21:22:47.483893 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:47.483716 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bdc7cb4f-7e99-4acb-bf59-dcc0b742bd84-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-cc7z4\" (UID: \"bdc7cb4f-7e99-4acb-bf59-dcc0b742bd84\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cc7z4" Jun 08 21:22:47.483893 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:47.483743 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2wcm\" (UniqueName: \"kubernetes.io/projected/bdc7cb4f-7e99-4acb-bf59-dcc0b742bd84-kube-api-access-w2wcm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-cc7z4\" (UID: \"bdc7cb4f-7e99-4acb-bf59-dcc0b742bd84\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cc7z4" Jun 08 21:22:47.483893 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:47.483778 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bdc7cb4f-7e99-4acb-bf59-dcc0b742bd84-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-cc7z4\" (UID: \"bdc7cb4f-7e99-4acb-bf59-dcc0b742bd84\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cc7z4" Jun 08 21:22:47.483893 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:47.483873 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bdc7cb4f-7e99-4acb-bf59-dcc0b742bd84-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-cc7z4\" (UID: \"bdc7cb4f-7e99-4acb-bf59-dcc0b742bd84\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cc7z4" Jun 08 21:22:47.584346 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:47.584308 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bdc7cb4f-7e99-4acb-bf59-dcc0b742bd84-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-cc7z4\" (UID: \"bdc7cb4f-7e99-4acb-bf59-dcc0b742bd84\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cc7z4" Jun 08 21:22:47.584346 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:47.584351 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bdc7cb4f-7e99-4acb-bf59-dcc0b742bd84-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-cc7z4\" (UID: \"bdc7cb4f-7e99-4acb-bf59-dcc0b742bd84\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cc7z4" Jun 08 21:22:47.584613 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:47.584392 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bdc7cb4f-7e99-4acb-bf59-dcc0b742bd84-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-cc7z4\" (UID: \"bdc7cb4f-7e99-4acb-bf59-dcc0b742bd84\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cc7z4" Jun 08 21:22:47.584613 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:47.584416 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2wcm\" (UniqueName: \"kubernetes.io/projected/bdc7cb4f-7e99-4acb-bf59-dcc0b742bd84-kube-api-access-w2wcm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-cc7z4\" (UID: \"bdc7cb4f-7e99-4acb-bf59-dcc0b742bd84\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cc7z4" Jun 08 21:22:47.584613 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:47.584441 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bdc7cb4f-7e99-4acb-bf59-dcc0b742bd84-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-cc7z4\" (UID: \"bdc7cb4f-7e99-4acb-bf59-dcc0b742bd84\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cc7z4" Jun 08 21:22:47.584613 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:47.584495 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bdc7cb4f-7e99-4acb-bf59-dcc0b742bd84-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-cc7z4\" (UID: \"bdc7cb4f-7e99-4acb-bf59-dcc0b742bd84\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cc7z4" Jun 08 21:22:47.584826 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:47.584799 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bdc7cb4f-7e99-4acb-bf59-dcc0b742bd84-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-cc7z4\" (UID: \"bdc7cb4f-7e99-4acb-bf59-dcc0b742bd84\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cc7z4" Jun 08 21:22:47.584870 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:47.584841 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bdc7cb4f-7e99-4acb-bf59-dcc0b742bd84-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-cc7z4\" (UID: \"bdc7cb4f-7e99-4acb-bf59-dcc0b742bd84\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cc7z4" Jun 08 21:22:47.584870 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:47.584860 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bdc7cb4f-7e99-4acb-bf59-dcc0b742bd84-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-cc7z4\" (UID: \"bdc7cb4f-7e99-4acb-bf59-dcc0b742bd84\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cc7z4" Jun 08 21:22:47.586780 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:47.586757 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bdc7cb4f-7e99-4acb-bf59-dcc0b742bd84-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-cc7z4\" (UID: \"bdc7cb4f-7e99-4acb-bf59-dcc0b742bd84\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cc7z4" Jun 08 21:22:47.586898 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:47.586880 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bdc7cb4f-7e99-4acb-bf59-dcc0b742bd84-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-cc7z4\" (UID: \"bdc7cb4f-7e99-4acb-bf59-dcc0b742bd84\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cc7z4" Jun 08 21:22:47.592284 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:47.592245 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2wcm\" (UniqueName: \"kubernetes.io/projected/bdc7cb4f-7e99-4acb-bf59-dcc0b742bd84-kube-api-access-w2wcm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-cc7z4\" (UID: \"bdc7cb4f-7e99-4acb-bf59-dcc0b742bd84\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cc7z4" Jun 08 21:22:47.703573 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:47.703491 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cc7z4" Jun 08 21:22:47.836420 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:47.836392 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-cc7z4"] Jun 08 21:22:47.838399 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:22:47.838373 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdc7cb4f_7e99_4acb_bf59_dcc0b742bd84.slice/crio-d2d0da6e97336e37d38a8b18f36a140aab5660583d7905e13f4247529f23c00d WatchSource:0}: Error finding container d2d0da6e97336e37d38a8b18f36a140aab5660583d7905e13f4247529f23c00d: Status 404 returned error can't find the container with id d2d0da6e97336e37d38a8b18f36a140aab5660583d7905e13f4247529f23c00d Jun 08 21:22:47.997339 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:47.997219 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqjds"] Jun 08 21:22:48.017853 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:48.017821 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cc7z4" event={"ID":"bdc7cb4f-7e99-4acb-bf59-dcc0b742bd84","Type":"ContainerStarted","Data":"27208016afcd08fdac6da42a664c73b56fd1c550b5cfc72f4597c58938cb2824"} Jun 08 21:22:48.018015 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:48.017869 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cc7z4" event={"ID":"bdc7cb4f-7e99-4acb-bf59-dcc0b742bd84","Type":"ContainerStarted","Data":"d2d0da6e97336e37d38a8b18f36a140aab5660583d7905e13f4247529f23c00d"} Jun 08 21:22:50.028541 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:50.028454 2564 generic.go:356] "Generic (PLEG): container finished" podID="bdc7cb4f-7e99-4acb-bf59-dcc0b742bd84" containerID="27208016afcd08fdac6da42a664c73b56fd1c550b5cfc72f4597c58938cb2824" exitCode=0 Jun 08 21:22:50.028541 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:50.028527 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cc7z4" event={"ID":"bdc7cb4f-7e99-4acb-bf59-dcc0b742bd84","Type":"ContainerDied","Data":"27208016afcd08fdac6da42a664c73b56fd1c550b5cfc72f4597c58938cb2824"} Jun 08 21:22:51.037658 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:51.037569 2564 generic.go:356] "Generic (PLEG): container finished" podID="26614403-75fb-4ea3-8fdd-e4c8f9650c8e" containerID="4c02070bd669ac05331a4bcd7ac0ff5bf5161e0d48b9ebaa2117e6723ae651d3" exitCode=1 Jun 08 21:22:51.037658 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:51.037642 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-xcgxn" event={"ID":"26614403-75fb-4ea3-8fdd-e4c8f9650c8e","Type":"ContainerDied","Data":"4c02070bd669ac05331a4bcd7ac0ff5bf5161e0d48b9ebaa2117e6723ae651d3"} Jun 08 21:22:51.038218 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:51.038054 2564 scope.go:117] "RemoveContainer" containerID="4c02070bd669ac05331a4bcd7ac0ff5bf5161e0d48b9ebaa2117e6723ae651d3" Jun 08 21:22:52.044722 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:52.044685 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-xcgxn" event={"ID":"26614403-75fb-4ea3-8fdd-e4c8f9650c8e","Type":"ContainerStarted","Data":"829c882a4c06a526b9a516f7a126b3a562f1338ae41871c1dec7c636f11cbcd7"} Jun 08 21:22:52.045174 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:52.044915 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-xcgxn" Jun 08 21:22:52.046475 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:52.046455 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cc7z4" event={"ID":"bdc7cb4f-7e99-4acb-bf59-dcc0b742bd84","Type":"ContainerStarted","Data":"e379e6dba03055caccc68a3a5cf05ee50e6e92ee14b54f108771e9d92b02f965"} Jun 08 21:22:52.078824 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:52.078773 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cc7z4" podStartSLOduration=2.161411225 podStartE2EDuration="5.078759252s" totalImagesPullingTime="1.111203868s" totalInitContainerRuntime="1.806144159s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:22:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:22:52.077509292 +0000 UTC m=+933.335185669" watchObservedRunningTime="2026-06-08 21:22:52.078759252 +0000 UTC m=+933.336435626" Jun 08 21:22:54.023205 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:54.023167 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-hhhmd"] Jun 08 21:22:54.027412 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:54.027391 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hhhmd" Jun 08 21:22:54.030536 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:54.030509 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 08 21:22:54.042521 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:54.042494 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-hhhmd"] Jun 08 21:22:54.045347 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:54.045323 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/01070a95-d3f8-4f43-923c-c5dea4d9d97e-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-hhhmd\" (UID: \"01070a95-d3f8-4f43-923c-c5dea4d9d97e\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hhhmd" Jun 08 21:22:54.045487 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:54.045353 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/01070a95-d3f8-4f43-923c-c5dea4d9d97e-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-hhhmd\" (UID: \"01070a95-d3f8-4f43-923c-c5dea4d9d97e\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hhhmd" Jun 08 21:22:54.045487 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:54.045378 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/01070a95-d3f8-4f43-923c-c5dea4d9d97e-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-hhhmd\" (UID: \"01070a95-d3f8-4f43-923c-c5dea4d9d97e\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hhhmd" Jun 08 21:22:54.045585 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:54.045508 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/01070a95-d3f8-4f43-923c-c5dea4d9d97e-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-hhhmd\" (UID: \"01070a95-d3f8-4f43-923c-c5dea4d9d97e\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hhhmd" Jun 08 21:22:54.045585 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:54.045561 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfw7z\" (UniqueName: \"kubernetes.io/projected/01070a95-d3f8-4f43-923c-c5dea4d9d97e-kube-api-access-nfw7z\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-hhhmd\" (UID: \"01070a95-d3f8-4f43-923c-c5dea4d9d97e\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hhhmd" Jun 08 21:22:54.045664 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:54.045589 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/01070a95-d3f8-4f43-923c-c5dea4d9d97e-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-hhhmd\" (UID: \"01070a95-d3f8-4f43-923c-c5dea4d9d97e\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hhhmd" Jun 08 21:22:54.146642 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:54.146604 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/01070a95-d3f8-4f43-923c-c5dea4d9d97e-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-hhhmd\" (UID: \"01070a95-d3f8-4f43-923c-c5dea4d9d97e\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hhhmd" Jun 08 21:22:54.146835 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:54.146657 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfw7z\" (UniqueName: \"kubernetes.io/projected/01070a95-d3f8-4f43-923c-c5dea4d9d97e-kube-api-access-nfw7z\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-hhhmd\" (UID: \"01070a95-d3f8-4f43-923c-c5dea4d9d97e\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hhhmd" Jun 08 21:22:54.146835 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:54.146678 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/01070a95-d3f8-4f43-923c-c5dea4d9d97e-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-hhhmd\" (UID: \"01070a95-d3f8-4f43-923c-c5dea4d9d97e\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hhhmd" Jun 08 21:22:54.146835 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:54.146725 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/01070a95-d3f8-4f43-923c-c5dea4d9d97e-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-hhhmd\" (UID: \"01070a95-d3f8-4f43-923c-c5dea4d9d97e\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hhhmd" Jun 08 21:22:54.146835 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:54.146748 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/01070a95-d3f8-4f43-923c-c5dea4d9d97e-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-hhhmd\" (UID: \"01070a95-d3f8-4f43-923c-c5dea4d9d97e\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hhhmd" Jun 08 21:22:54.146835 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:54.146776 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/01070a95-d3f8-4f43-923c-c5dea4d9d97e-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-hhhmd\" (UID: \"01070a95-d3f8-4f43-923c-c5dea4d9d97e\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hhhmd" Jun 08 21:22:54.147070 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:54.147035 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/01070a95-d3f8-4f43-923c-c5dea4d9d97e-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-hhhmd\" (UID: \"01070a95-d3f8-4f43-923c-c5dea4d9d97e\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hhhmd" Jun 08 21:22:54.147110 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:54.147070 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/01070a95-d3f8-4f43-923c-c5dea4d9d97e-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-hhhmd\" (UID: \"01070a95-d3f8-4f43-923c-c5dea4d9d97e\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hhhmd" Jun 08 21:22:54.147257 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:54.147231 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/01070a95-d3f8-4f43-923c-c5dea4d9d97e-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-hhhmd\" (UID: \"01070a95-d3f8-4f43-923c-c5dea4d9d97e\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hhhmd" Jun 08 21:22:54.149204 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:54.149172 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/01070a95-d3f8-4f43-923c-c5dea4d9d97e-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-hhhmd\" (UID: \"01070a95-d3f8-4f43-923c-c5dea4d9d97e\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hhhmd" Jun 08 21:22:54.149509 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:54.149488 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/01070a95-d3f8-4f43-923c-c5dea4d9d97e-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-hhhmd\" (UID: \"01070a95-d3f8-4f43-923c-c5dea4d9d97e\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hhhmd" Jun 08 21:22:54.154629 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:54.154609 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfw7z\" (UniqueName: \"kubernetes.io/projected/01070a95-d3f8-4f43-923c-c5dea4d9d97e-kube-api-access-nfw7z\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-hhhmd\" (UID: \"01070a95-d3f8-4f43-923c-c5dea4d9d97e\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hhhmd" Jun 08 21:22:54.337183 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:54.337102 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hhhmd" Jun 08 21:22:54.472220 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:54.472122 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-hhhmd"] Jun 08 21:22:54.474390 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:22:54.474364 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01070a95_d3f8_4f43_923c_c5dea4d9d97e.slice/crio-224dbdbdc2bb20692546205c778e37eb01818733c86f7780ff91e21cbe6c4517 WatchSource:0}: Error finding container 224dbdbdc2bb20692546205c778e37eb01818733c86f7780ff91e21cbe6c4517: Status 404 returned error can't find the container with id 224dbdbdc2bb20692546205c778e37eb01818733c86f7780ff91e21cbe6c4517 Jun 08 21:22:55.064624 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:55.064584 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hhhmd" event={"ID":"01070a95-d3f8-4f43-923c-c5dea4d9d97e","Type":"ContainerStarted","Data":"fa38f7b77e9351eb6422e9adb25ba7d4c2a7ae9e79d7ce9a04e956a528cc3428"} Jun 08 21:22:55.064624 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:55.064628 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hhhmd" event={"ID":"01070a95-d3f8-4f43-923c-c5dea4d9d97e","Type":"ContainerStarted","Data":"224dbdbdc2bb20692546205c778e37eb01818733c86f7780ff91e21cbe6c4517"} Jun 08 21:22:55.102445 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:55.102409 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqjds"] Jun 08 21:22:56.071135 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:56.071038 2564 generic.go:356] "Generic (PLEG): container finished" podID="01070a95-d3f8-4f43-923c-c5dea4d9d97e" containerID="fa38f7b77e9351eb6422e9adb25ba7d4c2a7ae9e79d7ce9a04e956a528cc3428" exitCode=0 Jun 08 21:22:56.071135 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:56.071093 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hhhmd" event={"ID":"01070a95-d3f8-4f43-923c-c5dea4d9d97e","Type":"ContainerDied","Data":"fa38f7b77e9351eb6422e9adb25ba7d4c2a7ae9e79d7ce9a04e956a528cc3428"} Jun 08 21:22:57.078687 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:57.078652 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hhhmd" event={"ID":"01070a95-d3f8-4f43-923c-c5dea4d9d97e","Type":"ContainerStarted","Data":"e1a98002ffeb1f55788035a4491cd7d990eca656a4e19ac68b34d998daee10fa"} Jun 08 21:22:57.096000 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:57.095927 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hhhmd" podStartSLOduration=2.5693701129999997 podStartE2EDuration="4.095910682s" totalImagesPullingTime="261.518542ms" totalInitContainerRuntime="1.265022027s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:22:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:22:57.095177917 +0000 UTC m=+938.352854289" watchObservedRunningTime="2026-06-08 21:22:57.095910682 +0000 UTC m=+938.353587057" Jun 08 21:22:57.704228 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:57.704195 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cc7z4" Jun 08 21:22:57.704442 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:57.704253 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cc7z4" Jun 08 21:22:57.717931 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:57.717901 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cc7z4" Jun 08 21:22:58.095198 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:22:58.095179 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cc7z4" Jun 08 21:23:03.054180 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:23:03.054150 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-xcgxn" Jun 08 21:23:04.337348 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:23:04.337314 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hhhmd" Jun 08 21:23:04.337755 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:23:04.337358 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hhhmd" Jun 08 21:23:04.349710 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:23:04.349688 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hhhmd" Jun 08 21:23:05.131462 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:23:05.131435 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hhhmd" Jun 08 21:24:51.615145 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:24:51.615109 2564 generic.go:356] "Generic (PLEG): container finished" podID="26614403-75fb-4ea3-8fdd-e4c8f9650c8e" containerID="829c882a4c06a526b9a516f7a126b3a562f1338ae41871c1dec7c636f11cbcd7" exitCode=1 Jun 08 21:24:51.615691 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:24:51.615182 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-xcgxn" event={"ID":"26614403-75fb-4ea3-8fdd-e4c8f9650c8e","Type":"ContainerDied","Data":"829c882a4c06a526b9a516f7a126b3a562f1338ae41871c1dec7c636f11cbcd7"} Jun 08 21:24:51.615691 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:24:51.615287 2564 scope.go:117] "RemoveContainer" containerID="4c02070bd669ac05331a4bcd7ac0ff5bf5161e0d48b9ebaa2117e6723ae651d3" Jun 08 21:24:51.615691 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:24:51.615619 2564 scope.go:117] "RemoveContainer" containerID="829c882a4c06a526b9a516f7a126b3a562f1338ae41871c1dec7c636f11cbcd7" Jun 08 21:24:51.615913 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:24:51.615893 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 10s restarting failed container=payload-processing pod=payload-processing-7c6c859784-xcgxn_openshift-ingress(26614403-75fb-4ea3-8fdd-e4c8f9650c8e)\"" pod="openshift-ingress/payload-processing-7c6c859784-xcgxn" podUID="26614403-75fb-4ea3-8fdd-e4c8f9650c8e" Jun 08 21:24:53.052665 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:24:53.052634 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-xcgxn" Jun 08 21:24:53.053059 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:24:53.052974 2564 scope.go:117] "RemoveContainer" containerID="829c882a4c06a526b9a516f7a126b3a562f1338ae41871c1dec7c636f11cbcd7" Jun 08 21:24:53.053181 ip-10-0-133-247 kubenswrapper[2564]: E0608 21:24:53.053163 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 10s restarting failed container=payload-processing pod=payload-processing-7c6c859784-xcgxn_openshift-ingress(26614403-75fb-4ea3-8fdd-e4c8f9650c8e)\"" pod="openshift-ingress/payload-processing-7c6c859784-xcgxn" podUID="26614403-75fb-4ea3-8fdd-e4c8f9650c8e" Jun 08 21:24:56.462192 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:24:56.462161 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5878f5f596-276nr_15b1095d-40aa-41af-a0bc-eb8ac5be1e5f/nginx/0.log" Jun 08 21:24:56.690446 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:24:56.690411 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-xk5z2_7f105ac5-db47-4a8c-ac59-dbb61e64b4cc/manager/0.log" Jun 08 21:24:56.809074 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:24:56.808998 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-m6lln_2738d7dc-1fa7-4515-8ab1-0081e0151338/manager/0.log" Jun 08 21:24:57.044158 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:24:57.044125 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-6hnmd_361593ae-f855-4f44-8481-9fb11492bc51/server/0.log" Jun 08 21:24:57.158166 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:24:57.158134 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-vx7rs_a77b5ad6-2f5e-490c-8e4a-86bcfee473d0/manager/0.log" Jun 08 21:24:57.520026 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:24:57.519949 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-598c8c4df5-pskbn_c2ebb161-313b-4e21-8a3f-e8b8c4b33fa4/copy-manifests/0.log" Jun 08 21:24:57.533204 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:24:57.533164 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-598c8c4df5-pskbn_c2ebb161-313b-4e21-8a3f-e8b8c4b33fa4/manager/0.log" Jun 08 21:24:58.955491 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:24:58.955457 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-nbflx_11729911-6017-4c07-8230-05989b9d0c40/manager/0.log" Jun 08 21:24:59.551588 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:24:59.551554 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-pqjds_d7c4068f-2b40-4640-b4df-b2afb131ea41/limitador/0.log" Jun 08 21:25:00.147795 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:00.147766 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-p9q7f_cba49617-3046-41dd-953a-374a4261ab64/discovery/0.log" Jun 08 21:25:00.263660 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:00.263628 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-58c984cbf9-c9thn_639b9953-6cf4-4a88-8528-0591da47579f/kube-auth-proxy/0.log" Jun 08 21:25:00.726073 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:00.726027 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-xcgxn_26614403-75fb-4ea3-8fdd-e4c8f9650c8e/payload-processing/1.log" Jun 08 21:25:01.436795 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:01.436768 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-898xx_07a25526-8939-412b-8c5e-7f216b076a32/storage-initializer/0.log" Jun 08 21:25:01.678170 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:01.678142 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-cc7z4_bdc7cb4f-7e99-4acb-bf59-dcc0b742bd84/storage-initializer/0.log" Jun 08 21:25:01.686439 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:01.686400 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-cc7z4_bdc7cb4f-7e99-4acb-bf59-dcc0b742bd84/main/0.log" Jun 08 21:25:01.801194 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:01.801090 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-hhhmd_01070a95-d3f8-4f43-923c-c5dea4d9d97e/storage-initializer/0.log" Jun 08 21:25:01.808719 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:01.808697 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-hhhmd_01070a95-d3f8-4f43-923c-c5dea4d9d97e/main/0.log" Jun 08 21:25:06.136823 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:06.136750 2564 scope.go:117] "RemoveContainer" containerID="829c882a4c06a526b9a516f7a126b3a562f1338ae41871c1dec7c636f11cbcd7" Jun 08 21:25:06.692064 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:06.692032 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-xcgxn" event={"ID":"26614403-75fb-4ea3-8fdd-e4c8f9650c8e","Type":"ContainerStarted","Data":"98610c5e6264c6b18a061f336493fe9b5ad9569cdaea79f5746d5eb1bd7f0407"} Jun 08 21:25:06.692259 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:06.692240 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-xcgxn" Jun 08 21:25:08.983846 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:08.983820 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9pzqb_502a6cc3-183a-4d9d-833d-2f14f5e1c946/global-pull-secret-syncer/0.log" Jun 08 21:25:09.117549 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:09.117516 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-s5gwn_dc019e92-af44-4184-8277-e14ccbbe377a/konnectivity-agent/0.log" Jun 08 21:25:09.137542 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:09.137511 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-247.ec2.internal_0313b76425dedbbdaa2ce42744a43bc4/haproxy/0.log" Jun 08 21:25:12.585007 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:12.584979 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-vgt65_c32ce703-5c5b-4d8a-98a4-d3ffe71f6608/sail-operator/0.log" Jun 08 21:25:14.201932 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:14.201901 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-nbflx_11729911-6017-4c07-8230-05989b9d0c40/manager/0.log" Jun 08 21:25:14.352625 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:14.352600 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-pqjds_d7c4068f-2b40-4640-b4df-b2afb131ea41/limitador/0.log" Jun 08 21:25:16.362151 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:16.362121 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2vzws_ce9991a2-3c1a-4e14-b155-131273415f12/node-exporter/0.log" Jun 08 21:25:16.391468 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:16.391437 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2vzws_ce9991a2-3c1a-4e14-b155-131273415f12/kube-rbac-proxy/0.log" Jun 08 21:25:16.414187 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:16.414165 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2vzws_ce9991a2-3c1a-4e14-b155-131273415f12/init-textfile/0.log" Jun 08 21:25:16.715608 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:16.715580 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2c525714-d79a-48df-9957-e907893153bf/prometheus/0.log" Jun 08 21:25:16.736594 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:16.736566 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2c525714-d79a-48df-9957-e907893153bf/config-reloader/0.log" Jun 08 21:25:16.757594 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:16.757523 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2c525714-d79a-48df-9957-e907893153bf/thanos-sidecar/0.log" Jun 08 21:25:16.785435 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:16.785397 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2c525714-d79a-48df-9957-e907893153bf/kube-rbac-proxy-web/0.log" Jun 08 21:25:16.821255 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:16.821234 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2c525714-d79a-48df-9957-e907893153bf/kube-rbac-proxy/0.log" Jun 08 21:25:16.845882 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:16.845858 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2c525714-d79a-48df-9957-e907893153bf/kube-rbac-proxy-thanos/0.log" Jun 08 21:25:16.868818 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:16.868795 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2c525714-d79a-48df-9957-e907893153bf/init-config-reloader/0.log" Jun 08 21:25:17.012978 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:17.012906 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7bd7945487-rc87h_c1f6da7d-d86d-4c7f-a2c3-0043b8f6194f/telemeter-client/0.log" Jun 08 21:25:17.038247 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:17.038224 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7bd7945487-rc87h_c1f6da7d-d86d-4c7f-a2c3-0043b8f6194f/reload/0.log" Jun 08 21:25:17.060205 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:17.060174 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7bd7945487-rc87h_c1f6da7d-d86d-4c7f-a2c3-0043b8f6194f/kube-rbac-proxy/0.log" Jun 08 21:25:17.698304 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:17.698257 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-xcgxn" Jun 08 21:25:20.575843 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:20.575806 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6lpfs/perf-node-gather-daemonset-p9ngz"] Jun 08 21:25:20.579515 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:20.579492 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6lpfs/perf-node-gather-daemonset-p9ngz" Jun 08 21:25:20.581863 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:20.581839 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6lpfs\"/\"default-dockercfg-99bb6\"" Jun 08 21:25:20.581962 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:20.581839 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6lpfs\"/\"openshift-service-ca.crt\"" Jun 08 21:25:20.583025 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:20.583008 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6lpfs\"/\"kube-root-ca.crt\"" Jun 08 21:25:20.588406 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:20.588382 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6lpfs/perf-node-gather-daemonset-p9ngz"] Jun 08 21:25:20.707016 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:20.706986 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fa61ece6-264e-4fa5-81b9-240730756feb-proc\") pod \"perf-node-gather-daemonset-p9ngz\" (UID: \"fa61ece6-264e-4fa5-81b9-240730756feb\") " pod="openshift-must-gather-6lpfs/perf-node-gather-daemonset-p9ngz" Jun 08 21:25:20.707204 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:20.707059 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fa61ece6-264e-4fa5-81b9-240730756feb-sys\") pod \"perf-node-gather-daemonset-p9ngz\" (UID: \"fa61ece6-264e-4fa5-81b9-240730756feb\") " pod="openshift-must-gather-6lpfs/perf-node-gather-daemonset-p9ngz" Jun 08 21:25:20.707204 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:20.707086 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fa61ece6-264e-4fa5-81b9-240730756feb-lib-modules\") pod \"perf-node-gather-daemonset-p9ngz\" (UID: \"fa61ece6-264e-4fa5-81b9-240730756feb\") " pod="openshift-must-gather-6lpfs/perf-node-gather-daemonset-p9ngz" Jun 08 21:25:20.707204 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:20.707107 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xch4c\" (UniqueName: \"kubernetes.io/projected/fa61ece6-264e-4fa5-81b9-240730756feb-kube-api-access-xch4c\") pod \"perf-node-gather-daemonset-p9ngz\" (UID: \"fa61ece6-264e-4fa5-81b9-240730756feb\") " pod="openshift-must-gather-6lpfs/perf-node-gather-daemonset-p9ngz" Jun 08 21:25:20.707386 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:20.707212 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fa61ece6-264e-4fa5-81b9-240730756feb-podres\") pod \"perf-node-gather-daemonset-p9ngz\" (UID: \"fa61ece6-264e-4fa5-81b9-240730756feb\") " pod="openshift-must-gather-6lpfs/perf-node-gather-daemonset-p9ngz" Jun 08 21:25:20.808077 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:20.808035 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fa61ece6-264e-4fa5-81b9-240730756feb-sys\") pod \"perf-node-gather-daemonset-p9ngz\" (UID: \"fa61ece6-264e-4fa5-81b9-240730756feb\") " pod="openshift-must-gather-6lpfs/perf-node-gather-daemonset-p9ngz" Jun 08 21:25:20.808300 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:20.808085 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fa61ece6-264e-4fa5-81b9-240730756feb-lib-modules\") pod \"perf-node-gather-daemonset-p9ngz\" (UID: \"fa61ece6-264e-4fa5-81b9-240730756feb\") " pod="openshift-must-gather-6lpfs/perf-node-gather-daemonset-p9ngz" Jun 08 21:25:20.808300 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:20.808142 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xch4c\" (UniqueName: \"kubernetes.io/projected/fa61ece6-264e-4fa5-81b9-240730756feb-kube-api-access-xch4c\") pod \"perf-node-gather-daemonset-p9ngz\" (UID: \"fa61ece6-264e-4fa5-81b9-240730756feb\") " pod="openshift-must-gather-6lpfs/perf-node-gather-daemonset-p9ngz" Jun 08 21:25:20.808300 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:20.808237 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fa61ece6-264e-4fa5-81b9-240730756feb-podres\") pod \"perf-node-gather-daemonset-p9ngz\" (UID: \"fa61ece6-264e-4fa5-81b9-240730756feb\") " pod="openshift-must-gather-6lpfs/perf-node-gather-daemonset-p9ngz" Jun 08 21:25:20.808300 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:20.808296 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fa61ece6-264e-4fa5-81b9-240730756feb-sys\") pod \"perf-node-gather-daemonset-p9ngz\" (UID: \"fa61ece6-264e-4fa5-81b9-240730756feb\") " pod="openshift-must-gather-6lpfs/perf-node-gather-daemonset-p9ngz" Jun 08 21:25:20.808494 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:20.808299 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fa61ece6-264e-4fa5-81b9-240730756feb-proc\") pod \"perf-node-gather-daemonset-p9ngz\" (UID: \"fa61ece6-264e-4fa5-81b9-240730756feb\") " pod="openshift-must-gather-6lpfs/perf-node-gather-daemonset-p9ngz" Jun 08 21:25:20.808494 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:20.808242 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fa61ece6-264e-4fa5-81b9-240730756feb-lib-modules\") pod \"perf-node-gather-daemonset-p9ngz\" (UID: \"fa61ece6-264e-4fa5-81b9-240730756feb\") " pod="openshift-must-gather-6lpfs/perf-node-gather-daemonset-p9ngz" Jun 08 21:25:20.808494 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:20.808353 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fa61ece6-264e-4fa5-81b9-240730756feb-proc\") pod \"perf-node-gather-daemonset-p9ngz\" (UID: \"fa61ece6-264e-4fa5-81b9-240730756feb\") " pod="openshift-must-gather-6lpfs/perf-node-gather-daemonset-p9ngz" Jun 08 21:25:20.808494 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:20.808422 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fa61ece6-264e-4fa5-81b9-240730756feb-podres\") pod \"perf-node-gather-daemonset-p9ngz\" (UID: \"fa61ece6-264e-4fa5-81b9-240730756feb\") " pod="openshift-must-gather-6lpfs/perf-node-gather-daemonset-p9ngz" Jun 08 21:25:20.816378 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:20.816353 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xch4c\" (UniqueName: \"kubernetes.io/projected/fa61ece6-264e-4fa5-81b9-240730756feb-kube-api-access-xch4c\") pod \"perf-node-gather-daemonset-p9ngz\" (UID: \"fa61ece6-264e-4fa5-81b9-240730756feb\") " pod="openshift-must-gather-6lpfs/perf-node-gather-daemonset-p9ngz" Jun 08 21:25:20.890229 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:20.890195 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6lpfs/perf-node-gather-daemonset-p9ngz" Jun 08 21:25:21.021359 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:21.021330 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6lpfs/perf-node-gather-daemonset-p9ngz"] Jun 08 21:25:21.024341 ip-10-0-133-247 kubenswrapper[2564]: W0608 21:25:21.024311 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podfa61ece6_264e_4fa5_81b9_240730756feb.slice/crio-f9f85214c308ac904e633eaf228ecf7e008c35a638f2a048fb39f4ea98674691 WatchSource:0}: Error finding container f9f85214c308ac904e633eaf228ecf7e008c35a638f2a048fb39f4ea98674691: Status 404 returned error can't find the container with id f9f85214c308ac904e633eaf228ecf7e008c35a638f2a048fb39f4ea98674691 Jun 08 21:25:21.763180 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:21.763140 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6lpfs/perf-node-gather-daemonset-p9ngz" event={"ID":"fa61ece6-264e-4fa5-81b9-240730756feb","Type":"ContainerStarted","Data":"a12084b0ae3c6ade7f4cde4b3937c9f3a9df2b88c25a9b2561f9c061754b4a7f"} Jun 08 21:25:21.763670 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:21.763193 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6lpfs/perf-node-gather-daemonset-p9ngz" event={"ID":"fa61ece6-264e-4fa5-81b9-240730756feb","Type":"ContainerStarted","Data":"f9f85214c308ac904e633eaf228ecf7e008c35a638f2a048fb39f4ea98674691"} Jun 08 21:25:21.763670 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:21.763215 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6lpfs/perf-node-gather-daemonset-p9ngz" Jun 08 21:25:21.782032 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:21.781981 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6lpfs/perf-node-gather-daemonset-p9ngz" podStartSLOduration=1.7819644239999999 podStartE2EDuration="1.781964424s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 21:25:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:25:21.780357813 +0000 UTC m=+1083.038034188" watchObservedRunningTime="2026-06-08 21:25:21.781964424 +0000 UTC m=+1083.039640839" Jun 08 21:25:21.934813 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:21.934786 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-t8nlh_0ca98eeb-ce9d-438c-857a-15126a9b53d9/dns/0.log" Jun 08 21:25:21.955253 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:21.955231 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-t8nlh_0ca98eeb-ce9d-438c-857a-15126a9b53d9/kube-rbac-proxy/0.log" Jun 08 21:25:22.080785 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:22.080712 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zhdb2_4fcb5113-dc25-491d-b570-2c2818b90ea9/dns-node-resolver/0.log" Jun 08 21:25:22.636792 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:22.636767 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ls8lw_767ccdbc-66e2-441f-932d-4ae6885b6411/node-ca/0.log" Jun 08 21:25:23.642431 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:23.642399 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-p9q7f_cba49617-3046-41dd-953a-374a4261ab64/discovery/0.log" Jun 08 21:25:23.661258 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:23.661234 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-58c984cbf9-c9thn_639b9953-6cf4-4a88-8528-0591da47579f/kube-auth-proxy/0.log" Jun 08 21:25:23.759823 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:23.759792 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-xcgxn_26614403-75fb-4ea3-8fdd-e4c8f9650c8e/payload-processing/2.log" Jun 08 21:25:23.763677 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:23.763657 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-xcgxn_26614403-75fb-4ea3-8fdd-e4c8f9650c8e/payload-processing/1.log" Jun 08 21:25:24.385162 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:24.385127 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9s24h_9df91842-6892-4958-8620-329df65f8afc/serve-healthcheck-canary/0.log" Jun 08 21:25:25.092786 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:25.092759 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qtdwj_67ba959e-bffc-4172-b5e6-7c644b28e9ed/kube-rbac-proxy/0.log" Jun 08 21:25:25.114041 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:25.114014 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qtdwj_67ba959e-bffc-4172-b5e6-7c644b28e9ed/exporter/0.log" Jun 08 21:25:25.136317 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:25.136289 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qtdwj_67ba959e-bffc-4172-b5e6-7c644b28e9ed/extractor/0.log" Jun 08 21:25:27.295041 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:27.295017 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5878f5f596-276nr_15b1095d-40aa-41af-a0bc-eb8ac5be1e5f/nginx/0.log" Jun 08 21:25:27.344463 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:27.344436 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-xk5z2_7f105ac5-db47-4a8c-ac59-dbb61e64b4cc/manager/0.log" Jun 08 21:25:27.374073 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:27.374041 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-m6lln_2738d7dc-1fa7-4515-8ab1-0081e0151338/manager/0.log" Jun 08 21:25:27.418888 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:27.418859 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-6hnmd_361593ae-f855-4f44-8481-9fb11492bc51/server/0.log" Jun 08 21:25:27.464552 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:27.464520 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-vx7rs_a77b5ad6-2f5e-490c-8e4a-86bcfee473d0/manager/0.log" Jun 08 21:25:27.617471 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:27.617440 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-598c8c4df5-pskbn_c2ebb161-313b-4e21-8a3f-e8b8c4b33fa4/manager/0.log" Jun 08 21:25:27.634058 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:27.634034 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-598c8c4df5-pskbn_c2ebb161-313b-4e21-8a3f-e8b8c4b33fa4/copy-manifests/0.log" Jun 08 21:25:27.777903 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:27.777867 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6lpfs/perf-node-gather-daemonset-p9ngz" Jun 08 21:25:34.827816 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:34.827789 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-p9q7f_cba49617-3046-41dd-953a-374a4261ab64/discovery/0.log" Jun 08 21:25:34.839405 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:34.839379 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-58c984cbf9-c9thn_639b9953-6cf4-4a88-8528-0591da47579f/kube-auth-proxy/0.log" Jun 08 21:25:34.916110 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:34.916079 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-xcgxn_26614403-75fb-4ea3-8fdd-e4c8f9650c8e/payload-processing/2.log" Jun 08 21:25:34.920254 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:34.920235 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-xcgxn_26614403-75fb-4ea3-8fdd-e4c8f9650c8e/payload-processing/1.log" Jun 08 21:25:36.118109 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:36.118031 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-p9q7f_cba49617-3046-41dd-953a-374a4261ab64/discovery/0.log" Jun 08 21:25:36.131110 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:36.131089 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-58c984cbf9-c9thn_639b9953-6cf4-4a88-8528-0591da47579f/kube-auth-proxy/0.log" Jun 08 21:25:36.215293 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:36.215240 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-xcgxn_26614403-75fb-4ea3-8fdd-e4c8f9650c8e/payload-processing/2.log" Jun 08 21:25:36.219756 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:36.219734 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-xcgxn_26614403-75fb-4ea3-8fdd-e4c8f9650c8e/payload-processing/1.log" Jun 08 21:25:36.778429 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:36.778402 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6fp8f_78668bcc-29d2-42c0-9b9e-4e356590bb96/kube-multus-additional-cni-plugins/0.log" Jun 08 21:25:36.799153 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:36.799123 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6fp8f_78668bcc-29d2-42c0-9b9e-4e356590bb96/egress-router-binary-copy/0.log" Jun 08 21:25:36.822057 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:36.822031 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6fp8f_78668bcc-29d2-42c0-9b9e-4e356590bb96/cni-plugins/0.log" Jun 08 21:25:36.852544 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:36.852516 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6fp8f_78668bcc-29d2-42c0-9b9e-4e356590bb96/bond-cni-plugin/0.log" Jun 08 21:25:36.873586 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:36.873559 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6fp8f_78668bcc-29d2-42c0-9b9e-4e356590bb96/routeoverride-cni/0.log" Jun 08 21:25:36.895909 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:36.895882 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6fp8f_78668bcc-29d2-42c0-9b9e-4e356590bb96/whereabouts-cni-bincopy/0.log" Jun 08 21:25:36.915554 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:36.915526 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6fp8f_78668bcc-29d2-42c0-9b9e-4e356590bb96/whereabouts-cni/0.log" Jun 08 21:25:37.136532 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:37.136499 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-sljxg_751418cf-8061-45fc-b69f-8e45f348cd88/kube-multus/0.log" Jun 08 21:25:37.292659 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:37.292626 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xx978_2d7e9360-16e4-4a37-a3e1-b734efbc6292/network-metrics-daemon/0.log" Jun 08 21:25:37.316209 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:37.316183 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xx978_2d7e9360-16e4-4a37-a3e1-b734efbc6292/kube-rbac-proxy/0.log" Jun 08 21:25:37.789424 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:37.789399 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-p9q7f_cba49617-3046-41dd-953a-374a4261ab64/discovery/0.log" Jun 08 21:25:37.802681 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:37.802658 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-58c984cbf9-c9thn_639b9953-6cf4-4a88-8528-0591da47579f/kube-auth-proxy/0.log" Jun 08 21:25:37.876119 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:37.876094 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-xcgxn_26614403-75fb-4ea3-8fdd-e4c8f9650c8e/payload-processing/2.log" Jun 08 21:25:37.880186 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:37.880169 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-xcgxn_26614403-75fb-4ea3-8fdd-e4c8f9650c8e/payload-processing/1.log" Jun 08 21:25:38.676440 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:38.676411 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pt842_85a49d6e-acdf-43ce-b9c9-1c2d7773a948/ovn-controller/0.log" Jun 08 21:25:38.694709 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:38.694680 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pt842_85a49d6e-acdf-43ce-b9c9-1c2d7773a948/ovn-acl-logging/0.log" Jun 08 21:25:38.694857 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:38.694757 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pt842_85a49d6e-acdf-43ce-b9c9-1c2d7773a948/ovn-acl-logging/1.log" Jun 08 21:25:38.713403 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:38.713380 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pt842_85a49d6e-acdf-43ce-b9c9-1c2d7773a948/kube-rbac-proxy-node/0.log" Jun 08 21:25:38.733580 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:38.733552 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pt842_85a49d6e-acdf-43ce-b9c9-1c2d7773a948/kube-rbac-proxy-ovn-metrics/0.log" Jun 08 21:25:38.751403 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:38.751383 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pt842_85a49d6e-acdf-43ce-b9c9-1c2d7773a948/northd/0.log" Jun 08 21:25:38.771494 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:38.771473 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pt842_85a49d6e-acdf-43ce-b9c9-1c2d7773a948/nbdb/0.log" Jun 08 21:25:38.790883 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:38.790861 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pt842_85a49d6e-acdf-43ce-b9c9-1c2d7773a948/sbdb/0.log" Jun 08 21:25:38.828248 ip-10-0-133-247 kubenswrapper[2564]: I0608 21:25:38.828223 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pt842_85a49d6e-acdf-43ce-b9c9-1c2d7773a948/ovnkube-controller/0.log"