Jun 02 12:36:59.022112 ip-10-0-128-229 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 02 12:36:59.022124 ip-10-0-128-229 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 02 12:36:59.022132 ip-10-0-128-229 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 02 12:36:59.022344 ip-10-0-128-229 systemd[1]: Failed to start Kubernetes Kubelet. Jun 02 12:37:09.183578 ip-10-0-128-229 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 02 12:37:09.183597 ip-10-0-128-229 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 5ae0abdb72d2497f87ea58729e9caa6e -- Jun 02 12:39:29.981117 ip-10-0-128-229 systemd[1]: Starting Kubernetes Kubelet... Jun 02 12:39:30.447466 ip-10-0-128-229 kubenswrapper[2545]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 12:39:30.447466 ip-10-0-128-229 kubenswrapper[2545]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 02 12:39:30.447466 ip-10-0-128-229 kubenswrapper[2545]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 12:39:30.447466 ip-10-0-128-229 kubenswrapper[2545]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 02 12:39:30.447466 ip-10-0-128-229 kubenswrapper[2545]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 12:39:30.450847 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.450741 2545 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 02 12:39:30.454869 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.454855 2545 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 12:39:30.454869 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.454869 2545 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 12:39:30.454927 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.454873 2545 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 12:39:30.454927 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.454877 2545 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 12:39:30.454927 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.454880 2545 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 12:39:30.454927 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.454883 2545 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 12:39:30.454927 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.454885 2545 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 12:39:30.454927 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.454888 2545 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 12:39:30.454927 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.454891 2545 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 12:39:30.454927 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.454899 2545 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 12:39:30.454927 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.454902 2545 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 12:39:30.454927 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.454904 2545 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 12:39:30.454927 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.454907 2545 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 12:39:30.454927 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.454909 2545 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 12:39:30.454927 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.454912 2545 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 12:39:30.454927 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.454915 2545 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 12:39:30.454927 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.454917 2545 feature_gate.go:328] unrecognized feature gate: Example Jun 02 12:39:30.454927 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.454920 2545 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 12:39:30.454927 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.454923 2545 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 12:39:30.454927 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.454925 2545 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 12:39:30.454927 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.454928 2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 12:39:30.454927 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.454931 2545 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 12:39:30.455392 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.454933 2545 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 12:39:30.455392 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.454936 2545 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 12:39:30.455392 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.454939 2545 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 12:39:30.455392 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.454942 2545 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 12:39:30.455392 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.454944 2545 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 12:39:30.455392 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.454947 2545 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 12:39:30.455392 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.454950 2545 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 12:39:30.455392 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.454952 2545 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 12:39:30.455392 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.454955 2545 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 12:39:30.455392 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.454957 2545 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 12:39:30.455392 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.454960 2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 12:39:30.455392 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.454964 2545 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 12:39:30.455392 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.454966 2545 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 12:39:30.455392 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.454969 2545 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 12:39:30.455392 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.454972 2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 12:39:30.455392 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.454974 2545 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 12:39:30.455392 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.454977 2545 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 12:39:30.455392 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.454979 2545 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 12:39:30.455392 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.454982 2545 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 12:39:30.455392 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.454984 2545 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 12:39:30.455885 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.454986 2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 12:39:30.455885 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.454992 2545 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 12:39:30.455885 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.454995 2545 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 12:39:30.455885 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.454998 2545 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 12:39:30.455885 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.455001 2545 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 12:39:30.455885 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.455003 2545 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 12:39:30.455885 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.455006 2545 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 12:39:30.455885 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.455008 2545 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 12:39:30.455885 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.455011 2545 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 12:39:30.455885 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.455013 2545 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 12:39:30.455885 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.455015 2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 12:39:30.455885 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.455018 2545 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 12:39:30.455885 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.455022 2545 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 12:39:30.455885 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.455026 2545 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 12:39:30.455885 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.455030 2545 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 12:39:30.455885 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.455032 2545 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 12:39:30.455885 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.455035 2545 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 12:39:30.455885 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.455038 2545 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 12:39:30.455885 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.455041 2545 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 12:39:30.456342 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.455043 2545 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 12:39:30.456342 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.455046 2545 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 12:39:30.456342 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.455048 2545 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 12:39:30.456342 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.455051 2545 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 12:39:30.456342 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.455054 2545 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 12:39:30.456342 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.455057 2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 12:39:30.456342 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.455059 2545 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 12:39:30.456342 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.455062 2545 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 12:39:30.456342 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.455064 2545 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 12:39:30.456342 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.455067 2545 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 12:39:30.456342 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.455069 2545 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 12:39:30.456342 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.455071 2545 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 12:39:30.456342 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.455074 2545 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 12:39:30.456342 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.455076 2545 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 12:39:30.456342 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.455079 2545 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 12:39:30.456342 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.455083 2545 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 12:39:30.456342 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.455085 2545 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 12:39:30.456342 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.455088 2545 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 12:39:30.456342 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.455091 2545 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 12:39:30.456342 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.455093 2545 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 12:39:30.456819 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.455096 2545 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 12:39:30.456819 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.455098 2545 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 12:39:30.456819 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.455101 2545 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 12:39:30.456819 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.455104 2545 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 12:39:30.456819 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.455106 2545 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 12:39:30.457191 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457180 2545 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 12:39:30.457191 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457191 2545 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 12:39:30.457245 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457194 2545 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 12:39:30.457245 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457197 2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 12:39:30.457245 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457200 2545 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 12:39:30.457245 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457204 2545 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 12:39:30.457245 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457207 2545 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 12:39:30.457245 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457215 2545 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 12:39:30.457245 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457217 2545 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 12:39:30.457245 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457220 2545 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 12:39:30.457245 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457223 2545 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 12:39:30.457245 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457225 2545 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 12:39:30.457245 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457228 2545 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 12:39:30.457245 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457231 2545 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 12:39:30.457245 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457234 2545 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 12:39:30.457245 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457236 2545 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 12:39:30.457245 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457239 2545 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 12:39:30.457245 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457242 2545 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 12:39:30.457245 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457244 2545 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 12:39:30.457245 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457247 2545 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 12:39:30.457245 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457250 2545 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 12:39:30.457695 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457253 2545 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 12:39:30.457695 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457256 2545 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 12:39:30.457695 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457259 2545 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 12:39:30.457695 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457262 2545 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 12:39:30.457695 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457264 2545 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 12:39:30.457695 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457267 2545 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 12:39:30.457695 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457269 2545 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 12:39:30.457695 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457272 2545 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 12:39:30.457695 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457275 2545 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 12:39:30.457695 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457277 2545 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 12:39:30.457695 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457280 2545 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 12:39:30.457695 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457282 2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 12:39:30.457695 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457286 2545 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 12:39:30.457695 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457290 2545 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 12:39:30.457695 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457294 2545 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 12:39:30.457695 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457297 2545 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 12:39:30.457695 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457300 2545 feature_gate.go:328] unrecognized feature gate: Example Jun 02 12:39:30.457695 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457302 2545 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 12:39:30.457695 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457305 2545 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 12:39:30.458272 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457308 2545 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 12:39:30.458272 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457310 2545 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 12:39:30.458272 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457313 2545 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 12:39:30.458272 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457315 2545 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 12:39:30.458272 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457318 2545 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 12:39:30.458272 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457321 2545 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 12:39:30.458272 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457323 2545 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 12:39:30.458272 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457326 2545 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 12:39:30.458272 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457328 2545 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 12:39:30.458272 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457331 2545 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 12:39:30.458272 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457334 2545 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 12:39:30.458272 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457336 2545 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 12:39:30.458272 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457339 2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 12:39:30.458272 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457341 2545 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 12:39:30.458272 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457348 2545 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 12:39:30.458272 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457351 2545 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 12:39:30.458272 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457353 2545 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 12:39:30.458272 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457356 2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 12:39:30.458272 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457358 2545 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 12:39:30.458272 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457361 2545 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 12:39:30.458761 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457364 2545 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 12:39:30.458761 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457366 2545 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 12:39:30.458761 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457369 2545 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 12:39:30.458761 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457371 2545 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 12:39:30.458761 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457374 2545 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 12:39:30.458761 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457378 2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 12:39:30.458761 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457381 2545 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 12:39:30.458761 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457383 2545 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 12:39:30.458761 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457387 2545 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 12:39:30.458761 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457390 2545 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 12:39:30.458761 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457393 2545 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 12:39:30.458761 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457395 2545 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 12:39:30.458761 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457398 2545 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 12:39:30.458761 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457400 2545 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 12:39:30.458761 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457403 2545 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 12:39:30.458761 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457405 2545 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 12:39:30.458761 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457408 2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 12:39:30.458761 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457410 2545 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 12:39:30.458761 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457413 2545 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 12:39:30.458761 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457416 2545 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 12:39:30.459265 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457418 2545 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 12:39:30.459265 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457421 2545 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 12:39:30.459265 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457423 2545 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 12:39:30.459265 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457426 2545 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 12:39:30.459265 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457428 2545 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 12:39:30.459265 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.457431 2545 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 12:39:30.459265 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457506 2545 flags.go:64] FLAG: --address="0.0.0.0" Jun 02 12:39:30.459265 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457516 2545 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 02 12:39:30.459265 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457524 2545 flags.go:64] FLAG: --anonymous-auth="true" Jun 02 12:39:30.459265 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457531 2545 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 02 12:39:30.459265 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457536 2545 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 02 12:39:30.459265 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457539 2545 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 02 12:39:30.459265 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457543 2545 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 02 12:39:30.459265 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457547 2545 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 02 12:39:30.459265 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457550 2545 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 02 12:39:30.459265 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457553 2545 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 02 12:39:30.459265 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457556 2545 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 02 12:39:30.459265 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457560 2545 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 02 12:39:30.459265 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457562 2545 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 02 12:39:30.459265 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457565 2545 flags.go:64] FLAG: --cgroup-root="" Jun 02 12:39:30.459265 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457568 2545 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 02 12:39:30.459265 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457571 2545 flags.go:64] FLAG: --client-ca-file="" Jun 02 12:39:30.459265 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457574 2545 flags.go:64] FLAG: --cloud-config="" Jun 02 12:39:30.459265 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457577 2545 flags.go:64] FLAG: --cloud-provider="external" Jun 02 12:39:30.459846 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457580 2545 flags.go:64] FLAG: --cluster-dns="[]" Jun 02 12:39:30.459846 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457584 2545 flags.go:64] FLAG: --cluster-domain="" Jun 02 12:39:30.459846 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457587 2545 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 02 12:39:30.459846 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457590 2545 flags.go:64] FLAG: --config-dir="" Jun 02 12:39:30.459846 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457593 2545 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 02 12:39:30.459846 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457597 2545 flags.go:64] FLAG: --container-log-max-files="5" Jun 02 12:39:30.459846 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457600 2545 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 02 12:39:30.459846 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457605 2545 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 02 12:39:30.459846 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457608 2545 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 02 12:39:30.459846 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457611 2545 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 02 12:39:30.459846 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457614 2545 flags.go:64] FLAG: --contention-profiling="false" Jun 02 12:39:30.459846 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457617 2545 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 02 12:39:30.459846 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457620 2545 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 02 12:39:30.459846 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457623 2545 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 02 12:39:30.459846 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457629 2545 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 02 12:39:30.459846 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457633 2545 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 02 12:39:30.459846 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457636 2545 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 02 12:39:30.459846 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457639 2545 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 02 12:39:30.459846 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457642 2545 flags.go:64] FLAG: --enable-load-reader="false" Jun 02 12:39:30.459846 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457645 2545 flags.go:64] FLAG: --enable-server="true" Jun 02 12:39:30.459846 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457647 2545 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 02 12:39:30.459846 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457651 2545 flags.go:64] FLAG: --event-burst="100" Jun 02 12:39:30.459846 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457655 2545 flags.go:64] FLAG: --event-qps="50" Jun 02 12:39:30.459846 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457658 2545 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 02 12:39:30.459846 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457661 2545 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 02 12:39:30.460453 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457664 2545 flags.go:64] FLAG: --eviction-hard="" Jun 02 12:39:30.460453 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457668 2545 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 02 12:39:30.460453 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457670 2545 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 02 12:39:30.460453 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457673 2545 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 02 12:39:30.460453 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457676 2545 flags.go:64] FLAG: --eviction-soft="" Jun 02 12:39:30.460453 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457679 2545 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 02 12:39:30.460453 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457682 2545 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 02 12:39:30.460453 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457685 2545 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 02 12:39:30.460453 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457688 2545 flags.go:64] FLAG: --experimental-mounter-path="" Jun 02 12:39:30.460453 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457690 2545 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 02 12:39:30.460453 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457693 2545 flags.go:64] FLAG: --fail-swap-on="true" Jun 02 12:39:30.460453 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457696 2545 flags.go:64] FLAG: --feature-gates="" Jun 02 12:39:30.460453 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457703 2545 flags.go:64] FLAG: --file-check-frequency="20s" Jun 02 12:39:30.460453 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457706 2545 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 02 12:39:30.460453 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457709 2545 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 02 12:39:30.460453 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457715 2545 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 02 12:39:30.460453 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457718 2545 flags.go:64] FLAG: --healthz-port="10248" Jun 02 12:39:30.460453 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457721 2545 flags.go:64] FLAG: --help="false" Jun 02 12:39:30.460453 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457724 2545 flags.go:64] FLAG: --hostname-override="ip-10-0-128-229.ec2.internal" Jun 02 12:39:30.460453 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457728 2545 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 02 12:39:30.460453 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457730 2545 flags.go:64] FLAG: --http-check-frequency="20s" Jun 02 12:39:30.460453 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457735 2545 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 02 12:39:30.460453 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457738 2545 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 02 12:39:30.460453 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457742 2545 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 02 12:39:30.461053 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457744 2545 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 02 12:39:30.461053 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457747 2545 flags.go:64] FLAG: --image-service-endpoint="" Jun 02 12:39:30.461053 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457750 2545 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 02 12:39:30.461053 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457753 2545 flags.go:64] FLAG: --kube-api-burst="100" Jun 02 12:39:30.461053 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457756 2545 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 02 12:39:30.461053 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457759 2545 flags.go:64] FLAG: --kube-api-qps="50" Jun 02 12:39:30.461053 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457762 2545 flags.go:64] FLAG: --kube-reserved="" Jun 02 12:39:30.461053 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457765 2545 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 02 12:39:30.461053 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457767 2545 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 02 12:39:30.461053 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457771 2545 flags.go:64] FLAG: --kubelet-cgroups="" Jun 02 12:39:30.461053 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457773 2545 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 02 12:39:30.461053 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457776 2545 flags.go:64] FLAG: --lock-file="" Jun 02 12:39:30.461053 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457779 2545 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 02 12:39:30.461053 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457782 2545 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 02 12:39:30.461053 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457785 2545 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 02 12:39:30.461053 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457790 2545 flags.go:64] FLAG: --log-json-split-stream="false" Jun 02 12:39:30.461053 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457793 2545 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 02 12:39:30.461053 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457795 2545 flags.go:64] FLAG: --log-text-split-stream="false" Jun 02 12:39:30.461053 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457798 2545 flags.go:64] FLAG: --logging-format="text" Jun 02 12:39:30.461053 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457801 2545 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 02 12:39:30.461053 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457804 2545 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 02 12:39:30.461053 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457807 2545 flags.go:64] FLAG: --manifest-url="" Jun 02 12:39:30.461053 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457810 2545 flags.go:64] FLAG: --manifest-url-header="" Jun 02 12:39:30.461053 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457814 2545 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 02 12:39:30.461053 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457817 2545 flags.go:64] FLAG: --max-open-files="1000000" Jun 02 12:39:30.461693 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457821 2545 flags.go:64] FLAG: --max-pods="110" Jun 02 12:39:30.461693 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457824 2545 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 02 12:39:30.461693 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457827 2545 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 02 12:39:30.461693 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457830 2545 flags.go:64] FLAG: --memory-manager-policy="None" Jun 02 12:39:30.461693 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457846 2545 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 02 12:39:30.461693 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457850 2545 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 02 12:39:30.461693 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457853 2545 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 02 12:39:30.461693 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457856 2545 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 02 12:39:30.461693 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457863 2545 flags.go:64] FLAG: --node-status-max-images="50" Jun 02 12:39:30.461693 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457866 2545 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 02 12:39:30.461693 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457869 2545 flags.go:64] FLAG: --oom-score-adj="-999" Jun 02 12:39:30.461693 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457872 2545 flags.go:64] FLAG: --pod-cidr="" Jun 02 12:39:30.461693 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457875 2545 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 02 12:39:30.461693 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457880 2545 flags.go:64] FLAG: --pod-manifest-path="" Jun 02 12:39:30.461693 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457884 2545 flags.go:64] FLAG: --pod-max-pids="-1" Jun 02 12:39:30.461693 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457887 2545 flags.go:64] FLAG: --pods-per-core="0" Jun 02 12:39:30.461693 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457890 2545 flags.go:64] FLAG: --port="10250" Jun 02 12:39:30.461693 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457893 2545 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 02 12:39:30.461693 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457896 2545 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-077f16ca3cafb61bc" Jun 02 12:39:30.461693 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457899 2545 flags.go:64] FLAG: --qos-reserved="" Jun 02 12:39:30.461693 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457902 2545 flags.go:64] FLAG: --read-only-port="10255" Jun 02 12:39:30.461693 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457905 2545 flags.go:64] FLAG: --register-node="true" Jun 02 12:39:30.461693 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457908 2545 flags.go:64] FLAG: --register-schedulable="true" Jun 02 12:39:30.461693 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457911 2545 flags.go:64] FLAG: --register-with-taints="" Jun 02 12:39:30.462280 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457914 2545 flags.go:64] FLAG: --registry-burst="10" Jun 02 12:39:30.462280 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457917 2545 flags.go:64] FLAG: --registry-qps="5" Jun 02 12:39:30.462280 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457920 2545 flags.go:64] FLAG: --reserved-cpus="" Jun 02 12:39:30.462280 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457922 2545 flags.go:64] FLAG: --reserved-memory="" Jun 02 12:39:30.462280 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457926 2545 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 02 12:39:30.462280 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457929 2545 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 02 12:39:30.462280 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457932 2545 flags.go:64] FLAG: --rotate-certificates="false" Jun 02 12:39:30.462280 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457935 2545 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 02 12:39:30.462280 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457938 2545 flags.go:64] FLAG: --runonce="false" Jun 02 12:39:30.462280 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457941 2545 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 02 12:39:30.462280 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457944 2545 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 02 12:39:30.462280 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457947 2545 flags.go:64] FLAG: --seccomp-default="false" Jun 02 12:39:30.462280 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457951 2545 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 02 12:39:30.462280 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457955 2545 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 02 12:39:30.462280 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457959 2545 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 02 12:39:30.462280 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457962 2545 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 02 12:39:30.462280 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457964 2545 flags.go:64] FLAG: --storage-driver-password="root" Jun 02 12:39:30.462280 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457967 2545 flags.go:64] FLAG: --storage-driver-secure="false" Jun 02 12:39:30.462280 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457983 2545 flags.go:64] FLAG: --storage-driver-table="stats" Jun 02 12:39:30.462280 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457988 2545 flags.go:64] FLAG: --storage-driver-user="root" Jun 02 12:39:30.462280 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457991 2545 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 02 12:39:30.462280 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457995 2545 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 02 12:39:30.462280 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.457998 2545 flags.go:64] FLAG: --system-cgroups="" Jun 02 12:39:30.462280 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.458001 2545 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 02 12:39:30.462280 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.458007 2545 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 02 12:39:30.462912 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.458010 2545 flags.go:64] FLAG: --tls-cert-file="" Jun 02 12:39:30.462912 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.458012 2545 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 02 12:39:30.462912 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.458017 2545 flags.go:64] FLAG: --tls-min-version="" Jun 02 12:39:30.462912 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.458020 2545 flags.go:64] FLAG: --tls-private-key-file="" Jun 02 12:39:30.462912 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.458022 2545 flags.go:64] FLAG: --topology-manager-policy="none" Jun 02 12:39:30.462912 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.458025 2545 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 02 12:39:30.462912 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.458028 2545 flags.go:64] FLAG: --topology-manager-scope="container" Jun 02 12:39:30.462912 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.458031 2545 flags.go:64] FLAG: --v="2" Jun 02 12:39:30.462912 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.458035 2545 flags.go:64] FLAG: --version="false" Jun 02 12:39:30.462912 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.458040 2545 flags.go:64] FLAG: --vmodule="" Jun 02 12:39:30.462912 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.458044 2545 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 02 12:39:30.462912 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.458047 2545 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 02 12:39:30.462912 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458138 2545 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 12:39:30.462912 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458143 2545 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 12:39:30.462912 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458146 2545 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 12:39:30.462912 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458149 2545 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 12:39:30.462912 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458153 2545 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 12:39:30.462912 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458156 2545 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 12:39:30.462912 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458159 2545 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 12:39:30.462912 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458163 2545 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 12:39:30.462912 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458167 2545 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 12:39:30.462912 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458170 2545 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 12:39:30.462912 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458173 2545 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 12:39:30.463497 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458175 2545 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 12:39:30.463497 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458178 2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 12:39:30.463497 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458180 2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 12:39:30.463497 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458183 2545 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 12:39:30.463497 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458186 2545 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 12:39:30.463497 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458188 2545 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 12:39:30.463497 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458191 2545 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 12:39:30.463497 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458193 2545 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 12:39:30.463497 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458196 2545 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 12:39:30.463497 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458198 2545 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 12:39:30.463497 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458201 2545 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 12:39:30.463497 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458204 2545 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 12:39:30.463497 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458206 2545 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 12:39:30.463497 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458209 2545 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 12:39:30.463497 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458211 2545 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 12:39:30.463497 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458214 2545 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 12:39:30.463497 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458216 2545 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 12:39:30.463497 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458219 2545 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 12:39:30.463497 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458221 2545 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 12:39:30.463497 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458224 2545 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 12:39:30.464014 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458228 2545 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 12:39:30.464014 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458231 2545 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 12:39:30.464014 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458233 2545 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 12:39:30.464014 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458236 2545 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 12:39:30.464014 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458239 2545 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 12:39:30.464014 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458241 2545 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 12:39:30.464014 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458244 2545 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 12:39:30.464014 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458247 2545 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 12:39:30.464014 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458251 2545 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 12:39:30.464014 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458255 2545 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 12:39:30.464014 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458257 2545 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 12:39:30.464014 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458260 2545 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 12:39:30.464014 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458262 2545 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 12:39:30.464014 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458265 2545 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 12:39:30.464014 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458267 2545 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 12:39:30.464014 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458270 2545 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 12:39:30.464014 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458273 2545 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 12:39:30.464014 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458275 2545 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 12:39:30.464014 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458278 2545 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 12:39:30.464506 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458281 2545 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 12:39:30.464506 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458283 2545 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 12:39:30.464506 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458286 2545 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 12:39:30.464506 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458289 2545 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 12:39:30.464506 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458291 2545 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 12:39:30.464506 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458294 2545 feature_gate.go:328] unrecognized feature gate: Example Jun 02 12:39:30.464506 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458296 2545 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 12:39:30.464506 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458299 2545 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 12:39:30.464506 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458301 2545 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 12:39:30.464506 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458304 2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 12:39:30.464506 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458306 2545 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 12:39:30.464506 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458309 2545 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 12:39:30.464506 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458312 2545 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 12:39:30.464506 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458315 2545 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 12:39:30.464506 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458317 2545 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 12:39:30.464506 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458320 2545 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 12:39:30.464506 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458322 2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 12:39:30.464506 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458325 2545 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 12:39:30.464506 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458327 2545 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 12:39:30.464506 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458330 2545 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 12:39:30.465011 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458333 2545 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 12:39:30.465011 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458337 2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 12:39:30.465011 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458341 2545 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 12:39:30.465011 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458344 2545 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 12:39:30.465011 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458346 2545 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 12:39:30.465011 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458348 2545 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 12:39:30.465011 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458351 2545 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 12:39:30.465011 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458354 2545 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 12:39:30.465011 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458356 2545 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 12:39:30.465011 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458359 2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 12:39:30.465011 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458363 2545 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 12:39:30.465011 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458366 2545 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 12:39:30.465011 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458369 2545 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 12:39:30.465011 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458372 2545 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 12:39:30.465011 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458374 2545 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 12:39:30.465011 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.458377 2545 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 12:39:30.465430 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.459258 2545 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 12:39:30.467359 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.467337 2545 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 02 12:39:30.467359 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.467358 2545 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 02 12:39:30.467472 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467405 2545 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 12:39:30.467472 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467411 2545 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 12:39:30.467472 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467416 2545 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 12:39:30.467472 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467420 2545 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 12:39:30.467472 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467423 2545 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 12:39:30.467472 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467426 2545 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 12:39:30.467472 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467431 2545 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 12:39:30.467472 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467435 2545 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 12:39:30.467472 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467438 2545 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 12:39:30.467472 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467441 2545 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 12:39:30.467472 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467444 2545 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 12:39:30.467472 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467447 2545 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 12:39:30.467472 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467449 2545 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 12:39:30.467472 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467452 2545 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 12:39:30.467472 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467455 2545 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 12:39:30.467472 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467457 2545 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 12:39:30.467472 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467460 2545 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 12:39:30.467472 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467463 2545 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 12:39:30.467472 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467465 2545 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 12:39:30.467952 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467468 2545 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 12:39:30.467952 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467471 2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 12:39:30.467952 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467474 2545 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 12:39:30.467952 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467477 2545 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 12:39:30.467952 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467480 2545 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 12:39:30.467952 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467483 2545 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 12:39:30.467952 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467486 2545 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 12:39:30.467952 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467488 2545 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 12:39:30.467952 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467491 2545 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 12:39:30.467952 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467494 2545 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 12:39:30.467952 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467496 2545 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 12:39:30.467952 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467499 2545 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 12:39:30.467952 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467501 2545 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 12:39:30.467952 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467504 2545 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 12:39:30.467952 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467506 2545 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 12:39:30.467952 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467509 2545 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 12:39:30.467952 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467512 2545 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 12:39:30.467952 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467514 2545 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 12:39:30.467952 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467517 2545 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 12:39:30.467952 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467520 2545 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 12:39:30.468437 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467523 2545 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 12:39:30.468437 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467525 2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 12:39:30.468437 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467528 2545 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 12:39:30.468437 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467531 2545 feature_gate.go:328] unrecognized feature gate: Example Jun 02 12:39:30.468437 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467533 2545 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 12:39:30.468437 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467535 2545 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 12:39:30.468437 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467539 2545 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 12:39:30.468437 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467541 2545 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 12:39:30.468437 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467544 2545 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 12:39:30.468437 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467563 2545 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 12:39:30.468437 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467566 2545 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 12:39:30.468437 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467569 2545 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 12:39:30.468437 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467572 2545 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 12:39:30.468437 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467576 2545 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 12:39:30.468437 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467579 2545 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 12:39:30.468437 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467582 2545 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 12:39:30.468437 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467585 2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 12:39:30.468437 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467587 2545 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 12:39:30.468437 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467590 2545 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 12:39:30.468437 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467593 2545 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 12:39:30.468932 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467595 2545 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 12:39:30.468932 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467598 2545 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 12:39:30.468932 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467601 2545 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 12:39:30.468932 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467603 2545 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 12:39:30.468932 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467605 2545 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 12:39:30.468932 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467608 2545 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 12:39:30.468932 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467611 2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 12:39:30.468932 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467613 2545 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 12:39:30.468932 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467616 2545 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 12:39:30.468932 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467618 2545 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 12:39:30.468932 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467621 2545 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 12:39:30.468932 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467623 2545 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 12:39:30.468932 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467626 2545 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 12:39:30.468932 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467629 2545 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 12:39:30.468932 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467631 2545 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 12:39:30.468932 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467634 2545 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 12:39:30.468932 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467636 2545 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 12:39:30.468932 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467639 2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 12:39:30.468932 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467642 2545 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 12:39:30.468932 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467644 2545 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 12:39:30.469426 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467647 2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 12:39:30.469426 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467649 2545 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 12:39:30.469426 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467652 2545 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 12:39:30.469426 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467654 2545 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 12:39:30.469426 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467657 2545 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 12:39:30.469426 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467660 2545 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 12:39:30.469426 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467663 2545 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 12:39:30.469426 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.467668 2545 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 12:39:30.469426 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467774 2545 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 12:39:30.469426 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467779 2545 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 12:39:30.469426 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467783 2545 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 12:39:30.469426 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467786 2545 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 12:39:30.469426 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467788 2545 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 12:39:30.469426 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467791 2545 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 12:39:30.469426 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467796 2545 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 12:39:30.469795 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467800 2545 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 12:39:30.469795 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467803 2545 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 12:39:30.469795 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467806 2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 12:39:30.469795 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467809 2545 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 12:39:30.469795 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467812 2545 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 12:39:30.469795 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467814 2545 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 12:39:30.469795 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467817 2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 12:39:30.469795 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467819 2545 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 12:39:30.469795 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467822 2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 12:39:30.469795 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467824 2545 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 12:39:30.469795 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467827 2545 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 12:39:30.469795 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467830 2545 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 12:39:30.469795 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467832 2545 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 12:39:30.469795 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467851 2545 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 12:39:30.469795 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467854 2545 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 12:39:30.469795 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467858 2545 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 12:39:30.469795 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467860 2545 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 12:39:30.469795 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467863 2545 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 12:39:30.469795 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467866 2545 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 12:39:30.469795 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467869 2545 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 12:39:30.470292 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467871 2545 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 12:39:30.470292 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467874 2545 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 12:39:30.470292 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467876 2545 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 12:39:30.470292 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467879 2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 12:39:30.470292 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467882 2545 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 12:39:30.470292 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467884 2545 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 12:39:30.470292 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467887 2545 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 12:39:30.470292 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467890 2545 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 12:39:30.470292 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467892 2545 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 12:39:30.470292 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467895 2545 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 12:39:30.470292 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467898 2545 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 12:39:30.470292 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467900 2545 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 12:39:30.470292 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467903 2545 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 12:39:30.470292 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467905 2545 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 12:39:30.470292 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467909 2545 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 12:39:30.470292 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467911 2545 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 12:39:30.470292 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467914 2545 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 12:39:30.470292 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467917 2545 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 12:39:30.470292 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467919 2545 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 12:39:30.470292 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467922 2545 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 12:39:30.470769 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467924 2545 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 12:39:30.470769 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467927 2545 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 12:39:30.470769 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467929 2545 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 12:39:30.470769 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467932 2545 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 12:39:30.470769 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467934 2545 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 12:39:30.470769 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467937 2545 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 12:39:30.470769 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467940 2545 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 12:39:30.470769 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467942 2545 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 12:39:30.470769 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467946 2545 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 12:39:30.470769 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467949 2545 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 12:39:30.470769 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467953 2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 12:39:30.470769 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467956 2545 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 12:39:30.470769 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467959 2545 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 12:39:30.470769 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467962 2545 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 12:39:30.470769 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467965 2545 feature_gate.go:328] unrecognized feature gate: Example Jun 02 12:39:30.470769 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467968 2545 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 12:39:30.470769 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467970 2545 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 12:39:30.470769 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467972 2545 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 12:39:30.470769 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467975 2545 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 12:39:30.471255 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467977 2545 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 12:39:30.471255 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467980 2545 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 12:39:30.471255 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467982 2545 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 12:39:30.471255 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467985 2545 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 12:39:30.471255 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467987 2545 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 12:39:30.471255 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467990 2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 12:39:30.471255 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467992 2545 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 12:39:30.471255 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467995 2545 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 12:39:30.471255 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.467998 2545 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 12:39:30.471255 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.468000 2545 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 12:39:30.471255 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.468003 2545 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 12:39:30.471255 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.468005 2545 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 12:39:30.471255 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.468008 2545 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 12:39:30.471255 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.468010 2545 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 12:39:30.471255 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.468013 2545 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 12:39:30.471255 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.468015 2545 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 12:39:30.471255 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.468018 2545 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 12:39:30.471255 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.468020 2545 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 12:39:30.471255 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.468023 2545 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 12:39:30.471255 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:30.468025 2545 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 12:39:30.471761 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.468030 2545 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 12:39:30.471761 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.468884 2545 server.go:962] "Client rotation is on, will bootstrap in background" Jun 02 12:39:30.473318 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.473303 2545 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 02 12:39:30.474416 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.474404 2545 server.go:1019] "Starting client certificate rotation" Jun 02 12:39:30.474523 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.474506 2545 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 12:39:30.474559 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.474547 2545 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 12:39:30.503703 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.503684 2545 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 12:39:30.505567 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.505549 2545 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 12:39:30.518663 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.518643 2545 log.go:25] "Validated CRI v1 runtime API" Jun 02 12:39:30.526353 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.526337 2545 log.go:25] "Validated CRI v1 image API" Jun 02 12:39:30.527813 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.527797 2545 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 02 12:39:30.530336 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.530307 2545 fs.go:135] Filesystem UUIDs: map[6df93866-64c0-41d0-a24b-4a9adcd03f92:/dev/nvme0n1p4 77f0c618-f453-47f2-ba43-141e5d178be3:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jun 02 12:39:30.530419 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.530334 2545 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 02 12:39:30.533124 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.533082 2545 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 12:39:30.535693 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.535588 2545 manager.go:217] Machine: {Timestamp:2026-06-02 12:39:30.535084657 +0000 UTC m=+0.452699744 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099202 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a053e3be122549863112f1cfbe9d4 SystemUUID:ec2a053e-3be1-2254-9863-112f1cfbe9d4 BootID:5ae0abdb-72d2-497f-87ea-58729e9caa6e Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:70:31:ed:de:1d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:70:31:ed:de:1d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2a:8e:29:5a:96:ef Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 02 12:39:30.536509 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.536497 2545 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 02 12:39:30.536592 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.536579 2545 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 02 12:39:30.539704 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.539681 2545 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 02 12:39:30.539853 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.539708 2545 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-229.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 02 12:39:30.539897 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.539863 2545 topology_manager.go:138] "Creating topology manager with none policy" Jun 02 12:39:30.539897 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.539871 2545 container_manager_linux.go:306] "Creating device plugin manager" Jun 02 12:39:30.539897 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.539878 2545 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 12:39:30.539897 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.539891 2545 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 12:39:30.542044 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.542034 2545 state_mem.go:36] "Initialized new in-memory state store" Jun 02 12:39:30.542159 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.542151 2545 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 02 12:39:30.545502 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.545489 2545 kubelet.go:491] "Attempting to sync node with API server" Jun 02 12:39:30.545542 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.545506 2545 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 02 12:39:30.545542 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.545523 2545 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 02 12:39:30.545542 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.545532 2545 kubelet.go:397] "Adding apiserver pod source" Jun 02 12:39:30.545542 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.545539 2545 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 02 12:39:30.546803 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.546791 2545 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 12:39:30.546854 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.546810 2545 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 12:39:30.550307 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.550289 2545 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 02 12:39:30.552537 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.552523 2545 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 02 12:39:30.555033 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.555013 2545 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wchlw" Jun 02 12:39:30.555294 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.555281 2545 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 02 12:39:30.555294 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.555297 2545 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 02 12:39:30.555405 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.555303 2545 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 02 12:39:30.555405 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.555309 2545 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 02 12:39:30.555405 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.555321 2545 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 02 12:39:30.555405 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.555330 2545 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 02 12:39:30.555405 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.555336 2545 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 02 12:39:30.555405 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.555341 2545 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 02 12:39:30.555405 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.555351 2545 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 02 12:39:30.555405 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.555360 2545 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 02 12:39:30.555405 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.555373 2545 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 02 12:39:30.555405 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.555381 2545 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 02 12:39:30.556378 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.556366 2545 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 02 12:39:30.556423 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.556387 2545 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 02 12:39:30.556920 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:30.556892 2545 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-229.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 02 12:39:30.556971 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:30.556895 2545 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 02 12:39:30.559945 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.559932 2545 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 02 12:39:30.560002 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.559967 2545 server.go:1295] "Started kubelet" Jun 02 12:39:30.560103 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.560042 2545 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 02 12:39:30.560151 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.560123 2545 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 02 12:39:30.560206 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.560053 2545 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 02 12:39:30.560806 ip-10-0-128-229 systemd[1]: Started Kubernetes Kubelet. Jun 02 12:39:30.561564 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.561516 2545 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 02 12:39:30.563007 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.562992 2545 server.go:317] "Adding debug handlers to kubelet server" Jun 02 12:39:30.564120 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.564100 2545 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wchlw" Jun 02 12:39:30.565334 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.565316 2545 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-229.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 02 12:39:30.566451 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:30.565264 2545 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-229.ec2.internal.18b543fa6deba525 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-229.ec2.internal,UID:ip-10-0-128-229.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-229.ec2.internal,},FirstTimestamp:2026-06-02 12:39:30.559943973 +0000 UTC m=+0.477559059,LastTimestamp:2026-06-02 12:39:30.559943973 +0000 UTC m=+0.477559059,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-229.ec2.internal,}" Jun 02 12:39:30.569734 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.569718 2545 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 02 12:39:30.570408 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.570395 2545 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 02 12:39:30.570475 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.570466 2545 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 02 12:39:30.570525 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.570477 2545 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 02 12:39:30.570608 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.570594 2545 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 02 12:39:30.571499 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:30.571325 2545 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 02 12:39:30.571562 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:30.571541 2545 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-229.ec2.internal\" not found" Jun 02 12:39:30.571618 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.571604 2545 reconstruct.go:97] "Volume reconstruction finished" Jun 02 12:39:30.571618 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.571614 2545 reconciler.go:26] "Reconciler: start to sync state" Jun 02 12:39:30.571932 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.571762 2545 factory.go:55] Registering systemd factory Jun 02 12:39:30.571932 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.571781 2545 factory.go:223] Registration of the systemd container factory successfully Jun 02 12:39:30.572053 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.572032 2545 factory.go:153] Registering CRI-O factory Jun 02 12:39:30.572053 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.572046 2545 factory.go:223] Registration of the crio container factory successfully Jun 02 12:39:30.572174 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.572122 2545 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 02 12:39:30.572174 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.572173 2545 factory.go:103] Registering Raw factory Jun 02 12:39:30.572285 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.572189 2545 manager.go:1196] Started watching for new ooms in manager Jun 02 12:39:30.573965 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.573938 2545 manager.go:319] Starting recovery of all containers Jun 02 12:39:30.577571 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.577526 2545 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 12:39:30.580289 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:30.580255 2545 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-128-229.ec2.internal\" not found" node="ip-10-0-128-229.ec2.internal" Jun 02 12:39:30.585313 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.585194 2545 manager.go:324] Recovery completed Jun 02 12:39:30.589444 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.589431 2545 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 12:39:30.591479 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.591465 2545 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-229.ec2.internal" event="NodeHasSufficientMemory" Jun 02 12:39:30.591549 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.591504 2545 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-229.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 12:39:30.591549 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.591539 2545 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-229.ec2.internal" event="NodeHasSufficientPID" Jun 02 12:39:30.592040 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.592027 2545 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 02 12:39:30.592040 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.592038 2545 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 02 12:39:30.592125 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.592057 2545 state_mem.go:36] "Initialized new in-memory state store" Jun 02 12:39:30.595979 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.595959 2545 policy_none.go:49] "None policy: Start" Jun 02 12:39:30.595979 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.595981 2545 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 02 12:39:30.596108 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.595994 2545 state_mem.go:35] "Initializing new in-memory state store" Jun 02 12:39:30.628408 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.628394 2545 manager.go:341] "Starting Device Plugin manager" Jun 02 12:39:30.653657 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:30.628432 2545 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 02 12:39:30.653657 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.628444 2545 server.go:85] "Starting device plugin registration server" Jun 02 12:39:30.653657 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.628671 2545 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 02 12:39:30.653657 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.628684 2545 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 02 12:39:30.653657 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.628795 2545 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 02 12:39:30.653657 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.628873 2545 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 02 12:39:30.653657 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.628879 2545 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 02 12:39:30.653657 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:30.629288 2545 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 02 12:39:30.653657 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:30.629323 2545 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-229.ec2.internal\" not found" Jun 02 12:39:30.700105 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.700044 2545 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 02 12:39:30.701256 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.701239 2545 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 02 12:39:30.701361 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.701268 2545 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 02 12:39:30.701361 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.701304 2545 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 02 12:39:30.701361 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.701316 2545 kubelet.go:2451] "Starting kubelet main sync loop" Jun 02 12:39:30.701488 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:30.701364 2545 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 02 12:39:30.708046 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.708027 2545 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 12:39:30.729049 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.729030 2545 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 12:39:30.729871 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.729852 2545 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-229.ec2.internal" event="NodeHasSufficientMemory" Jun 02 12:39:30.729934 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.729885 2545 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-229.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 12:39:30.729934 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.729895 2545 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-229.ec2.internal" event="NodeHasSufficientPID" Jun 02 12:39:30.729934 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.729918 2545 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-229.ec2.internal" Jun 02 12:39:30.738670 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.738655 2545 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-229.ec2.internal" Jun 02 12:39:30.738765 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:30.738677 2545 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-229.ec2.internal\": node \"ip-10-0-128-229.ec2.internal\" not found" Jun 02 12:39:30.754008 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:30.753986 2545 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-229.ec2.internal\" not found" Jun 02 12:39:30.801951 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.801908 2545 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-229.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-229.ec2.internal"] Jun 02 12:39:30.802044 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.801995 2545 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 12:39:30.803552 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.803537 2545 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-229.ec2.internal" event="NodeHasSufficientMemory" Jun 02 12:39:30.803652 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.803571 2545 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-229.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 12:39:30.803652 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.803585 2545 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-229.ec2.internal" event="NodeHasSufficientPID" Jun 02 12:39:30.804793 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.804778 2545 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 12:39:30.804963 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.804947 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-229.ec2.internal" Jun 02 12:39:30.805018 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.804992 2545 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 12:39:30.805524 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.805509 2545 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-229.ec2.internal" event="NodeHasSufficientMemory" Jun 02 12:39:30.805587 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.805533 2545 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-229.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 12:39:30.805587 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.805543 2545 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-229.ec2.internal" event="NodeHasSufficientPID" Jun 02 12:39:30.805587 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.805565 2545 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-229.ec2.internal" event="NodeHasSufficientMemory" Jun 02 12:39:30.805673 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.805588 2545 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-229.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 12:39:30.805673 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.805598 2545 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-229.ec2.internal" event="NodeHasSufficientPID" Jun 02 12:39:30.806471 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.806450 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-229.ec2.internal" Jun 02 12:39:30.806534 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.806473 2545 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 12:39:30.807167 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.807152 2545 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-229.ec2.internal" event="NodeHasSufficientMemory" Jun 02 12:39:30.807257 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.807181 2545 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-229.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 12:39:30.807257 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.807195 2545 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-229.ec2.internal" event="NodeHasSufficientPID" Jun 02 12:39:30.830450 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:30.830428 2545 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-229.ec2.internal\" not found" node="ip-10-0-128-229.ec2.internal" Jun 02 12:39:30.835239 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:30.835224 2545 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-229.ec2.internal\" not found" node="ip-10-0-128-229.ec2.internal" Jun 02 12:39:30.854477 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:30.854457 2545 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-229.ec2.internal\" not found" Jun 02 12:39:30.873695 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.873671 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3baf4d93838fc3d664a8a17cf60359ce-config\") pod \"kube-apiserver-proxy-ip-10-0-128-229.ec2.internal\" (UID: \"3baf4d93838fc3d664a8a17cf60359ce\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-229.ec2.internal" Jun 02 12:39:30.873793 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.873696 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a1285734c0620c23a16adc49432d3f3e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-229.ec2.internal\" (UID: \"a1285734c0620c23a16adc49432d3f3e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-229.ec2.internal" Jun 02 12:39:30.873793 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.873714 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a1285734c0620c23a16adc49432d3f3e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-229.ec2.internal\" (UID: \"a1285734c0620c23a16adc49432d3f3e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-229.ec2.internal" Jun 02 12:39:30.955183 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:30.955119 2545 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-229.ec2.internal\" not found" Jun 02 12:39:30.974477 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.974451 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a1285734c0620c23a16adc49432d3f3e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-229.ec2.internal\" (UID: \"a1285734c0620c23a16adc49432d3f3e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-229.ec2.internal" Jun 02 12:39:30.974561 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.974488 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3baf4d93838fc3d664a8a17cf60359ce-config\") pod \"kube-apiserver-proxy-ip-10-0-128-229.ec2.internal\" (UID: \"3baf4d93838fc3d664a8a17cf60359ce\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-229.ec2.internal" Jun 02 12:39:30.974561 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.974513 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a1285734c0620c23a16adc49432d3f3e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-229.ec2.internal\" (UID: \"a1285734c0620c23a16adc49432d3f3e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-229.ec2.internal" Jun 02 12:39:30.974634 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.974571 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a1285734c0620c23a16adc49432d3f3e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-229.ec2.internal\" (UID: \"a1285734c0620c23a16adc49432d3f3e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-229.ec2.internal" Jun 02 12:39:30.974634 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.974580 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3baf4d93838fc3d664a8a17cf60359ce-config\") pod \"kube-apiserver-proxy-ip-10-0-128-229.ec2.internal\" (UID: \"3baf4d93838fc3d664a8a17cf60359ce\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-229.ec2.internal" Jun 02 12:39:30.974634 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:30.974587 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a1285734c0620c23a16adc49432d3f3e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-229.ec2.internal\" (UID: \"a1285734c0620c23a16adc49432d3f3e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-229.ec2.internal" Jun 02 12:39:31.055903 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:31.055864 2545 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-229.ec2.internal\" not found" Jun 02 12:39:31.133346 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:31.133321 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-229.ec2.internal" Jun 02 12:39:31.138774 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:31.138756 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-229.ec2.internal" Jun 02 12:39:31.156433 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:31.156410 2545 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-229.ec2.internal\" not found" Jun 02 12:39:31.256978 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:31.256908 2545 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-229.ec2.internal\" not found" Jun 02 12:39:31.357461 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:31.357435 2545 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-229.ec2.internal\" not found" Jun 02 12:39:31.458018 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:31.457993 2545 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-229.ec2.internal\" not found" Jun 02 12:39:31.474325 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:31.474303 2545 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 02 12:39:31.474455 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:31.474437 2545 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 12:39:31.474497 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:31.474461 2545 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 12:39:31.558965 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:31.558944 2545 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-229.ec2.internal\" not found" Jun 02 12:39:31.567632 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:31.567603 2545 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-01 12:34:30 +0000 UTC" deadline="2028-03-09 03:20:34.910230392 +0000 UTC" Jun 02 12:39:31.567632 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:31.567630 2545 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15494h41m3.342603842s" Jun 02 12:39:31.570764 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:31.570751 2545 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 02 12:39:31.581289 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:31.581269 2545 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 12:39:31.608768 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:31.608743 2545 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-447g9" Jun 02 12:39:31.616767 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:31.616742 2545 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-447g9" Jun 02 12:39:31.659733 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:31.659708 2545 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-229.ec2.internal\" not found" Jun 02 12:39:31.702963 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:31.702918 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3baf4d93838fc3d664a8a17cf60359ce.slice/crio-0ae007aa17564b33cda063de9132038607bef5903524f4f86424be06448404c4 WatchSource:0}: Error finding container 0ae007aa17564b33cda063de9132038607bef5903524f4f86424be06448404c4: Status 404 returned error can't find the container with id 0ae007aa17564b33cda063de9132038607bef5903524f4f86424be06448404c4 Jun 02 12:39:31.703299 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:31.703276 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1285734c0620c23a16adc49432d3f3e.slice/crio-93ba00dbadd00c45dbf1e5c64a497315ebb756b42c52fee1b1e5c8aef561d3bb WatchSource:0}: Error finding container 93ba00dbadd00c45dbf1e5c64a497315ebb756b42c52fee1b1e5c8aef561d3bb: Status 404 returned error can't find the container with id 93ba00dbadd00c45dbf1e5c64a497315ebb756b42c52fee1b1e5c8aef561d3bb Jun 02 12:39:31.707161 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:31.707143 2545 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 12:39:31.734142 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:31.734123 2545 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 12:39:31.771429 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:31.771411 2545 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-229.ec2.internal" Jun 02 12:39:31.784021 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:31.784002 2545 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 12:39:31.786047 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:31.786035 2545 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-229.ec2.internal" Jun 02 12:39:31.791751 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:31.791727 2545 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 12:39:32.124483 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.124455 2545 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 12:39:32.547760 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.547684 2545 apiserver.go:52] "Watching apiserver" Jun 02 12:39:32.554700 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.554679 2545 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 02 12:39:32.557094 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.557070 2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-229.ec2.internal","openshift-multus/multus-md7b9","openshift-multus/network-metrics-daemon-rvddx","kube-system/kube-apiserver-proxy-ip-10-0-128-229.ec2.internal","openshift-dns/node-resolver-zg55p","openshift-image-registry/node-ca-jcwvf","openshift-multus/multus-additional-cni-plugins-8qq7l","openshift-network-diagnostics/network-check-target-q88nq","openshift-network-operator/iptables-alerter-jj5kr","openshift-ovn-kubernetes/ovnkube-node-mb7lb","kube-system/konnectivity-agent-hv55n","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gv6qz","openshift-cluster-node-tuning-operator/tuned-x47f5"] Jun 02 12:39:32.559772 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.559747 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" Jun 02 12:39:32.561892 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.561860 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-md7b9" Jun 02 12:39:32.562255 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.562235 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 02 12:39:32.562663 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.562476 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 02 12:39:32.562663 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.562520 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 02 12:39:32.562663 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.562547 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 02 12:39:32.562663 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.562568 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 02 12:39:32.562663 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.562650 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 02 12:39:32.563039 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.562726 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-wz2js\"" Jun 02 12:39:32.563785 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.563766 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 02 12:39:32.563949 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.563933 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 02 12:39:32.564094 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.564075 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvddx" Jun 02 12:39:32.564215 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:32.564143 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rvddx" podUID="10c4158d-e827-4403-8ba4-17672f978f94" Jun 02 12:39:32.564298 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.564278 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 02 12:39:32.564417 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.564400 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 02 12:39:32.564473 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.564445 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4x5qt\"" Jun 02 12:39:32.566330 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.566158 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zg55p" Jun 02 12:39:32.569579 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.568685 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jcwvf" Jun 02 12:39:32.569579 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.568920 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 02 12:39:32.569579 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.569014 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 02 12:39:32.569579 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.569267 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-c7cmr\"" Jun 02 12:39:32.571297 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.571110 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 02 12:39:32.571444 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.571420 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-lqv7b\"" Jun 02 12:39:32.571523 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.571457 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 02 12:39:32.571523 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.571511 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 02 12:39:32.572507 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.572488 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8qq7l" Jun 02 12:39:32.574175 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.574157 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-gcg54\"" Jun 02 12:39:32.574264 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.574201 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 02 12:39:32.574264 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.574157 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 02 12:39:32.575402 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.575380 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q88nq" Jun 02 12:39:32.575496 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:32.575443 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q88nq" podUID="61950c4e-c9a1-4c0d-af77-980423e1d1d8" Jun 02 12:39:32.577775 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.577757 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jj5kr" Jun 02 12:39:32.579572 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.579400 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-9cmsq\"" Jun 02 12:39:32.580016 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.579768 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 02 12:39:32.580016 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.579856 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 02 12:39:32.580016 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.579926 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 02 12:39:32.580379 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.580347 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hv55n" Jun 02 12:39:32.583349 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.582521 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9d004590-abbc-46da-934f-471cf2c3495c-cni-binary-copy\") pod \"multus-additional-cni-plugins-8qq7l\" (UID: \"9d004590-abbc-46da-934f-471cf2c3495c\") " pod="openshift-multus/multus-additional-cni-plugins-8qq7l" Jun 02 12:39:32.583349 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.582597 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9211a780-13da-4a76-85dc-2f0a70a65c9c-host-kubelet\") pod \"ovnkube-node-mb7lb\" (UID: \"9211a780-13da-4a76-85dc-2f0a70a65c9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" Jun 02 12:39:32.583349 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.582605 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 02 12:39:32.583349 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.582624 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9211a780-13da-4a76-85dc-2f0a70a65c9c-host-slash\") pod \"ovnkube-node-mb7lb\" (UID: \"9211a780-13da-4a76-85dc-2f0a70a65c9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" Jun 02 12:39:32.583349 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.582648 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9211a780-13da-4a76-85dc-2f0a70a65c9c-run-ovn\") pod \"ovnkube-node-mb7lb\" (UID: \"9211a780-13da-4a76-85dc-2f0a70a65c9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" Jun 02 12:39:32.583349 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.582684 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9211a780-13da-4a76-85dc-2f0a70a65c9c-log-socket\") pod \"ovnkube-node-mb7lb\" (UID: \"9211a780-13da-4a76-85dc-2f0a70a65c9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" Jun 02 12:39:32.583349 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.582713 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1f5beceb-f998-436e-9b32-b72579c0ece3-os-release\") pod \"multus-md7b9\" (UID: \"1f5beceb-f998-436e-9b32-b72579c0ece3\") " pod="openshift-multus/multus-md7b9" Jun 02 12:39:32.583349 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.582752 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9211a780-13da-4a76-85dc-2f0a70a65c9c-host-run-netns\") pod \"ovnkube-node-mb7lb\" (UID: \"9211a780-13da-4a76-85dc-2f0a70a65c9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" Jun 02 12:39:32.583349 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.582774 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9211a780-13da-4a76-85dc-2f0a70a65c9c-run-systemd\") pod \"ovnkube-node-mb7lb\" (UID: \"9211a780-13da-4a76-85dc-2f0a70a65c9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" Jun 02 12:39:32.583349 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.582609 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gv6qz" Jun 02 12:39:32.583349 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.582907 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 02 12:39:32.583349 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.582812 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9211a780-13da-4a76-85dc-2f0a70a65c9c-host-cni-bin\") pod \"ovnkube-node-mb7lb\" (UID: \"9211a780-13da-4a76-85dc-2f0a70a65c9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" Jun 02 12:39:32.583349 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.582973 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9211a780-13da-4a76-85dc-2f0a70a65c9c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mb7lb\" (UID: \"9211a780-13da-4a76-85dc-2f0a70a65c9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" Jun 02 12:39:32.583349 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.583001 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmbbl\" (UniqueName: \"kubernetes.io/projected/9211a780-13da-4a76-85dc-2f0a70a65c9c-kube-api-access-wmbbl\") pod \"ovnkube-node-mb7lb\" (UID: \"9211a780-13da-4a76-85dc-2f0a70a65c9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" Jun 02 12:39:32.583349 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.583024 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1f5beceb-f998-436e-9b32-b72579c0ece3-host-var-lib-cni-bin\") pod \"multus-md7b9\" (UID: \"1f5beceb-f998-436e-9b32-b72579c0ece3\") " pod="openshift-multus/multus-md7b9" Jun 02 12:39:32.583349 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.583038 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-2l64m\"" Jun 02 12:39:32.583349 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.583048 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1f5beceb-f998-436e-9b32-b72579c0ece3-multus-conf-dir\") pod \"multus-md7b9\" (UID: \"1f5beceb-f998-436e-9b32-b72579c0ece3\") " pod="openshift-multus/multus-md7b9" Jun 02 12:39:32.583349 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.583072 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1f5beceb-f998-436e-9b32-b72579c0ece3-multus-daemon-config\") pod \"multus-md7b9\" (UID: \"1f5beceb-f998-436e-9b32-b72579c0ece3\") " pod="openshift-multus/multus-md7b9" Jun 02 12:39:32.583349 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.583095 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9d004590-abbc-46da-934f-471cf2c3495c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8qq7l\" (UID: \"9d004590-abbc-46da-934f-471cf2c3495c\") " pod="openshift-multus/multus-additional-cni-plugins-8qq7l" Jun 02 12:39:32.584387 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.583119 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e0da3dd7-3e7d-4873-9be6-1e77fce2a507-host\") pod \"node-ca-jcwvf\" (UID: \"e0da3dd7-3e7d-4873-9be6-1e77fce2a507\") " pod="openshift-image-registry/node-ca-jcwvf" Jun 02 12:39:32.584387 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.583142 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9d004590-abbc-46da-934f-471cf2c3495c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8qq7l\" (UID: \"9d004590-abbc-46da-934f-471cf2c3495c\") " pod="openshift-multus/multus-additional-cni-plugins-8qq7l" Jun 02 12:39:32.584387 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.583165 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9211a780-13da-4a76-85dc-2f0a70a65c9c-var-lib-openvswitch\") pod \"ovnkube-node-mb7lb\" (UID: \"9211a780-13da-4a76-85dc-2f0a70a65c9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" Jun 02 12:39:32.584387 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.583188 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9211a780-13da-4a76-85dc-2f0a70a65c9c-host-run-ovn-kubernetes\") pod \"ovnkube-node-mb7lb\" (UID: \"9211a780-13da-4a76-85dc-2f0a70a65c9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" Jun 02 12:39:32.584387 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.583210 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9211a780-13da-4a76-85dc-2f0a70a65c9c-host-cni-netd\") pod \"ovnkube-node-mb7lb\" (UID: \"9211a780-13da-4a76-85dc-2f0a70a65c9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" Jun 02 12:39:32.584387 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.583245 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9211a780-13da-4a76-85dc-2f0a70a65c9c-ovn-node-metrics-cert\") pod \"ovnkube-node-mb7lb\" (UID: \"9211a780-13da-4a76-85dc-2f0a70a65c9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" Jun 02 12:39:32.584387 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.583288 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9211a780-13da-4a76-85dc-2f0a70a65c9c-systemd-units\") pod \"ovnkube-node-mb7lb\" (UID: \"9211a780-13da-4a76-85dc-2f0a70a65c9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" Jun 02 12:39:32.584387 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.583314 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9211a780-13da-4a76-85dc-2f0a70a65c9c-etc-openvswitch\") pod \"ovnkube-node-mb7lb\" (UID: \"9211a780-13da-4a76-85dc-2f0a70a65c9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" Jun 02 12:39:32.584387 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.583344 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9211a780-13da-4a76-85dc-2f0a70a65c9c-run-openvswitch\") pod \"ovnkube-node-mb7lb\" (UID: \"9211a780-13da-4a76-85dc-2f0a70a65c9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" Jun 02 12:39:32.584387 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.583368 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9211a780-13da-4a76-85dc-2f0a70a65c9c-env-overrides\") pod \"ovnkube-node-mb7lb\" (UID: \"9211a780-13da-4a76-85dc-2f0a70a65c9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" Jun 02 12:39:32.584387 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.583389 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9211a780-13da-4a76-85dc-2f0a70a65c9c-ovnkube-script-lib\") pod \"ovnkube-node-mb7lb\" (UID: \"9211a780-13da-4a76-85dc-2f0a70a65c9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" Jun 02 12:39:32.584387 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.583429 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f5beceb-f998-436e-9b32-b72579c0ece3-multus-cni-dir\") pod \"multus-md7b9\" (UID: \"1f5beceb-f998-436e-9b32-b72579c0ece3\") " pod="openshift-multus/multus-md7b9" Jun 02 12:39:32.584387 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.583497 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1f5beceb-f998-436e-9b32-b72579c0ece3-host-run-netns\") pod \"multus-md7b9\" (UID: \"1f5beceb-f998-436e-9b32-b72579c0ece3\") " pod="openshift-multus/multus-md7b9" Jun 02 12:39:32.584387 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.583521 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e0da3dd7-3e7d-4873-9be6-1e77fce2a507-serviceca\") pod \"node-ca-jcwvf\" (UID: \"e0da3dd7-3e7d-4873-9be6-1e77fce2a507\") " pod="openshift-image-registry/node-ca-jcwvf" Jun 02 12:39:32.584387 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.583545 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9211a780-13da-4a76-85dc-2f0a70a65c9c-node-log\") pod \"ovnkube-node-mb7lb\" (UID: \"9211a780-13da-4a76-85dc-2f0a70a65c9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" Jun 02 12:39:32.584387 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.583567 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f5beceb-f998-436e-9b32-b72579c0ece3-system-cni-dir\") pod \"multus-md7b9\" (UID: \"1f5beceb-f998-436e-9b32-b72579c0ece3\") " pod="openshift-multus/multus-md7b9" Jun 02 12:39:32.584387 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.583589 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1f5beceb-f998-436e-9b32-b72579c0ece3-cni-binary-copy\") pod \"multus-md7b9\" (UID: \"1f5beceb-f998-436e-9b32-b72579c0ece3\") " pod="openshift-multus/multus-md7b9" Jun 02 12:39:32.585264 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.583612 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1f5beceb-f998-436e-9b32-b72579c0ece3-host-run-k8s-cni-cncf-io\") pod \"multus-md7b9\" (UID: \"1f5beceb-f998-436e-9b32-b72579c0ece3\") " pod="openshift-multus/multus-md7b9" Jun 02 12:39:32.585264 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.583647 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1f5beceb-f998-436e-9b32-b72579c0ece3-host-run-multus-certs\") pod \"multus-md7b9\" (UID: \"1f5beceb-f998-436e-9b32-b72579c0ece3\") " pod="openshift-multus/multus-md7b9" Jun 02 12:39:32.585264 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.583712 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1f5beceb-f998-436e-9b32-b72579c0ece3-etc-kubernetes\") pod \"multus-md7b9\" (UID: \"1f5beceb-f998-436e-9b32-b72579c0ece3\") " pod="openshift-multus/multus-md7b9" Jun 02 12:39:32.585264 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.583737 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tf52t\" (UniqueName: \"kubernetes.io/projected/10c4158d-e827-4403-8ba4-17672f978f94-kube-api-access-tf52t\") pod \"network-metrics-daemon-rvddx\" (UID: \"10c4158d-e827-4403-8ba4-17672f978f94\") " pod="openshift-multus/network-metrics-daemon-rvddx" Jun 02 12:39:32.585264 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.583757 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9d004590-abbc-46da-934f-471cf2c3495c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8qq7l\" (UID: \"9d004590-abbc-46da-934f-471cf2c3495c\") " pod="openshift-multus/multus-additional-cni-plugins-8qq7l" Jun 02 12:39:32.585264 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.583771 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5668g\" (UniqueName: \"kubernetes.io/projected/9d004590-abbc-46da-934f-471cf2c3495c-kube-api-access-5668g\") pod \"multus-additional-cni-plugins-8qq7l\" (UID: \"9d004590-abbc-46da-934f-471cf2c3495c\") " pod="openshift-multus/multus-additional-cni-plugins-8qq7l" Jun 02 12:39:32.585264 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.583786 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9211a780-13da-4a76-85dc-2f0a70a65c9c-ovnkube-config\") pod \"ovnkube-node-mb7lb\" (UID: \"9211a780-13da-4a76-85dc-2f0a70a65c9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" Jun 02 12:39:32.585264 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.583803 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1f5beceb-f998-436e-9b32-b72579c0ece3-host-var-lib-cni-multus\") pod \"multus-md7b9\" (UID: \"1f5beceb-f998-436e-9b32-b72579c0ece3\") " pod="openshift-multus/multus-md7b9" Jun 02 12:39:32.585264 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.583824 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1f5beceb-f998-436e-9b32-b72579c0ece3-hostroot\") pod \"multus-md7b9\" (UID: \"1f5beceb-f998-436e-9b32-b72579c0ece3\") " pod="openshift-multus/multus-md7b9" Jun 02 12:39:32.585264 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.583873 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bad7a9bf-61a6-4668-82c3-4f7e819472b9-tmp-dir\") pod \"node-resolver-zg55p\" (UID: \"bad7a9bf-61a6-4668-82c3-4f7e819472b9\") " pod="openshift-dns/node-resolver-zg55p" Jun 02 12:39:32.585264 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.583902 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lk2jc\" (UniqueName: \"kubernetes.io/projected/e0da3dd7-3e7d-4873-9be6-1e77fce2a507-kube-api-access-lk2jc\") pod \"node-ca-jcwvf\" (UID: \"e0da3dd7-3e7d-4873-9be6-1e77fce2a507\") " pod="openshift-image-registry/node-ca-jcwvf" Jun 02 12:39:32.585264 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.583940 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1f5beceb-f998-436e-9b32-b72579c0ece3-multus-socket-dir-parent\") pod \"multus-md7b9\" (UID: \"1f5beceb-f998-436e-9b32-b72579c0ece3\") " pod="openshift-multus/multus-md7b9" Jun 02 12:39:32.585264 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.584002 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gd9bb\" (UniqueName: \"kubernetes.io/projected/1f5beceb-f998-436e-9b32-b72579c0ece3-kube-api-access-gd9bb\") pod \"multus-md7b9\" (UID: \"1f5beceb-f998-436e-9b32-b72579c0ece3\") " pod="openshift-multus/multus-md7b9" Jun 02 12:39:32.585264 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.584034 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10c4158d-e827-4403-8ba4-17672f978f94-metrics-certs\") pod \"network-metrics-daemon-rvddx\" (UID: \"10c4158d-e827-4403-8ba4-17672f978f94\") " pod="openshift-multus/network-metrics-daemon-rvddx" Jun 02 12:39:32.585264 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.584059 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bad7a9bf-61a6-4668-82c3-4f7e819472b9-hosts-file\") pod \"node-resolver-zg55p\" (UID: \"bad7a9bf-61a6-4668-82c3-4f7e819472b9\") " pod="openshift-dns/node-resolver-zg55p" Jun 02 12:39:32.585264 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.584083 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2tkm\" (UniqueName: \"kubernetes.io/projected/bad7a9bf-61a6-4668-82c3-4f7e819472b9-kube-api-access-l2tkm\") pod \"node-resolver-zg55p\" (UID: \"bad7a9bf-61a6-4668-82c3-4f7e819472b9\") " pod="openshift-dns/node-resolver-zg55p" Jun 02 12:39:32.586119 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.584108 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9d004590-abbc-46da-934f-471cf2c3495c-os-release\") pod \"multus-additional-cni-plugins-8qq7l\" (UID: \"9d004590-abbc-46da-934f-471cf2c3495c\") " pod="openshift-multus/multus-additional-cni-plugins-8qq7l" Jun 02 12:39:32.586119 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.584144 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1f5beceb-f998-436e-9b32-b72579c0ece3-cnibin\") pod \"multus-md7b9\" (UID: \"1f5beceb-f998-436e-9b32-b72579c0ece3\") " pod="openshift-multus/multus-md7b9" Jun 02 12:39:32.586119 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.584173 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1f5beceb-f998-436e-9b32-b72579c0ece3-host-var-lib-kubelet\") pod \"multus-md7b9\" (UID: \"1f5beceb-f998-436e-9b32-b72579c0ece3\") " pod="openshift-multus/multus-md7b9" Jun 02 12:39:32.586119 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.584196 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9d004590-abbc-46da-934f-471cf2c3495c-system-cni-dir\") pod \"multus-additional-cni-plugins-8qq7l\" (UID: \"9d004590-abbc-46da-934f-471cf2c3495c\") " pod="openshift-multus/multus-additional-cni-plugins-8qq7l" Jun 02 12:39:32.586119 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.584236 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9d004590-abbc-46da-934f-471cf2c3495c-cnibin\") pod \"multus-additional-cni-plugins-8qq7l\" (UID: \"9d004590-abbc-46da-934f-471cf2c3495c\") " pod="openshift-multus/multus-additional-cni-plugins-8qq7l" Jun 02 12:39:32.586119 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.585233 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-x47f5" Jun 02 12:39:32.586119 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.585272 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 02 12:39:32.586119 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.585484 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 02 12:39:32.586119 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.585871 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 02 12:39:32.586119 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.586096 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-277j7\"" Jun 02 12:39:32.587122 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.587076 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-cn8bs\"" Jun 02 12:39:32.587236 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.587123 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 02 12:39:32.587388 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.587375 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 02 12:39:32.604600 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.604431 2545 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 12:39:32.617387 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.617358 2545 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 12:34:31 +0000 UTC" deadline="2027-11-04 15:36:14.053489502 +0000 UTC" Jun 02 12:39:32.617387 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.617386 2545 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12482h56m41.43610683s" Jun 02 12:39:32.671561 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.671533 2545 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 02 12:39:32.685293 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.685270 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e0da3dd7-3e7d-4873-9be6-1e77fce2a507-serviceca\") pod \"node-ca-jcwvf\" (UID: \"e0da3dd7-3e7d-4873-9be6-1e77fce2a507\") " pod="openshift-image-registry/node-ca-jcwvf" Jun 02 12:39:32.685448 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.685298 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9211a780-13da-4a76-85dc-2f0a70a65c9c-node-log\") pod \"ovnkube-node-mb7lb\" (UID: \"9211a780-13da-4a76-85dc-2f0a70a65c9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" Jun 02 12:39:32.685448 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.685319 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c-var-lib-kubelet\") pod \"tuned-x47f5\" (UID: \"7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c\") " pod="openshift-cluster-node-tuning-operator/tuned-x47f5" Jun 02 12:39:32.685448 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.685336 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9211a780-13da-4a76-85dc-2f0a70a65c9c-ovnkube-config\") pod \"ovnkube-node-mb7lb\" (UID: \"9211a780-13da-4a76-85dc-2f0a70a65c9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" Jun 02 12:39:32.685448 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.685360 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c-sys\") pod \"tuned-x47f5\" (UID: \"7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c\") " pod="openshift-cluster-node-tuning-operator/tuned-x47f5" Jun 02 12:39:32.685448 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.685384 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c-lib-modules\") pod \"tuned-x47f5\" (UID: \"7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c\") " pod="openshift-cluster-node-tuning-operator/tuned-x47f5" Jun 02 12:39:32.685448 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.685413 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9211a780-13da-4a76-85dc-2f0a70a65c9c-node-log\") pod \"ovnkube-node-mb7lb\" (UID: \"9211a780-13da-4a76-85dc-2f0a70a65c9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" Jun 02 12:39:32.685448 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.685426 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lk2jc\" (UniqueName: \"kubernetes.io/projected/e0da3dd7-3e7d-4873-9be6-1e77fce2a507-kube-api-access-lk2jc\") pod \"node-ca-jcwvf\" (UID: \"e0da3dd7-3e7d-4873-9be6-1e77fce2a507\") " pod="openshift-image-registry/node-ca-jcwvf" Jun 02 12:39:32.685737 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.685528 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gd9bb\" (UniqueName: \"kubernetes.io/projected/1f5beceb-f998-436e-9b32-b72579c0ece3-kube-api-access-gd9bb\") pod \"multus-md7b9\" (UID: \"1f5beceb-f998-436e-9b32-b72579c0ece3\") " pod="openshift-multus/multus-md7b9" Jun 02 12:39:32.685737 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.685653 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c-etc-sysctl-conf\") pod \"tuned-x47f5\" (UID: \"7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c\") " pod="openshift-cluster-node-tuning-operator/tuned-x47f5" Jun 02 12:39:32.685832 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.685771 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srj69\" (UniqueName: \"kubernetes.io/projected/7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c-kube-api-access-srj69\") pod \"tuned-x47f5\" (UID: \"7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c\") " pod="openshift-cluster-node-tuning-operator/tuned-x47f5" Jun 02 12:39:32.685832 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.685802 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8snf\" (UniqueName: \"kubernetes.io/projected/937d6529-311c-4484-b66d-e0278f105138-kube-api-access-j8snf\") pod \"iptables-alerter-jj5kr\" (UID: \"937d6529-311c-4484-b66d-e0278f105138\") " pod="openshift-network-operator/iptables-alerter-jj5kr" Jun 02 12:39:32.685832 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.685828 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9d004590-abbc-46da-934f-471cf2c3495c-os-release\") pod \"multus-additional-cni-plugins-8qq7l\" (UID: \"9d004590-abbc-46da-934f-471cf2c3495c\") " pod="openshift-multus/multus-additional-cni-plugins-8qq7l" Jun 02 12:39:32.686000 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.685830 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e0da3dd7-3e7d-4873-9be6-1e77fce2a507-serviceca\") pod \"node-ca-jcwvf\" (UID: \"e0da3dd7-3e7d-4873-9be6-1e77fce2a507\") " pod="openshift-image-registry/node-ca-jcwvf" Jun 02 12:39:32.686000 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.685873 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1f5beceb-f998-436e-9b32-b72579c0ece3-cnibin\") pod \"multus-md7b9\" (UID: \"1f5beceb-f998-436e-9b32-b72579c0ece3\") " pod="openshift-multus/multus-md7b9" Jun 02 12:39:32.686000 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.685921 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1f5beceb-f998-436e-9b32-b72579c0ece3-host-var-lib-kubelet\") pod \"multus-md7b9\" (UID: \"1f5beceb-f998-436e-9b32-b72579c0ece3\") " pod="openshift-multus/multus-md7b9" Jun 02 12:39:32.686000 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.685935 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1f5beceb-f998-436e-9b32-b72579c0ece3-cnibin\") pod \"multus-md7b9\" (UID: \"1f5beceb-f998-436e-9b32-b72579c0ece3\") " pod="openshift-multus/multus-md7b9" Jun 02 12:39:32.686000 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.685940 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9d004590-abbc-46da-934f-471cf2c3495c-os-release\") pod \"multus-additional-cni-plugins-8qq7l\" (UID: \"9d004590-abbc-46da-934f-471cf2c3495c\") " pod="openshift-multus/multus-additional-cni-plugins-8qq7l" Jun 02 12:39:32.686000 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.685953 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c-etc-modprobe-d\") pod \"tuned-x47f5\" (UID: \"7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c\") " pod="openshift-cluster-node-tuning-operator/tuned-x47f5" Jun 02 12:39:32.686000 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.685951 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9211a780-13da-4a76-85dc-2f0a70a65c9c-ovnkube-config\") pod \"ovnkube-node-mb7lb\" (UID: \"9211a780-13da-4a76-85dc-2f0a70a65c9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" Jun 02 12:39:32.686000 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.685974 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1f5beceb-f998-436e-9b32-b72579c0ece3-host-var-lib-kubelet\") pod \"multus-md7b9\" (UID: \"1f5beceb-f998-436e-9b32-b72579c0ece3\") " pod="openshift-multus/multus-md7b9" Jun 02 12:39:32.686000 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.685996 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/25f63a25-fe7d-455e-98e9-a7f8d1a44fcb-sys-fs\") pod \"aws-ebs-csi-driver-node-gv6qz\" (UID: \"25f63a25-fe7d-455e-98e9-a7f8d1a44fcb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gv6qz" Jun 02 12:39:32.686419 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.686041 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9d004590-abbc-46da-934f-471cf2c3495c-system-cni-dir\") pod \"multus-additional-cni-plugins-8qq7l\" (UID: \"9d004590-abbc-46da-934f-471cf2c3495c\") " pod="openshift-multus/multus-additional-cni-plugins-8qq7l" Jun 02 12:39:32.686419 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.686063 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9d004590-abbc-46da-934f-471cf2c3495c-cni-binary-copy\") pod \"multus-additional-cni-plugins-8qq7l\" (UID: \"9d004590-abbc-46da-934f-471cf2c3495c\") " pod="openshift-multus/multus-additional-cni-plugins-8qq7l" Jun 02 12:39:32.686419 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.686083 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9211a780-13da-4a76-85dc-2f0a70a65c9c-run-ovn\") pod \"ovnkube-node-mb7lb\" (UID: \"9211a780-13da-4a76-85dc-2f0a70a65c9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" Jun 02 12:39:32.686419 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.686111 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9211a780-13da-4a76-85dc-2f0a70a65c9c-log-socket\") pod \"ovnkube-node-mb7lb\" (UID: \"9211a780-13da-4a76-85dc-2f0a70a65c9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" Jun 02 12:39:32.686419 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.686115 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9d004590-abbc-46da-934f-471cf2c3495c-system-cni-dir\") pod \"multus-additional-cni-plugins-8qq7l\" (UID: \"9d004590-abbc-46da-934f-471cf2c3495c\") " pod="openshift-multus/multus-additional-cni-plugins-8qq7l" Jun 02 12:39:32.686419 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.686138 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/25f63a25-fe7d-455e-98e9-a7f8d1a44fcb-registration-dir\") pod \"aws-ebs-csi-driver-node-gv6qz\" (UID: \"25f63a25-fe7d-455e-98e9-a7f8d1a44fcb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gv6qz" Jun 02 12:39:32.686419 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.686159 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9211a780-13da-4a76-85dc-2f0a70a65c9c-log-socket\") pod \"ovnkube-node-mb7lb\" (UID: \"9211a780-13da-4a76-85dc-2f0a70a65c9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" Jun 02 12:39:32.686419 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.686166 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1f5beceb-f998-436e-9b32-b72579c0ece3-etc-kubernetes\") pod \"multus-md7b9\" (UID: \"1f5beceb-f998-436e-9b32-b72579c0ece3\") " pod="openshift-multus/multus-md7b9" Jun 02 12:39:32.686419 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.686191 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9211a780-13da-4a76-85dc-2f0a70a65c9c-host-run-netns\") pod \"ovnkube-node-mb7lb\" (UID: \"9211a780-13da-4a76-85dc-2f0a70a65c9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" Jun 02 12:39:32.686419 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.686210 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9211a780-13da-4a76-85dc-2f0a70a65c9c-host-cni-bin\") pod \"ovnkube-node-mb7lb\" (UID: \"9211a780-13da-4a76-85dc-2f0a70a65c9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" Jun 02 12:39:32.686419 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.686234 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1f5beceb-f998-436e-9b32-b72579c0ece3-host-var-lib-cni-bin\") pod \"multus-md7b9\" (UID: \"1f5beceb-f998-436e-9b32-b72579c0ece3\") " pod="openshift-multus/multus-md7b9" Jun 02 12:39:32.686419 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.686258 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c-tmp\") pod \"tuned-x47f5\" (UID: \"7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c\") " pod="openshift-cluster-node-tuning-operator/tuned-x47f5" Jun 02 12:39:32.686419 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.686260 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9211a780-13da-4a76-85dc-2f0a70a65c9c-run-ovn\") pod \"ovnkube-node-mb7lb\" (UID: \"9211a780-13da-4a76-85dc-2f0a70a65c9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" Jun 02 12:39:32.686419 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.686278 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9211a780-13da-4a76-85dc-2f0a70a65c9c-host-run-netns\") pod \"ovnkube-node-mb7lb\" (UID: \"9211a780-13da-4a76-85dc-2f0a70a65c9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" Jun 02 12:39:32.686419 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.686284 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/25f63a25-fe7d-455e-98e9-a7f8d1a44fcb-etc-selinux\") pod \"aws-ebs-csi-driver-node-gv6qz\" (UID: \"25f63a25-fe7d-455e-98e9-a7f8d1a44fcb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gv6qz" Jun 02 12:39:32.686419 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.686315 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9211a780-13da-4a76-85dc-2f0a70a65c9c-ovnkube-script-lib\") pod \"ovnkube-node-mb7lb\" (UID: \"9211a780-13da-4a76-85dc-2f0a70a65c9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" Jun 02 12:39:32.686419 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.686342 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9211a780-13da-4a76-85dc-2f0a70a65c9c-host-cni-bin\") pod \"ovnkube-node-mb7lb\" (UID: \"9211a780-13da-4a76-85dc-2f0a70a65c9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" Jun 02 12:39:32.687126 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.686342 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1f5beceb-f998-436e-9b32-b72579c0ece3-host-var-lib-cni-multus\") pod \"multus-md7b9\" (UID: \"1f5beceb-f998-436e-9b32-b72579c0ece3\") " pod="openshift-multus/multus-md7b9" Jun 02 12:39:32.687126 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.686349 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1f5beceb-f998-436e-9b32-b72579c0ece3-host-var-lib-cni-bin\") pod \"multus-md7b9\" (UID: \"1f5beceb-f998-436e-9b32-b72579c0ece3\") " pod="openshift-multus/multus-md7b9" Jun 02 12:39:32.687126 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.686372 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1f5beceb-f998-436e-9b32-b72579c0ece3-host-var-lib-cni-multus\") pod \"multus-md7b9\" (UID: \"1f5beceb-f998-436e-9b32-b72579c0ece3\") " pod="openshift-multus/multus-md7b9" Jun 02 12:39:32.687126 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.686375 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9d004590-abbc-46da-934f-471cf2c3495c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8qq7l\" (UID: \"9d004590-abbc-46da-934f-471cf2c3495c\") " pod="openshift-multus/multus-additional-cni-plugins-8qq7l" Jun 02 12:39:32.687126 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.686398 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1f5beceb-f998-436e-9b32-b72579c0ece3-etc-kubernetes\") pod \"multus-md7b9\" (UID: \"1f5beceb-f998-436e-9b32-b72579c0ece3\") " pod="openshift-multus/multus-md7b9" Jun 02 12:39:32.687126 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.686405 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9d004590-abbc-46da-934f-471cf2c3495c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8qq7l\" (UID: \"9d004590-abbc-46da-934f-471cf2c3495c\") " pod="openshift-multus/multus-additional-cni-plugins-8qq7l" Jun 02 12:39:32.687126 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.686475 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9211a780-13da-4a76-85dc-2f0a70a65c9c-host-run-ovn-kubernetes\") pod \"ovnkube-node-mb7lb\" (UID: \"9211a780-13da-4a76-85dc-2f0a70a65c9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" Jun 02 12:39:32.687126 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.686500 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/937d6529-311c-4484-b66d-e0278f105138-iptables-alerter-script\") pod \"iptables-alerter-jj5kr\" (UID: \"937d6529-311c-4484-b66d-e0278f105138\") " pod="openshift-network-operator/iptables-alerter-jj5kr" Jun 02 12:39:32.687126 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.686530 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9211a780-13da-4a76-85dc-2f0a70a65c9c-run-openvswitch\") pod \"ovnkube-node-mb7lb\" (UID: \"9211a780-13da-4a76-85dc-2f0a70a65c9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" Jun 02 12:39:32.687126 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.686567 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f5beceb-f998-436e-9b32-b72579c0ece3-multus-cni-dir\") pod \"multus-md7b9\" (UID: \"1f5beceb-f998-436e-9b32-b72579c0ece3\") " pod="openshift-multus/multus-md7b9" Jun 02 12:39:32.687126 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.686592 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1f5beceb-f998-436e-9b32-b72579c0ece3-host-run-netns\") pod \"multus-md7b9\" (UID: \"1f5beceb-f998-436e-9b32-b72579c0ece3\") " pod="openshift-multus/multus-md7b9" Jun 02 12:39:32.687126 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.686614 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c-host\") pod \"tuned-x47f5\" (UID: \"7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c\") " pod="openshift-cluster-node-tuning-operator/tuned-x47f5" Jun 02 12:39:32.687126 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.686639 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/937d6529-311c-4484-b66d-e0278f105138-host-slash\") pod \"iptables-alerter-jj5kr\" (UID: \"937d6529-311c-4484-b66d-e0278f105138\") " pod="openshift-network-operator/iptables-alerter-jj5kr" Jun 02 12:39:32.687126 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.686658 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9d004590-abbc-46da-934f-471cf2c3495c-cni-binary-copy\") pod \"multus-additional-cni-plugins-8qq7l\" (UID: \"9d004590-abbc-46da-934f-471cf2c3495c\") " pod="openshift-multus/multus-additional-cni-plugins-8qq7l" Jun 02 12:39:32.687126 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.686666 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f5beceb-f998-436e-9b32-b72579c0ece3-system-cni-dir\") pod \"multus-md7b9\" (UID: \"1f5beceb-f998-436e-9b32-b72579c0ece3\") " pod="openshift-multus/multus-md7b9" Jun 02 12:39:32.687126 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.686690 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1f5beceb-f998-436e-9b32-b72579c0ece3-cni-binary-copy\") pod \"multus-md7b9\" (UID: \"1f5beceb-f998-436e-9b32-b72579c0ece3\") " pod="openshift-multus/multus-md7b9" Jun 02 12:39:32.687126 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.686723 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1f5beceb-f998-436e-9b32-b72579c0ece3-host-run-k8s-cni-cncf-io\") pod \"multus-md7b9\" (UID: \"1f5beceb-f998-436e-9b32-b72579c0ece3\") " pod="openshift-multus/multus-md7b9" Jun 02 12:39:32.687851 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.686723 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9211a780-13da-4a76-85dc-2f0a70a65c9c-run-openvswitch\") pod \"ovnkube-node-mb7lb\" (UID: \"9211a780-13da-4a76-85dc-2f0a70a65c9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" Jun 02 12:39:32.687851 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.686762 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfxrf\" (UniqueName: \"kubernetes.io/projected/61950c4e-c9a1-4c0d-af77-980423e1d1d8-kube-api-access-vfxrf\") pod \"network-check-target-q88nq\" (UID: \"61950c4e-c9a1-4c0d-af77-980423e1d1d8\") " pod="openshift-network-diagnostics/network-check-target-q88nq" Jun 02 12:39:32.687851 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.686791 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f5beceb-f998-436e-9b32-b72579c0ece3-multus-cni-dir\") pod \"multus-md7b9\" (UID: \"1f5beceb-f998-436e-9b32-b72579c0ece3\") " pod="openshift-multus/multus-md7b9" Jun 02 12:39:32.687851 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.686791 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/25f63a25-fe7d-455e-98e9-a7f8d1a44fcb-device-dir\") pod \"aws-ebs-csi-driver-node-gv6qz\" (UID: \"25f63a25-fe7d-455e-98e9-a7f8d1a44fcb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gv6qz" Jun 02 12:39:32.687851 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.686826 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9d004590-abbc-46da-934f-471cf2c3495c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8qq7l\" (UID: \"9d004590-abbc-46da-934f-471cf2c3495c\") " pod="openshift-multus/multus-additional-cni-plugins-8qq7l" Jun 02 12:39:32.687851 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.686895 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9d004590-abbc-46da-934f-471cf2c3495c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8qq7l\" (UID: \"9d004590-abbc-46da-934f-471cf2c3495c\") " pod="openshift-multus/multus-additional-cni-plugins-8qq7l" Jun 02 12:39:32.687851 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.686920 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9211a780-13da-4a76-85dc-2f0a70a65c9c-host-run-ovn-kubernetes\") pod \"ovnkube-node-mb7lb\" (UID: \"9211a780-13da-4a76-85dc-2f0a70a65c9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" Jun 02 12:39:32.687851 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.686925 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9d004590-abbc-46da-934f-471cf2c3495c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8qq7l\" (UID: \"9d004590-abbc-46da-934f-471cf2c3495c\") " pod="openshift-multus/multus-additional-cni-plugins-8qq7l" Jun 02 12:39:32.687851 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.686928 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9211a780-13da-4a76-85dc-2f0a70a65c9c-ovnkube-script-lib\") pod \"ovnkube-node-mb7lb\" (UID: \"9211a780-13da-4a76-85dc-2f0a70a65c9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" Jun 02 12:39:32.687851 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.687027 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1f5beceb-f998-436e-9b32-b72579c0ece3-host-run-k8s-cni-cncf-io\") pod \"multus-md7b9\" (UID: \"1f5beceb-f998-436e-9b32-b72579c0ece3\") " pod="openshift-multus/multus-md7b9" Jun 02 12:39:32.687851 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.687034 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5668g\" (UniqueName: \"kubernetes.io/projected/9d004590-abbc-46da-934f-471cf2c3495c-kube-api-access-5668g\") pod \"multus-additional-cni-plugins-8qq7l\" (UID: \"9d004590-abbc-46da-934f-471cf2c3495c\") " pod="openshift-multus/multus-additional-cni-plugins-8qq7l" Jun 02 12:39:32.687851 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.687060 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f5beceb-f998-436e-9b32-b72579c0ece3-system-cni-dir\") pod \"multus-md7b9\" (UID: \"1f5beceb-f998-436e-9b32-b72579c0ece3\") " pod="openshift-multus/multus-md7b9" Jun 02 12:39:32.687851 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.687068 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1f5beceb-f998-436e-9b32-b72579c0ece3-hostroot\") pod \"multus-md7b9\" (UID: \"1f5beceb-f998-436e-9b32-b72579c0ece3\") " pod="openshift-multus/multus-md7b9" Jun 02 12:39:32.687851 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.687069 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1f5beceb-f998-436e-9b32-b72579c0ece3-host-run-netns\") pod \"multus-md7b9\" (UID: \"1f5beceb-f998-436e-9b32-b72579c0ece3\") " pod="openshift-multus/multus-md7b9" Jun 02 12:39:32.687851 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.687103 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/25f63a25-fe7d-455e-98e9-a7f8d1a44fcb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gv6qz\" (UID: \"25f63a25-fe7d-455e-98e9-a7f8d1a44fcb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gv6qz" Jun 02 12:39:32.687851 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.687132 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1f5beceb-f998-436e-9b32-b72579c0ece3-multus-socket-dir-parent\") pod \"multus-md7b9\" (UID: \"1f5beceb-f998-436e-9b32-b72579c0ece3\") " pod="openshift-multus/multus-md7b9" Jun 02 12:39:32.687851 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.687152 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l2tkm\" (UniqueName: \"kubernetes.io/projected/bad7a9bf-61a6-4668-82c3-4f7e819472b9-kube-api-access-l2tkm\") pod \"node-resolver-zg55p\" (UID: \"bad7a9bf-61a6-4668-82c3-4f7e819472b9\") " pod="openshift-dns/node-resolver-zg55p" Jun 02 12:39:32.688491 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.687169 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c-etc-kubernetes\") pod \"tuned-x47f5\" (UID: \"7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c\") " pod="openshift-cluster-node-tuning-operator/tuned-x47f5" Jun 02 12:39:32.688491 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.687194 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c-etc-sysctl-d\") pod \"tuned-x47f5\" (UID: \"7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c\") " pod="openshift-cluster-node-tuning-operator/tuned-x47f5" Jun 02 12:39:32.688491 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.687237 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1f5beceb-f998-436e-9b32-b72579c0ece3-multus-socket-dir-parent\") pod \"multus-md7b9\" (UID: \"1f5beceb-f998-436e-9b32-b72579c0ece3\") " pod="openshift-multus/multus-md7b9" Jun 02 12:39:32.688491 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.687274 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1f5beceb-f998-436e-9b32-b72579c0ece3-hostroot\") pod \"multus-md7b9\" (UID: \"1f5beceb-f998-436e-9b32-b72579c0ece3\") " pod="openshift-multus/multus-md7b9" Jun 02 12:39:32.688491 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.687368 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c-run\") pod \"tuned-x47f5\" (UID: \"7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c\") " pod="openshift-cluster-node-tuning-operator/tuned-x47f5" Jun 02 12:39:32.688491 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.687408 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c-etc-tuned\") pod \"tuned-x47f5\" (UID: \"7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c\") " pod="openshift-cluster-node-tuning-operator/tuned-x47f5" Jun 02 12:39:32.688491 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.687421 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1f5beceb-f998-436e-9b32-b72579c0ece3-cni-binary-copy\") pod \"multus-md7b9\" (UID: \"1f5beceb-f998-436e-9b32-b72579c0ece3\") " pod="openshift-multus/multus-md7b9" Jun 02 12:39:32.688491 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.687441 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9d004590-abbc-46da-934f-471cf2c3495c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8qq7l\" (UID: \"9d004590-abbc-46da-934f-471cf2c3495c\") " pod="openshift-multus/multus-additional-cni-plugins-8qq7l" Jun 02 12:39:32.688491 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.687447 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10c4158d-e827-4403-8ba4-17672f978f94-metrics-certs\") pod \"network-metrics-daemon-rvddx\" (UID: \"10c4158d-e827-4403-8ba4-17672f978f94\") " pod="openshift-multus/network-metrics-daemon-rvddx" Jun 02 12:39:32.688491 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.687490 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bad7a9bf-61a6-4668-82c3-4f7e819472b9-hosts-file\") pod \"node-resolver-zg55p\" (UID: \"bad7a9bf-61a6-4668-82c3-4f7e819472b9\") " pod="openshift-dns/node-resolver-zg55p" Jun 02 12:39:32.688491 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.687542 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9d004590-abbc-46da-934f-471cf2c3495c-cnibin\") pod \"multus-additional-cni-plugins-8qq7l\" (UID: \"9d004590-abbc-46da-934f-471cf2c3495c\") " pod="openshift-multus/multus-additional-cni-plugins-8qq7l" Jun 02 12:39:32.688491 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.687560 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bad7a9bf-61a6-4668-82c3-4f7e819472b9-hosts-file\") pod \"node-resolver-zg55p\" (UID: \"bad7a9bf-61a6-4668-82c3-4f7e819472b9\") " pod="openshift-dns/node-resolver-zg55p" Jun 02 12:39:32.688491 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:32.687575 2545 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 12:39:32.688491 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.687599 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9211a780-13da-4a76-85dc-2f0a70a65c9c-host-kubelet\") pod \"ovnkube-node-mb7lb\" (UID: \"9211a780-13da-4a76-85dc-2f0a70a65c9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" Jun 02 12:39:32.688491 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:32.687672 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10c4158d-e827-4403-8ba4-17672f978f94-metrics-certs podName:10c4158d-e827-4403-8ba4-17672f978f94 nodeName:}" failed. No retries permitted until 2026-06-02 12:39:33.187625529 +0000 UTC m=+3.105240623 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10c4158d-e827-4403-8ba4-17672f978f94-metrics-certs") pod "network-metrics-daemon-rvddx" (UID: "10c4158d-e827-4403-8ba4-17672f978f94") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 12:39:32.688491 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.687694 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9211a780-13da-4a76-85dc-2f0a70a65c9c-host-slash\") pod \"ovnkube-node-mb7lb\" (UID: \"9211a780-13da-4a76-85dc-2f0a70a65c9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" Jun 02 12:39:32.688491 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.687695 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9d004590-abbc-46da-934f-471cf2c3495c-cnibin\") pod \"multus-additional-cni-plugins-8qq7l\" (UID: \"9d004590-abbc-46da-934f-471cf2c3495c\") " pod="openshift-multus/multus-additional-cni-plugins-8qq7l" Jun 02 12:39:32.689196 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.687701 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9211a780-13da-4a76-85dc-2f0a70a65c9c-host-kubelet\") pod \"ovnkube-node-mb7lb\" (UID: \"9211a780-13da-4a76-85dc-2f0a70a65c9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" Jun 02 12:39:32.689196 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.687752 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9211a780-13da-4a76-85dc-2f0a70a65c9c-host-slash\") pod \"ovnkube-node-mb7lb\" (UID: \"9211a780-13da-4a76-85dc-2f0a70a65c9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" Jun 02 12:39:32.689196 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.687755 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1f5beceb-f998-436e-9b32-b72579c0ece3-os-release\") pod \"multus-md7b9\" (UID: \"1f5beceb-f998-436e-9b32-b72579c0ece3\") " pod="openshift-multus/multus-md7b9" Jun 02 12:39:32.689196 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.687785 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1f5beceb-f998-436e-9b32-b72579c0ece3-multus-conf-dir\") pod \"multus-md7b9\" (UID: \"1f5beceb-f998-436e-9b32-b72579c0ece3\") " pod="openshift-multus/multus-md7b9" Jun 02 12:39:32.689196 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.687802 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1f5beceb-f998-436e-9b32-b72579c0ece3-os-release\") pod \"multus-md7b9\" (UID: \"1f5beceb-f998-436e-9b32-b72579c0ece3\") " pod="openshift-multus/multus-md7b9" Jun 02 12:39:32.689196 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.687807 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c11a5292-1287-4f12-b1db-c31517a0ddc6-konnectivity-ca\") pod \"konnectivity-agent-hv55n\" (UID: \"c11a5292-1287-4f12-b1db-c31517a0ddc6\") " pod="kube-system/konnectivity-agent-hv55n" Jun 02 12:39:32.689196 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.687826 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1f5beceb-f998-436e-9b32-b72579c0ece3-host-run-multus-certs\") pod \"multus-md7b9\" (UID: \"1f5beceb-f998-436e-9b32-b72579c0ece3\") " pod="openshift-multus/multus-md7b9" Jun 02 12:39:32.689196 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.687832 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1f5beceb-f998-436e-9b32-b72579c0ece3-multus-conf-dir\") pod \"multus-md7b9\" (UID: \"1f5beceb-f998-436e-9b32-b72579c0ece3\") " pod="openshift-multus/multus-md7b9" Jun 02 12:39:32.689196 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.687879 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1f5beceb-f998-436e-9b32-b72579c0ece3-host-run-multus-certs\") pod \"multus-md7b9\" (UID: \"1f5beceb-f998-436e-9b32-b72579c0ece3\") " pod="openshift-multus/multus-md7b9" Jun 02 12:39:32.689196 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.687898 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9211a780-13da-4a76-85dc-2f0a70a65c9c-run-systemd\") pod \"ovnkube-node-mb7lb\" (UID: \"9211a780-13da-4a76-85dc-2f0a70a65c9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" Jun 02 12:39:32.689196 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.687930 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9211a780-13da-4a76-85dc-2f0a70a65c9c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mb7lb\" (UID: \"9211a780-13da-4a76-85dc-2f0a70a65c9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" Jun 02 12:39:32.689196 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.687961 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9211a780-13da-4a76-85dc-2f0a70a65c9c-run-systemd\") pod \"ovnkube-node-mb7lb\" (UID: \"9211a780-13da-4a76-85dc-2f0a70a65c9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" Jun 02 12:39:32.689196 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.687964 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wmbbl\" (UniqueName: \"kubernetes.io/projected/9211a780-13da-4a76-85dc-2f0a70a65c9c-kube-api-access-wmbbl\") pod \"ovnkube-node-mb7lb\" (UID: \"9211a780-13da-4a76-85dc-2f0a70a65c9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" Jun 02 12:39:32.689196 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.688000 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9211a780-13da-4a76-85dc-2f0a70a65c9c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mb7lb\" (UID: \"9211a780-13da-4a76-85dc-2f0a70a65c9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" Jun 02 12:39:32.689196 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.688003 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1f5beceb-f998-436e-9b32-b72579c0ece3-multus-daemon-config\") pod \"multus-md7b9\" (UID: \"1f5beceb-f998-436e-9b32-b72579c0ece3\") " pod="openshift-multus/multus-md7b9" Jun 02 12:39:32.689196 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.688040 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c-etc-sysconfig\") pod \"tuned-x47f5\" (UID: \"7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c\") " pod="openshift-cluster-node-tuning-operator/tuned-x47f5" Jun 02 12:39:32.689196 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.688063 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c-etc-systemd\") pod \"tuned-x47f5\" (UID: \"7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c\") " pod="openshift-cluster-node-tuning-operator/tuned-x47f5" Jun 02 12:39:32.689742 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.688086 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/25f63a25-fe7d-455e-98e9-a7f8d1a44fcb-socket-dir\") pod \"aws-ebs-csi-driver-node-gv6qz\" (UID: \"25f63a25-fe7d-455e-98e9-a7f8d1a44fcb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gv6qz" Jun 02 12:39:32.689742 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.688109 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bad7a9bf-61a6-4668-82c3-4f7e819472b9-tmp-dir\") pod \"node-resolver-zg55p\" (UID: \"bad7a9bf-61a6-4668-82c3-4f7e819472b9\") " pod="openshift-dns/node-resolver-zg55p" Jun 02 12:39:32.689742 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.688135 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e0da3dd7-3e7d-4873-9be6-1e77fce2a507-host\") pod \"node-ca-jcwvf\" (UID: \"e0da3dd7-3e7d-4873-9be6-1e77fce2a507\") " pod="openshift-image-registry/node-ca-jcwvf" Jun 02 12:39:32.689742 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.688158 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9211a780-13da-4a76-85dc-2f0a70a65c9c-var-lib-openvswitch\") pod \"ovnkube-node-mb7lb\" (UID: \"9211a780-13da-4a76-85dc-2f0a70a65c9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" Jun 02 12:39:32.689742 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.688182 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9211a780-13da-4a76-85dc-2f0a70a65c9c-host-cni-netd\") pod \"ovnkube-node-mb7lb\" (UID: \"9211a780-13da-4a76-85dc-2f0a70a65c9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" Jun 02 12:39:32.689742 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.688193 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e0da3dd7-3e7d-4873-9be6-1e77fce2a507-host\") pod \"node-ca-jcwvf\" (UID: \"e0da3dd7-3e7d-4873-9be6-1e77fce2a507\") " pod="openshift-image-registry/node-ca-jcwvf" Jun 02 12:39:32.689742 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.688205 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9211a780-13da-4a76-85dc-2f0a70a65c9c-ovn-node-metrics-cert\") pod \"ovnkube-node-mb7lb\" (UID: \"9211a780-13da-4a76-85dc-2f0a70a65c9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" Jun 02 12:39:32.689742 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.688233 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c11a5292-1287-4f12-b1db-c31517a0ddc6-agent-certs\") pod \"konnectivity-agent-hv55n\" (UID: \"c11a5292-1287-4f12-b1db-c31517a0ddc6\") " pod="kube-system/konnectivity-agent-hv55n" Jun 02 12:39:32.689742 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.688238 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9211a780-13da-4a76-85dc-2f0a70a65c9c-var-lib-openvswitch\") pod \"ovnkube-node-mb7lb\" (UID: \"9211a780-13da-4a76-85dc-2f0a70a65c9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" Jun 02 12:39:32.689742 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.688268 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9211a780-13da-4a76-85dc-2f0a70a65c9c-systemd-units\") pod \"ovnkube-node-mb7lb\" (UID: \"9211a780-13da-4a76-85dc-2f0a70a65c9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" Jun 02 12:39:32.689742 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.688292 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9211a780-13da-4a76-85dc-2f0a70a65c9c-host-cni-netd\") pod \"ovnkube-node-mb7lb\" (UID: \"9211a780-13da-4a76-85dc-2f0a70a65c9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" Jun 02 12:39:32.689742 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.688296 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9211a780-13da-4a76-85dc-2f0a70a65c9c-etc-openvswitch\") pod \"ovnkube-node-mb7lb\" (UID: \"9211a780-13da-4a76-85dc-2f0a70a65c9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" Jun 02 12:39:32.689742 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.688327 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9211a780-13da-4a76-85dc-2f0a70a65c9c-etc-openvswitch\") pod \"ovnkube-node-mb7lb\" (UID: \"9211a780-13da-4a76-85dc-2f0a70a65c9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" Jun 02 12:39:32.689742 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.688352 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9211a780-13da-4a76-85dc-2f0a70a65c9c-systemd-units\") pod \"ovnkube-node-mb7lb\" (UID: \"9211a780-13da-4a76-85dc-2f0a70a65c9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" Jun 02 12:39:32.689742 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.688357 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9211a780-13da-4a76-85dc-2f0a70a65c9c-env-overrides\") pod \"ovnkube-node-mb7lb\" (UID: \"9211a780-13da-4a76-85dc-2f0a70a65c9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" Jun 02 12:39:32.689742 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.688409 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tf52t\" (UniqueName: \"kubernetes.io/projected/10c4158d-e827-4403-8ba4-17672f978f94-kube-api-access-tf52t\") pod \"network-metrics-daemon-rvddx\" (UID: \"10c4158d-e827-4403-8ba4-17672f978f94\") " pod="openshift-multus/network-metrics-daemon-rvddx" Jun 02 12:39:32.689742 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.688437 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bad7a9bf-61a6-4668-82c3-4f7e819472b9-tmp-dir\") pod \"node-resolver-zg55p\" (UID: \"bad7a9bf-61a6-4668-82c3-4f7e819472b9\") " pod="openshift-dns/node-resolver-zg55p" Jun 02 12:39:32.690285 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.688440 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2vqt\" (UniqueName: \"kubernetes.io/projected/25f63a25-fe7d-455e-98e9-a7f8d1a44fcb-kube-api-access-r2vqt\") pod \"aws-ebs-csi-driver-node-gv6qz\" (UID: \"25f63a25-fe7d-455e-98e9-a7f8d1a44fcb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gv6qz" Jun 02 12:39:32.690285 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.688521 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1f5beceb-f998-436e-9b32-b72579c0ece3-multus-daemon-config\") pod \"multus-md7b9\" (UID: \"1f5beceb-f998-436e-9b32-b72579c0ece3\") " pod="openshift-multus/multus-md7b9" Jun 02 12:39:32.690285 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.688560 2545 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 02 12:39:32.690285 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.688701 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9211a780-13da-4a76-85dc-2f0a70a65c9c-env-overrides\") pod \"ovnkube-node-mb7lb\" (UID: \"9211a780-13da-4a76-85dc-2f0a70a65c9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" Jun 02 12:39:32.691891 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.691827 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9211a780-13da-4a76-85dc-2f0a70a65c9c-ovn-node-metrics-cert\") pod \"ovnkube-node-mb7lb\" (UID: \"9211a780-13da-4a76-85dc-2f0a70a65c9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" Jun 02 12:39:32.693723 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.693671 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gd9bb\" (UniqueName: \"kubernetes.io/projected/1f5beceb-f998-436e-9b32-b72579c0ece3-kube-api-access-gd9bb\") pod \"multus-md7b9\" (UID: \"1f5beceb-f998-436e-9b32-b72579c0ece3\") " pod="openshift-multus/multus-md7b9" Jun 02 12:39:32.694151 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.694130 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lk2jc\" (UniqueName: \"kubernetes.io/projected/e0da3dd7-3e7d-4873-9be6-1e77fce2a507-kube-api-access-lk2jc\") pod \"node-ca-jcwvf\" (UID: \"e0da3dd7-3e7d-4873-9be6-1e77fce2a507\") " pod="openshift-image-registry/node-ca-jcwvf" Jun 02 12:39:32.695008 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.694987 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5668g\" (UniqueName: \"kubernetes.io/projected/9d004590-abbc-46da-934f-471cf2c3495c-kube-api-access-5668g\") pod \"multus-additional-cni-plugins-8qq7l\" (UID: \"9d004590-abbc-46da-934f-471cf2c3495c\") " pod="openshift-multus/multus-additional-cni-plugins-8qq7l" Jun 02 12:39:32.695634 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.695615 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2tkm\" (UniqueName: \"kubernetes.io/projected/bad7a9bf-61a6-4668-82c3-4f7e819472b9-kube-api-access-l2tkm\") pod \"node-resolver-zg55p\" (UID: \"bad7a9bf-61a6-4668-82c3-4f7e819472b9\") " pod="openshift-dns/node-resolver-zg55p" Jun 02 12:39:32.701051 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.700999 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tf52t\" (UniqueName: \"kubernetes.io/projected/10c4158d-e827-4403-8ba4-17672f978f94-kube-api-access-tf52t\") pod \"network-metrics-daemon-rvddx\" (UID: \"10c4158d-e827-4403-8ba4-17672f978f94\") " pod="openshift-multus/network-metrics-daemon-rvddx" Jun 02 12:39:32.701202 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.701185 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmbbl\" (UniqueName: \"kubernetes.io/projected/9211a780-13da-4a76-85dc-2f0a70a65c9c-kube-api-access-wmbbl\") pod \"ovnkube-node-mb7lb\" (UID: \"9211a780-13da-4a76-85dc-2f0a70a65c9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" Jun 02 12:39:32.707682 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.707625 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-229.ec2.internal" event={"ID":"a1285734c0620c23a16adc49432d3f3e","Type":"ContainerStarted","Data":"93ba00dbadd00c45dbf1e5c64a497315ebb756b42c52fee1b1e5c8aef561d3bb"} Jun 02 12:39:32.708620 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.708599 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-229.ec2.internal" event={"ID":"3baf4d93838fc3d664a8a17cf60359ce","Type":"ContainerStarted","Data":"0ae007aa17564b33cda063de9132038607bef5903524f4f86424be06448404c4"} Jun 02 12:39:32.789404 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.789374 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c-run\") pod \"tuned-x47f5\" (UID: \"7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c\") " pod="openshift-cluster-node-tuning-operator/tuned-x47f5" Jun 02 12:39:32.789579 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.789416 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c-etc-tuned\") pod \"tuned-x47f5\" (UID: \"7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c\") " pod="openshift-cluster-node-tuning-operator/tuned-x47f5" Jun 02 12:39:32.789579 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.789466 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c11a5292-1287-4f12-b1db-c31517a0ddc6-konnectivity-ca\") pod \"konnectivity-agent-hv55n\" (UID: \"c11a5292-1287-4f12-b1db-c31517a0ddc6\") " pod="kube-system/konnectivity-agent-hv55n" Jun 02 12:39:32.789579 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.789497 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c-etc-sysconfig\") pod \"tuned-x47f5\" (UID: \"7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c\") " pod="openshift-cluster-node-tuning-operator/tuned-x47f5" Jun 02 12:39:32.789579 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.789509 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c-run\") pod \"tuned-x47f5\" (UID: \"7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c\") " pod="openshift-cluster-node-tuning-operator/tuned-x47f5" Jun 02 12:39:32.789579 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.789518 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c-etc-systemd\") pod \"tuned-x47f5\" (UID: \"7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c\") " pod="openshift-cluster-node-tuning-operator/tuned-x47f5" Jun 02 12:39:32.789579 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.789568 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c-etc-systemd\") pod \"tuned-x47f5\" (UID: \"7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c\") " pod="openshift-cluster-node-tuning-operator/tuned-x47f5" Jun 02 12:39:32.789579 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.789572 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/25f63a25-fe7d-455e-98e9-a7f8d1a44fcb-socket-dir\") pod \"aws-ebs-csi-driver-node-gv6qz\" (UID: \"25f63a25-fe7d-455e-98e9-a7f8d1a44fcb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gv6qz" Jun 02 12:39:32.789957 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.789615 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c11a5292-1287-4f12-b1db-c31517a0ddc6-agent-certs\") pod \"konnectivity-agent-hv55n\" (UID: \"c11a5292-1287-4f12-b1db-c31517a0ddc6\") " pod="kube-system/konnectivity-agent-hv55n" Jun 02 12:39:32.789957 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.789644 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r2vqt\" (UniqueName: \"kubernetes.io/projected/25f63a25-fe7d-455e-98e9-a7f8d1a44fcb-kube-api-access-r2vqt\") pod \"aws-ebs-csi-driver-node-gv6qz\" (UID: \"25f63a25-fe7d-455e-98e9-a7f8d1a44fcb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gv6qz" Jun 02 12:39:32.789957 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.789672 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c-var-lib-kubelet\") pod \"tuned-x47f5\" (UID: \"7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c\") " pod="openshift-cluster-node-tuning-operator/tuned-x47f5" Jun 02 12:39:32.789957 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.789695 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c-sys\") pod \"tuned-x47f5\" (UID: \"7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c\") " pod="openshift-cluster-node-tuning-operator/tuned-x47f5" Jun 02 12:39:32.789957 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.789697 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/25f63a25-fe7d-455e-98e9-a7f8d1a44fcb-socket-dir\") pod \"aws-ebs-csi-driver-node-gv6qz\" (UID: \"25f63a25-fe7d-455e-98e9-a7f8d1a44fcb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gv6qz" Jun 02 12:39:32.789957 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.789735 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c-lib-modules\") pod \"tuned-x47f5\" (UID: \"7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c\") " pod="openshift-cluster-node-tuning-operator/tuned-x47f5" Jun 02 12:39:32.789957 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.789744 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c-sys\") pod \"tuned-x47f5\" (UID: \"7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c\") " pod="openshift-cluster-node-tuning-operator/tuned-x47f5" Jun 02 12:39:32.789957 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.789763 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c-etc-sysctl-conf\") pod \"tuned-x47f5\" (UID: \"7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c\") " pod="openshift-cluster-node-tuning-operator/tuned-x47f5" Jun 02 12:39:32.789957 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.789792 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-srj69\" (UniqueName: \"kubernetes.io/projected/7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c-kube-api-access-srj69\") pod \"tuned-x47f5\" (UID: \"7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c\") " pod="openshift-cluster-node-tuning-operator/tuned-x47f5" Jun 02 12:39:32.789957 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.789818 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j8snf\" (UniqueName: \"kubernetes.io/projected/937d6529-311c-4484-b66d-e0278f105138-kube-api-access-j8snf\") pod \"iptables-alerter-jj5kr\" (UID: \"937d6529-311c-4484-b66d-e0278f105138\") " pod="openshift-network-operator/iptables-alerter-jj5kr" Jun 02 12:39:32.789957 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.789866 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c-etc-modprobe-d\") pod \"tuned-x47f5\" (UID: \"7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c\") " pod="openshift-cluster-node-tuning-operator/tuned-x47f5" Jun 02 12:39:32.789957 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.789893 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/25f63a25-fe7d-455e-98e9-a7f8d1a44fcb-sys-fs\") pod \"aws-ebs-csi-driver-node-gv6qz\" (UID: \"25f63a25-fe7d-455e-98e9-a7f8d1a44fcb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gv6qz" Jun 02 12:39:32.789957 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.789921 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/25f63a25-fe7d-455e-98e9-a7f8d1a44fcb-registration-dir\") pod \"aws-ebs-csi-driver-node-gv6qz\" (UID: \"25f63a25-fe7d-455e-98e9-a7f8d1a44fcb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gv6qz" Jun 02 12:39:32.789957 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.789952 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c-tmp\") pod \"tuned-x47f5\" (UID: \"7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c\") " pod="openshift-cluster-node-tuning-operator/tuned-x47f5" Jun 02 12:39:32.790595 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.789975 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/25f63a25-fe7d-455e-98e9-a7f8d1a44fcb-etc-selinux\") pod \"aws-ebs-csi-driver-node-gv6qz\" (UID: \"25f63a25-fe7d-455e-98e9-a7f8d1a44fcb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gv6qz" Jun 02 12:39:32.790595 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.789976 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c-lib-modules\") pod \"tuned-x47f5\" (UID: \"7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c\") " pod="openshift-cluster-node-tuning-operator/tuned-x47f5" Jun 02 12:39:32.790595 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.790006 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/937d6529-311c-4484-b66d-e0278f105138-iptables-alerter-script\") pod \"iptables-alerter-jj5kr\" (UID: \"937d6529-311c-4484-b66d-e0278f105138\") " pod="openshift-network-operator/iptables-alerter-jj5kr" Jun 02 12:39:32.790595 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.790034 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c-host\") pod \"tuned-x47f5\" (UID: \"7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c\") " pod="openshift-cluster-node-tuning-operator/tuned-x47f5" Jun 02 12:39:32.790595 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.790038 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c-var-lib-kubelet\") pod \"tuned-x47f5\" (UID: \"7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c\") " pod="openshift-cluster-node-tuning-operator/tuned-x47f5" Jun 02 12:39:32.790595 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.790070 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/937d6529-311c-4484-b66d-e0278f105138-host-slash\") pod \"iptables-alerter-jj5kr\" (UID: \"937d6529-311c-4484-b66d-e0278f105138\") " pod="openshift-network-operator/iptables-alerter-jj5kr" Jun 02 12:39:32.790595 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.790092 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c-host\") pod \"tuned-x47f5\" (UID: \"7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c\") " pod="openshift-cluster-node-tuning-operator/tuned-x47f5" Jun 02 12:39:32.790595 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.790102 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vfxrf\" (UniqueName: \"kubernetes.io/projected/61950c4e-c9a1-4c0d-af77-980423e1d1d8-kube-api-access-vfxrf\") pod \"network-check-target-q88nq\" (UID: \"61950c4e-c9a1-4c0d-af77-980423e1d1d8\") " pod="openshift-network-diagnostics/network-check-target-q88nq" Jun 02 12:39:32.790595 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.790125 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c-etc-sysconfig\") pod \"tuned-x47f5\" (UID: \"7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c\") " pod="openshift-cluster-node-tuning-operator/tuned-x47f5" Jun 02 12:39:32.790595 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.790138 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/25f63a25-fe7d-455e-98e9-a7f8d1a44fcb-sys-fs\") pod \"aws-ebs-csi-driver-node-gv6qz\" (UID: \"25f63a25-fe7d-455e-98e9-a7f8d1a44fcb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gv6qz" Jun 02 12:39:32.790595 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.790146 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/25f63a25-fe7d-455e-98e9-a7f8d1a44fcb-registration-dir\") pod \"aws-ebs-csi-driver-node-gv6qz\" (UID: \"25f63a25-fe7d-455e-98e9-a7f8d1a44fcb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gv6qz" Jun 02 12:39:32.790595 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.790128 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/25f63a25-fe7d-455e-98e9-a7f8d1a44fcb-device-dir\") pod \"aws-ebs-csi-driver-node-gv6qz\" (UID: \"25f63a25-fe7d-455e-98e9-a7f8d1a44fcb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gv6qz" Jun 02 12:39:32.790595 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.790170 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/25f63a25-fe7d-455e-98e9-a7f8d1a44fcb-device-dir\") pod \"aws-ebs-csi-driver-node-gv6qz\" (UID: \"25f63a25-fe7d-455e-98e9-a7f8d1a44fcb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gv6qz" Jun 02 12:39:32.790595 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.790186 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/25f63a25-fe7d-455e-98e9-a7f8d1a44fcb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gv6qz\" (UID: \"25f63a25-fe7d-455e-98e9-a7f8d1a44fcb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gv6qz" Jun 02 12:39:32.790595 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.790205 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/937d6529-311c-4484-b66d-e0278f105138-host-slash\") pod \"iptables-alerter-jj5kr\" (UID: \"937d6529-311c-4484-b66d-e0278f105138\") " pod="openshift-network-operator/iptables-alerter-jj5kr" Jun 02 12:39:32.790595 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.790216 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c-etc-kubernetes\") pod \"tuned-x47f5\" (UID: \"7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c\") " pod="openshift-cluster-node-tuning-operator/tuned-x47f5" Jun 02 12:39:32.790595 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.790256 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/25f63a25-fe7d-455e-98e9-a7f8d1a44fcb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gv6qz\" (UID: \"25f63a25-fe7d-455e-98e9-a7f8d1a44fcb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gv6qz" Jun 02 12:39:32.791397 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.790270 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c-etc-sysctl-d\") pod \"tuned-x47f5\" (UID: \"7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c\") " pod="openshift-cluster-node-tuning-operator/tuned-x47f5" Jun 02 12:39:32.791397 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.790305 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c-etc-kubernetes\") pod \"tuned-x47f5\" (UID: \"7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c\") " pod="openshift-cluster-node-tuning-operator/tuned-x47f5" Jun 02 12:39:32.791397 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.790373 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c-etc-modprobe-d\") pod \"tuned-x47f5\" (UID: \"7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c\") " pod="openshift-cluster-node-tuning-operator/tuned-x47f5" Jun 02 12:39:32.791397 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.790376 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c-etc-sysctl-conf\") pod \"tuned-x47f5\" (UID: \"7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c\") " pod="openshift-cluster-node-tuning-operator/tuned-x47f5" Jun 02 12:39:32.791397 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.790386 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/25f63a25-fe7d-455e-98e9-a7f8d1a44fcb-etc-selinux\") pod \"aws-ebs-csi-driver-node-gv6qz\" (UID: \"25f63a25-fe7d-455e-98e9-a7f8d1a44fcb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gv6qz" Jun 02 12:39:32.791397 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.790414 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c-etc-sysctl-d\") pod \"tuned-x47f5\" (UID: \"7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c\") " pod="openshift-cluster-node-tuning-operator/tuned-x47f5" Jun 02 12:39:32.791397 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.790879 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/937d6529-311c-4484-b66d-e0278f105138-iptables-alerter-script\") pod \"iptables-alerter-jj5kr\" (UID: \"937d6529-311c-4484-b66d-e0278f105138\") " pod="openshift-network-operator/iptables-alerter-jj5kr" Jun 02 12:39:32.791397 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.791129 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c11a5292-1287-4f12-b1db-c31517a0ddc6-konnectivity-ca\") pod \"konnectivity-agent-hv55n\" (UID: \"c11a5292-1287-4f12-b1db-c31517a0ddc6\") " pod="kube-system/konnectivity-agent-hv55n" Jun 02 12:39:32.792682 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.792659 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c-tmp\") pod \"tuned-x47f5\" (UID: \"7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c\") " pod="openshift-cluster-node-tuning-operator/tuned-x47f5" Jun 02 12:39:32.792812 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.792793 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c-etc-tuned\") pod \"tuned-x47f5\" (UID: \"7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c\") " pod="openshift-cluster-node-tuning-operator/tuned-x47f5" Jun 02 12:39:32.793274 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.793252 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c11a5292-1287-4f12-b1db-c31517a0ddc6-agent-certs\") pod \"konnectivity-agent-hv55n\" (UID: \"c11a5292-1287-4f12-b1db-c31517a0ddc6\") " pod="kube-system/konnectivity-agent-hv55n" Jun 02 12:39:32.796202 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:32.796179 2545 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 12:39:32.796202 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:32.796207 2545 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 12:39:32.796372 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:32.796219 2545 projected.go:194] Error preparing data for projected volume kube-api-access-vfxrf for pod openshift-network-diagnostics/network-check-target-q88nq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 12:39:32.796372 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:32.796284 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/61950c4e-c9a1-4c0d-af77-980423e1d1d8-kube-api-access-vfxrf podName:61950c4e-c9a1-4c0d-af77-980423e1d1d8 nodeName:}" failed. No retries permitted until 2026-06-02 12:39:33.29626433 +0000 UTC m=+3.213879421 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vfxrf" (UniqueName: "kubernetes.io/projected/61950c4e-c9a1-4c0d-af77-980423e1d1d8-kube-api-access-vfxrf") pod "network-check-target-q88nq" (UID: "61950c4e-c9a1-4c0d-af77-980423e1d1d8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 12:39:32.798040 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.797989 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2vqt\" (UniqueName: \"kubernetes.io/projected/25f63a25-fe7d-455e-98e9-a7f8d1a44fcb-kube-api-access-r2vqt\") pod \"aws-ebs-csi-driver-node-gv6qz\" (UID: \"25f63a25-fe7d-455e-98e9-a7f8d1a44fcb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gv6qz" Jun 02 12:39:32.799096 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.799038 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8snf\" (UniqueName: \"kubernetes.io/projected/937d6529-311c-4484-b66d-e0278f105138-kube-api-access-j8snf\") pod \"iptables-alerter-jj5kr\" (UID: \"937d6529-311c-4484-b66d-e0278f105138\") " pod="openshift-network-operator/iptables-alerter-jj5kr" Jun 02 12:39:32.799214 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.799187 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-srj69\" (UniqueName: \"kubernetes.io/projected/7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c-kube-api-access-srj69\") pod \"tuned-x47f5\" (UID: \"7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c\") " pod="openshift-cluster-node-tuning-operator/tuned-x47f5" Jun 02 12:39:32.870525 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.870496 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" Jun 02 12:39:32.878364 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.878346 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-md7b9" Jun 02 12:39:32.889953 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.889930 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zg55p" Jun 02 12:39:32.893580 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.893563 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jcwvf" Jun 02 12:39:32.901083 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.901064 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8qq7l" Jun 02 12:39:32.908574 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.908554 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jj5kr" Jun 02 12:39:32.915184 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.915161 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hv55n" Jun 02 12:39:32.916823 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.916808 2545 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 12:39:32.922202 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.922184 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gv6qz" Jun 02 12:39:32.929219 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:32.929199 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-x47f5" Jun 02 12:39:33.192301 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:33.192212 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10c4158d-e827-4403-8ba4-17672f978f94-metrics-certs\") pod \"network-metrics-daemon-rvddx\" (UID: \"10c4158d-e827-4403-8ba4-17672f978f94\") " pod="openshift-multus/network-metrics-daemon-rvddx" Jun 02 12:39:33.192440 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:33.192332 2545 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 12:39:33.192440 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:33.192394 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10c4158d-e827-4403-8ba4-17672f978f94-metrics-certs podName:10c4158d-e827-4403-8ba4-17672f978f94 nodeName:}" failed. No retries permitted until 2026-06-02 12:39:34.192374475 +0000 UTC m=+4.109989552 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10c4158d-e827-4403-8ba4-17672f978f94-metrics-certs") pod "network-metrics-daemon-rvddx" (UID: "10c4158d-e827-4403-8ba4-17672f978f94") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 12:39:33.393180 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:33.393148 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vfxrf\" (UniqueName: \"kubernetes.io/projected/61950c4e-c9a1-4c0d-af77-980423e1d1d8-kube-api-access-vfxrf\") pod \"network-check-target-q88nq\" (UID: \"61950c4e-c9a1-4c0d-af77-980423e1d1d8\") " pod="openshift-network-diagnostics/network-check-target-q88nq" Jun 02 12:39:33.393321 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:33.393310 2545 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 12:39:33.393356 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:33.393324 2545 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 12:39:33.393356 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:33.393334 2545 projected.go:194] Error preparing data for projected volume kube-api-access-vfxrf for pod openshift-network-diagnostics/network-check-target-q88nq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 12:39:33.393412 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:33.393384 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/61950c4e-c9a1-4c0d-af77-980423e1d1d8-kube-api-access-vfxrf podName:61950c4e-c9a1-4c0d-af77-980423e1d1d8 nodeName:}" failed. No retries permitted until 2026-06-02 12:39:34.393368598 +0000 UTC m=+4.310983677 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vfxrf" (UniqueName: "kubernetes.io/projected/61950c4e-c9a1-4c0d-af77-980423e1d1d8-kube-api-access-vfxrf") pod "network-check-target-q88nq" (UID: "61950c4e-c9a1-4c0d-af77-980423e1d1d8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 12:39:33.428764 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:33.428736 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbad7a9bf_61a6_4668_82c3_4f7e819472b9.slice/crio-ec1d6b17351d950a9fcee805d96077ab158c21bd89f866607d9e7ad787b8333b WatchSource:0}: Error finding container ec1d6b17351d950a9fcee805d96077ab158c21bd89f866607d9e7ad787b8333b: Status 404 returned error can't find the container with id ec1d6b17351d950a9fcee805d96077ab158c21bd89f866607d9e7ad787b8333b Jun 02 12:39:33.429450 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:33.429423 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod937d6529_311c_4484_b66d_e0278f105138.slice/crio-f930417dc431dfc385884f0dd3ed149979e9c63d2e1ac26db407b1ca83709af5 WatchSource:0}: Error finding container f930417dc431dfc385884f0dd3ed149979e9c63d2e1ac26db407b1ca83709af5: Status 404 returned error can't find the container with id f930417dc431dfc385884f0dd3ed149979e9c63d2e1ac26db407b1ca83709af5 Jun 02 12:39:33.433817 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:33.433798 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc11a5292_1287_4f12_b1db_c31517a0ddc6.slice/crio-1e9ea2b9ce7a699b99626943750f2bd9af7098bd3801e03c33ab576e392d7a4a WatchSource:0}: Error finding container 1e9ea2b9ce7a699b99626943750f2bd9af7098bd3801e03c33ab576e392d7a4a: Status 404 returned error can't find the container with id 1e9ea2b9ce7a699b99626943750f2bd9af7098bd3801e03c33ab576e392d7a4a Jun 02 12:39:33.436339 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:33.436184 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d004590_abbc_46da_934f_471cf2c3495c.slice/crio-8e7a0bebdd9d9508ff63b05a11e474a906e0df3d38ce76b0c836850ff39b62bf WatchSource:0}: Error finding container 8e7a0bebdd9d9508ff63b05a11e474a906e0df3d38ce76b0c836850ff39b62bf: Status 404 returned error can't find the container with id 8e7a0bebdd9d9508ff63b05a11e474a906e0df3d38ce76b0c836850ff39b62bf Jun 02 12:39:33.436447 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:33.436425 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0da3dd7_3e7d_4873_9be6_1e77fce2a507.slice/crio-f0a8f0c68eeefd31bfceb6bb5d3bf07986adb4d13f0dd0b098399e3ef19e9906 WatchSource:0}: Error finding container f0a8f0c68eeefd31bfceb6bb5d3bf07986adb4d13f0dd0b098399e3ef19e9906: Status 404 returned error can't find the container with id f0a8f0c68eeefd31bfceb6bb5d3bf07986adb4d13f0dd0b098399e3ef19e9906 Jun 02 12:39:33.437299 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:33.437168 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f5beceb_f998_436e_9b32_b72579c0ece3.slice/crio-cbd0b3527e870e1d23455c15633bef20e1a43a80aee9da003bdb4550f07c7b0d WatchSource:0}: Error finding container cbd0b3527e870e1d23455c15633bef20e1a43a80aee9da003bdb4550f07c7b0d: Status 404 returned error can't find the container with id cbd0b3527e870e1d23455c15633bef20e1a43a80aee9da003bdb4550f07c7b0d Jun 02 12:39:33.439402 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:33.439381 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b10a4ef_6ad1_4783_8ec7_08c41e7ab57c.slice/crio-6cb396ade2268eb1106848bb3bf46a4d829e7ec28a655a4e9d42251fb72c9ce9 WatchSource:0}: Error finding container 6cb396ade2268eb1106848bb3bf46a4d829e7ec28a655a4e9d42251fb72c9ce9: Status 404 returned error can't find the container with id 6cb396ade2268eb1106848bb3bf46a4d829e7ec28a655a4e9d42251fb72c9ce9 Jun 02 12:39:33.440293 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:33.439690 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25f63a25_fe7d_455e_98e9_a7f8d1a44fcb.slice/crio-32b451e0843eccfa5c750fe84bed03a59dc799a204e6934fd1509e059d2c6507 WatchSource:0}: Error finding container 32b451e0843eccfa5c750fe84bed03a59dc799a204e6934fd1509e059d2c6507: Status 404 returned error can't find the container with id 32b451e0843eccfa5c750fe84bed03a59dc799a204e6934fd1509e059d2c6507 Jun 02 12:39:33.440789 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:39:33.440379 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9211a780_13da_4a76_85dc_2f0a70a65c9c.slice/crio-5d26eaec2da97c28fcafee0b37cdecdfb68c296f24445b72e80bf7ad75b7e26a WatchSource:0}: Error finding container 5d26eaec2da97c28fcafee0b37cdecdfb68c296f24445b72e80bf7ad75b7e26a: Status 404 returned error can't find the container with id 5d26eaec2da97c28fcafee0b37cdecdfb68c296f24445b72e80bf7ad75b7e26a Jun 02 12:39:33.618636 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:33.618450 2545 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 12:34:31 +0000 UTC" deadline="2028-03-01 14:53:09.175629152 +0000 UTC" Jun 02 12:39:33.618636 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:33.618631 2545 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15314h13m35.557001466s" Jun 02 12:39:33.710976 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:33.710876 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gv6qz" event={"ID":"25f63a25-fe7d-455e-98e9-a7f8d1a44fcb","Type":"ContainerStarted","Data":"32b451e0843eccfa5c750fe84bed03a59dc799a204e6934fd1509e059d2c6507"} Jun 02 12:39:33.711932 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:33.711900 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-x47f5" event={"ID":"7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c","Type":"ContainerStarted","Data":"6cb396ade2268eb1106848bb3bf46a4d829e7ec28a655a4e9d42251fb72c9ce9"} Jun 02 12:39:33.712880 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:33.712855 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jcwvf" event={"ID":"e0da3dd7-3e7d-4873-9be6-1e77fce2a507","Type":"ContainerStarted","Data":"f0a8f0c68eeefd31bfceb6bb5d3bf07986adb4d13f0dd0b098399e3ef19e9906"} Jun 02 12:39:33.713868 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:33.713831 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-md7b9" event={"ID":"1f5beceb-f998-436e-9b32-b72579c0ece3","Type":"ContainerStarted","Data":"cbd0b3527e870e1d23455c15633bef20e1a43a80aee9da003bdb4550f07c7b0d"} Jun 02 12:39:33.714804 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:33.714776 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hv55n" event={"ID":"c11a5292-1287-4f12-b1db-c31517a0ddc6","Type":"ContainerStarted","Data":"1e9ea2b9ce7a699b99626943750f2bd9af7098bd3801e03c33ab576e392d7a4a"} Jun 02 12:39:33.715749 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:33.715726 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8qq7l" event={"ID":"9d004590-abbc-46da-934f-471cf2c3495c","Type":"ContainerStarted","Data":"8e7a0bebdd9d9508ff63b05a11e474a906e0df3d38ce76b0c836850ff39b62bf"} Jun 02 12:39:33.716671 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:33.716652 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jj5kr" event={"ID":"937d6529-311c-4484-b66d-e0278f105138","Type":"ContainerStarted","Data":"f930417dc431dfc385884f0dd3ed149979e9c63d2e1ac26db407b1ca83709af5"} Jun 02 12:39:33.717533 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:33.717516 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zg55p" event={"ID":"bad7a9bf-61a6-4668-82c3-4f7e819472b9","Type":"ContainerStarted","Data":"ec1d6b17351d950a9fcee805d96077ab158c21bd89f866607d9e7ad787b8333b"} Jun 02 12:39:33.718783 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:33.718764 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-229.ec2.internal" event={"ID":"3baf4d93838fc3d664a8a17cf60359ce","Type":"ContainerStarted","Data":"12562077d982f40f186dca15a0acf714b8bb06f70f452311b4510a246b7cb334"} Jun 02 12:39:33.719695 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:33.719676 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" event={"ID":"9211a780-13da-4a76-85dc-2f0a70a65c9c","Type":"ContainerStarted","Data":"5d26eaec2da97c28fcafee0b37cdecdfb68c296f24445b72e80bf7ad75b7e26a"} Jun 02 12:39:33.744977 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:33.744940 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-229.ec2.internal" podStartSLOduration=2.744924913 podStartE2EDuration="2.744924913s" podCreationTimestamp="2026-06-02 12:39:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 12:39:33.744665587 +0000 UTC m=+3.662280681" watchObservedRunningTime="2026-06-02 12:39:33.744924913 +0000 UTC m=+3.662540008" Jun 02 12:39:34.199241 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:34.199154 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10c4158d-e827-4403-8ba4-17672f978f94-metrics-certs\") pod \"network-metrics-daemon-rvddx\" (UID: \"10c4158d-e827-4403-8ba4-17672f978f94\") " pod="openshift-multus/network-metrics-daemon-rvddx" Jun 02 12:39:34.199396 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:34.199343 2545 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 12:39:34.199461 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:34.199410 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10c4158d-e827-4403-8ba4-17672f978f94-metrics-certs podName:10c4158d-e827-4403-8ba4-17672f978f94 nodeName:}" failed. No retries permitted until 2026-06-02 12:39:36.199389803 +0000 UTC m=+6.117004889 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10c4158d-e827-4403-8ba4-17672f978f94-metrics-certs") pod "network-metrics-daemon-rvddx" (UID: "10c4158d-e827-4403-8ba4-17672f978f94") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 12:39:34.401133 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:34.401094 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vfxrf\" (UniqueName: \"kubernetes.io/projected/61950c4e-c9a1-4c0d-af77-980423e1d1d8-kube-api-access-vfxrf\") pod \"network-check-target-q88nq\" (UID: \"61950c4e-c9a1-4c0d-af77-980423e1d1d8\") " pod="openshift-network-diagnostics/network-check-target-q88nq" Jun 02 12:39:34.401324 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:34.401308 2545 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 12:39:34.401383 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:34.401333 2545 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 12:39:34.401383 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:34.401345 2545 projected.go:194] Error preparing data for projected volume kube-api-access-vfxrf for pod openshift-network-diagnostics/network-check-target-q88nq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 12:39:34.401479 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:34.401404 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/61950c4e-c9a1-4c0d-af77-980423e1d1d8-kube-api-access-vfxrf podName:61950c4e-c9a1-4c0d-af77-980423e1d1d8 nodeName:}" failed. No retries permitted until 2026-06-02 12:39:36.401385494 +0000 UTC m=+6.319000570 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vfxrf" (UniqueName: "kubernetes.io/projected/61950c4e-c9a1-4c0d-af77-980423e1d1d8-kube-api-access-vfxrf") pod "network-check-target-q88nq" (UID: "61950c4e-c9a1-4c0d-af77-980423e1d1d8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 12:39:34.702035 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:34.702006 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q88nq" Jun 02 12:39:34.702449 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:34.702134 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q88nq" podUID="61950c4e-c9a1-4c0d-af77-980423e1d1d8" Jun 02 12:39:34.702654 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:34.702633 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvddx" Jun 02 12:39:34.702774 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:34.702753 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rvddx" podUID="10c4158d-e827-4403-8ba4-17672f978f94" Jun 02 12:39:34.735723 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:34.735653 2545 generic.go:358] "Generic (PLEG): container finished" podID="a1285734c0620c23a16adc49432d3f3e" containerID="f3b5b16491c58610912428952446431c2ef08bdb3b74a7f0599a62b2ded21611" exitCode=0 Jun 02 12:39:34.736616 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:34.736561 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-229.ec2.internal" event={"ID":"a1285734c0620c23a16adc49432d3f3e","Type":"ContainerDied","Data":"f3b5b16491c58610912428952446431c2ef08bdb3b74a7f0599a62b2ded21611"} Jun 02 12:39:35.740552 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:35.740513 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-229.ec2.internal" event={"ID":"a1285734c0620c23a16adc49432d3f3e","Type":"ContainerStarted","Data":"35b515af613d1b02a2d700998653f07ead2b852e96de42934a327174ad1c7dc5"} Jun 02 12:39:36.218505 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:36.217823 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10c4158d-e827-4403-8ba4-17672f978f94-metrics-certs\") pod \"network-metrics-daemon-rvddx\" (UID: \"10c4158d-e827-4403-8ba4-17672f978f94\") " pod="openshift-multus/network-metrics-daemon-rvddx" Jun 02 12:39:36.218505 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:36.218041 2545 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 12:39:36.218505 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:36.218107 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10c4158d-e827-4403-8ba4-17672f978f94-metrics-certs podName:10c4158d-e827-4403-8ba4-17672f978f94 nodeName:}" failed. No retries permitted until 2026-06-02 12:39:40.218087526 +0000 UTC m=+10.135702609 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10c4158d-e827-4403-8ba4-17672f978f94-metrics-certs") pod "network-metrics-daemon-rvddx" (UID: "10c4158d-e827-4403-8ba4-17672f978f94") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 12:39:36.420422 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:36.419772 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vfxrf\" (UniqueName: \"kubernetes.io/projected/61950c4e-c9a1-4c0d-af77-980423e1d1d8-kube-api-access-vfxrf\") pod \"network-check-target-q88nq\" (UID: \"61950c4e-c9a1-4c0d-af77-980423e1d1d8\") " pod="openshift-network-diagnostics/network-check-target-q88nq" Jun 02 12:39:36.420422 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:36.419975 2545 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 12:39:36.420422 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:36.419994 2545 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 12:39:36.420422 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:36.420006 2545 projected.go:194] Error preparing data for projected volume kube-api-access-vfxrf for pod openshift-network-diagnostics/network-check-target-q88nq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 12:39:36.420422 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:36.420063 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/61950c4e-c9a1-4c0d-af77-980423e1d1d8-kube-api-access-vfxrf podName:61950c4e-c9a1-4c0d-af77-980423e1d1d8 nodeName:}" failed. No retries permitted until 2026-06-02 12:39:40.420046295 +0000 UTC m=+10.337661391 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vfxrf" (UniqueName: "kubernetes.io/projected/61950c4e-c9a1-4c0d-af77-980423e1d1d8-kube-api-access-vfxrf") pod "network-check-target-q88nq" (UID: "61950c4e-c9a1-4c0d-af77-980423e1d1d8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 12:39:36.705372 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:36.704611 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q88nq" Jun 02 12:39:36.705372 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:36.704730 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q88nq" podUID="61950c4e-c9a1-4c0d-af77-980423e1d1d8" Jun 02 12:39:36.705372 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:36.705155 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvddx" Jun 02 12:39:36.705372 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:36.705252 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rvddx" podUID="10c4158d-e827-4403-8ba4-17672f978f94" Jun 02 12:39:38.701876 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:38.701824 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvddx" Jun 02 12:39:38.702356 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:38.701988 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rvddx" podUID="10c4158d-e827-4403-8ba4-17672f978f94" Jun 02 12:39:38.702356 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:38.702044 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q88nq" Jun 02 12:39:38.702356 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:38.702159 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q88nq" podUID="61950c4e-c9a1-4c0d-af77-980423e1d1d8" Jun 02 12:39:40.251528 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:40.251492 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10c4158d-e827-4403-8ba4-17672f978f94-metrics-certs\") pod \"network-metrics-daemon-rvddx\" (UID: \"10c4158d-e827-4403-8ba4-17672f978f94\") " pod="openshift-multus/network-metrics-daemon-rvddx" Jun 02 12:39:40.252013 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:40.251665 2545 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 12:39:40.252013 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:40.251741 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10c4158d-e827-4403-8ba4-17672f978f94-metrics-certs podName:10c4158d-e827-4403-8ba4-17672f978f94 nodeName:}" failed. No retries permitted until 2026-06-02 12:39:48.251722047 +0000 UTC m=+18.169337121 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10c4158d-e827-4403-8ba4-17672f978f94-metrics-certs") pod "network-metrics-daemon-rvddx" (UID: "10c4158d-e827-4403-8ba4-17672f978f94") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 12:39:40.453159 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:40.453101 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vfxrf\" (UniqueName: \"kubernetes.io/projected/61950c4e-c9a1-4c0d-af77-980423e1d1d8-kube-api-access-vfxrf\") pod \"network-check-target-q88nq\" (UID: \"61950c4e-c9a1-4c0d-af77-980423e1d1d8\") " pod="openshift-network-diagnostics/network-check-target-q88nq" Jun 02 12:39:40.453344 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:40.453271 2545 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 12:39:40.453344 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:40.453290 2545 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 12:39:40.453344 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:40.453302 2545 projected.go:194] Error preparing data for projected volume kube-api-access-vfxrf for pod openshift-network-diagnostics/network-check-target-q88nq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 12:39:40.453497 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:40.453358 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/61950c4e-c9a1-4c0d-af77-980423e1d1d8-kube-api-access-vfxrf podName:61950c4e-c9a1-4c0d-af77-980423e1d1d8 nodeName:}" failed. No retries permitted until 2026-06-02 12:39:48.45333932 +0000 UTC m=+18.370954392 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vfxrf" (UniqueName: "kubernetes.io/projected/61950c4e-c9a1-4c0d-af77-980423e1d1d8-kube-api-access-vfxrf") pod "network-check-target-q88nq" (UID: "61950c4e-c9a1-4c0d-af77-980423e1d1d8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 12:39:40.702665 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:40.702592 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvddx" Jun 02 12:39:40.702829 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:40.702717 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rvddx" podUID="10c4158d-e827-4403-8ba4-17672f978f94" Jun 02 12:39:40.702829 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:40.702757 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q88nq" Jun 02 12:39:40.702959 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:40.702829 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q88nq" podUID="61950c4e-c9a1-4c0d-af77-980423e1d1d8" Jun 02 12:39:42.702357 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:42.702322 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvddx" Jun 02 12:39:42.702808 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:42.702470 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q88nq" Jun 02 12:39:42.702808 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:42.702623 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q88nq" podUID="61950c4e-c9a1-4c0d-af77-980423e1d1d8" Jun 02 12:39:42.702808 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:42.702466 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rvddx" podUID="10c4158d-e827-4403-8ba4-17672f978f94" Jun 02 12:39:44.701871 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:44.701806 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvddx" Jun 02 12:39:44.701871 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:44.701822 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q88nq" Jun 02 12:39:44.702362 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:44.701952 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rvddx" podUID="10c4158d-e827-4403-8ba4-17672f978f94" Jun 02 12:39:44.702362 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:44.702092 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q88nq" podUID="61950c4e-c9a1-4c0d-af77-980423e1d1d8" Jun 02 12:39:46.701512 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:46.701477 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q88nq" Jun 02 12:39:46.702059 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:46.701599 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q88nq" podUID="61950c4e-c9a1-4c0d-af77-980423e1d1d8" Jun 02 12:39:46.702059 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:46.701661 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvddx" Jun 02 12:39:46.702059 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:46.701788 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rvddx" podUID="10c4158d-e827-4403-8ba4-17672f978f94" Jun 02 12:39:48.307942 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:48.307901 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10c4158d-e827-4403-8ba4-17672f978f94-metrics-certs\") pod \"network-metrics-daemon-rvddx\" (UID: \"10c4158d-e827-4403-8ba4-17672f978f94\") " pod="openshift-multus/network-metrics-daemon-rvddx" Jun 02 12:39:48.308404 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:48.308085 2545 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 12:39:48.308404 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:48.308160 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10c4158d-e827-4403-8ba4-17672f978f94-metrics-certs podName:10c4158d-e827-4403-8ba4-17672f978f94 nodeName:}" failed. No retries permitted until 2026-06-02 12:40:04.308137717 +0000 UTC m=+34.225752792 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10c4158d-e827-4403-8ba4-17672f978f94-metrics-certs") pod "network-metrics-daemon-rvddx" (UID: "10c4158d-e827-4403-8ba4-17672f978f94") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 12:39:48.509210 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:48.509166 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vfxrf\" (UniqueName: \"kubernetes.io/projected/61950c4e-c9a1-4c0d-af77-980423e1d1d8-kube-api-access-vfxrf\") pod \"network-check-target-q88nq\" (UID: \"61950c4e-c9a1-4c0d-af77-980423e1d1d8\") " pod="openshift-network-diagnostics/network-check-target-q88nq" Jun 02 12:39:48.509365 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:48.509343 2545 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 12:39:48.509365 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:48.509365 2545 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 12:39:48.509470 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:48.509380 2545 projected.go:194] Error preparing data for projected volume kube-api-access-vfxrf for pod openshift-network-diagnostics/network-check-target-q88nq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 12:39:48.509470 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:48.509441 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/61950c4e-c9a1-4c0d-af77-980423e1d1d8-kube-api-access-vfxrf podName:61950c4e-c9a1-4c0d-af77-980423e1d1d8 nodeName:}" failed. No retries permitted until 2026-06-02 12:40:04.509423227 +0000 UTC m=+34.427038314 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vfxrf" (UniqueName: "kubernetes.io/projected/61950c4e-c9a1-4c0d-af77-980423e1d1d8-kube-api-access-vfxrf") pod "network-check-target-q88nq" (UID: "61950c4e-c9a1-4c0d-af77-980423e1d1d8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 12:39:48.702025 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:48.701931 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvddx" Jun 02 12:39:48.702025 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:48.701963 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q88nq" Jun 02 12:39:48.702226 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:48.702072 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rvddx" podUID="10c4158d-e827-4403-8ba4-17672f978f94" Jun 02 12:39:48.702289 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:48.702228 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q88nq" podUID="61950c4e-c9a1-4c0d-af77-980423e1d1d8" Jun 02 12:39:50.702747 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:50.702704 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvddx" Jun 02 12:39:50.703200 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:50.702762 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q88nq" Jun 02 12:39:50.703200 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:50.702825 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rvddx" podUID="10c4158d-e827-4403-8ba4-17672f978f94" Jun 02 12:39:50.703200 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:50.702930 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q88nq" podUID="61950c4e-c9a1-4c0d-af77-980423e1d1d8" Jun 02 12:39:51.767930 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:51.767813 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hv55n" event={"ID":"c11a5292-1287-4f12-b1db-c31517a0ddc6","Type":"ContainerStarted","Data":"22cdbd20e081fa9962550e3de84934acb5920a68978a5947a82270449ad020a0"} Jun 02 12:39:51.769543 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:51.769509 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zg55p" event={"ID":"bad7a9bf-61a6-4668-82c3-4f7e819472b9","Type":"ContainerStarted","Data":"122a48169bf4d1d339defd33df3c10cefd430411ea1c604908d92ea26a807d6f"} Jun 02 12:39:52.702438 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:52.702010 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q88nq" Jun 02 12:39:52.702627 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:52.702090 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvddx" Jun 02 12:39:52.702627 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:52.702555 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q88nq" podUID="61950c4e-c9a1-4c0d-af77-980423e1d1d8" Jun 02 12:39:52.702715 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:52.702647 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rvddx" podUID="10c4158d-e827-4403-8ba4-17672f978f94" Jun 02 12:39:52.773144 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:52.773107 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gv6qz" event={"ID":"25f63a25-fe7d-455e-98e9-a7f8d1a44fcb","Type":"ContainerStarted","Data":"bce7282430da3a7cefa408aebf3118eab4bb0a21edaafcac20663a0011506119"} Jun 02 12:39:52.774604 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:52.774577 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-x47f5" event={"ID":"7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c","Type":"ContainerStarted","Data":"3160dc0b1db6aed0942036a56082c2c436922968ee2629b93f66f1a76255328f"} Jun 02 12:39:52.776090 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:52.776065 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jcwvf" event={"ID":"e0da3dd7-3e7d-4873-9be6-1e77fce2a507","Type":"ContainerStarted","Data":"0c421b2ec0235d85b622a6047317d14102cddcd1a9382720f4d1e6f8093ce575"} Jun 02 12:39:52.777629 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:52.777609 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-md7b9" event={"ID":"1f5beceb-f998-436e-9b32-b72579c0ece3","Type":"ContainerStarted","Data":"528ceb09737dbace7b538eb38e8244003b5efeb22371c30ad45cfd8c6623643d"} Jun 02 12:39:52.779428 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:52.779405 2545 generic.go:358] "Generic (PLEG): container finished" podID="9d004590-abbc-46da-934f-471cf2c3495c" containerID="72dbdb0854085fa508c5f9447845b1f33aef0a997b36e8d6d5a3248cdcbe0b29" exitCode=0 Jun 02 12:39:52.779533 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:52.779494 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8qq7l" event={"ID":"9d004590-abbc-46da-934f-471cf2c3495c","Type":"ContainerDied","Data":"72dbdb0854085fa508c5f9447845b1f33aef0a997b36e8d6d5a3248cdcbe0b29"} Jun 02 12:39:52.784637 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:52.784608 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" event={"ID":"9211a780-13da-4a76-85dc-2f0a70a65c9c","Type":"ContainerStarted","Data":"0a5ba820800d26e3b1eef5f8d179a2c4aca3b6f202eabb9826fa04ecb70cd18d"} Jun 02 12:39:52.784740 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:52.784643 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" event={"ID":"9211a780-13da-4a76-85dc-2f0a70a65c9c","Type":"ContainerStarted","Data":"f111e0b0e55690f785bf4f8745515507e42880e9912552ad1a3895f110f63b29"} Jun 02 12:39:52.784740 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:52.784658 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" event={"ID":"9211a780-13da-4a76-85dc-2f0a70a65c9c","Type":"ContainerStarted","Data":"992ba2ae9ef54df1968f693f730565f67d96eff2983901f8ccee0b23b9c9b5ad"} Jun 02 12:39:52.784740 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:52.784671 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" event={"ID":"9211a780-13da-4a76-85dc-2f0a70a65c9c","Type":"ContainerStarted","Data":"69e8c717b004aeff38b6f2454d86969a0cf3433cb0783b6ec53e2ce5398c8628"} Jun 02 12:39:52.784740 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:52.784685 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" event={"ID":"9211a780-13da-4a76-85dc-2f0a70a65c9c","Type":"ContainerStarted","Data":"8f08b7d43e8b6572cb7da40882e4f27db2beb132a88c59cb5720175943036bd2"} Jun 02 12:39:52.784740 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:52.784697 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" event={"ID":"9211a780-13da-4a76-85dc-2f0a70a65c9c","Type":"ContainerStarted","Data":"17dbb81fbf1247c53ba5c5ae5d1824641bde59c222b07d586fbe5f4cf8ddef82"} Jun 02 12:39:52.790036 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:52.789993 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-229.ec2.internal" podStartSLOduration=21.789968435 podStartE2EDuration="21.789968435s" podCreationTimestamp="2026-06-02 12:39:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 12:39:35.755503091 +0000 UTC m=+5.673118187" watchObservedRunningTime="2026-06-02 12:39:52.789968435 +0000 UTC m=+22.707583529" Jun 02 12:39:52.790755 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:52.790719 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-x47f5" podStartSLOduration=4.636003004 podStartE2EDuration="22.790708849s" podCreationTimestamp="2026-06-02 12:39:30 +0000 UTC" firstStartedPulling="2026-06-02 12:39:33.440831409 +0000 UTC m=+3.358446486" lastFinishedPulling="2026-06-02 12:39:51.595537259 +0000 UTC m=+21.513152331" observedRunningTime="2026-06-02 12:39:52.790110954 +0000 UTC m=+22.707726034" watchObservedRunningTime="2026-06-02 12:39:52.790708849 +0000 UTC m=+22.708323940" Jun 02 12:39:52.803136 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:52.803105 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-zg55p" podStartSLOduration=9.498226071 podStartE2EDuration="22.803094747s" podCreationTimestamp="2026-06-02 12:39:30 +0000 UTC" firstStartedPulling="2026-06-02 12:39:33.431162972 +0000 UTC m=+3.348778049" lastFinishedPulling="2026-06-02 12:39:46.736031653 +0000 UTC m=+16.653646725" observedRunningTime="2026-06-02 12:39:52.802863617 +0000 UTC m=+22.720478711" watchObservedRunningTime="2026-06-02 12:39:52.803094747 +0000 UTC m=+22.720709852" Jun 02 12:39:52.843475 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:52.843429 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-md7b9" podStartSLOduration=4.673332144 podStartE2EDuration="22.84341533s" podCreationTimestamp="2026-06-02 12:39:30 +0000 UTC" firstStartedPulling="2026-06-02 12:39:33.439426435 +0000 UTC m=+3.357041522" lastFinishedPulling="2026-06-02 12:39:51.609509634 +0000 UTC m=+21.527124708" observedRunningTime="2026-06-02 12:39:52.843223924 +0000 UTC m=+22.760839032" watchObservedRunningTime="2026-06-02 12:39:52.84341533 +0000 UTC m=+22.761030424" Jun 02 12:39:52.858592 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:52.858550 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-jcwvf" podStartSLOduration=4.703234709 podStartE2EDuration="22.858538901s" podCreationTimestamp="2026-06-02 12:39:30 +0000 UTC" firstStartedPulling="2026-06-02 12:39:33.438424757 +0000 UTC m=+3.356039830" lastFinishedPulling="2026-06-02 12:39:51.59372895 +0000 UTC m=+21.511344022" observedRunningTime="2026-06-02 12:39:52.858521274 +0000 UTC m=+22.776136368" watchObservedRunningTime="2026-06-02 12:39:52.858538901 +0000 UTC m=+22.776153995" Jun 02 12:39:52.872461 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:52.872416 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-hv55n" podStartSLOduration=9.574845685 podStartE2EDuration="22.87240374s" podCreationTimestamp="2026-06-02 12:39:30 +0000 UTC" firstStartedPulling="2026-06-02 12:39:33.438400935 +0000 UTC m=+3.356016016" lastFinishedPulling="2026-06-02 12:39:46.735958985 +0000 UTC m=+16.653574071" observedRunningTime="2026-06-02 12:39:52.871942072 +0000 UTC m=+22.789557166" watchObservedRunningTime="2026-06-02 12:39:52.87240374 +0000 UTC m=+22.790018834" Jun 02 12:39:53.000934 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:53.000909 2545 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 02 12:39:53.641614 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:53.641511 2545 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-02T12:39:53.000930431Z","UUID":"3ee369ba-8d52-4276-8189-bf68ff99492c","Handler":null,"Name":"","Endpoint":""} Jun 02 12:39:53.643450 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:53.643429 2545 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 02 12:39:53.643582 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:53.643459 2545 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 02 12:39:53.788570 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:53.788533 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jj5kr" event={"ID":"937d6529-311c-4484-b66d-e0278f105138","Type":"ContainerStarted","Data":"9cc5aa2c7df93fbcc4759a4ef8e841f168b4f3d51c9788bbb0c50a613b51d49f"} Jun 02 12:39:53.790286 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:53.790248 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gv6qz" event={"ID":"25f63a25-fe7d-455e-98e9-a7f8d1a44fcb","Type":"ContainerStarted","Data":"86abc2328f491a00a769dd31010073ee59ca0c05567dfcb726ac765c6549e38e"} Jun 02 12:39:53.802344 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:53.802304 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-jj5kr" podStartSLOduration=5.6408251719999996 podStartE2EDuration="23.802291203s" podCreationTimestamp="2026-06-02 12:39:30 +0000 UTC" firstStartedPulling="2026-06-02 12:39:33.43227323 +0000 UTC m=+3.349888302" lastFinishedPulling="2026-06-02 12:39:51.593739256 +0000 UTC m=+21.511354333" observedRunningTime="2026-06-02 12:39:53.802226438 +0000 UTC m=+23.719841544" watchObservedRunningTime="2026-06-02 12:39:53.802291203 +0000 UTC m=+23.719906297" Jun 02 12:39:54.702589 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:54.702557 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q88nq" Jun 02 12:39:54.702789 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:54.702685 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q88nq" podUID="61950c4e-c9a1-4c0d-af77-980423e1d1d8" Jun 02 12:39:54.702789 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:54.702758 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvddx" Jun 02 12:39:54.702928 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:54.702876 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rvddx" podUID="10c4158d-e827-4403-8ba4-17672f978f94" Jun 02 12:39:54.796042 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:54.796009 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" event={"ID":"9211a780-13da-4a76-85dc-2f0a70a65c9c","Type":"ContainerStarted","Data":"54f6e81f265938997a655a2896e85d9b655f6cc1681b2e13d5965aca75867eee"} Jun 02 12:39:54.797629 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:54.797603 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gv6qz" event={"ID":"25f63a25-fe7d-455e-98e9-a7f8d1a44fcb","Type":"ContainerStarted","Data":"04209f4796237e249c932d309205b042a9261c7db6350275ee54aea8cce673c7"} Jun 02 12:39:54.815462 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:54.815413 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gv6qz" podStartSLOduration=4.157810285 podStartE2EDuration="24.815396808s" podCreationTimestamp="2026-06-02 12:39:30 +0000 UTC" firstStartedPulling="2026-06-02 12:39:33.441518888 +0000 UTC m=+3.359133974" lastFinishedPulling="2026-06-02 12:39:54.099105411 +0000 UTC m=+24.016720497" observedRunningTime="2026-06-02 12:39:54.813584749 +0000 UTC m=+24.731199849" watchObservedRunningTime="2026-06-02 12:39:54.815396808 +0000 UTC m=+24.733011902" Jun 02 12:39:56.702135 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:56.701885 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvddx" Jun 02 12:39:56.702880 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:56.701892 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q88nq" Jun 02 12:39:56.702880 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:56.702205 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rvddx" podUID="10c4158d-e827-4403-8ba4-17672f978f94" Jun 02 12:39:56.702880 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:56.702254 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q88nq" podUID="61950c4e-c9a1-4c0d-af77-980423e1d1d8" Jun 02 12:39:56.805218 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:56.805186 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" event={"ID":"9211a780-13da-4a76-85dc-2f0a70a65c9c","Type":"ContainerStarted","Data":"2107e40a125c0031e1daa927139f2dbe0cf4820188173db3072ba3baed79e8ff"} Jun 02 12:39:56.805531 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:56.805510 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" Jun 02 12:39:56.822408 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:56.822382 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" Jun 02 12:39:56.837824 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:56.837769 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" podStartSLOduration=8.637732728 podStartE2EDuration="26.83775428s" podCreationTimestamp="2026-06-02 12:39:30 +0000 UTC" firstStartedPulling="2026-06-02 12:39:33.442230406 +0000 UTC m=+3.359845479" lastFinishedPulling="2026-06-02 12:39:51.642251957 +0000 UTC m=+21.559867031" observedRunningTime="2026-06-02 12:39:56.837363076 +0000 UTC m=+26.754978172" watchObservedRunningTime="2026-06-02 12:39:56.83775428 +0000 UTC m=+26.755369374" Jun 02 12:39:56.912633 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:56.912597 2545 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-hv55n" Jun 02 12:39:56.913413 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:56.913391 2545 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-hv55n" Jun 02 12:39:57.807158 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:57.807127 2545 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 02 12:39:57.807893 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:57.807875 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-hv55n" Jun 02 12:39:57.807961 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:57.807934 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hv55n" Jun 02 12:39:57.807961 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:57.807950 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" Jun 02 12:39:57.824033 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:57.824007 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" Jun 02 12:39:58.612792 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:58.612605 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rvddx"] Jun 02 12:39:58.612953 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:58.612905 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvddx" Jun 02 12:39:58.613014 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:58.612995 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rvddx" podUID="10c4158d-e827-4403-8ba4-17672f978f94" Jun 02 12:39:58.618135 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:58.618115 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-q88nq"] Jun 02 12:39:58.618229 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:58.618198 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q88nq" Jun 02 12:39:58.618283 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:39:58.618266 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q88nq" podUID="61950c4e-c9a1-4c0d-af77-980423e1d1d8" Jun 02 12:39:58.657753 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:58.657667 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zg55p_bad7a9bf-61a6-4668-82c3-4f7e819472b9/dns-node-resolver/0.log" Jun 02 12:39:58.719024 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:58.718995 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" Jun 02 12:39:59.242151 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:59.242081 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jcwvf_e0da3dd7-3e7d-4873-9be6-1e77fce2a507/node-ca/0.log" Jun 02 12:39:59.812186 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:59.812157 2545 generic.go:358] "Generic (PLEG): container finished" podID="9d004590-abbc-46da-934f-471cf2c3495c" containerID="04a5d69a1d27a332b8433d0dfee693bb7164be7db4c891c85eb15660ebd2b399" exitCode=0 Jun 02 12:39:59.812367 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:39:59.812225 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8qq7l" event={"ID":"9d004590-abbc-46da-934f-471cf2c3495c","Type":"ContainerDied","Data":"04a5d69a1d27a332b8433d0dfee693bb7164be7db4c891c85eb15660ebd2b399"} Jun 02 12:40:00.703145 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:00.703076 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q88nq" Jun 02 12:40:00.703527 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:40:00.703154 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q88nq" podUID="61950c4e-c9a1-4c0d-af77-980423e1d1d8" Jun 02 12:40:00.703527 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:00.703246 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvddx" Jun 02 12:40:00.703527 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:40:00.703372 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rvddx" podUID="10c4158d-e827-4403-8ba4-17672f978f94" Jun 02 12:40:01.817362 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:01.817326 2545 generic.go:358] "Generic (PLEG): container finished" podID="9d004590-abbc-46da-934f-471cf2c3495c" containerID="5b1b96e09cc5aaee2cc166792caf70f4d7aadbdc1318212ec012249723af3e19" exitCode=0 Jun 02 12:40:01.817713 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:01.817382 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8qq7l" event={"ID":"9d004590-abbc-46da-934f-471cf2c3495c","Type":"ContainerDied","Data":"5b1b96e09cc5aaee2cc166792caf70f4d7aadbdc1318212ec012249723af3e19"} Jun 02 12:40:02.702615 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:02.702420 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q88nq" Jun 02 12:40:02.702796 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:02.702479 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvddx" Jun 02 12:40:02.702796 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:40:02.702704 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q88nq" podUID="61950c4e-c9a1-4c0d-af77-980423e1d1d8" Jun 02 12:40:02.702904 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:40:02.702803 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rvddx" podUID="10c4158d-e827-4403-8ba4-17672f978f94" Jun 02 12:40:03.822630 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:03.822595 2545 generic.go:358] "Generic (PLEG): container finished" podID="9d004590-abbc-46da-934f-471cf2c3495c" containerID="cea37a64de9b5661f258af92c532efe221ccd70e8768a0af23582750e7697d8a" exitCode=0 Jun 02 12:40:03.823095 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:03.822654 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8qq7l" event={"ID":"9d004590-abbc-46da-934f-471cf2c3495c","Type":"ContainerDied","Data":"cea37a64de9b5661f258af92c532efe221ccd70e8768a0af23582750e7697d8a"} Jun 02 12:40:04.322600 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:04.322571 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10c4158d-e827-4403-8ba4-17672f978f94-metrics-certs\") pod \"network-metrics-daemon-rvddx\" (UID: \"10c4158d-e827-4403-8ba4-17672f978f94\") " pod="openshift-multus/network-metrics-daemon-rvddx" Jun 02 12:40:04.322785 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:40:04.322706 2545 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 12:40:04.322785 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:40:04.322774 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10c4158d-e827-4403-8ba4-17672f978f94-metrics-certs podName:10c4158d-e827-4403-8ba4-17672f978f94 nodeName:}" failed. No retries permitted until 2026-06-02 12:40:36.322755031 +0000 UTC m=+66.240370114 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10c4158d-e827-4403-8ba4-17672f978f94-metrics-certs") pod "network-metrics-daemon-rvddx" (UID: "10c4158d-e827-4403-8ba4-17672f978f94") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 12:40:04.523710 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:04.523671 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vfxrf\" (UniqueName: \"kubernetes.io/projected/61950c4e-c9a1-4c0d-af77-980423e1d1d8-kube-api-access-vfxrf\") pod \"network-check-target-q88nq\" (UID: \"61950c4e-c9a1-4c0d-af77-980423e1d1d8\") " pod="openshift-network-diagnostics/network-check-target-q88nq" Jun 02 12:40:04.523917 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:40:04.523870 2545 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 12:40:04.523917 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:40:04.523892 2545 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 12:40:04.523917 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:40:04.523905 2545 projected.go:194] Error preparing data for projected volume kube-api-access-vfxrf for pod openshift-network-diagnostics/network-check-target-q88nq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 12:40:04.524086 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:40:04.523970 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/61950c4e-c9a1-4c0d-af77-980423e1d1d8-kube-api-access-vfxrf podName:61950c4e-c9a1-4c0d-af77-980423e1d1d8 nodeName:}" failed. No retries permitted until 2026-06-02 12:40:36.523948672 +0000 UTC m=+66.441563746 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vfxrf" (UniqueName: "kubernetes.io/projected/61950c4e-c9a1-4c0d-af77-980423e1d1d8-kube-api-access-vfxrf") pod "network-check-target-q88nq" (UID: "61950c4e-c9a1-4c0d-af77-980423e1d1d8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 12:40:04.705151 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:04.705126 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q88nq" Jun 02 12:40:04.705320 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:04.705132 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvddx" Jun 02 12:40:04.705320 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:40:04.705232 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q88nq" podUID="61950c4e-c9a1-4c0d-af77-980423e1d1d8" Jun 02 12:40:04.705405 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:40:04.705327 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rvddx" podUID="10c4158d-e827-4403-8ba4-17672f978f94" Jun 02 12:40:06.701745 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:06.701706 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q88nq" Jun 02 12:40:06.701745 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:06.701739 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvddx" Jun 02 12:40:06.702280 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:40:06.701851 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q88nq" podUID="61950c4e-c9a1-4c0d-af77-980423e1d1d8" Jun 02 12:40:06.702280 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:40:06.701927 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rvddx" podUID="10c4158d-e827-4403-8ba4-17672f978f94" Jun 02 12:40:08.702191 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:08.702156 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q88nq" Jun 02 12:40:08.702761 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:08.702156 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvddx" Jun 02 12:40:08.702761 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:40:08.702288 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q88nq" podUID="61950c4e-c9a1-4c0d-af77-980423e1d1d8" Jun 02 12:40:08.702761 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:40:08.702396 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rvddx" podUID="10c4158d-e827-4403-8ba4-17672f978f94" Jun 02 12:40:09.835831 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:09.835803 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8qq7l" event={"ID":"9d004590-abbc-46da-934f-471cf2c3495c","Type":"ContainerStarted","Data":"b7ba6ca46782561634dfff447cf5c9f2e1fbf77bd0e017a90ea727420de3ca9c"} Jun 02 12:40:10.704533 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:10.704505 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q88nq" Jun 02 12:40:10.704533 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:10.704521 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvddx" Jun 02 12:40:10.704759 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:40:10.704587 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q88nq" podUID="61950c4e-c9a1-4c0d-af77-980423e1d1d8" Jun 02 12:40:10.704759 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:40:10.704730 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rvddx" podUID="10c4158d-e827-4403-8ba4-17672f978f94" Jun 02 12:40:10.839515 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:10.839479 2545 generic.go:358] "Generic (PLEG): container finished" podID="9d004590-abbc-46da-934f-471cf2c3495c" containerID="b7ba6ca46782561634dfff447cf5c9f2e1fbf77bd0e017a90ea727420de3ca9c" exitCode=0 Jun 02 12:40:10.839888 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:10.839539 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8qq7l" event={"ID":"9d004590-abbc-46da-934f-471cf2c3495c","Type":"ContainerDied","Data":"b7ba6ca46782561634dfff447cf5c9f2e1fbf77bd0e017a90ea727420de3ca9c"} Jun 02 12:40:11.846344 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:11.846309 2545 generic.go:358] "Generic (PLEG): container finished" podID="9d004590-abbc-46da-934f-471cf2c3495c" containerID="a0af428aac6bc41885273ab9ac5553943dc486246b671852bf7abfce8eef6e2f" exitCode=0 Jun 02 12:40:11.846737 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:11.846363 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8qq7l" event={"ID":"9d004590-abbc-46da-934f-471cf2c3495c","Type":"ContainerDied","Data":"a0af428aac6bc41885273ab9ac5553943dc486246b671852bf7abfce8eef6e2f"} Jun 02 12:40:12.705006 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:12.704982 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvddx" Jun 02 12:40:12.705168 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:12.704982 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q88nq" Jun 02 12:40:12.705168 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:40:12.705073 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rvddx" podUID="10c4158d-e827-4403-8ba4-17672f978f94" Jun 02 12:40:12.705168 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:40:12.705134 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q88nq" podUID="61950c4e-c9a1-4c0d-af77-980423e1d1d8" Jun 02 12:40:12.850902 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:12.850829 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8qq7l" event={"ID":"9d004590-abbc-46da-934f-471cf2c3495c","Type":"ContainerStarted","Data":"e122068ac28ba603850dcf5fd9f346e3f55eaae1214607384f4d96a9b0055f9e"} Jun 02 12:40:12.877188 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:12.877145 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8qq7l" podStartSLOduration=6.609550818 podStartE2EDuration="42.877133092s" podCreationTimestamp="2026-06-02 12:39:30 +0000 UTC" firstStartedPulling="2026-06-02 12:39:33.437982399 +0000 UTC m=+3.355597486" lastFinishedPulling="2026-06-02 12:40:09.705564683 +0000 UTC m=+39.623179760" observedRunningTime="2026-06-02 12:40:12.876292367 +0000 UTC m=+42.793907473" watchObservedRunningTime="2026-06-02 12:40:12.877133092 +0000 UTC m=+42.794748187" Jun 02 12:40:14.703996 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:14.703965 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvddx" Jun 02 12:40:14.704379 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:14.703968 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q88nq" Jun 02 12:40:14.704379 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:40:14.704073 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rvddx" podUID="10c4158d-e827-4403-8ba4-17672f978f94" Jun 02 12:40:14.704379 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:40:14.704141 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q88nq" podUID="61950c4e-c9a1-4c0d-af77-980423e1d1d8" Jun 02 12:40:16.702576 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:16.702544 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q88nq" Jun 02 12:40:16.703093 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:40:16.702671 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q88nq" podUID="61950c4e-c9a1-4c0d-af77-980423e1d1d8" Jun 02 12:40:16.703093 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:16.702719 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvddx" Jun 02 12:40:16.703093 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:40:16.702810 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rvddx" podUID="10c4158d-e827-4403-8ba4-17672f978f94" Jun 02 12:40:18.704723 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:18.704691 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q88nq" Jun 02 12:40:18.705154 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:18.704701 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvddx" Jun 02 12:40:18.705154 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:40:18.704796 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q88nq" podUID="61950c4e-c9a1-4c0d-af77-980423e1d1d8" Jun 02 12:40:18.705154 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:40:18.704884 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rvddx" podUID="10c4158d-e827-4403-8ba4-17672f978f94" Jun 02 12:40:20.410463 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:20.410434 2545 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-229.ec2.internal" event="NodeReady" Jun 02 12:40:20.410884 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:20.410552 2545 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 02 12:40:20.464158 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:20.464079 2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-q84kk"] Jun 02 12:40:20.466847 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:20.466820 2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-st6dv"] Jun 02 12:40:20.466992 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:20.466972 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-q84kk" Jun 02 12:40:20.468765 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:20.468744 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 02 12:40:20.468994 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:20.468981 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zzqdr\"" Jun 02 12:40:20.469036 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:20.469014 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 02 12:40:20.469303 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:20.469290 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-st6dv" Jun 02 12:40:20.471778 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:20.471760 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9gzk7\"" Jun 02 12:40:20.472019 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:20.472004 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 02 12:40:20.472087 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:20.472038 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 02 12:40:20.472129 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:20.472113 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 02 12:40:20.481529 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:20.481512 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-q84kk"] Jun 02 12:40:20.482177 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:20.482158 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-st6dv"] Jun 02 12:40:20.493472 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:20.493455 2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-96cfv"] Jun 02 12:40:20.496327 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:20.496311 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-96cfv" Jun 02 12:40:20.498140 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:20.498122 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 02 12:40:20.498373 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:20.498359 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 02 12:40:20.498808 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:20.498789 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xmd4n\"" Jun 02 12:40:20.498921 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:20.498832 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 02 12:40:20.498966 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:20.498937 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 02 12:40:20.511360 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:20.511340 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-96cfv"] Jun 02 12:40:20.645085 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:20.645056 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36675602-1c0b-494f-95b0-72b7a7fa5381-metrics-tls\") pod \"dns-default-q84kk\" (UID: \"36675602-1c0b-494f-95b0-72b7a7fa5381\") " pod="openshift-dns/dns-default-q84kk" Jun 02 12:40:20.645085 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:20.645087 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gr7z\" (UniqueName: \"kubernetes.io/projected/8784056f-c039-4719-947a-5e3fe6ac2227-kube-api-access-4gr7z\") pod \"insights-runtime-extractor-96cfv\" (UID: \"8784056f-c039-4719-947a-5e3fe6ac2227\") " pod="openshift-insights/insights-runtime-extractor-96cfv" Jun 02 12:40:20.645314 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:20.645106 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9af245f1-954a-426a-94b6-a8969279cadb-cert\") pod \"ingress-canary-st6dv\" (UID: \"9af245f1-954a-426a-94b6-a8969279cadb\") " pod="openshift-ingress-canary/ingress-canary-st6dv" Jun 02 12:40:20.645314 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:20.645122 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/36675602-1c0b-494f-95b0-72b7a7fa5381-config-volume\") pod \"dns-default-q84kk\" (UID: \"36675602-1c0b-494f-95b0-72b7a7fa5381\") " pod="openshift-dns/dns-default-q84kk" Jun 02 12:40:20.645314 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:20.645136 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8784056f-c039-4719-947a-5e3fe6ac2227-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-96cfv\" (UID: \"8784056f-c039-4719-947a-5e3fe6ac2227\") " pod="openshift-insights/insights-runtime-extractor-96cfv" Jun 02 12:40:20.645314 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:20.645223 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36675602-1c0b-494f-95b0-72b7a7fa5381-tmp-dir\") pod \"dns-default-q84kk\" (UID: \"36675602-1c0b-494f-95b0-72b7a7fa5381\") " pod="openshift-dns/dns-default-q84kk" Jun 02 12:40:20.645314 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:20.645267 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8784056f-c039-4719-947a-5e3fe6ac2227-data-volume\") pod \"insights-runtime-extractor-96cfv\" (UID: \"8784056f-c039-4719-947a-5e3fe6ac2227\") " pod="openshift-insights/insights-runtime-extractor-96cfv" Jun 02 12:40:20.645314 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:20.645306 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpv2f\" (UniqueName: \"kubernetes.io/projected/9af245f1-954a-426a-94b6-a8969279cadb-kube-api-access-vpv2f\") pod \"ingress-canary-st6dv\" (UID: \"9af245f1-954a-426a-94b6-a8969279cadb\") " pod="openshift-ingress-canary/ingress-canary-st6dv" Jun 02 12:40:20.645561 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:20.645371 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qs5pj\" (UniqueName: \"kubernetes.io/projected/36675602-1c0b-494f-95b0-72b7a7fa5381-kube-api-access-qs5pj\") pod \"dns-default-q84kk\" (UID: \"36675602-1c0b-494f-95b0-72b7a7fa5381\") " pod="openshift-dns/dns-default-q84kk" Jun 02 12:40:20.645561 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:20.645403 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8784056f-c039-4719-947a-5e3fe6ac2227-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-96cfv\" (UID: \"8784056f-c039-4719-947a-5e3fe6ac2227\") " pod="openshift-insights/insights-runtime-extractor-96cfv" Jun 02 12:40:20.645561 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:20.645434 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8784056f-c039-4719-947a-5e3fe6ac2227-crio-socket\") pod \"insights-runtime-extractor-96cfv\" (UID: \"8784056f-c039-4719-947a-5e3fe6ac2227\") " pod="openshift-insights/insights-runtime-extractor-96cfv" Jun 02 12:40:20.703760 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:20.703735 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q88nq" Jun 02 12:40:20.703895 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:20.703742 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvddx" Jun 02 12:40:20.705679 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:20.705663 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 12:40:20.705780 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:20.705683 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hxrmw\"" Jun 02 12:40:20.705780 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:20.705752 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 12:40:20.705780 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:20.705752 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-k267c\"" Jun 02 12:40:20.705939 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:20.705780 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 12:40:20.746198 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:20.746178 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qs5pj\" (UniqueName: \"kubernetes.io/projected/36675602-1c0b-494f-95b0-72b7a7fa5381-kube-api-access-qs5pj\") pod \"dns-default-q84kk\" (UID: \"36675602-1c0b-494f-95b0-72b7a7fa5381\") " pod="openshift-dns/dns-default-q84kk" Jun 02 12:40:20.746281 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:20.746206 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8784056f-c039-4719-947a-5e3fe6ac2227-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-96cfv\" (UID: \"8784056f-c039-4719-947a-5e3fe6ac2227\") " pod="openshift-insights/insights-runtime-extractor-96cfv" Jun 02 12:40:20.746281 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:20.746225 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8784056f-c039-4719-947a-5e3fe6ac2227-crio-socket\") pod \"insights-runtime-extractor-96cfv\" (UID: \"8784056f-c039-4719-947a-5e3fe6ac2227\") " pod="openshift-insights/insights-runtime-extractor-96cfv" Jun 02 12:40:20.746281 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:20.746244 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36675602-1c0b-494f-95b0-72b7a7fa5381-metrics-tls\") pod \"dns-default-q84kk\" (UID: \"36675602-1c0b-494f-95b0-72b7a7fa5381\") " pod="openshift-dns/dns-default-q84kk" Jun 02 12:40:20.746281 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:20.746262 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4gr7z\" (UniqueName: \"kubernetes.io/projected/8784056f-c039-4719-947a-5e3fe6ac2227-kube-api-access-4gr7z\") pod \"insights-runtime-extractor-96cfv\" (UID: \"8784056f-c039-4719-947a-5e3fe6ac2227\") " pod="openshift-insights/insights-runtime-extractor-96cfv" Jun 02 12:40:20.746449 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:20.746284 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9af245f1-954a-426a-94b6-a8969279cadb-cert\") pod \"ingress-canary-st6dv\" (UID: \"9af245f1-954a-426a-94b6-a8969279cadb\") " pod="openshift-ingress-canary/ingress-canary-st6dv" Jun 02 12:40:20.746449 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:20.746312 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/36675602-1c0b-494f-95b0-72b7a7fa5381-config-volume\") pod \"dns-default-q84kk\" (UID: \"36675602-1c0b-494f-95b0-72b7a7fa5381\") " pod="openshift-dns/dns-default-q84kk" Jun 02 12:40:20.746449 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:20.746335 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8784056f-c039-4719-947a-5e3fe6ac2227-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-96cfv\" (UID: \"8784056f-c039-4719-947a-5e3fe6ac2227\") " pod="openshift-insights/insights-runtime-extractor-96cfv" Jun 02 12:40:20.746449 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:20.746406 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36675602-1c0b-494f-95b0-72b7a7fa5381-tmp-dir\") pod \"dns-default-q84kk\" (UID: \"36675602-1c0b-494f-95b0-72b7a7fa5381\") " pod="openshift-dns/dns-default-q84kk" Jun 02 12:40:20.746449 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:20.746438 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8784056f-c039-4719-947a-5e3fe6ac2227-data-volume\") pod \"insights-runtime-extractor-96cfv\" (UID: \"8784056f-c039-4719-947a-5e3fe6ac2227\") " pod="openshift-insights/insights-runtime-extractor-96cfv" Jun 02 12:40:20.746666 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:20.746470 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vpv2f\" (UniqueName: \"kubernetes.io/projected/9af245f1-954a-426a-94b6-a8969279cadb-kube-api-access-vpv2f\") pod \"ingress-canary-st6dv\" (UID: \"9af245f1-954a-426a-94b6-a8969279cadb\") " pod="openshift-ingress-canary/ingress-canary-st6dv" Jun 02 12:40:20.746666 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:20.746482 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8784056f-c039-4719-947a-5e3fe6ac2227-crio-socket\") pod \"insights-runtime-extractor-96cfv\" (UID: \"8784056f-c039-4719-947a-5e3fe6ac2227\") " pod="openshift-insights/insights-runtime-extractor-96cfv" Jun 02 12:40:20.746804 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:20.746787 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36675602-1c0b-494f-95b0-72b7a7fa5381-tmp-dir\") pod \"dns-default-q84kk\" (UID: \"36675602-1c0b-494f-95b0-72b7a7fa5381\") " pod="openshift-dns/dns-default-q84kk" Jun 02 12:40:20.746945 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:20.746923 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/36675602-1c0b-494f-95b0-72b7a7fa5381-config-volume\") pod \"dns-default-q84kk\" (UID: \"36675602-1c0b-494f-95b0-72b7a7fa5381\") " pod="openshift-dns/dns-default-q84kk" Jun 02 12:40:20.747121 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:20.747104 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8784056f-c039-4719-947a-5e3fe6ac2227-data-volume\") pod \"insights-runtime-extractor-96cfv\" (UID: \"8784056f-c039-4719-947a-5e3fe6ac2227\") " pod="openshift-insights/insights-runtime-extractor-96cfv" Jun 02 12:40:20.747348 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:20.747329 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8784056f-c039-4719-947a-5e3fe6ac2227-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-96cfv\" (UID: \"8784056f-c039-4719-947a-5e3fe6ac2227\") " pod="openshift-insights/insights-runtime-extractor-96cfv" Jun 02 12:40:20.750106 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:20.750081 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8784056f-c039-4719-947a-5e3fe6ac2227-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-96cfv\" (UID: \"8784056f-c039-4719-947a-5e3fe6ac2227\") " pod="openshift-insights/insights-runtime-extractor-96cfv" Jun 02 12:40:20.750191 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:20.750083 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36675602-1c0b-494f-95b0-72b7a7fa5381-metrics-tls\") pod \"dns-default-q84kk\" (UID: \"36675602-1c0b-494f-95b0-72b7a7fa5381\") " pod="openshift-dns/dns-default-q84kk" Jun 02 12:40:20.750259 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:20.750245 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9af245f1-954a-426a-94b6-a8969279cadb-cert\") pod \"ingress-canary-st6dv\" (UID: \"9af245f1-954a-426a-94b6-a8969279cadb\") " pod="openshift-ingress-canary/ingress-canary-st6dv" Jun 02 12:40:20.753914 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:20.753896 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpv2f\" (UniqueName: \"kubernetes.io/projected/9af245f1-954a-426a-94b6-a8969279cadb-kube-api-access-vpv2f\") pod \"ingress-canary-st6dv\" (UID: \"9af245f1-954a-426a-94b6-a8969279cadb\") " pod="openshift-ingress-canary/ingress-canary-st6dv" Jun 02 12:40:20.756190 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:20.756172 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qs5pj\" (UniqueName: \"kubernetes.io/projected/36675602-1c0b-494f-95b0-72b7a7fa5381-kube-api-access-qs5pj\") pod \"dns-default-q84kk\" (UID: \"36675602-1c0b-494f-95b0-72b7a7fa5381\") " pod="openshift-dns/dns-default-q84kk" Jun 02 12:40:20.756508 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:20.756489 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gr7z\" (UniqueName: \"kubernetes.io/projected/8784056f-c039-4719-947a-5e3fe6ac2227-kube-api-access-4gr7z\") pod \"insights-runtime-extractor-96cfv\" (UID: \"8784056f-c039-4719-947a-5e3fe6ac2227\") " pod="openshift-insights/insights-runtime-extractor-96cfv" Jun 02 12:40:20.776436 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:20.776414 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-q84kk" Jun 02 12:40:20.782082 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:20.782061 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-st6dv" Jun 02 12:40:20.804695 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:20.804672 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-96cfv" Jun 02 12:40:20.923066 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:20.923030 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-q84kk"] Jun 02 12:40:20.929815 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:40:20.929784 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36675602_1c0b_494f_95b0_72b7a7fa5381.slice/crio-548e1a9b3d5b4b2c60f18096bc5f160616ea7a99eca6d768c0efcfa3932850af WatchSource:0}: Error finding container 548e1a9b3d5b4b2c60f18096bc5f160616ea7a99eca6d768c0efcfa3932850af: Status 404 returned error can't find the container with id 548e1a9b3d5b4b2c60f18096bc5f160616ea7a99eca6d768c0efcfa3932850af Jun 02 12:40:20.938909 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:20.938635 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-st6dv"] Jun 02 12:40:20.942286 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:40:20.942260 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9af245f1_954a_426a_94b6_a8969279cadb.slice/crio-a923d8341f8a96372873b4a63b1f128e60e97e81982747ce66de9810af82b4c2 WatchSource:0}: Error finding container a923d8341f8a96372873b4a63b1f128e60e97e81982747ce66de9810af82b4c2: Status 404 returned error can't find the container with id a923d8341f8a96372873b4a63b1f128e60e97e81982747ce66de9810af82b4c2 Jun 02 12:40:20.959081 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:20.959055 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-96cfv"] Jun 02 12:40:20.961724 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:40:20.961703 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8784056f_c039_4719_947a_5e3fe6ac2227.slice/crio-1197e46f9e2e355932208fb05a18ccf782d472bceba393acdc4ab8e478f0fa2a WatchSource:0}: Error finding container 1197e46f9e2e355932208fb05a18ccf782d472bceba393acdc4ab8e478f0fa2a: Status 404 returned error can't find the container with id 1197e46f9e2e355932208fb05a18ccf782d472bceba393acdc4ab8e478f0fa2a Jun 02 12:40:21.869730 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:21.869650 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-st6dv" event={"ID":"9af245f1-954a-426a-94b6-a8969279cadb","Type":"ContainerStarted","Data":"a923d8341f8a96372873b4a63b1f128e60e97e81982747ce66de9810af82b4c2"} Jun 02 12:40:21.871204 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:21.871181 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-96cfv" event={"ID":"8784056f-c039-4719-947a-5e3fe6ac2227","Type":"ContainerStarted","Data":"979313321be900a61b86b5b696cba02b1e1563bf753257afcff6c029c84e28e7"} Jun 02 12:40:21.871204 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:21.871207 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-96cfv" event={"ID":"8784056f-c039-4719-947a-5e3fe6ac2227","Type":"ContainerStarted","Data":"4604f57db49ec1dddbd96df70e3df8d5848c64e246290751153ff9a58209683b"} Jun 02 12:40:21.871348 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:21.871216 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-96cfv" event={"ID":"8784056f-c039-4719-947a-5e3fe6ac2227","Type":"ContainerStarted","Data":"1197e46f9e2e355932208fb05a18ccf782d472bceba393acdc4ab8e478f0fa2a"} Jun 02 12:40:21.872182 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:21.872163 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-q84kk" event={"ID":"36675602-1c0b-494f-95b0-72b7a7fa5381","Type":"ContainerStarted","Data":"548e1a9b3d5b4b2c60f18096bc5f160616ea7a99eca6d768c0efcfa3932850af"} Jun 02 12:40:22.495070 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:22.494950 2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-rjkpk"] Jun 02 12:40:22.498278 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:22.498258 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-rjkpk" Jun 02 12:40:22.500032 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:22.500008 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 02 12:40:22.500160 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:22.500142 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-q7bx4\"" Jun 02 12:40:22.507352 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:22.507333 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-rjkpk"] Jun 02 12:40:22.562547 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:22.562513 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/33545b63-c529-43d7-87b3-dbf1c2cf7526-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-rjkpk\" (UID: \"33545b63-c529-43d7-87b3-dbf1c2cf7526\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-rjkpk" Jun 02 12:40:22.663756 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:22.663723 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/33545b63-c529-43d7-87b3-dbf1c2cf7526-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-rjkpk\" (UID: \"33545b63-c529-43d7-87b3-dbf1c2cf7526\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-rjkpk" Jun 02 12:40:22.665965 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:22.665946 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/33545b63-c529-43d7-87b3-dbf1c2cf7526-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-rjkpk\" (UID: \"33545b63-c529-43d7-87b3-dbf1c2cf7526\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-rjkpk" Jun 02 12:40:22.807795 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:22.807707 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-rjkpk" Jun 02 12:40:22.876608 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:22.876569 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-q84kk" event={"ID":"36675602-1c0b-494f-95b0-72b7a7fa5381","Type":"ContainerStarted","Data":"c855b4f2ad12cc016fbdc52c81711cf77ff5aaec114a87f97493d5d56522d4b7"} Jun 02 12:40:22.876608 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:22.876612 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-q84kk" event={"ID":"36675602-1c0b-494f-95b0-72b7a7fa5381","Type":"ContainerStarted","Data":"41baf762e960217c6ef50f17c3d9b9168e4d305581df57f23b0295cf8a027d17"} Jun 02 12:40:22.877134 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:22.876778 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-q84kk" Jun 02 12:40:22.934202 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:22.934156 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-q84kk" podStartSLOduration=1.650243959 podStartE2EDuration="2.934137497s" podCreationTimestamp="2026-06-02 12:40:20 +0000 UTC" firstStartedPulling="2026-06-02 12:40:20.931526501 +0000 UTC m=+50.849141575" lastFinishedPulling="2026-06-02 12:40:22.215420035 +0000 UTC m=+52.133035113" observedRunningTime="2026-06-02 12:40:22.932776844 +0000 UTC m=+52.850391953" watchObservedRunningTime="2026-06-02 12:40:22.934137497 +0000 UTC m=+52.851752594" Jun 02 12:40:24.178655 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:24.177283 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-rjkpk"] Jun 02 12:40:24.179720 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:40:24.179692 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33545b63_c529_43d7_87b3_dbf1c2cf7526.slice/crio-93982a31d62cb99a2d04832a27814e0dc034ee33001bcff89cf7f327d3e79086 WatchSource:0}: Error finding container 93982a31d62cb99a2d04832a27814e0dc034ee33001bcff89cf7f327d3e79086: Status 404 returned error can't find the container with id 93982a31d62cb99a2d04832a27814e0dc034ee33001bcff89cf7f327d3e79086 Jun 02 12:40:24.883054 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:24.883023 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-96cfv" event={"ID":"8784056f-c039-4719-947a-5e3fe6ac2227","Type":"ContainerStarted","Data":"cd654d3aa2fd20eea8cfbe200d65302f18eadac3854240e99c28028824c5f15c"} Jun 02 12:40:24.884253 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:24.884223 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-st6dv" event={"ID":"9af245f1-954a-426a-94b6-a8969279cadb","Type":"ContainerStarted","Data":"341372c728c9e74dc46af908595af57c1a897cbcad7200fe8dfcca07bb99935b"} Jun 02 12:40:24.885189 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:24.885169 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-rjkpk" event={"ID":"33545b63-c529-43d7-87b3-dbf1c2cf7526","Type":"ContainerStarted","Data":"93982a31d62cb99a2d04832a27814e0dc034ee33001bcff89cf7f327d3e79086"} Jun 02 12:40:24.898707 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:24.898654 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-96cfv" podStartSLOduration=1.8860725139999999 podStartE2EDuration="4.898643674s" podCreationTimestamp="2026-06-02 12:40:20 +0000 UTC" firstStartedPulling="2026-06-02 12:40:21.042315287 +0000 UTC m=+50.959930367" lastFinishedPulling="2026-06-02 12:40:24.054886454 +0000 UTC m=+53.972501527" observedRunningTime="2026-06-02 12:40:24.897628297 +0000 UTC m=+54.815243394" watchObservedRunningTime="2026-06-02 12:40:24.898643674 +0000 UTC m=+54.816258780" Jun 02 12:40:25.888810 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:25.888772 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-rjkpk" event={"ID":"33545b63-c529-43d7-87b3-dbf1c2cf7526","Type":"ContainerStarted","Data":"a874bdf6605aaa591dd51aa22a60272fb5fe0eb38cedc38af66f184a32128884"} Jun 02 12:40:25.889314 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:25.889291 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-rjkpk" Jun 02 12:40:25.893318 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:25.893297 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-rjkpk" Jun 02 12:40:25.903644 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:25.903604 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-st6dv" podStartSLOduration=2.795599913 podStartE2EDuration="5.90359355s" podCreationTimestamp="2026-06-02 12:40:20 +0000 UTC" firstStartedPulling="2026-06-02 12:40:20.944041634 +0000 UTC m=+50.861656707" lastFinishedPulling="2026-06-02 12:40:24.052035266 +0000 UTC m=+53.969650344" observedRunningTime="2026-06-02 12:40:24.911575381 +0000 UTC m=+54.829190475" watchObservedRunningTime="2026-06-02 12:40:25.90359355 +0000 UTC m=+55.821208643" Jun 02 12:40:25.903773 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:25.903675 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-rjkpk" podStartSLOduration=2.320244796 podStartE2EDuration="3.903669469s" podCreationTimestamp="2026-06-02 12:40:22 +0000 UTC" firstStartedPulling="2026-06-02 12:40:24.182459864 +0000 UTC m=+54.100074937" lastFinishedPulling="2026-06-02 12:40:25.765884536 +0000 UTC m=+55.683499610" observedRunningTime="2026-06-02 12:40:25.902980153 +0000 UTC m=+55.820595247" watchObservedRunningTime="2026-06-02 12:40:25.903669469 +0000 UTC m=+55.821284561" Jun 02 12:40:26.562253 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:26.562218 2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-gtpdx"] Jun 02 12:40:26.582126 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:26.582103 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-gtpdx"] Jun 02 12:40:26.582247 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:26.582217 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-gtpdx" Jun 02 12:40:26.584261 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:26.584240 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 02 12:40:26.584517 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:26.584496 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 02 12:40:26.584933 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:26.584914 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 02 12:40:26.585035 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:26.584980 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-sgtg2\"" Jun 02 12:40:26.585035 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:26.584995 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 02 12:40:26.585282 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:26.585234 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 02 12:40:26.590817 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:26.590795 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9mp8\" (UniqueName: \"kubernetes.io/projected/813e7359-d285-4204-ac7f-ac6ff4f6584c-kube-api-access-j9mp8\") pod \"prometheus-operator-658bcd8bdf-gtpdx\" (UID: \"813e7359-d285-4204-ac7f-ac6ff4f6584c\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-gtpdx" Jun 02 12:40:26.590931 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:26.590863 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/813e7359-d285-4204-ac7f-ac6ff4f6584c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-gtpdx\" (UID: \"813e7359-d285-4204-ac7f-ac6ff4f6584c\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-gtpdx" Jun 02 12:40:26.590931 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:26.590884 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/813e7359-d285-4204-ac7f-ac6ff4f6584c-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-gtpdx\" (UID: \"813e7359-d285-4204-ac7f-ac6ff4f6584c\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-gtpdx" Jun 02 12:40:26.590931 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:26.590901 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/813e7359-d285-4204-ac7f-ac6ff4f6584c-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-gtpdx\" (UID: \"813e7359-d285-4204-ac7f-ac6ff4f6584c\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-gtpdx" Jun 02 12:40:26.691928 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:26.691888 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j9mp8\" (UniqueName: \"kubernetes.io/projected/813e7359-d285-4204-ac7f-ac6ff4f6584c-kube-api-access-j9mp8\") pod \"prometheus-operator-658bcd8bdf-gtpdx\" (UID: \"813e7359-d285-4204-ac7f-ac6ff4f6584c\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-gtpdx" Jun 02 12:40:26.692115 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:26.691958 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/813e7359-d285-4204-ac7f-ac6ff4f6584c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-gtpdx\" (UID: \"813e7359-d285-4204-ac7f-ac6ff4f6584c\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-gtpdx" Jun 02 12:40:26.692115 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:26.691982 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/813e7359-d285-4204-ac7f-ac6ff4f6584c-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-gtpdx\" (UID: \"813e7359-d285-4204-ac7f-ac6ff4f6584c\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-gtpdx" Jun 02 12:40:26.692115 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:26.692001 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/813e7359-d285-4204-ac7f-ac6ff4f6584c-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-gtpdx\" (UID: \"813e7359-d285-4204-ac7f-ac6ff4f6584c\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-gtpdx" Jun 02 12:40:26.692590 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:26.692570 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/813e7359-d285-4204-ac7f-ac6ff4f6584c-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-gtpdx\" (UID: \"813e7359-d285-4204-ac7f-ac6ff4f6584c\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-gtpdx" Jun 02 12:40:26.694463 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:26.694439 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/813e7359-d285-4204-ac7f-ac6ff4f6584c-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-gtpdx\" (UID: \"813e7359-d285-4204-ac7f-ac6ff4f6584c\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-gtpdx" Jun 02 12:40:26.694463 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:26.694451 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/813e7359-d285-4204-ac7f-ac6ff4f6584c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-gtpdx\" (UID: \"813e7359-d285-4204-ac7f-ac6ff4f6584c\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-gtpdx" Jun 02 12:40:26.699570 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:26.699551 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9mp8\" (UniqueName: \"kubernetes.io/projected/813e7359-d285-4204-ac7f-ac6ff4f6584c-kube-api-access-j9mp8\") pod \"prometheus-operator-658bcd8bdf-gtpdx\" (UID: \"813e7359-d285-4204-ac7f-ac6ff4f6584c\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-gtpdx" Jun 02 12:40:26.891041 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:26.891015 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-gtpdx" Jun 02 12:40:27.005617 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:27.005587 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-gtpdx"] Jun 02 12:40:27.008665 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:40:27.008635 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod813e7359_d285_4204_ac7f_ac6ff4f6584c.slice/crio-5a74d9bfa714466124732b38df3f44c43683d794c1577ee19139ed96b80736a2 WatchSource:0}: Error finding container 5a74d9bfa714466124732b38df3f44c43683d794c1577ee19139ed96b80736a2: Status 404 returned error can't find the container with id 5a74d9bfa714466124732b38df3f44c43683d794c1577ee19139ed96b80736a2 Jun 02 12:40:27.894606 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:27.894574 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-gtpdx" event={"ID":"813e7359-d285-4204-ac7f-ac6ff4f6584c","Type":"ContainerStarted","Data":"5a74d9bfa714466124732b38df3f44c43683d794c1577ee19139ed96b80736a2"} Jun 02 12:40:28.899170 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:28.899084 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-gtpdx" event={"ID":"813e7359-d285-4204-ac7f-ac6ff4f6584c","Type":"ContainerStarted","Data":"f59e491cb45a77d7374622494d5fa74081f7665d4331a5a737ef060166a138c6"} Jun 02 12:40:28.899639 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:28.899215 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-gtpdx" event={"ID":"813e7359-d285-4204-ac7f-ac6ff4f6584c","Type":"ContainerStarted","Data":"cdd119ce3b4a63efdfd0de1c994c8ca8e44996f41263c413148df4c54f6bf8c8"} Jun 02 12:40:28.915450 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:28.915400 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-gtpdx" podStartSLOduration=1.278494304 podStartE2EDuration="2.915385099s" podCreationTimestamp="2026-06-02 12:40:26 +0000 UTC" firstStartedPulling="2026-06-02 12:40:27.010573667 +0000 UTC m=+56.928188739" lastFinishedPulling="2026-06-02 12:40:28.647464461 +0000 UTC m=+58.565079534" observedRunningTime="2026-06-02 12:40:28.914882972 +0000 UTC m=+58.832498063" watchObservedRunningTime="2026-06-02 12:40:28.915385099 +0000 UTC m=+58.833000194" Jun 02 12:40:29.423267 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:29.423232 2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-7758dbbf8b-52rx4"] Jun 02 12:40:29.442018 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:29.441989 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7758dbbf8b-52rx4"] Jun 02 12:40:29.442175 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:29.442116 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7758dbbf8b-52rx4" Jun 02 12:40:29.444057 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:29.444032 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 02 12:40:29.444369 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:29.444347 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 02 12:40:29.445097 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:29.445076 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 02 12:40:29.445196 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:29.445131 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 02 12:40:29.445266 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:29.445236 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 02 12:40:29.445393 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:29.445375 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-cjngn\"" Jun 02 12:40:29.445464 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:29.445445 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 02 12:40:29.445595 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:29.445581 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 02 12:40:29.509735 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:29.509701 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lc5c6\" (UniqueName: \"kubernetes.io/projected/c7436547-622e-49df-afc9-c12b4886dd85-kube-api-access-lc5c6\") pod \"console-7758dbbf8b-52rx4\" (UID: \"c7436547-622e-49df-afc9-c12b4886dd85\") " pod="openshift-console/console-7758dbbf8b-52rx4" Jun 02 12:40:29.509735 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:29.509735 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7436547-622e-49df-afc9-c12b4886dd85-service-ca\") pod \"console-7758dbbf8b-52rx4\" (UID: \"c7436547-622e-49df-afc9-c12b4886dd85\") " pod="openshift-console/console-7758dbbf8b-52rx4" Jun 02 12:40:29.509973 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:29.509768 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7436547-622e-49df-afc9-c12b4886dd85-console-serving-cert\") pod \"console-7758dbbf8b-52rx4\" (UID: \"c7436547-622e-49df-afc9-c12b4886dd85\") " pod="openshift-console/console-7758dbbf8b-52rx4" Jun 02 12:40:29.509973 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:29.509784 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c7436547-622e-49df-afc9-c12b4886dd85-oauth-serving-cert\") pod \"console-7758dbbf8b-52rx4\" (UID: \"c7436547-622e-49df-afc9-c12b4886dd85\") " pod="openshift-console/console-7758dbbf8b-52rx4" Jun 02 12:40:29.509973 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:29.509817 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c7436547-622e-49df-afc9-c12b4886dd85-console-oauth-config\") pod \"console-7758dbbf8b-52rx4\" (UID: \"c7436547-622e-49df-afc9-c12b4886dd85\") " pod="openshift-console/console-7758dbbf8b-52rx4" Jun 02 12:40:29.509973 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:29.509832 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c7436547-622e-49df-afc9-c12b4886dd85-console-config\") pod \"console-7758dbbf8b-52rx4\" (UID: \"c7436547-622e-49df-afc9-c12b4886dd85\") " pod="openshift-console/console-7758dbbf8b-52rx4" Jun 02 12:40:29.611220 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:29.611184 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c7436547-622e-49df-afc9-c12b4886dd85-console-oauth-config\") pod \"console-7758dbbf8b-52rx4\" (UID: \"c7436547-622e-49df-afc9-c12b4886dd85\") " pod="openshift-console/console-7758dbbf8b-52rx4" Jun 02 12:40:29.611220 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:29.611221 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c7436547-622e-49df-afc9-c12b4886dd85-console-config\") pod \"console-7758dbbf8b-52rx4\" (UID: \"c7436547-622e-49df-afc9-c12b4886dd85\") " pod="openshift-console/console-7758dbbf8b-52rx4" Jun 02 12:40:29.611433 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:29.611260 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lc5c6\" (UniqueName: \"kubernetes.io/projected/c7436547-622e-49df-afc9-c12b4886dd85-kube-api-access-lc5c6\") pod \"console-7758dbbf8b-52rx4\" (UID: \"c7436547-622e-49df-afc9-c12b4886dd85\") " pod="openshift-console/console-7758dbbf8b-52rx4" Jun 02 12:40:29.611433 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:29.611278 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7436547-622e-49df-afc9-c12b4886dd85-service-ca\") pod \"console-7758dbbf8b-52rx4\" (UID: \"c7436547-622e-49df-afc9-c12b4886dd85\") " pod="openshift-console/console-7758dbbf8b-52rx4" Jun 02 12:40:29.611433 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:29.611310 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7436547-622e-49df-afc9-c12b4886dd85-console-serving-cert\") pod \"console-7758dbbf8b-52rx4\" (UID: \"c7436547-622e-49df-afc9-c12b4886dd85\") " pod="openshift-console/console-7758dbbf8b-52rx4" Jun 02 12:40:29.611433 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:29.611359 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c7436547-622e-49df-afc9-c12b4886dd85-oauth-serving-cert\") pod \"console-7758dbbf8b-52rx4\" (UID: \"c7436547-622e-49df-afc9-c12b4886dd85\") " pod="openshift-console/console-7758dbbf8b-52rx4" Jun 02 12:40:29.612118 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:29.612092 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7436547-622e-49df-afc9-c12b4886dd85-service-ca\") pod \"console-7758dbbf8b-52rx4\" (UID: \"c7436547-622e-49df-afc9-c12b4886dd85\") " pod="openshift-console/console-7758dbbf8b-52rx4" Jun 02 12:40:29.612118 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:29.612107 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c7436547-622e-49df-afc9-c12b4886dd85-console-config\") pod \"console-7758dbbf8b-52rx4\" (UID: \"c7436547-622e-49df-afc9-c12b4886dd85\") " pod="openshift-console/console-7758dbbf8b-52rx4" Jun 02 12:40:29.612118 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:29.612112 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c7436547-622e-49df-afc9-c12b4886dd85-oauth-serving-cert\") pod \"console-7758dbbf8b-52rx4\" (UID: \"c7436547-622e-49df-afc9-c12b4886dd85\") " pod="openshift-console/console-7758dbbf8b-52rx4" Jun 02 12:40:29.613689 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:29.613670 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7436547-622e-49df-afc9-c12b4886dd85-console-serving-cert\") pod \"console-7758dbbf8b-52rx4\" (UID: \"c7436547-622e-49df-afc9-c12b4886dd85\") " pod="openshift-console/console-7758dbbf8b-52rx4" Jun 02 12:40:29.613775 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:29.613674 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c7436547-622e-49df-afc9-c12b4886dd85-console-oauth-config\") pod \"console-7758dbbf8b-52rx4\" (UID: \"c7436547-622e-49df-afc9-c12b4886dd85\") " pod="openshift-console/console-7758dbbf8b-52rx4" Jun 02 12:40:29.619170 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:29.619148 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lc5c6\" (UniqueName: \"kubernetes.io/projected/c7436547-622e-49df-afc9-c12b4886dd85-kube-api-access-lc5c6\") pod \"console-7758dbbf8b-52rx4\" (UID: \"c7436547-622e-49df-afc9-c12b4886dd85\") " pod="openshift-console/console-7758dbbf8b-52rx4" Jun 02 12:40:29.751399 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:29.751302 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7758dbbf8b-52rx4" Jun 02 12:40:29.829242 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:29.829221 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mb7lb" Jun 02 12:40:29.872051 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:29.872021 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7758dbbf8b-52rx4"] Jun 02 12:40:29.875114 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:40:29.875087 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7436547_622e_49df_afc9_c12b4886dd85.slice/crio-09314884e215be90a6c0caac17b905eed6206e9803ea151fe4b28b440c9700be WatchSource:0}: Error finding container 09314884e215be90a6c0caac17b905eed6206e9803ea151fe4b28b440c9700be: Status 404 returned error can't find the container with id 09314884e215be90a6c0caac17b905eed6206e9803ea151fe4b28b440c9700be Jun 02 12:40:29.902896 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:29.902869 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7758dbbf8b-52rx4" event={"ID":"c7436547-622e-49df-afc9-c12b4886dd85","Type":"ContainerStarted","Data":"09314884e215be90a6c0caac17b905eed6206e9803ea151fe4b28b440c9700be"} Jun 02 12:40:30.924237 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:30.924205 2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-46jp4"] Jun 02 12:40:30.945649 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:30.945574 2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-mfc4d"] Jun 02 12:40:30.945797 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:30.945734 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-46jp4" Jun 02 12:40:30.947773 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:30.947753 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 02 12:40:30.948525 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:30.948507 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 02 12:40:30.948865 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:30.948811 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-wdfn5\"" Jun 02 12:40:30.961608 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:30.961588 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-46jp4"] Jun 02 12:40:30.961694 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:30.961615 2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-v5cjj"] Jun 02 12:40:30.961740 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:30.961723 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-8469c486bb-mfc4d" Jun 02 12:40:30.963739 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:30.963715 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-95cxl\"" Jun 02 12:40:30.963739 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:30.963736 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 02 12:40:30.963868 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:30.963723 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 02 12:40:30.963868 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:30.963723 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 02 12:40:30.975643 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:30.975626 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-mfc4d"] Jun 02 12:40:30.975731 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:30.975718 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-v5cjj" Jun 02 12:40:30.977803 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:30.977784 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 02 12:40:30.977922 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:30.977808 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 02 12:40:30.977922 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:30.977862 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 02 12:40:30.977922 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:30.977864 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-7gmg2\"" Jun 02 12:40:31.022233 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:31.022203 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2cbe8332-2bf5-4725-8973-310bfeae787b-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-mfc4d\" (UID: \"2cbe8332-2bf5-4725-8973-310bfeae787b\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-mfc4d" Jun 02 12:40:31.022382 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:31.022238 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c6fe1151-3fa5-45d6-baf6-773d6dbcc40d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-46jp4\" (UID: \"c6fe1151-3fa5-45d6-baf6-773d6dbcc40d\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-46jp4" Jun 02 12:40:31.022382 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:31.022284 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rd5m5\" (UniqueName: \"kubernetes.io/projected/c6fe1151-3fa5-45d6-baf6-773d6dbcc40d-kube-api-access-rd5m5\") pod \"openshift-state-metrics-85658796db-46jp4\" (UID: \"c6fe1151-3fa5-45d6-baf6-773d6dbcc40d\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-46jp4" Jun 02 12:40:31.022382 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:31.022303 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2a5c8f65-1825-4ccb-88b6-806b2203fca0-root\") pod \"node-exporter-v5cjj\" (UID: \"2a5c8f65-1825-4ccb-88b6-806b2203fca0\") " pod="openshift-monitoring/node-exporter-v5cjj" Jun 02 12:40:31.022382 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:31.022319 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2a5c8f65-1825-4ccb-88b6-806b2203fca0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v5cjj\" (UID: \"2a5c8f65-1825-4ccb-88b6-806b2203fca0\") " pod="openshift-monitoring/node-exporter-v5cjj" Jun 02 12:40:31.022382 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:31.022337 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2cbe8332-2bf5-4725-8973-310bfeae787b-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-mfc4d\" (UID: \"2cbe8332-2bf5-4725-8973-310bfeae787b\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-mfc4d" Jun 02 12:40:31.022382 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:31.022355 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2cbe8332-2bf5-4725-8973-310bfeae787b-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-mfc4d\" (UID: \"2cbe8332-2bf5-4725-8973-310bfeae787b\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-mfc4d" Jun 02 12:40:31.022587 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:31.022395 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a5c8f65-1825-4ccb-88b6-806b2203fca0-metrics-client-ca\") pod \"node-exporter-v5cjj\" (UID: \"2a5c8f65-1825-4ccb-88b6-806b2203fca0\") " pod="openshift-monitoring/node-exporter-v5cjj" Jun 02 12:40:31.022587 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:31.022424 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2nxx\" (UniqueName: \"kubernetes.io/projected/2a5c8f65-1825-4ccb-88b6-806b2203fca0-kube-api-access-l2nxx\") pod \"node-exporter-v5cjj\" (UID: \"2a5c8f65-1825-4ccb-88b6-806b2203fca0\") " pod="openshift-monitoring/node-exporter-v5cjj" Jun 02 12:40:31.022587 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:31.022459 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2a5c8f65-1825-4ccb-88b6-806b2203fca0-node-exporter-wtmp\") pod \"node-exporter-v5cjj\" (UID: \"2a5c8f65-1825-4ccb-88b6-806b2203fca0\") " pod="openshift-monitoring/node-exporter-v5cjj" Jun 02 12:40:31.022587 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:31.022478 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2cbe8332-2bf5-4725-8973-310bfeae787b-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-mfc4d\" (UID: \"2cbe8332-2bf5-4725-8973-310bfeae787b\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-mfc4d" Jun 02 12:40:31.022587 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:31.022503 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c6fe1151-3fa5-45d6-baf6-773d6dbcc40d-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-46jp4\" (UID: \"c6fe1151-3fa5-45d6-baf6-773d6dbcc40d\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-46jp4" Jun 02 12:40:31.022587 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:31.022525 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c6fe1151-3fa5-45d6-baf6-773d6dbcc40d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-46jp4\" (UID: \"c6fe1151-3fa5-45d6-baf6-773d6dbcc40d\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-46jp4" Jun 02 12:40:31.022587 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:31.022556 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2a5c8f65-1825-4ccb-88b6-806b2203fca0-sys\") pod \"node-exporter-v5cjj\" (UID: \"2a5c8f65-1825-4ccb-88b6-806b2203fca0\") " pod="openshift-monitoring/node-exporter-v5cjj" Jun 02 12:40:31.022587 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:31.022573 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2a5c8f65-1825-4ccb-88b6-806b2203fca0-node-exporter-textfile\") pod \"node-exporter-v5cjj\" (UID: \"2a5c8f65-1825-4ccb-88b6-806b2203fca0\") " pod="openshift-monitoring/node-exporter-v5cjj" Jun 02 12:40:31.022587 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:31.022588 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2cbe8332-2bf5-4725-8973-310bfeae787b-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-mfc4d\" (UID: \"2cbe8332-2bf5-4725-8973-310bfeae787b\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-mfc4d" Jun 02 12:40:31.022909 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:31.022605 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2a5c8f65-1825-4ccb-88b6-806b2203fca0-node-exporter-tls\") pod \"node-exporter-v5cjj\" (UID: \"2a5c8f65-1825-4ccb-88b6-806b2203fca0\") " pod="openshift-monitoring/node-exporter-v5cjj" Jun 02 12:40:31.022909 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:31.022633 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2a5c8f65-1825-4ccb-88b6-806b2203fca0-node-exporter-accelerators-collector-config\") pod \"node-exporter-v5cjj\" (UID: \"2a5c8f65-1825-4ccb-88b6-806b2203fca0\") " pod="openshift-monitoring/node-exporter-v5cjj" Jun 02 12:40:31.022909 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:31.022647 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ch4nn\" (UniqueName: \"kubernetes.io/projected/2cbe8332-2bf5-4725-8973-310bfeae787b-kube-api-access-ch4nn\") pod \"kube-state-metrics-8469c486bb-mfc4d\" (UID: \"2cbe8332-2bf5-4725-8973-310bfeae787b\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-mfc4d" Jun 02 12:40:31.123659 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:31.123625 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2cbe8332-2bf5-4725-8973-310bfeae787b-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-mfc4d\" (UID: \"2cbe8332-2bf5-4725-8973-310bfeae787b\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-mfc4d" Jun 02 12:40:31.123826 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:31.123667 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c6fe1151-3fa5-45d6-baf6-773d6dbcc40d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-46jp4\" (UID: \"c6fe1151-3fa5-45d6-baf6-773d6dbcc40d\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-46jp4" Jun 02 12:40:31.123826 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:40:31.123771 2545 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 02 12:40:31.123826 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:40:31.123775 2545 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 02 12:40:31.123826 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:31.123792 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rd5m5\" (UniqueName: \"kubernetes.io/projected/c6fe1151-3fa5-45d6-baf6-773d6dbcc40d-kube-api-access-rd5m5\") pod \"openshift-state-metrics-85658796db-46jp4\" (UID: \"c6fe1151-3fa5-45d6-baf6-773d6dbcc40d\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-46jp4" Jun 02 12:40:31.124064 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:40:31.123851 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6fe1151-3fa5-45d6-baf6-773d6dbcc40d-openshift-state-metrics-tls podName:c6fe1151-3fa5-45d6-baf6-773d6dbcc40d nodeName:}" failed. No retries permitted until 2026-06-02 12:40:31.623820314 +0000 UTC m=+61.541435387 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/c6fe1151-3fa5-45d6-baf6-773d6dbcc40d-openshift-state-metrics-tls") pod "openshift-state-metrics-85658796db-46jp4" (UID: "c6fe1151-3fa5-45d6-baf6-773d6dbcc40d") : secret "openshift-state-metrics-tls" not found Jun 02 12:40:31.124064 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:40:31.123873 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cbe8332-2bf5-4725-8973-310bfeae787b-kube-state-metrics-tls podName:2cbe8332-2bf5-4725-8973-310bfeae787b nodeName:}" failed. No retries permitted until 2026-06-02 12:40:31.623863146 +0000 UTC m=+61.541478223 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/2cbe8332-2bf5-4725-8973-310bfeae787b-kube-state-metrics-tls") pod "kube-state-metrics-8469c486bb-mfc4d" (UID: "2cbe8332-2bf5-4725-8973-310bfeae787b") : secret "kube-state-metrics-tls" not found Jun 02 12:40:31.124064 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:31.123897 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2a5c8f65-1825-4ccb-88b6-806b2203fca0-root\") pod \"node-exporter-v5cjj\" (UID: \"2a5c8f65-1825-4ccb-88b6-806b2203fca0\") " pod="openshift-monitoring/node-exporter-v5cjj" Jun 02 12:40:31.124064 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:31.123923 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2a5c8f65-1825-4ccb-88b6-806b2203fca0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v5cjj\" (UID: \"2a5c8f65-1825-4ccb-88b6-806b2203fca0\") " pod="openshift-monitoring/node-exporter-v5cjj" Jun 02 12:40:31.124064 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:31.123973 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2a5c8f65-1825-4ccb-88b6-806b2203fca0-root\") pod \"node-exporter-v5cjj\" (UID: \"2a5c8f65-1825-4ccb-88b6-806b2203fca0\") " pod="openshift-monitoring/node-exporter-v5cjj" Jun 02 12:40:31.124064 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:31.124011 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2cbe8332-2bf5-4725-8973-310bfeae787b-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-mfc4d\" (UID: \"2cbe8332-2bf5-4725-8973-310bfeae787b\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-mfc4d" Jun 02 12:40:31.124064 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:31.124045 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2cbe8332-2bf5-4725-8973-310bfeae787b-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-mfc4d\" (UID: \"2cbe8332-2bf5-4725-8973-310bfeae787b\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-mfc4d" Jun 02 12:40:31.124408 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:31.124083 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a5c8f65-1825-4ccb-88b6-806b2203fca0-metrics-client-ca\") pod \"node-exporter-v5cjj\" (UID: \"2a5c8f65-1825-4ccb-88b6-806b2203fca0\") " pod="openshift-monitoring/node-exporter-v5cjj" Jun 02 12:40:31.124408 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:31.124110 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l2nxx\" (UniqueName: \"kubernetes.io/projected/2a5c8f65-1825-4ccb-88b6-806b2203fca0-kube-api-access-l2nxx\") pod \"node-exporter-v5cjj\" (UID: \"2a5c8f65-1825-4ccb-88b6-806b2203fca0\") " pod="openshift-monitoring/node-exporter-v5cjj" Jun 02 12:40:31.124408 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:31.124145 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2a5c8f65-1825-4ccb-88b6-806b2203fca0-node-exporter-wtmp\") pod \"node-exporter-v5cjj\" (UID: \"2a5c8f65-1825-4ccb-88b6-806b2203fca0\") " pod="openshift-monitoring/node-exporter-v5cjj" Jun 02 12:40:31.124408 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:31.124171 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2cbe8332-2bf5-4725-8973-310bfeae787b-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-mfc4d\" (UID: \"2cbe8332-2bf5-4725-8973-310bfeae787b\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-mfc4d" Jun 02 12:40:31.124587 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:31.124461 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c6fe1151-3fa5-45d6-baf6-773d6dbcc40d-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-46jp4\" (UID: \"c6fe1151-3fa5-45d6-baf6-773d6dbcc40d\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-46jp4" Jun 02 12:40:31.124587 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:31.124509 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c6fe1151-3fa5-45d6-baf6-773d6dbcc40d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-46jp4\" (UID: \"c6fe1151-3fa5-45d6-baf6-773d6dbcc40d\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-46jp4" Jun 02 12:40:31.124587 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:31.124526 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2a5c8f65-1825-4ccb-88b6-806b2203fca0-node-exporter-wtmp\") pod \"node-exporter-v5cjj\" (UID: \"2a5c8f65-1825-4ccb-88b6-806b2203fca0\") " pod="openshift-monitoring/node-exporter-v5cjj" Jun 02 12:40:31.124587 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:31.124569 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2a5c8f65-1825-4ccb-88b6-806b2203fca0-sys\") pod \"node-exporter-v5cjj\" (UID: \"2a5c8f65-1825-4ccb-88b6-806b2203fca0\") " pod="openshift-monitoring/node-exporter-v5cjj" Jun 02 12:40:31.124784 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:31.124597 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2a5c8f65-1825-4ccb-88b6-806b2203fca0-node-exporter-textfile\") pod \"node-exporter-v5cjj\" (UID: \"2a5c8f65-1825-4ccb-88b6-806b2203fca0\") " pod="openshift-monitoring/node-exporter-v5cjj" Jun 02 12:40:31.124784 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:31.124625 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2cbe8332-2bf5-4725-8973-310bfeae787b-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-mfc4d\" (UID: \"2cbe8332-2bf5-4725-8973-310bfeae787b\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-mfc4d" Jun 02 12:40:31.124784 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:31.124664 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2a5c8f65-1825-4ccb-88b6-806b2203fca0-sys\") pod \"node-exporter-v5cjj\" (UID: \"2a5c8f65-1825-4ccb-88b6-806b2203fca0\") " pod="openshift-monitoring/node-exporter-v5cjj" Jun 02 12:40:31.124784 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:31.124664 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2a5c8f65-1825-4ccb-88b6-806b2203fca0-node-exporter-tls\") pod \"node-exporter-v5cjj\" (UID: \"2a5c8f65-1825-4ccb-88b6-806b2203fca0\") " pod="openshift-monitoring/node-exporter-v5cjj" Jun 02 12:40:31.124784 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:31.124724 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2a5c8f65-1825-4ccb-88b6-806b2203fca0-node-exporter-accelerators-collector-config\") pod \"node-exporter-v5cjj\" (UID: \"2a5c8f65-1825-4ccb-88b6-806b2203fca0\") " pod="openshift-monitoring/node-exporter-v5cjj" Jun 02 12:40:31.124784 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:31.124745 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ch4nn\" (UniqueName: \"kubernetes.io/projected/2cbe8332-2bf5-4725-8973-310bfeae787b-kube-api-access-ch4nn\") pod \"kube-state-metrics-8469c486bb-mfc4d\" (UID: \"2cbe8332-2bf5-4725-8973-310bfeae787b\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-mfc4d" Jun 02 12:40:31.124784 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:31.124748 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2cbe8332-2bf5-4725-8973-310bfeae787b-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-mfc4d\" (UID: \"2cbe8332-2bf5-4725-8973-310bfeae787b\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-mfc4d" Jun 02 12:40:31.125143 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:31.124664 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a5c8f65-1825-4ccb-88b6-806b2203fca0-metrics-client-ca\") pod \"node-exporter-v5cjj\" (UID: \"2a5c8f65-1825-4ccb-88b6-806b2203fca0\") " pod="openshift-monitoring/node-exporter-v5cjj" Jun 02 12:40:31.125269 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:31.125244 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2a5c8f65-1825-4ccb-88b6-806b2203fca0-node-exporter-accelerators-collector-config\") pod \"node-exporter-v5cjj\" (UID: \"2a5c8f65-1825-4ccb-88b6-806b2203fca0\") " pod="openshift-monitoring/node-exporter-v5cjj" Jun 02 12:40:31.125331 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:31.125266 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2cbe8332-2bf5-4725-8973-310bfeae787b-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-mfc4d\" (UID: \"2cbe8332-2bf5-4725-8973-310bfeae787b\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-mfc4d" Jun 02 12:40:31.125331 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:31.125315 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c6fe1151-3fa5-45d6-baf6-773d6dbcc40d-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-46jp4\" (UID: \"c6fe1151-3fa5-45d6-baf6-773d6dbcc40d\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-46jp4" Jun 02 12:40:31.125432 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:31.125370 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2cbe8332-2bf5-4725-8973-310bfeae787b-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-mfc4d\" (UID: \"2cbe8332-2bf5-4725-8973-310bfeae787b\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-mfc4d" Jun 02 12:40:31.125551 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:31.125532 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2a5c8f65-1825-4ccb-88b6-806b2203fca0-node-exporter-textfile\") pod \"node-exporter-v5cjj\" (UID: \"2a5c8f65-1825-4ccb-88b6-806b2203fca0\") " pod="openshift-monitoring/node-exporter-v5cjj" Jun 02 12:40:31.126728 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:31.126699 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2a5c8f65-1825-4ccb-88b6-806b2203fca0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v5cjj\" (UID: \"2a5c8f65-1825-4ccb-88b6-806b2203fca0\") " pod="openshift-monitoring/node-exporter-v5cjj" Jun 02 12:40:31.127572 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:31.127545 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c6fe1151-3fa5-45d6-baf6-773d6dbcc40d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-46jp4\" (UID: \"c6fe1151-3fa5-45d6-baf6-773d6dbcc40d\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-46jp4" Jun 02 12:40:31.127769 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:31.127747 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2a5c8f65-1825-4ccb-88b6-806b2203fca0-node-exporter-tls\") pod \"node-exporter-v5cjj\" (UID: \"2a5c8f65-1825-4ccb-88b6-806b2203fca0\") " pod="openshift-monitoring/node-exporter-v5cjj" Jun 02 12:40:31.128519 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:31.128498 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2cbe8332-2bf5-4725-8973-310bfeae787b-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-mfc4d\" (UID: \"2cbe8332-2bf5-4725-8973-310bfeae787b\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-mfc4d" Jun 02 12:40:31.133766 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:31.133742 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2nxx\" (UniqueName: \"kubernetes.io/projected/2a5c8f65-1825-4ccb-88b6-806b2203fca0-kube-api-access-l2nxx\") pod \"node-exporter-v5cjj\" (UID: \"2a5c8f65-1825-4ccb-88b6-806b2203fca0\") " pod="openshift-monitoring/node-exporter-v5cjj" Jun 02 12:40:31.133926 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:31.133872 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rd5m5\" (UniqueName: \"kubernetes.io/projected/c6fe1151-3fa5-45d6-baf6-773d6dbcc40d-kube-api-access-rd5m5\") pod \"openshift-state-metrics-85658796db-46jp4\" (UID: \"c6fe1151-3fa5-45d6-baf6-773d6dbcc40d\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-46jp4" Jun 02 12:40:31.134545 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:31.134523 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ch4nn\" (UniqueName: \"kubernetes.io/projected/2cbe8332-2bf5-4725-8973-310bfeae787b-kube-api-access-ch4nn\") pod \"kube-state-metrics-8469c486bb-mfc4d\" (UID: \"2cbe8332-2bf5-4725-8973-310bfeae787b\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-mfc4d" Jun 02 12:40:31.283391 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:31.283287 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-v5cjj" Jun 02 12:40:31.292251 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:40:31.292218 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a5c8f65_1825_4ccb_88b6_806b2203fca0.slice/crio-9db3322dad2298896fdd6ed4961237cb3859ebc642bb01a614c9292a663cacd5 WatchSource:0}: Error finding container 9db3322dad2298896fdd6ed4961237cb3859ebc642bb01a614c9292a663cacd5: Status 404 returned error can't find the container with id 9db3322dad2298896fdd6ed4961237cb3859ebc642bb01a614c9292a663cacd5 Jun 02 12:40:31.628792 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:31.628761 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2cbe8332-2bf5-4725-8973-310bfeae787b-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-mfc4d\" (UID: \"2cbe8332-2bf5-4725-8973-310bfeae787b\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-mfc4d" Jun 02 12:40:31.628970 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:31.628806 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c6fe1151-3fa5-45d6-baf6-773d6dbcc40d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-46jp4\" (UID: \"c6fe1151-3fa5-45d6-baf6-773d6dbcc40d\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-46jp4" Jun 02 12:40:31.631358 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:31.631334 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c6fe1151-3fa5-45d6-baf6-773d6dbcc40d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-46jp4\" (UID: \"c6fe1151-3fa5-45d6-baf6-773d6dbcc40d\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-46jp4" Jun 02 12:40:31.631481 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:31.631423 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2cbe8332-2bf5-4725-8973-310bfeae787b-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-mfc4d\" (UID: \"2cbe8332-2bf5-4725-8973-310bfeae787b\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-mfc4d" Jun 02 12:40:31.858546 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:31.858504 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-46jp4" Jun 02 12:40:31.869332 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:31.869277 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-8469c486bb-mfc4d" Jun 02 12:40:31.914233 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:31.914194 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v5cjj" event={"ID":"2a5c8f65-1825-4ccb-88b6-806b2203fca0","Type":"ContainerStarted","Data":"9db3322dad2298896fdd6ed4961237cb3859ebc642bb01a614c9292a663cacd5"} Jun 02 12:40:32.023376 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:32.022861 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-46jp4"] Jun 02 12:40:32.024470 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:32.024441 2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 12:40:32.027705 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:40:32.027675 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6fe1151_3fa5_45d6_baf6_773d6dbcc40d.slice/crio-3e47c7b0e6a071810998c56ecabbde12a83ad5d1d264a238b8a05190cba2259d WatchSource:0}: Error finding container 3e47c7b0e6a071810998c56ecabbde12a83ad5d1d264a238b8a05190cba2259d: Status 404 returned error can't find the container with id 3e47c7b0e6a071810998c56ecabbde12a83ad5d1d264a238b8a05190cba2259d Jun 02 12:40:32.049056 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:32.048970 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 12:40:32.049056 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:32.049000 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-mfc4d"] Jun 02 12:40:32.049298 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:32.049182 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:40:32.050709 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:40:32.050658 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cbe8332_2bf5_4725_8973_310bfeae787b.slice/crio-b7003ffb35f0db55d7b6e6a634f4701ee503606328aadf02382aab60803d58c9 WatchSource:0}: Error finding container b7003ffb35f0db55d7b6e6a634f4701ee503606328aadf02382aab60803d58c9: Status 404 returned error can't find the container with id b7003ffb35f0db55d7b6e6a634f4701ee503606328aadf02382aab60803d58c9 Jun 02 12:40:32.052978 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:32.051749 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 02 12:40:32.052978 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:32.051974 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 02 12:40:32.052978 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:32.052154 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 02 12:40:32.052978 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:32.052383 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 02 12:40:32.052978 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:32.052392 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-v8tj5\"" Jun 02 12:40:32.052978 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:32.052556 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 02 12:40:32.052978 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:32.052713 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 02 12:40:32.052978 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:32.052713 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 02 12:40:32.052978 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:32.052962 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 02 12:40:32.055314 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:32.054487 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 02 12:40:32.133947 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:32.133856 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a90b8b35-8d21-472e-b073-a2887f5cb5cc-web-config\") pod \"alertmanager-main-0\" (UID: \"a90b8b35-8d21-472e-b073-a2887f5cb5cc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:40:32.133947 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:32.133911 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a90b8b35-8d21-472e-b073-a2887f5cb5cc-config-out\") pod \"alertmanager-main-0\" (UID: \"a90b8b35-8d21-472e-b073-a2887f5cb5cc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:40:32.133947 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:32.133937 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a90b8b35-8d21-472e-b073-a2887f5cb5cc-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a90b8b35-8d21-472e-b073-a2887f5cb5cc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:40:32.134194 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:32.133971 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a90b8b35-8d21-472e-b073-a2887f5cb5cc-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a90b8b35-8d21-472e-b073-a2887f5cb5cc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:40:32.134194 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:32.133998 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a90b8b35-8d21-472e-b073-a2887f5cb5cc-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a90b8b35-8d21-472e-b073-a2887f5cb5cc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:40:32.134194 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:32.134030 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a90b8b35-8d21-472e-b073-a2887f5cb5cc-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a90b8b35-8d21-472e-b073-a2887f5cb5cc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:40:32.134194 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:32.134064 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a90b8b35-8d21-472e-b073-a2887f5cb5cc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a90b8b35-8d21-472e-b073-a2887f5cb5cc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:40:32.134194 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:32.134095 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a90b8b35-8d21-472e-b073-a2887f5cb5cc-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a90b8b35-8d21-472e-b073-a2887f5cb5cc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:40:32.134194 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:32.134124 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a90b8b35-8d21-472e-b073-a2887f5cb5cc-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a90b8b35-8d21-472e-b073-a2887f5cb5cc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:40:32.134194 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:32.134169 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lj2vn\" (UniqueName: \"kubernetes.io/projected/a90b8b35-8d21-472e-b073-a2887f5cb5cc-kube-api-access-lj2vn\") pod \"alertmanager-main-0\" (UID: \"a90b8b35-8d21-472e-b073-a2887f5cb5cc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:40:32.134555 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:32.134220 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a90b8b35-8d21-472e-b073-a2887f5cb5cc-config-volume\") pod \"alertmanager-main-0\" (UID: \"a90b8b35-8d21-472e-b073-a2887f5cb5cc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:40:32.134555 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:32.134259 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a90b8b35-8d21-472e-b073-a2887f5cb5cc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a90b8b35-8d21-472e-b073-a2887f5cb5cc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:40:32.134555 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:32.134277 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a90b8b35-8d21-472e-b073-a2887f5cb5cc-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a90b8b35-8d21-472e-b073-a2887f5cb5cc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:40:32.235674 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:32.235636 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a90b8b35-8d21-472e-b073-a2887f5cb5cc-config-volume\") pod \"alertmanager-main-0\" (UID: \"a90b8b35-8d21-472e-b073-a2887f5cb5cc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:40:32.235905 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:32.235711 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a90b8b35-8d21-472e-b073-a2887f5cb5cc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a90b8b35-8d21-472e-b073-a2887f5cb5cc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:40:32.235905 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:32.235738 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a90b8b35-8d21-472e-b073-a2887f5cb5cc-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a90b8b35-8d21-472e-b073-a2887f5cb5cc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:40:32.235905 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:32.235788 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a90b8b35-8d21-472e-b073-a2887f5cb5cc-web-config\") pod \"alertmanager-main-0\" (UID: \"a90b8b35-8d21-472e-b073-a2887f5cb5cc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:40:32.235905 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:32.235823 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a90b8b35-8d21-472e-b073-a2887f5cb5cc-config-out\") pod \"alertmanager-main-0\" (UID: \"a90b8b35-8d21-472e-b073-a2887f5cb5cc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:40:32.235905 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:32.235885 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a90b8b35-8d21-472e-b073-a2887f5cb5cc-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a90b8b35-8d21-472e-b073-a2887f5cb5cc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:40:32.235905 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:32.235908 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a90b8b35-8d21-472e-b073-a2887f5cb5cc-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a90b8b35-8d21-472e-b073-a2887f5cb5cc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:40:32.236218 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:32.235932 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a90b8b35-8d21-472e-b073-a2887f5cb5cc-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a90b8b35-8d21-472e-b073-a2887f5cb5cc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:40:32.236218 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:32.235966 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a90b8b35-8d21-472e-b073-a2887f5cb5cc-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a90b8b35-8d21-472e-b073-a2887f5cb5cc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:40:32.236218 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:32.235997 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a90b8b35-8d21-472e-b073-a2887f5cb5cc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a90b8b35-8d21-472e-b073-a2887f5cb5cc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:40:32.236218 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:32.236029 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a90b8b35-8d21-472e-b073-a2887f5cb5cc-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a90b8b35-8d21-472e-b073-a2887f5cb5cc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:40:32.236218 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:32.236062 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a90b8b35-8d21-472e-b073-a2887f5cb5cc-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a90b8b35-8d21-472e-b073-a2887f5cb5cc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:40:32.236218 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:32.236105 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lj2vn\" (UniqueName: \"kubernetes.io/projected/a90b8b35-8d21-472e-b073-a2887f5cb5cc-kube-api-access-lj2vn\") pod \"alertmanager-main-0\" (UID: \"a90b8b35-8d21-472e-b073-a2887f5cb5cc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:40:32.236504 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:40:32.236229 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a90b8b35-8d21-472e-b073-a2887f5cb5cc-alertmanager-trusted-ca-bundle podName:a90b8b35-8d21-472e-b073-a2887f5cb5cc nodeName:}" failed. No retries permitted until 2026-06-02 12:40:32.736205027 +0000 UTC m=+62.653820120 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/a90b8b35-8d21-472e-b073-a2887f5cb5cc-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "a90b8b35-8d21-472e-b073-a2887f5cb5cc") : configmap references non-existent config key: ca-bundle.crt Jun 02 12:40:32.236740 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:32.236698 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a90b8b35-8d21-472e-b073-a2887f5cb5cc-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a90b8b35-8d21-472e-b073-a2887f5cb5cc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:40:32.237712 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:32.237073 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a90b8b35-8d21-472e-b073-a2887f5cb5cc-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a90b8b35-8d21-472e-b073-a2887f5cb5cc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:40:32.240212 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:32.240175 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a90b8b35-8d21-472e-b073-a2887f5cb5cc-config-volume\") pod \"alertmanager-main-0\" (UID: \"a90b8b35-8d21-472e-b073-a2887f5cb5cc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:40:32.240956 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:32.240728 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a90b8b35-8d21-472e-b073-a2887f5cb5cc-config-out\") pod \"alertmanager-main-0\" (UID: \"a90b8b35-8d21-472e-b073-a2887f5cb5cc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:40:32.240956 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:32.240882 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a90b8b35-8d21-472e-b073-a2887f5cb5cc-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a90b8b35-8d21-472e-b073-a2887f5cb5cc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:40:32.241107 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:32.241024 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a90b8b35-8d21-472e-b073-a2887f5cb5cc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a90b8b35-8d21-472e-b073-a2887f5cb5cc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:40:32.241107 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:32.241091 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a90b8b35-8d21-472e-b073-a2887f5cb5cc-web-config\") pod \"alertmanager-main-0\" (UID: \"a90b8b35-8d21-472e-b073-a2887f5cb5cc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:40:32.241633 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:32.241591 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a90b8b35-8d21-472e-b073-a2887f5cb5cc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a90b8b35-8d21-472e-b073-a2887f5cb5cc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:40:32.242276 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:32.242194 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a90b8b35-8d21-472e-b073-a2887f5cb5cc-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a90b8b35-8d21-472e-b073-a2887f5cb5cc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:40:32.242674 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:32.242623 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a90b8b35-8d21-472e-b073-a2887f5cb5cc-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a90b8b35-8d21-472e-b073-a2887f5cb5cc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:40:32.243205 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:32.243166 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a90b8b35-8d21-472e-b073-a2887f5cb5cc-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a90b8b35-8d21-472e-b073-a2887f5cb5cc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:40:32.245219 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:32.245169 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lj2vn\" (UniqueName: \"kubernetes.io/projected/a90b8b35-8d21-472e-b073-a2887f5cb5cc-kube-api-access-lj2vn\") pod \"alertmanager-main-0\" (UID: \"a90b8b35-8d21-472e-b073-a2887f5cb5cc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:40:32.739925 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:32.739882 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a90b8b35-8d21-472e-b073-a2887f5cb5cc-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a90b8b35-8d21-472e-b073-a2887f5cb5cc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:40:32.740858 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:32.740808 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a90b8b35-8d21-472e-b073-a2887f5cb5cc-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a90b8b35-8d21-472e-b073-a2887f5cb5cc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:40:32.880969 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:32.880939 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-q84kk" Jun 02 12:40:32.918918 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:32.918872 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-mfc4d" event={"ID":"2cbe8332-2bf5-4725-8973-310bfeae787b","Type":"ContainerStarted","Data":"b7003ffb35f0db55d7b6e6a634f4701ee503606328aadf02382aab60803d58c9"} Jun 02 12:40:32.920424 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:32.920396 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-46jp4" event={"ID":"c6fe1151-3fa5-45d6-baf6-773d6dbcc40d","Type":"ContainerStarted","Data":"ec7f1c10366dd87497d05657ccabbdfb51f08703077de93e34f3214ae3b2d787"} Jun 02 12:40:32.920543 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:32.920432 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-46jp4" event={"ID":"c6fe1151-3fa5-45d6-baf6-773d6dbcc40d","Type":"ContainerStarted","Data":"3e47c7b0e6a071810998c56ecabbde12a83ad5d1d264a238b8a05190cba2259d"} Jun 02 12:40:32.965990 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:32.965950 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:40:34.013465 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:34.013396 2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6896675589-25jf5"] Jun 02 12:40:34.031625 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:34.031602 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6896675589-25jf5"] Jun 02 12:40:34.031754 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:34.031743 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6896675589-25jf5" Jun 02 12:40:34.034213 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:34.034187 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 02 12:40:34.034333 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:34.034301 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 02 12:40:34.034394 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:34.034336 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 02 12:40:34.034719 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:34.034696 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 02 12:40:34.034808 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:34.034742 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-78r7aqa04huaf\"" Jun 02 12:40:34.034912 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:34.034861 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 02 12:40:34.034912 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:34.034870 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-wd7bj\"" Jun 02 12:40:34.050155 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:34.050130 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a55432b3-ae2e-47a6-a79e-ee36eddcd330-metrics-client-ca\") pod \"thanos-querier-6896675589-25jf5\" (UID: \"a55432b3-ae2e-47a6-a79e-ee36eddcd330\") " pod="openshift-monitoring/thanos-querier-6896675589-25jf5" Jun 02 12:40:34.050239 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:34.050205 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a55432b3-ae2e-47a6-a79e-ee36eddcd330-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6896675589-25jf5\" (UID: \"a55432b3-ae2e-47a6-a79e-ee36eddcd330\") " pod="openshift-monitoring/thanos-querier-6896675589-25jf5" Jun 02 12:40:34.050290 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:34.050253 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a55432b3-ae2e-47a6-a79e-ee36eddcd330-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6896675589-25jf5\" (UID: \"a55432b3-ae2e-47a6-a79e-ee36eddcd330\") " pod="openshift-monitoring/thanos-querier-6896675589-25jf5" Jun 02 12:40:34.050331 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:34.050293 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxw6m\" (UniqueName: \"kubernetes.io/projected/a55432b3-ae2e-47a6-a79e-ee36eddcd330-kube-api-access-rxw6m\") pod \"thanos-querier-6896675589-25jf5\" (UID: \"a55432b3-ae2e-47a6-a79e-ee36eddcd330\") " pod="openshift-monitoring/thanos-querier-6896675589-25jf5" Jun 02 12:40:34.050397 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:34.050377 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a55432b3-ae2e-47a6-a79e-ee36eddcd330-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6896675589-25jf5\" (UID: \"a55432b3-ae2e-47a6-a79e-ee36eddcd330\") " pod="openshift-monitoring/thanos-querier-6896675589-25jf5" Jun 02 12:40:34.050436 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:34.050411 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a55432b3-ae2e-47a6-a79e-ee36eddcd330-secret-grpc-tls\") pod \"thanos-querier-6896675589-25jf5\" (UID: \"a55432b3-ae2e-47a6-a79e-ee36eddcd330\") " pod="openshift-monitoring/thanos-querier-6896675589-25jf5" Jun 02 12:40:34.050466 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:34.050434 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a55432b3-ae2e-47a6-a79e-ee36eddcd330-secret-thanos-querier-tls\") pod \"thanos-querier-6896675589-25jf5\" (UID: \"a55432b3-ae2e-47a6-a79e-ee36eddcd330\") " pod="openshift-monitoring/thanos-querier-6896675589-25jf5" Jun 02 12:40:34.050466 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:34.050454 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a55432b3-ae2e-47a6-a79e-ee36eddcd330-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6896675589-25jf5\" (UID: \"a55432b3-ae2e-47a6-a79e-ee36eddcd330\") " pod="openshift-monitoring/thanos-querier-6896675589-25jf5" Jun 02 12:40:34.151556 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:34.151525 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a55432b3-ae2e-47a6-a79e-ee36eddcd330-metrics-client-ca\") pod \"thanos-querier-6896675589-25jf5\" (UID: \"a55432b3-ae2e-47a6-a79e-ee36eddcd330\") " pod="openshift-monitoring/thanos-querier-6896675589-25jf5" Jun 02 12:40:34.151714 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:34.151591 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a55432b3-ae2e-47a6-a79e-ee36eddcd330-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6896675589-25jf5\" (UID: \"a55432b3-ae2e-47a6-a79e-ee36eddcd330\") " pod="openshift-monitoring/thanos-querier-6896675589-25jf5" Jun 02 12:40:34.151714 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:34.151636 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a55432b3-ae2e-47a6-a79e-ee36eddcd330-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6896675589-25jf5\" (UID: \"a55432b3-ae2e-47a6-a79e-ee36eddcd330\") " pod="openshift-monitoring/thanos-querier-6896675589-25jf5" Jun 02 12:40:34.151714 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:34.151669 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rxw6m\" (UniqueName: \"kubernetes.io/projected/a55432b3-ae2e-47a6-a79e-ee36eddcd330-kube-api-access-rxw6m\") pod \"thanos-querier-6896675589-25jf5\" (UID: \"a55432b3-ae2e-47a6-a79e-ee36eddcd330\") " pod="openshift-monitoring/thanos-querier-6896675589-25jf5" Jun 02 12:40:34.151893 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:34.151719 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a55432b3-ae2e-47a6-a79e-ee36eddcd330-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6896675589-25jf5\" (UID: \"a55432b3-ae2e-47a6-a79e-ee36eddcd330\") " pod="openshift-monitoring/thanos-querier-6896675589-25jf5" Jun 02 12:40:34.151893 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:34.151752 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a55432b3-ae2e-47a6-a79e-ee36eddcd330-secret-grpc-tls\") pod \"thanos-querier-6896675589-25jf5\" (UID: \"a55432b3-ae2e-47a6-a79e-ee36eddcd330\") " pod="openshift-monitoring/thanos-querier-6896675589-25jf5" Jun 02 12:40:34.151893 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:34.151782 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a55432b3-ae2e-47a6-a79e-ee36eddcd330-secret-thanos-querier-tls\") pod \"thanos-querier-6896675589-25jf5\" (UID: \"a55432b3-ae2e-47a6-a79e-ee36eddcd330\") " pod="openshift-monitoring/thanos-querier-6896675589-25jf5" Jun 02 12:40:34.151893 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:34.151811 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a55432b3-ae2e-47a6-a79e-ee36eddcd330-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6896675589-25jf5\" (UID: \"a55432b3-ae2e-47a6-a79e-ee36eddcd330\") " pod="openshift-monitoring/thanos-querier-6896675589-25jf5" Jun 02 12:40:34.152339 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:34.152309 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a55432b3-ae2e-47a6-a79e-ee36eddcd330-metrics-client-ca\") pod \"thanos-querier-6896675589-25jf5\" (UID: \"a55432b3-ae2e-47a6-a79e-ee36eddcd330\") " pod="openshift-monitoring/thanos-querier-6896675589-25jf5" Jun 02 12:40:34.154720 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:34.154664 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a55432b3-ae2e-47a6-a79e-ee36eddcd330-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6896675589-25jf5\" (UID: \"a55432b3-ae2e-47a6-a79e-ee36eddcd330\") " pod="openshift-monitoring/thanos-querier-6896675589-25jf5" Jun 02 12:40:34.154854 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:34.154723 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a55432b3-ae2e-47a6-a79e-ee36eddcd330-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6896675589-25jf5\" (UID: \"a55432b3-ae2e-47a6-a79e-ee36eddcd330\") " pod="openshift-monitoring/thanos-querier-6896675589-25jf5" Jun 02 12:40:34.154986 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:34.154964 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a55432b3-ae2e-47a6-a79e-ee36eddcd330-secret-thanos-querier-tls\") pod \"thanos-querier-6896675589-25jf5\" (UID: \"a55432b3-ae2e-47a6-a79e-ee36eddcd330\") " pod="openshift-monitoring/thanos-querier-6896675589-25jf5" Jun 02 12:40:34.155048 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:34.154981 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a55432b3-ae2e-47a6-a79e-ee36eddcd330-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6896675589-25jf5\" (UID: \"a55432b3-ae2e-47a6-a79e-ee36eddcd330\") " pod="openshift-monitoring/thanos-querier-6896675589-25jf5" Jun 02 12:40:34.155048 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:34.154971 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a55432b3-ae2e-47a6-a79e-ee36eddcd330-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6896675589-25jf5\" (UID: \"a55432b3-ae2e-47a6-a79e-ee36eddcd330\") " pod="openshift-monitoring/thanos-querier-6896675589-25jf5" Jun 02 12:40:34.155561 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:34.155543 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a55432b3-ae2e-47a6-a79e-ee36eddcd330-secret-grpc-tls\") pod \"thanos-querier-6896675589-25jf5\" (UID: \"a55432b3-ae2e-47a6-a79e-ee36eddcd330\") " pod="openshift-monitoring/thanos-querier-6896675589-25jf5" Jun 02 12:40:34.160653 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:34.160622 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxw6m\" (UniqueName: \"kubernetes.io/projected/a55432b3-ae2e-47a6-a79e-ee36eddcd330-kube-api-access-rxw6m\") pod \"thanos-querier-6896675589-25jf5\" (UID: \"a55432b3-ae2e-47a6-a79e-ee36eddcd330\") " pod="openshift-monitoring/thanos-querier-6896675589-25jf5" Jun 02 12:40:34.341425 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:34.341348 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6896675589-25jf5" Jun 02 12:40:34.626799 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:34.626773 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 12:40:34.629918 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:40:34.629892 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda90b8b35_8d21_472e_b073_a2887f5cb5cc.slice/crio-e5867b4c59606778f1ae2f4a7d7f12bd4cc096ef458a4ef5d7ad73f8c5a73039 WatchSource:0}: Error finding container e5867b4c59606778f1ae2f4a7d7f12bd4cc096ef458a4ef5d7ad73f8c5a73039: Status 404 returned error can't find the container with id e5867b4c59606778f1ae2f4a7d7f12bd4cc096ef458a4ef5d7ad73f8c5a73039 Jun 02 12:40:34.639180 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:34.639160 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6896675589-25jf5"] Jun 02 12:40:34.641350 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:40:34.641326 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda55432b3_ae2e_47a6_a79e_ee36eddcd330.slice/crio-91af93359368cc4b52712480a766c561662adb9fdb225100825961bbf09a22a0 WatchSource:0}: Error finding container 91af93359368cc4b52712480a766c561662adb9fdb225100825961bbf09a22a0: Status 404 returned error can't find the container with id 91af93359368cc4b52712480a766c561662adb9fdb225100825961bbf09a22a0 Jun 02 12:40:34.927996 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:34.927965 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-mfc4d" event={"ID":"2cbe8332-2bf5-4725-8973-310bfeae787b","Type":"ContainerStarted","Data":"d961697d36b9616b965cc49efd6efd72c009b291208254c3701391ea685cbd85"} Jun 02 12:40:34.929129 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:34.929107 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6896675589-25jf5" event={"ID":"a55432b3-ae2e-47a6-a79e-ee36eddcd330","Type":"ContainerStarted","Data":"91af93359368cc4b52712480a766c561662adb9fdb225100825961bbf09a22a0"} Jun 02 12:40:34.930514 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:34.930489 2545 generic.go:358] "Generic (PLEG): container finished" podID="2a5c8f65-1825-4ccb-88b6-806b2203fca0" containerID="032cf83acbe7d2636eb687ee44f9fb78843b5dad8b9c15c9f7f20a9701d60363" exitCode=0 Jun 02 12:40:34.930606 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:34.930570 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v5cjj" event={"ID":"2a5c8f65-1825-4ccb-88b6-806b2203fca0","Type":"ContainerDied","Data":"032cf83acbe7d2636eb687ee44f9fb78843b5dad8b9c15c9f7f20a9701d60363"} Jun 02 12:40:34.932299 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:34.932271 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-46jp4" event={"ID":"c6fe1151-3fa5-45d6-baf6-773d6dbcc40d","Type":"ContainerStarted","Data":"4bdde5c428ba0dd786ea9e1724bf5edd87113117a8806390e212fc5892f20a5f"} Jun 02 12:40:34.933472 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:34.933448 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a90b8b35-8d21-472e-b073-a2887f5cb5cc","Type":"ContainerStarted","Data":"e5867b4c59606778f1ae2f4a7d7f12bd4cc096ef458a4ef5d7ad73f8c5a73039"} Jun 02 12:40:34.935049 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:34.934994 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7758dbbf8b-52rx4" event={"ID":"c7436547-622e-49df-afc9-c12b4886dd85","Type":"ContainerStarted","Data":"8ed8fab40c9b1b60fed3d5441ad23076fb7815c9d90cb1f49c728497884a84b8"} Jun 02 12:40:34.969563 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:34.969472 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-7758dbbf8b-52rx4" podStartSLOduration=1.3670047379999999 podStartE2EDuration="5.969451423s" podCreationTimestamp="2026-06-02 12:40:29 +0000 UTC" firstStartedPulling="2026-06-02 12:40:29.877025679 +0000 UTC m=+59.794640752" lastFinishedPulling="2026-06-02 12:40:34.479472348 +0000 UTC m=+64.397087437" observedRunningTime="2026-06-02 12:40:34.968664475 +0000 UTC m=+64.886279583" watchObservedRunningTime="2026-06-02 12:40:34.969451423 +0000 UTC m=+64.887066519" Jun 02 12:40:35.333868 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:35.332929 2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5c6c7d459-l4vwr"] Jun 02 12:40:35.355896 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:35.355139 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5c6c7d459-l4vwr"] Jun 02 12:40:35.355896 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:35.355288 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5c6c7d459-l4vwr" Jun 02 12:40:35.358429 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:35.358187 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 02 12:40:35.358429 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:35.358205 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 02 12:40:35.358429 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:35.358380 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 02 12:40:35.358672 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:35.358520 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 02 12:40:35.358672 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:35.358595 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-5ltplmu0s96up\"" Jun 02 12:40:35.358778 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:35.358714 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-86wt2\"" Jun 02 12:40:35.463419 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:35.463329 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ac4a9cbe-a8e7-43b7-bed7-493148569aba-secret-metrics-server-client-certs\") pod \"metrics-server-5c6c7d459-l4vwr\" (UID: \"ac4a9cbe-a8e7-43b7-bed7-493148569aba\") " pod="openshift-monitoring/metrics-server-5c6c7d459-l4vwr" Jun 02 12:40:35.463419 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:35.463389 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac4a9cbe-a8e7-43b7-bed7-493148569aba-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5c6c7d459-l4vwr\" (UID: \"ac4a9cbe-a8e7-43b7-bed7-493148569aba\") " pod="openshift-monitoring/metrics-server-5c6c7d459-l4vwr" Jun 02 12:40:35.463632 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:35.463468 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ac4a9cbe-a8e7-43b7-bed7-493148569aba-audit-log\") pod \"metrics-server-5c6c7d459-l4vwr\" (UID: \"ac4a9cbe-a8e7-43b7-bed7-493148569aba\") " pod="openshift-monitoring/metrics-server-5c6c7d459-l4vwr" Jun 02 12:40:35.463632 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:35.463517 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ac4a9cbe-a8e7-43b7-bed7-493148569aba-metrics-server-audit-profiles\") pod \"metrics-server-5c6c7d459-l4vwr\" (UID: \"ac4a9cbe-a8e7-43b7-bed7-493148569aba\") " pod="openshift-monitoring/metrics-server-5c6c7d459-l4vwr" Jun 02 12:40:35.463632 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:35.463559 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7f26c\" (UniqueName: \"kubernetes.io/projected/ac4a9cbe-a8e7-43b7-bed7-493148569aba-kube-api-access-7f26c\") pod \"metrics-server-5c6c7d459-l4vwr\" (UID: \"ac4a9cbe-a8e7-43b7-bed7-493148569aba\") " pod="openshift-monitoring/metrics-server-5c6c7d459-l4vwr" Jun 02 12:40:35.463632 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:35.463595 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ac4a9cbe-a8e7-43b7-bed7-493148569aba-secret-metrics-server-tls\") pod \"metrics-server-5c6c7d459-l4vwr\" (UID: \"ac4a9cbe-a8e7-43b7-bed7-493148569aba\") " pod="openshift-monitoring/metrics-server-5c6c7d459-l4vwr" Jun 02 12:40:35.463833 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:35.463708 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ac4a9cbe-a8e7-43b7-bed7-493148569aba-client-ca-bundle\") pod \"metrics-server-5c6c7d459-l4vwr\" (UID: \"ac4a9cbe-a8e7-43b7-bed7-493148569aba\") " pod="openshift-monitoring/metrics-server-5c6c7d459-l4vwr" Jun 02 12:40:35.564706 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:35.564659 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7f26c\" (UniqueName: \"kubernetes.io/projected/ac4a9cbe-a8e7-43b7-bed7-493148569aba-kube-api-access-7f26c\") pod \"metrics-server-5c6c7d459-l4vwr\" (UID: \"ac4a9cbe-a8e7-43b7-bed7-493148569aba\") " pod="openshift-monitoring/metrics-server-5c6c7d459-l4vwr" Jun 02 12:40:35.564888 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:35.564711 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ac4a9cbe-a8e7-43b7-bed7-493148569aba-secret-metrics-server-tls\") pod \"metrics-server-5c6c7d459-l4vwr\" (UID: \"ac4a9cbe-a8e7-43b7-bed7-493148569aba\") " pod="openshift-monitoring/metrics-server-5c6c7d459-l4vwr" Jun 02 12:40:35.564888 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:35.564802 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ac4a9cbe-a8e7-43b7-bed7-493148569aba-client-ca-bundle\") pod \"metrics-server-5c6c7d459-l4vwr\" (UID: \"ac4a9cbe-a8e7-43b7-bed7-493148569aba\") " pod="openshift-monitoring/metrics-server-5c6c7d459-l4vwr" Jun 02 12:40:35.564888 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:35.564875 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ac4a9cbe-a8e7-43b7-bed7-493148569aba-secret-metrics-server-client-certs\") pod \"metrics-server-5c6c7d459-l4vwr\" (UID: \"ac4a9cbe-a8e7-43b7-bed7-493148569aba\") " pod="openshift-monitoring/metrics-server-5c6c7d459-l4vwr" Jun 02 12:40:35.565059 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:35.564912 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac4a9cbe-a8e7-43b7-bed7-493148569aba-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5c6c7d459-l4vwr\" (UID: \"ac4a9cbe-a8e7-43b7-bed7-493148569aba\") " pod="openshift-monitoring/metrics-server-5c6c7d459-l4vwr" Jun 02 12:40:35.565059 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:35.564950 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ac4a9cbe-a8e7-43b7-bed7-493148569aba-audit-log\") pod \"metrics-server-5c6c7d459-l4vwr\" (UID: \"ac4a9cbe-a8e7-43b7-bed7-493148569aba\") " pod="openshift-monitoring/metrics-server-5c6c7d459-l4vwr" Jun 02 12:40:35.565059 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:35.564985 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ac4a9cbe-a8e7-43b7-bed7-493148569aba-metrics-server-audit-profiles\") pod \"metrics-server-5c6c7d459-l4vwr\" (UID: \"ac4a9cbe-a8e7-43b7-bed7-493148569aba\") " pod="openshift-monitoring/metrics-server-5c6c7d459-l4vwr" Jun 02 12:40:35.566110 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:35.566025 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ac4a9cbe-a8e7-43b7-bed7-493148569aba-metrics-server-audit-profiles\") pod \"metrics-server-5c6c7d459-l4vwr\" (UID: \"ac4a9cbe-a8e7-43b7-bed7-493148569aba\") " pod="openshift-monitoring/metrics-server-5c6c7d459-l4vwr" Jun 02 12:40:35.566505 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:35.566466 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ac4a9cbe-a8e7-43b7-bed7-493148569aba-audit-log\") pod \"metrics-server-5c6c7d459-l4vwr\" (UID: \"ac4a9cbe-a8e7-43b7-bed7-493148569aba\") " pod="openshift-monitoring/metrics-server-5c6c7d459-l4vwr" Jun 02 12:40:35.566638 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:35.566517 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac4a9cbe-a8e7-43b7-bed7-493148569aba-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5c6c7d459-l4vwr\" (UID: \"ac4a9cbe-a8e7-43b7-bed7-493148569aba\") " pod="openshift-monitoring/metrics-server-5c6c7d459-l4vwr" Jun 02 12:40:35.569957 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:35.569917 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ac4a9cbe-a8e7-43b7-bed7-493148569aba-secret-metrics-server-client-certs\") pod \"metrics-server-5c6c7d459-l4vwr\" (UID: \"ac4a9cbe-a8e7-43b7-bed7-493148569aba\") " pod="openshift-monitoring/metrics-server-5c6c7d459-l4vwr" Jun 02 12:40:35.570605 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:35.570495 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ac4a9cbe-a8e7-43b7-bed7-493148569aba-secret-metrics-server-tls\") pod \"metrics-server-5c6c7d459-l4vwr\" (UID: \"ac4a9cbe-a8e7-43b7-bed7-493148569aba\") " pod="openshift-monitoring/metrics-server-5c6c7d459-l4vwr" Jun 02 12:40:35.571806 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:35.571765 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ac4a9cbe-a8e7-43b7-bed7-493148569aba-client-ca-bundle\") pod \"metrics-server-5c6c7d459-l4vwr\" (UID: \"ac4a9cbe-a8e7-43b7-bed7-493148569aba\") " pod="openshift-monitoring/metrics-server-5c6c7d459-l4vwr" Jun 02 12:40:35.574148 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:35.574126 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7f26c\" (UniqueName: \"kubernetes.io/projected/ac4a9cbe-a8e7-43b7-bed7-493148569aba-kube-api-access-7f26c\") pod \"metrics-server-5c6c7d459-l4vwr\" (UID: \"ac4a9cbe-a8e7-43b7-bed7-493148569aba\") " pod="openshift-monitoring/metrics-server-5c6c7d459-l4vwr" Jun 02 12:40:35.668741 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:35.668709 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5c6c7d459-l4vwr" Jun 02 12:40:35.696075 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:35.696040 2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-w4p9l"] Jun 02 12:40:35.713865 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:35.713774 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-w4p9l"] Jun 02 12:40:35.714006 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:35.713941 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-w4p9l" Jun 02 12:40:35.716323 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:35.716111 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 02 12:40:35.716323 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:35.716279 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-qvzpx\"" Jun 02 12:40:35.766384 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:35.766352 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/10cd3d70-24b5-490f-a286-3c506f225186-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-w4p9l\" (UID: \"10cd3d70-24b5-490f-a286-3c506f225186\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-w4p9l" Jun 02 12:40:35.867398 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:35.867339 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/10cd3d70-24b5-490f-a286-3c506f225186-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-w4p9l\" (UID: \"10cd3d70-24b5-490f-a286-3c506f225186\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-w4p9l" Jun 02 12:40:35.867580 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:40:35.867515 2545 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 02 12:40:35.867698 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:40:35.867602 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10cd3d70-24b5-490f-a286-3c506f225186-monitoring-plugin-cert podName:10cd3d70-24b5-490f-a286-3c506f225186 nodeName:}" failed. No retries permitted until 2026-06-02 12:40:36.367579273 +0000 UTC m=+66.285194363 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/10cd3d70-24b5-490f-a286-3c506f225186-monitoring-plugin-cert") pod "monitoring-plugin-5768fcc9dd-w4p9l" (UID: "10cd3d70-24b5-490f-a286-3c506f225186") : secret "monitoring-plugin-cert" not found Jun 02 12:40:35.940141 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:35.940080 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-mfc4d" event={"ID":"2cbe8332-2bf5-4725-8973-310bfeae787b","Type":"ContainerStarted","Data":"3b3ba6a67e4fff2c629853026451387d1c27bc3e2f1830d625ce8822fe12d8a5"} Jun 02 12:40:35.940141 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:35.940124 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-mfc4d" event={"ID":"2cbe8332-2bf5-4725-8973-310bfeae787b","Type":"ContainerStarted","Data":"4003bbee5f02930a9438946feae9b153423e35ef1cc579ca0f81d1495ffe2024"} Jun 02 12:40:35.942958 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:35.942920 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v5cjj" event={"ID":"2a5c8f65-1825-4ccb-88b6-806b2203fca0","Type":"ContainerStarted","Data":"64dd992478917ecc8b35d6ab5e15bfb737a141ae63f9e86250c2412147bc6c15"} Jun 02 12:40:35.943097 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:35.942964 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v5cjj" event={"ID":"2a5c8f65-1825-4ccb-88b6-806b2203fca0","Type":"ContainerStarted","Data":"fdf16179732d6b9dc5fb8db02b39da24fd66eea035a061417c888a2a16aed7a3"} Jun 02 12:40:35.957732 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:35.957690 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-8469c486bb-mfc4d" podStartSLOduration=3.195728172 podStartE2EDuration="5.957674512s" podCreationTimestamp="2026-06-02 12:40:30 +0000 UTC" firstStartedPulling="2026-06-02 12:40:32.056539328 +0000 UTC m=+61.974154499" lastFinishedPulling="2026-06-02 12:40:34.818485752 +0000 UTC m=+64.736100839" observedRunningTime="2026-06-02 12:40:35.956437688 +0000 UTC m=+65.874052796" watchObservedRunningTime="2026-06-02 12:40:35.957674512 +0000 UTC m=+65.875289609" Jun 02 12:40:35.975417 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:35.975336 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-v5cjj" podStartSLOduration=2.7907211910000003 podStartE2EDuration="5.975323306s" podCreationTimestamp="2026-06-02 12:40:30 +0000 UTC" firstStartedPulling="2026-06-02 12:40:31.294132825 +0000 UTC m=+61.211747903" lastFinishedPulling="2026-06-02 12:40:34.478734917 +0000 UTC m=+64.396350018" observedRunningTime="2026-06-02 12:40:35.974120298 +0000 UTC m=+65.891735394" watchObservedRunningTime="2026-06-02 12:40:35.975323306 +0000 UTC m=+65.892938401" Jun 02 12:40:36.138542 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:36.138508 2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7cdbfff797-bhlnw"] Jun 02 12:40:36.142443 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:36.142421 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7cdbfff797-bhlnw" Jun 02 12:40:36.144985 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:36.144960 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 02 12:40:36.145124 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:36.145063 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 02 12:40:36.145124 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:36.145111 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 02 12:40:36.145249 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:36.145198 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 02 12:40:36.145249 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:36.145237 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-8tf6h\"" Jun 02 12:40:36.145355 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:36.145279 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 02 12:40:36.150284 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:36.150260 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 02 12:40:36.153920 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:36.153896 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7cdbfff797-bhlnw"] Jun 02 12:40:36.170532 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:36.170509 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f12e91cc-0524-40d7-9dd3-1360f8095dd3-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7cdbfff797-bhlnw\" (UID: \"f12e91cc-0524-40d7-9dd3-1360f8095dd3\") " pod="openshift-monitoring/telemeter-client-7cdbfff797-bhlnw" Jun 02 12:40:36.170647 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:36.170548 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f12e91cc-0524-40d7-9dd3-1360f8095dd3-telemeter-client-tls\") pod \"telemeter-client-7cdbfff797-bhlnw\" (UID: \"f12e91cc-0524-40d7-9dd3-1360f8095dd3\") " pod="openshift-monitoring/telemeter-client-7cdbfff797-bhlnw" Jun 02 12:40:36.170647 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:36.170576 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f12e91cc-0524-40d7-9dd3-1360f8095dd3-federate-client-tls\") pod \"telemeter-client-7cdbfff797-bhlnw\" (UID: \"f12e91cc-0524-40d7-9dd3-1360f8095dd3\") " pod="openshift-monitoring/telemeter-client-7cdbfff797-bhlnw" Jun 02 12:40:36.170765 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:36.170743 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f12e91cc-0524-40d7-9dd3-1360f8095dd3-secret-telemeter-client\") pod \"telemeter-client-7cdbfff797-bhlnw\" (UID: \"f12e91cc-0524-40d7-9dd3-1360f8095dd3\") " pod="openshift-monitoring/telemeter-client-7cdbfff797-bhlnw" Jun 02 12:40:36.170818 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:36.170793 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f12e91cc-0524-40d7-9dd3-1360f8095dd3-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7cdbfff797-bhlnw\" (UID: \"f12e91cc-0524-40d7-9dd3-1360f8095dd3\") " pod="openshift-monitoring/telemeter-client-7cdbfff797-bhlnw" Jun 02 12:40:36.170912 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:36.170891 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f12e91cc-0524-40d7-9dd3-1360f8095dd3-serving-certs-ca-bundle\") pod \"telemeter-client-7cdbfff797-bhlnw\" (UID: \"f12e91cc-0524-40d7-9dd3-1360f8095dd3\") " pod="openshift-monitoring/telemeter-client-7cdbfff797-bhlnw" Jun 02 12:40:36.170958 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:36.170929 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f12e91cc-0524-40d7-9dd3-1360f8095dd3-metrics-client-ca\") pod \"telemeter-client-7cdbfff797-bhlnw\" (UID: \"f12e91cc-0524-40d7-9dd3-1360f8095dd3\") " pod="openshift-monitoring/telemeter-client-7cdbfff797-bhlnw" Jun 02 12:40:36.171006 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:36.170955 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cn95t\" (UniqueName: \"kubernetes.io/projected/f12e91cc-0524-40d7-9dd3-1360f8095dd3-kube-api-access-cn95t\") pod \"telemeter-client-7cdbfff797-bhlnw\" (UID: \"f12e91cc-0524-40d7-9dd3-1360f8095dd3\") " pod="openshift-monitoring/telemeter-client-7cdbfff797-bhlnw" Jun 02 12:40:36.272178 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:36.272080 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f12e91cc-0524-40d7-9dd3-1360f8095dd3-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7cdbfff797-bhlnw\" (UID: \"f12e91cc-0524-40d7-9dd3-1360f8095dd3\") " pod="openshift-monitoring/telemeter-client-7cdbfff797-bhlnw" Jun 02 12:40:36.272178 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:36.272134 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f12e91cc-0524-40d7-9dd3-1360f8095dd3-telemeter-client-tls\") pod \"telemeter-client-7cdbfff797-bhlnw\" (UID: \"f12e91cc-0524-40d7-9dd3-1360f8095dd3\") " pod="openshift-monitoring/telemeter-client-7cdbfff797-bhlnw" Jun 02 12:40:36.272178 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:36.272164 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f12e91cc-0524-40d7-9dd3-1360f8095dd3-federate-client-tls\") pod \"telemeter-client-7cdbfff797-bhlnw\" (UID: \"f12e91cc-0524-40d7-9dd3-1360f8095dd3\") " pod="openshift-monitoring/telemeter-client-7cdbfff797-bhlnw" Jun 02 12:40:36.272448 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:36.272372 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f12e91cc-0524-40d7-9dd3-1360f8095dd3-secret-telemeter-client\") pod \"telemeter-client-7cdbfff797-bhlnw\" (UID: \"f12e91cc-0524-40d7-9dd3-1360f8095dd3\") " pod="openshift-monitoring/telemeter-client-7cdbfff797-bhlnw" Jun 02 12:40:36.272448 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:36.272418 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f12e91cc-0524-40d7-9dd3-1360f8095dd3-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7cdbfff797-bhlnw\" (UID: \"f12e91cc-0524-40d7-9dd3-1360f8095dd3\") " pod="openshift-monitoring/telemeter-client-7cdbfff797-bhlnw" Jun 02 12:40:36.272546 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:36.272453 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f12e91cc-0524-40d7-9dd3-1360f8095dd3-serving-certs-ca-bundle\") pod \"telemeter-client-7cdbfff797-bhlnw\" (UID: \"f12e91cc-0524-40d7-9dd3-1360f8095dd3\") " pod="openshift-monitoring/telemeter-client-7cdbfff797-bhlnw" Jun 02 12:40:36.272546 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:36.272487 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f12e91cc-0524-40d7-9dd3-1360f8095dd3-metrics-client-ca\") pod \"telemeter-client-7cdbfff797-bhlnw\" (UID: \"f12e91cc-0524-40d7-9dd3-1360f8095dd3\") " pod="openshift-monitoring/telemeter-client-7cdbfff797-bhlnw" Jun 02 12:40:36.272546 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:36.272523 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cn95t\" (UniqueName: \"kubernetes.io/projected/f12e91cc-0524-40d7-9dd3-1360f8095dd3-kube-api-access-cn95t\") pod \"telemeter-client-7cdbfff797-bhlnw\" (UID: \"f12e91cc-0524-40d7-9dd3-1360f8095dd3\") " pod="openshift-monitoring/telemeter-client-7cdbfff797-bhlnw" Jun 02 12:40:36.273412 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:36.273349 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f12e91cc-0524-40d7-9dd3-1360f8095dd3-serving-certs-ca-bundle\") pod \"telemeter-client-7cdbfff797-bhlnw\" (UID: \"f12e91cc-0524-40d7-9dd3-1360f8095dd3\") " pod="openshift-monitoring/telemeter-client-7cdbfff797-bhlnw" Jun 02 12:40:36.273533 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:36.273429 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f12e91cc-0524-40d7-9dd3-1360f8095dd3-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7cdbfff797-bhlnw\" (UID: \"f12e91cc-0524-40d7-9dd3-1360f8095dd3\") " pod="openshift-monitoring/telemeter-client-7cdbfff797-bhlnw" Jun 02 12:40:36.273533 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:36.273460 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f12e91cc-0524-40d7-9dd3-1360f8095dd3-metrics-client-ca\") pod \"telemeter-client-7cdbfff797-bhlnw\" (UID: \"f12e91cc-0524-40d7-9dd3-1360f8095dd3\") " pod="openshift-monitoring/telemeter-client-7cdbfff797-bhlnw" Jun 02 12:40:36.275489 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:36.275465 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f12e91cc-0524-40d7-9dd3-1360f8095dd3-federate-client-tls\") pod \"telemeter-client-7cdbfff797-bhlnw\" (UID: \"f12e91cc-0524-40d7-9dd3-1360f8095dd3\") " pod="openshift-monitoring/telemeter-client-7cdbfff797-bhlnw" Jun 02 12:40:36.275593 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:36.275543 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f12e91cc-0524-40d7-9dd3-1360f8095dd3-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7cdbfff797-bhlnw\" (UID: \"f12e91cc-0524-40d7-9dd3-1360f8095dd3\") " pod="openshift-monitoring/telemeter-client-7cdbfff797-bhlnw" Jun 02 12:40:36.275733 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:36.275714 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f12e91cc-0524-40d7-9dd3-1360f8095dd3-secret-telemeter-client\") pod \"telemeter-client-7cdbfff797-bhlnw\" (UID: \"f12e91cc-0524-40d7-9dd3-1360f8095dd3\") " pod="openshift-monitoring/telemeter-client-7cdbfff797-bhlnw" Jun 02 12:40:36.275810 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:36.275775 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f12e91cc-0524-40d7-9dd3-1360f8095dd3-telemeter-client-tls\") pod \"telemeter-client-7cdbfff797-bhlnw\" (UID: \"f12e91cc-0524-40d7-9dd3-1360f8095dd3\") " pod="openshift-monitoring/telemeter-client-7cdbfff797-bhlnw" Jun 02 12:40:36.280219 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:36.280198 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cn95t\" (UniqueName: \"kubernetes.io/projected/f12e91cc-0524-40d7-9dd3-1360f8095dd3-kube-api-access-cn95t\") pod \"telemeter-client-7cdbfff797-bhlnw\" (UID: \"f12e91cc-0524-40d7-9dd3-1360f8095dd3\") " pod="openshift-monitoring/telemeter-client-7cdbfff797-bhlnw" Jun 02 12:40:36.373945 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:36.373912 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10c4158d-e827-4403-8ba4-17672f978f94-metrics-certs\") pod \"network-metrics-daemon-rvddx\" (UID: \"10c4158d-e827-4403-8ba4-17672f978f94\") " pod="openshift-multus/network-metrics-daemon-rvddx" Jun 02 12:40:36.374403 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:36.373960 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/10cd3d70-24b5-490f-a286-3c506f225186-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-w4p9l\" (UID: \"10cd3d70-24b5-490f-a286-3c506f225186\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-w4p9l" Jun 02 12:40:36.376472 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:36.376448 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/10cd3d70-24b5-490f-a286-3c506f225186-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-w4p9l\" (UID: \"10cd3d70-24b5-490f-a286-3c506f225186\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-w4p9l" Jun 02 12:40:36.377428 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:36.377405 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 12:40:36.386464 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:36.386438 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10c4158d-e827-4403-8ba4-17672f978f94-metrics-certs\") pod \"network-metrics-daemon-rvddx\" (UID: \"10c4158d-e827-4403-8ba4-17672f978f94\") " pod="openshift-multus/network-metrics-daemon-rvddx" Jun 02 12:40:36.453241 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:36.453203 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7cdbfff797-bhlnw" Jun 02 12:40:36.575892 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:36.575786 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vfxrf\" (UniqueName: \"kubernetes.io/projected/61950c4e-c9a1-4c0d-af77-980423e1d1d8-kube-api-access-vfxrf\") pod \"network-check-target-q88nq\" (UID: \"61950c4e-c9a1-4c0d-af77-980423e1d1d8\") " pod="openshift-network-diagnostics/network-check-target-q88nq" Jun 02 12:40:36.578360 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:36.578340 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 12:40:36.590785 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:36.590760 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 12:40:36.600759 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:36.600732 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfxrf\" (UniqueName: \"kubernetes.io/projected/61950c4e-c9a1-4c0d-af77-980423e1d1d8-kube-api-access-vfxrf\") pod \"network-check-target-q88nq\" (UID: \"61950c4e-c9a1-4c0d-af77-980423e1d1d8\") " pod="openshift-network-diagnostics/network-check-target-q88nq" Jun 02 12:40:36.615923 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:36.615899 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-k267c\"" Jun 02 12:40:36.619489 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:36.619462 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hxrmw\"" Jun 02 12:40:36.623983 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:36.623963 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q88nq" Jun 02 12:40:36.627722 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:36.627699 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-w4p9l" Jun 02 12:40:36.627824 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:36.627794 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvddx" Jun 02 12:40:36.934991 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:36.930475 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5c6c7d459-l4vwr"] Jun 02 12:40:36.934991 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:36.932671 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-q88nq"] Jun 02 12:40:36.940529 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:40:36.935734 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac4a9cbe_a8e7_43b7_bed7_493148569aba.slice/crio-6cc06d5090467954504cd76dc26c5608388e6437bee070d9dae1665817bc6f0a WatchSource:0}: Error finding container 6cc06d5090467954504cd76dc26c5608388e6437bee070d9dae1665817bc6f0a: Status 404 returned error can't find the container with id 6cc06d5090467954504cd76dc26c5608388e6437bee070d9dae1665817bc6f0a Jun 02 12:40:36.950699 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:36.950653 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6896675589-25jf5" event={"ID":"a55432b3-ae2e-47a6-a79e-ee36eddcd330","Type":"ContainerStarted","Data":"a31d92de21e4b011eac0a2c424c05f7e1b1807a6211639f16368a6084d6154b0"} Jun 02 12:40:36.952186 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:36.952155 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5c6c7d459-l4vwr" event={"ID":"ac4a9cbe-a8e7-43b7-bed7-493148569aba","Type":"ContainerStarted","Data":"6cc06d5090467954504cd76dc26c5608388e6437bee070d9dae1665817bc6f0a"} Jun 02 12:40:36.954914 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:36.954870 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-46jp4" event={"ID":"c6fe1151-3fa5-45d6-baf6-773d6dbcc40d","Type":"ContainerStarted","Data":"d227be218ecd0119ca29c41f68c75f85704e0f236d29417451b68a49d1f4e9f1"} Jun 02 12:40:36.956913 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:36.956897 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-w4p9l"] Jun 02 12:40:36.958898 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:36.958758 2545 generic.go:358] "Generic (PLEG): container finished" podID="a90b8b35-8d21-472e-b073-a2887f5cb5cc" containerID="2c51dd68e9f28a35c2d86bdfd0758ee1a1325f30c76dcb44852e0b207e72f331" exitCode=0 Jun 02 12:40:36.958898 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:36.958829 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a90b8b35-8d21-472e-b073-a2887f5cb5cc","Type":"ContainerDied","Data":"2c51dd68e9f28a35c2d86bdfd0758ee1a1325f30c76dcb44852e0b207e72f331"} Jun 02 12:40:36.961593 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:36.961569 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-q88nq" event={"ID":"61950c4e-c9a1-4c0d-af77-980423e1d1d8","Type":"ContainerStarted","Data":"234098fc04db42d30b376d0381d389c1765f78018eda226459a0ec763b01fab3"} Jun 02 12:40:36.984307 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:36.984247 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-85658796db-46jp4" podStartSLOduration=4.855630792 podStartE2EDuration="6.984228813s" podCreationTimestamp="2026-06-02 12:40:30 +0000 UTC" firstStartedPulling="2026-06-02 12:40:34.579235605 +0000 UTC m=+64.496850681" lastFinishedPulling="2026-06-02 12:40:36.707833624 +0000 UTC m=+66.625448702" observedRunningTime="2026-06-02 12:40:36.975276187 +0000 UTC m=+66.892891283" watchObservedRunningTime="2026-06-02 12:40:36.984228813 +0000 UTC m=+66.901843909" Jun 02 12:40:36.986019 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:36.985996 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7cdbfff797-bhlnw"] Jun 02 12:40:36.988268 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:40:36.988237 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf12e91cc_0524_40d7_9dd3_1360f8095dd3.slice/crio-e1ecfe32f4992a1022de936afded6870d5ddd979fb57188f483d7089fc8a91de WatchSource:0}: Error finding container e1ecfe32f4992a1022de936afded6870d5ddd979fb57188f483d7089fc8a91de: Status 404 returned error can't find the container with id e1ecfe32f4992a1022de936afded6870d5ddd979fb57188f483d7089fc8a91de Jun 02 12:40:37.007825 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.007755 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rvddx"] Jun 02 12:40:37.016823 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:40:37.011924 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10c4158d_e827_4403_8ba4_17672f978f94.slice/crio-7b247c8e236f5fcd39dbd714321392c953f352108f067b998fe8976fbe70e1fa WatchSource:0}: Error finding container 7b247c8e236f5fcd39dbd714321392c953f352108f067b998fe8976fbe70e1fa: Status 404 returned error can't find the container with id 7b247c8e236f5fcd39dbd714321392c953f352108f067b998fe8976fbe70e1fa Jun 02 12:40:37.192802 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.192766 2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 12:40:37.196752 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.196723 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:40:37.200574 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.200553 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 02 12:40:37.200862 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.200828 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 02 12:40:37.200862 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.200826 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-72ehf7uv8sfqn\"" Jun 02 12:40:37.201160 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.201122 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 02 12:40:37.201266 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.201183 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 02 12:40:37.201340 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.201261 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 02 12:40:37.201340 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.201277 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 02 12:40:37.201599 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.201582 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 02 12:40:37.201599 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.201595 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 02 12:40:37.201736 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.201647 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 02 12:40:37.201879 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.201864 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-8p2nh\"" Jun 02 12:40:37.201996 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.201981 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 02 12:40:37.202409 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.202366 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 02 12:40:37.204725 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.204193 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 02 12:40:37.213477 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.213452 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 12:40:37.285435 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.285398 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8caf18b-5f4e-4cd3-9a55-89644414806e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f8caf18b-5f4e-4cd3-9a55-89644414806e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:40:37.285435 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.285432 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67dp8\" (UniqueName: \"kubernetes.io/projected/f8caf18b-5f4e-4cd3-9a55-89644414806e-kube-api-access-67dp8\") pod \"prometheus-k8s-0\" (UID: \"f8caf18b-5f4e-4cd3-9a55-89644414806e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:40:37.285669 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.285451 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f8caf18b-5f4e-4cd3-9a55-89644414806e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f8caf18b-5f4e-4cd3-9a55-89644414806e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:40:37.285669 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.285480 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f8caf18b-5f4e-4cd3-9a55-89644414806e-web-config\") pod \"prometheus-k8s-0\" (UID: \"f8caf18b-5f4e-4cd3-9a55-89644414806e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:40:37.285669 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.285577 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f8caf18b-5f4e-4cd3-9a55-89644414806e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f8caf18b-5f4e-4cd3-9a55-89644414806e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:40:37.285669 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.285607 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f8caf18b-5f4e-4cd3-9a55-89644414806e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f8caf18b-5f4e-4cd3-9a55-89644414806e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:40:37.285669 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.285633 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f8caf18b-5f4e-4cd3-9a55-89644414806e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f8caf18b-5f4e-4cd3-9a55-89644414806e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:40:37.285669 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.285655 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f8caf18b-5f4e-4cd3-9a55-89644414806e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f8caf18b-5f4e-4cd3-9a55-89644414806e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:40:37.285994 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.285680 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f8caf18b-5f4e-4cd3-9a55-89644414806e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f8caf18b-5f4e-4cd3-9a55-89644414806e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:40:37.285994 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.285725 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f8caf18b-5f4e-4cd3-9a55-89644414806e-config\") pod \"prometheus-k8s-0\" (UID: \"f8caf18b-5f4e-4cd3-9a55-89644414806e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:40:37.285994 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.285751 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f8caf18b-5f4e-4cd3-9a55-89644414806e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f8caf18b-5f4e-4cd3-9a55-89644414806e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:40:37.285994 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.285810 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8caf18b-5f4e-4cd3-9a55-89644414806e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f8caf18b-5f4e-4cd3-9a55-89644414806e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:40:37.285994 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.285830 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f8caf18b-5f4e-4cd3-9a55-89644414806e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f8caf18b-5f4e-4cd3-9a55-89644414806e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:40:37.285994 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.285878 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f8caf18b-5f4e-4cd3-9a55-89644414806e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f8caf18b-5f4e-4cd3-9a55-89644414806e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:40:37.285994 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.285898 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8caf18b-5f4e-4cd3-9a55-89644414806e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f8caf18b-5f4e-4cd3-9a55-89644414806e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:40:37.285994 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.285915 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f8caf18b-5f4e-4cd3-9a55-89644414806e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f8caf18b-5f4e-4cd3-9a55-89644414806e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:40:37.285994 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.285932 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f8caf18b-5f4e-4cd3-9a55-89644414806e-config-out\") pod \"prometheus-k8s-0\" (UID: \"f8caf18b-5f4e-4cd3-9a55-89644414806e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:40:37.285994 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.285958 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8caf18b-5f4e-4cd3-9a55-89644414806e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f8caf18b-5f4e-4cd3-9a55-89644414806e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:40:37.387119 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.387077 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f8caf18b-5f4e-4cd3-9a55-89644414806e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f8caf18b-5f4e-4cd3-9a55-89644414806e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:40:37.387599 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.387130 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f8caf18b-5f4e-4cd3-9a55-89644414806e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f8caf18b-5f4e-4cd3-9a55-89644414806e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:40:37.387599 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.387166 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f8caf18b-5f4e-4cd3-9a55-89644414806e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f8caf18b-5f4e-4cd3-9a55-89644414806e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:40:37.387599 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.387206 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f8caf18b-5f4e-4cd3-9a55-89644414806e-config\") pod \"prometheus-k8s-0\" (UID: \"f8caf18b-5f4e-4cd3-9a55-89644414806e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:40:37.387599 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.387232 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f8caf18b-5f4e-4cd3-9a55-89644414806e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f8caf18b-5f4e-4cd3-9a55-89644414806e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:40:37.387599 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.387269 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8caf18b-5f4e-4cd3-9a55-89644414806e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f8caf18b-5f4e-4cd3-9a55-89644414806e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:40:37.387599 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.387299 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f8caf18b-5f4e-4cd3-9a55-89644414806e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f8caf18b-5f4e-4cd3-9a55-89644414806e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:40:37.388599 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.387789 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f8caf18b-5f4e-4cd3-9a55-89644414806e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f8caf18b-5f4e-4cd3-9a55-89644414806e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:40:37.388599 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.387861 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8caf18b-5f4e-4cd3-9a55-89644414806e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f8caf18b-5f4e-4cd3-9a55-89644414806e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:40:37.388599 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.387897 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f8caf18b-5f4e-4cd3-9a55-89644414806e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f8caf18b-5f4e-4cd3-9a55-89644414806e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:40:37.388599 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.387924 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f8caf18b-5f4e-4cd3-9a55-89644414806e-config-out\") pod \"prometheus-k8s-0\" (UID: \"f8caf18b-5f4e-4cd3-9a55-89644414806e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:40:37.388599 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.387957 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8caf18b-5f4e-4cd3-9a55-89644414806e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f8caf18b-5f4e-4cd3-9a55-89644414806e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:40:37.388599 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.388001 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8caf18b-5f4e-4cd3-9a55-89644414806e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f8caf18b-5f4e-4cd3-9a55-89644414806e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:40:37.388599 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.388028 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-67dp8\" (UniqueName: \"kubernetes.io/projected/f8caf18b-5f4e-4cd3-9a55-89644414806e-kube-api-access-67dp8\") pod \"prometheus-k8s-0\" (UID: \"f8caf18b-5f4e-4cd3-9a55-89644414806e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:40:37.388599 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.388061 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f8caf18b-5f4e-4cd3-9a55-89644414806e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f8caf18b-5f4e-4cd3-9a55-89644414806e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:40:37.388599 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.388264 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f8caf18b-5f4e-4cd3-9a55-89644414806e-web-config\") pod \"prometheus-k8s-0\" (UID: \"f8caf18b-5f4e-4cd3-9a55-89644414806e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:40:37.388599 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.388326 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f8caf18b-5f4e-4cd3-9a55-89644414806e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f8caf18b-5f4e-4cd3-9a55-89644414806e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:40:37.388599 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.388363 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f8caf18b-5f4e-4cd3-9a55-89644414806e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f8caf18b-5f4e-4cd3-9a55-89644414806e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:40:37.389207 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.388767 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8caf18b-5f4e-4cd3-9a55-89644414806e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f8caf18b-5f4e-4cd3-9a55-89644414806e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:40:37.389821 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.389465 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8caf18b-5f4e-4cd3-9a55-89644414806e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f8caf18b-5f4e-4cd3-9a55-89644414806e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:40:37.390524 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.390189 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/f8caf18b-5f4e-4cd3-9a55-89644414806e-config\") pod \"prometheus-k8s-0\" (UID: \"f8caf18b-5f4e-4cd3-9a55-89644414806e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:40:37.390524 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.390376 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f8caf18b-5f4e-4cd3-9a55-89644414806e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f8caf18b-5f4e-4cd3-9a55-89644414806e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:40:37.391101 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.391080 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f8caf18b-5f4e-4cd3-9a55-89644414806e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f8caf18b-5f4e-4cd3-9a55-89644414806e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:40:37.393422 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.392641 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f8caf18b-5f4e-4cd3-9a55-89644414806e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f8caf18b-5f4e-4cd3-9a55-89644414806e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:40:37.393422 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.392650 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8caf18b-5f4e-4cd3-9a55-89644414806e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f8caf18b-5f4e-4cd3-9a55-89644414806e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:40:37.393422 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.393112 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f8caf18b-5f4e-4cd3-9a55-89644414806e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f8caf18b-5f4e-4cd3-9a55-89644414806e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:40:37.393422 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.393276 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f8caf18b-5f4e-4cd3-9a55-89644414806e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f8caf18b-5f4e-4cd3-9a55-89644414806e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:40:37.393665 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.393634 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8caf18b-5f4e-4cd3-9a55-89644414806e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f8caf18b-5f4e-4cd3-9a55-89644414806e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:40:37.395583 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.395558 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f8caf18b-5f4e-4cd3-9a55-89644414806e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f8caf18b-5f4e-4cd3-9a55-89644414806e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:40:37.396277 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.396234 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f8caf18b-5f4e-4cd3-9a55-89644414806e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f8caf18b-5f4e-4cd3-9a55-89644414806e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:40:37.396543 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.396522 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f8caf18b-5f4e-4cd3-9a55-89644414806e-config-out\") pod \"prometheus-k8s-0\" (UID: \"f8caf18b-5f4e-4cd3-9a55-89644414806e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:40:37.397522 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.397499 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f8caf18b-5f4e-4cd3-9a55-89644414806e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f8caf18b-5f4e-4cd3-9a55-89644414806e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:40:37.398478 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.398456 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f8caf18b-5f4e-4cd3-9a55-89644414806e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f8caf18b-5f4e-4cd3-9a55-89644414806e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:40:37.399301 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.399089 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f8caf18b-5f4e-4cd3-9a55-89644414806e-web-config\") pod \"prometheus-k8s-0\" (UID: \"f8caf18b-5f4e-4cd3-9a55-89644414806e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:40:37.399493 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.399465 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f8caf18b-5f4e-4cd3-9a55-89644414806e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f8caf18b-5f4e-4cd3-9a55-89644414806e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:40:37.401798 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.401764 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-67dp8\" (UniqueName: \"kubernetes.io/projected/f8caf18b-5f4e-4cd3-9a55-89644414806e-kube-api-access-67dp8\") pod \"prometheus-k8s-0\" (UID: \"f8caf18b-5f4e-4cd3-9a55-89644414806e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:40:37.510204 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.510165 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:40:37.716303 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.716156 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 12:40:37.724323 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:40:37.724290 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8caf18b_5f4e_4cd3_9a55_89644414806e.slice/crio-d65fbe86f360f4a1c15765cf45bca4165bb7f15f4b3654f2d6b34c4519b24f42 WatchSource:0}: Error finding container d65fbe86f360f4a1c15765cf45bca4165bb7f15f4b3654f2d6b34c4519b24f42: Status 404 returned error can't find the container with id d65fbe86f360f4a1c15765cf45bca4165bb7f15f4b3654f2d6b34c4519b24f42 Jun 02 12:40:37.981131 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.981021 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rvddx" event={"ID":"10c4158d-e827-4403-8ba4-17672f978f94","Type":"ContainerStarted","Data":"7b247c8e236f5fcd39dbd714321392c953f352108f067b998fe8976fbe70e1fa"} Jun 02 12:40:37.994253 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.994105 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6896675589-25jf5" event={"ID":"a55432b3-ae2e-47a6-a79e-ee36eddcd330","Type":"ContainerStarted","Data":"3d02590841c8932abb6e8a54e1e0f8748037ee5aecf004ace5de9560a13f24a5"} Jun 02 12:40:37.994253 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:37.994191 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6896675589-25jf5" event={"ID":"a55432b3-ae2e-47a6-a79e-ee36eddcd330","Type":"ContainerStarted","Data":"c8aa48bda2d013290e58db8545aeb89c87c581a28de5635e8e380fee5e538daf"} Jun 02 12:40:38.002850 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:38.001832 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f8caf18b-5f4e-4cd3-9a55-89644414806e","Type":"ContainerStarted","Data":"1ffc76a8c308c8dd9a20b884dec13c5ac3318c22fbe92ddd9631aa675e0daad1"} Jun 02 12:40:38.002850 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:38.001890 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f8caf18b-5f4e-4cd3-9a55-89644414806e","Type":"ContainerStarted","Data":"d65fbe86f360f4a1c15765cf45bca4165bb7f15f4b3654f2d6b34c4519b24f42"} Jun 02 12:40:38.009542 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:38.009487 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7cdbfff797-bhlnw" event={"ID":"f12e91cc-0524-40d7-9dd3-1360f8095dd3","Type":"ContainerStarted","Data":"e1ecfe32f4992a1022de936afded6870d5ddd979fb57188f483d7089fc8a91de"} Jun 02 12:40:38.016967 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:38.016929 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-w4p9l" event={"ID":"10cd3d70-24b5-490f-a286-3c506f225186","Type":"ContainerStarted","Data":"43bb8b089006ea1c1be4984f6c86f4d65010a9baab1fda0a5f9a41b8f6c2242c"} Jun 02 12:40:39.022499 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:39.022453 2545 generic.go:358] "Generic (PLEG): container finished" podID="f8caf18b-5f4e-4cd3-9a55-89644414806e" containerID="1ffc76a8c308c8dd9a20b884dec13c5ac3318c22fbe92ddd9631aa675e0daad1" exitCode=0 Jun 02 12:40:39.022992 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:39.022541 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f8caf18b-5f4e-4cd3-9a55-89644414806e","Type":"ContainerDied","Data":"1ffc76a8c308c8dd9a20b884dec13c5ac3318c22fbe92ddd9631aa675e0daad1"} Jun 02 12:40:39.751480 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:39.751434 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7758dbbf8b-52rx4" Jun 02 12:40:39.751638 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:39.751581 2545 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7758dbbf8b-52rx4" Jun 02 12:40:39.756573 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:39.756552 2545 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7758dbbf8b-52rx4" Jun 02 12:40:40.030222 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:40.030137 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7758dbbf8b-52rx4" Jun 02 12:40:43.042956 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:43.042876 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a90b8b35-8d21-472e-b073-a2887f5cb5cc","Type":"ContainerStarted","Data":"d80b7e8898d7735d0f54b04d3fef16cb6779a297a609bacf410f193c764b270c"} Jun 02 12:40:43.042956 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:43.042922 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a90b8b35-8d21-472e-b073-a2887f5cb5cc","Type":"ContainerStarted","Data":"d26bb3f76c89323d9b2133e2639ed99c049489eae4979737fab25dfe7df0cd22"} Jun 02 12:40:43.046193 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:43.045969 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-q88nq" event={"ID":"61950c4e-c9a1-4c0d-af77-980423e1d1d8","Type":"ContainerStarted","Data":"ceb570a421fb1a2bfc47595ab2b669bef5799b3578bc04abbabd789217735cf7"} Jun 02 12:40:43.046193 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:43.046119 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-q88nq" Jun 02 12:40:43.048577 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:43.048525 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7cdbfff797-bhlnw" event={"ID":"f12e91cc-0524-40d7-9dd3-1360f8095dd3","Type":"ContainerStarted","Data":"7c6a8483990c84cce33a2d52e42f5c19fcd23efda340a330b48f366877200dbe"} Jun 02 12:40:43.048577 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:43.048557 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7cdbfff797-bhlnw" event={"ID":"f12e91cc-0524-40d7-9dd3-1360f8095dd3","Type":"ContainerStarted","Data":"549f26566e6e103837258968ead6a3cc3526f0f1c95b2579331919e6092fa19d"} Jun 02 12:40:43.050045 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:43.050010 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-w4p9l" event={"ID":"10cd3d70-24b5-490f-a286-3c506f225186","Type":"ContainerStarted","Data":"89eae3ab4f555709e23f5d0eb50bb6669e3eee38f052541da7a4ab93aa30f27e"} Jun 02 12:40:43.050984 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:43.050798 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-w4p9l" Jun 02 12:40:43.053241 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:43.053177 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rvddx" event={"ID":"10c4158d-e827-4403-8ba4-17672f978f94","Type":"ContainerStarted","Data":"87e2f12e029d2b8d265610caeb8938c442ef8df3db4a5b1da73a300f90c4ac7f"} Jun 02 12:40:43.053241 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:43.053214 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rvddx" event={"ID":"10c4158d-e827-4403-8ba4-17672f978f94","Type":"ContainerStarted","Data":"255fab27695977cf41c0a5ba80ac5f22813fa76c9a99665a1f56f081e4d783ed"} Jun 02 12:40:43.058969 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:43.057122 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6896675589-25jf5" event={"ID":"a55432b3-ae2e-47a6-a79e-ee36eddcd330","Type":"ContainerStarted","Data":"2aab7576ab86c602f9485c58162c6abdeff85bc632e7ee7758cb3c0e009a4b3d"} Jun 02 12:40:43.058969 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:43.057168 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6896675589-25jf5" event={"ID":"a55432b3-ae2e-47a6-a79e-ee36eddcd330","Type":"ContainerStarted","Data":"157945b3825c28ce6c84392ae33d6455d126cfa9ba43618cb6d804d7f1d80058"} Jun 02 12:40:43.058969 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:43.057184 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6896675589-25jf5" event={"ID":"a55432b3-ae2e-47a6-a79e-ee36eddcd330","Type":"ContainerStarted","Data":"30f1938818b359e77deb1d6e59c0b040bc7231ed1e56f44b577b6666b44bed2b"} Jun 02 12:40:43.058969 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:43.058584 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6896675589-25jf5" Jun 02 12:40:43.061780 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:43.061738 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5c6c7d459-l4vwr" event={"ID":"ac4a9cbe-a8e7-43b7-bed7-493148569aba","Type":"ContainerStarted","Data":"cc2c13409d58a467fb6ad2a86fac1d9f48ded6e983781ff2b581b94ad9d51897"} Jun 02 12:40:43.062061 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:43.062032 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-w4p9l" Jun 02 12:40:43.071688 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:43.069195 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-q88nq" podStartSLOduration=67.353448334 podStartE2EDuration="1m13.069181633s" podCreationTimestamp="2026-06-02 12:39:30 +0000 UTC" firstStartedPulling="2026-06-02 12:40:36.935826722 +0000 UTC m=+66.853441801" lastFinishedPulling="2026-06-02 12:40:42.651560026 +0000 UTC m=+72.569175100" observedRunningTime="2026-06-02 12:40:43.065651713 +0000 UTC m=+72.983266811" watchObservedRunningTime="2026-06-02 12:40:43.069181633 +0000 UTC m=+72.986796733" Jun 02 12:40:43.071688 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:43.071502 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f8caf18b-5f4e-4cd3-9a55-89644414806e","Type":"ContainerStarted","Data":"497f91848c39a3c444271d58737e0ace4a244c204719187c33874b53b87c21b1"} Jun 02 12:40:43.071688 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:43.071529 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f8caf18b-5f4e-4cd3-9a55-89644414806e","Type":"ContainerStarted","Data":"2b27aafa01cfcf215170772a5405b6fa59348947d335a5c2a6bc7f64a96f42b0"} Jun 02 12:40:43.073931 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:43.073913 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6896675589-25jf5" Jun 02 12:40:43.114197 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:43.114127 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6896675589-25jf5" podStartSLOduration=3.086164015 podStartE2EDuration="10.114106212s" podCreationTimestamp="2026-06-02 12:40:33 +0000 UTC" firstStartedPulling="2026-06-02 12:40:34.645435241 +0000 UTC m=+64.563050313" lastFinishedPulling="2026-06-02 12:40:41.673377433 +0000 UTC m=+71.590992510" observedRunningTime="2026-06-02 12:40:43.091426746 +0000 UTC m=+73.009041842" watchObservedRunningTime="2026-06-02 12:40:43.114106212 +0000 UTC m=+73.031721310" Jun 02 12:40:43.115360 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:43.115311 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-w4p9l" podStartSLOduration=3.3551103749999998 podStartE2EDuration="8.115296876s" podCreationTimestamp="2026-06-02 12:40:35 +0000 UTC" firstStartedPulling="2026-06-02 12:40:36.972505317 +0000 UTC m=+66.890120390" lastFinishedPulling="2026-06-02 12:40:41.732691804 +0000 UTC m=+71.650306891" observedRunningTime="2026-06-02 12:40:43.111696513 +0000 UTC m=+73.029311609" watchObservedRunningTime="2026-06-02 12:40:43.115296876 +0000 UTC m=+73.032911978" Jun 02 12:40:43.166076 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:43.165078 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-rvddx" podStartSLOduration=68.452360874 podStartE2EDuration="1m13.165059287s" podCreationTimestamp="2026-06-02 12:39:30 +0000 UTC" firstStartedPulling="2026-06-02 12:40:37.019984956 +0000 UTC m=+66.937600043" lastFinishedPulling="2026-06-02 12:40:41.732683366 +0000 UTC m=+71.650298456" observedRunningTime="2026-06-02 12:40:43.132702987 +0000 UTC m=+73.050318083" watchObservedRunningTime="2026-06-02 12:40:43.165059287 +0000 UTC m=+73.082674383" Jun 02 12:40:43.189224 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:43.189155 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5c6c7d459-l4vwr" podStartSLOduration=3.395350085 podStartE2EDuration="8.189135751s" podCreationTimestamp="2026-06-02 12:40:35 +0000 UTC" firstStartedPulling="2026-06-02 12:40:36.939984236 +0000 UTC m=+66.857599312" lastFinishedPulling="2026-06-02 12:40:41.733769885 +0000 UTC m=+71.651384978" observedRunningTime="2026-06-02 12:40:43.166403873 +0000 UTC m=+73.084018968" watchObservedRunningTime="2026-06-02 12:40:43.189135751 +0000 UTC m=+73.106750847" Jun 02 12:40:44.081515 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:44.081479 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f8caf18b-5f4e-4cd3-9a55-89644414806e","Type":"ContainerStarted","Data":"3cf67aa2c161e883a3521262244cd04eb3af4c8be99e965bf4743275f8f456c0"} Jun 02 12:40:44.081515 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:44.081518 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f8caf18b-5f4e-4cd3-9a55-89644414806e","Type":"ContainerStarted","Data":"fd989afb75a2e7696ac7f8399e9109e3cd26f6d7f061f48017ebc683588a4a72"} Jun 02 12:40:44.082002 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:44.081533 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f8caf18b-5f4e-4cd3-9a55-89644414806e","Type":"ContainerStarted","Data":"2372cb58ce2f8ce0c65d37083fb5a83f5016e267cf4f690ec269c186d5a5edb5"} Jun 02 12:40:44.082002 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:44.081545 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f8caf18b-5f4e-4cd3-9a55-89644414806e","Type":"ContainerStarted","Data":"b233d698eab4a2c5305f6cbb007f3ec6647d325a272881056f521a9b8c8db84a"} Jun 02 12:40:44.084457 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:44.084422 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a90b8b35-8d21-472e-b073-a2887f5cb5cc","Type":"ContainerStarted","Data":"5572b08c51789ed23c911b209ed00cbccc1389d090ae163ea7c8c8b5a4982782"} Jun 02 12:40:44.084580 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:44.084462 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a90b8b35-8d21-472e-b073-a2887f5cb5cc","Type":"ContainerStarted","Data":"b46fc47bfa2ab9a37ec7d46968661b2cb18e889ccbc38046a83eb96df277754c"} Jun 02 12:40:44.084580 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:44.084477 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a90b8b35-8d21-472e-b073-a2887f5cb5cc","Type":"ContainerStarted","Data":"bacfeedc33aa634a48eaab4ec68ad6db4ba6842c8143410d690f3f4f79ae1778"} Jun 02 12:40:44.084580 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:44.084493 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a90b8b35-8d21-472e-b073-a2887f5cb5cc","Type":"ContainerStarted","Data":"586c3b16d99f7559d8cc7185b1835e8c80d24c59c580a8705f1685aee00d1fc6"} Jun 02 12:40:44.086302 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:44.086258 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7cdbfff797-bhlnw" event={"ID":"f12e91cc-0524-40d7-9dd3-1360f8095dd3","Type":"ContainerStarted","Data":"109a4be70c84142ee19b1ce94b9f4d1b33e9aaac41e336148233c1011d3c61eb"} Jun 02 12:40:44.118955 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:44.118888 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.41605854 podStartE2EDuration="7.118869556s" podCreationTimestamp="2026-06-02 12:40:37 +0000 UTC" firstStartedPulling="2026-06-02 12:40:39.024218716 +0000 UTC m=+68.941833792" lastFinishedPulling="2026-06-02 12:40:42.727029723 +0000 UTC m=+72.644644808" observedRunningTime="2026-06-02 12:40:44.110983076 +0000 UTC m=+74.028598184" watchObservedRunningTime="2026-06-02 12:40:44.118869556 +0000 UTC m=+74.036484652" Jun 02 12:40:44.145503 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:44.145450 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=5.043002369 podStartE2EDuration="12.14543792s" podCreationTimestamp="2026-06-02 12:40:32 +0000 UTC" firstStartedPulling="2026-06-02 12:40:34.632181471 +0000 UTC m=+64.549796544" lastFinishedPulling="2026-06-02 12:40:41.734617005 +0000 UTC m=+71.652232095" observedRunningTime="2026-06-02 12:40:44.144370959 +0000 UTC m=+74.061986058" watchObservedRunningTime="2026-06-02 12:40:44.14543792 +0000 UTC m=+74.063053014" Jun 02 12:40:44.174188 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:44.174119 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7cdbfff797-bhlnw" podStartSLOduration=2.5152289740000002 podStartE2EDuration="8.174100351s" podCreationTimestamp="2026-06-02 12:40:36 +0000 UTC" firstStartedPulling="2026-06-02 12:40:36.992129893 +0000 UTC m=+66.909744973" lastFinishedPulling="2026-06-02 12:40:42.65100127 +0000 UTC m=+72.568616350" observedRunningTime="2026-06-02 12:40:44.17220381 +0000 UTC m=+74.089818945" watchObservedRunningTime="2026-06-02 12:40:44.174100351 +0000 UTC m=+74.091715447" Jun 02 12:40:47.511446 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:47.511328 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:40:55.669145 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:55.669114 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5c6c7d459-l4vwr" Jun 02 12:40:55.669582 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:55.669155 2545 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5c6c7d459-l4vwr" Jun 02 12:40:56.036618 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:40:56.036536 2545 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7758dbbf8b-52rx4"] Jun 02 12:41:14.088911 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:14.088883 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-q88nq" Jun 02 12:41:15.674745 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:15.674715 2545 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5c6c7d459-l4vwr" Jun 02 12:41:15.678559 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:15.678539 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5c6c7d459-l4vwr" Jun 02 12:41:21.056618 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:21.056559 2545 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-7758dbbf8b-52rx4" podUID="c7436547-622e-49df-afc9-c12b4886dd85" containerName="console" containerID="cri-o://8ed8fab40c9b1b60fed3d5441ad23076fb7815c9d90cb1f49c728497884a84b8" gracePeriod=15 Jun 02 12:41:21.200106 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:21.199930 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7758dbbf8b-52rx4_c7436547-622e-49df-afc9-c12b4886dd85/console/0.log" Jun 02 12:41:21.200106 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:21.199978 2545 generic.go:358] "Generic (PLEG): container finished" podID="c7436547-622e-49df-afc9-c12b4886dd85" containerID="8ed8fab40c9b1b60fed3d5441ad23076fb7815c9d90cb1f49c728497884a84b8" exitCode=2 Jun 02 12:41:21.200106 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:21.200061 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7758dbbf8b-52rx4" event={"ID":"c7436547-622e-49df-afc9-c12b4886dd85","Type":"ContainerDied","Data":"8ed8fab40c9b1b60fed3d5441ad23076fb7815c9d90cb1f49c728497884a84b8"} Jun 02 12:41:21.296018 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:21.295998 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7758dbbf8b-52rx4_c7436547-622e-49df-afc9-c12b4886dd85/console/0.log" Jun 02 12:41:21.296129 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:21.296066 2545 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7758dbbf8b-52rx4" Jun 02 12:41:21.372087 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:21.372055 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7436547-622e-49df-afc9-c12b4886dd85-console-serving-cert\") pod \"c7436547-622e-49df-afc9-c12b4886dd85\" (UID: \"c7436547-622e-49df-afc9-c12b4886dd85\") " Jun 02 12:41:21.372237 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:21.372110 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lc5c6\" (UniqueName: \"kubernetes.io/projected/c7436547-622e-49df-afc9-c12b4886dd85-kube-api-access-lc5c6\") pod \"c7436547-622e-49df-afc9-c12b4886dd85\" (UID: \"c7436547-622e-49df-afc9-c12b4886dd85\") " Jun 02 12:41:21.372237 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:21.372129 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7436547-622e-49df-afc9-c12b4886dd85-service-ca\") pod \"c7436547-622e-49df-afc9-c12b4886dd85\" (UID: \"c7436547-622e-49df-afc9-c12b4886dd85\") " Jun 02 12:41:21.372237 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:21.372167 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c7436547-622e-49df-afc9-c12b4886dd85-console-oauth-config\") pod \"c7436547-622e-49df-afc9-c12b4886dd85\" (UID: \"c7436547-622e-49df-afc9-c12b4886dd85\") " Jun 02 12:41:21.372237 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:21.372186 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c7436547-622e-49df-afc9-c12b4886dd85-console-config\") pod \"c7436547-622e-49df-afc9-c12b4886dd85\" (UID: \"c7436547-622e-49df-afc9-c12b4886dd85\") " Jun 02 12:41:21.372237 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:21.372229 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c7436547-622e-49df-afc9-c12b4886dd85-oauth-serving-cert\") pod \"c7436547-622e-49df-afc9-c12b4886dd85\" (UID: \"c7436547-622e-49df-afc9-c12b4886dd85\") " Jun 02 12:41:21.372624 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:21.372586 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7436547-622e-49df-afc9-c12b4886dd85-service-ca" (OuterVolumeSpecName: "service-ca") pod "c7436547-622e-49df-afc9-c12b4886dd85" (UID: "c7436547-622e-49df-afc9-c12b4886dd85"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 12:41:21.372740 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:21.372596 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7436547-622e-49df-afc9-c12b4886dd85-console-config" (OuterVolumeSpecName: "console-config") pod "c7436547-622e-49df-afc9-c12b4886dd85" (UID: "c7436547-622e-49df-afc9-c12b4886dd85"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 12:41:21.372740 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:21.372657 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7436547-622e-49df-afc9-c12b4886dd85-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c7436547-622e-49df-afc9-c12b4886dd85" (UID: "c7436547-622e-49df-afc9-c12b4886dd85"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 12:41:21.374429 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:21.374408 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7436547-622e-49df-afc9-c12b4886dd85-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c7436547-622e-49df-afc9-c12b4886dd85" (UID: "c7436547-622e-49df-afc9-c12b4886dd85"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 12:41:21.374508 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:21.374403 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7436547-622e-49df-afc9-c12b4886dd85-kube-api-access-lc5c6" (OuterVolumeSpecName: "kube-api-access-lc5c6") pod "c7436547-622e-49df-afc9-c12b4886dd85" (UID: "c7436547-622e-49df-afc9-c12b4886dd85"). InnerVolumeSpecName "kube-api-access-lc5c6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 12:41:21.374508 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:21.374449 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7436547-622e-49df-afc9-c12b4886dd85-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c7436547-622e-49df-afc9-c12b4886dd85" (UID: "c7436547-622e-49df-afc9-c12b4886dd85"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 12:41:21.473281 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:21.473248 2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lc5c6\" (UniqueName: \"kubernetes.io/projected/c7436547-622e-49df-afc9-c12b4886dd85-kube-api-access-lc5c6\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\"" Jun 02 12:41:21.473281 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:21.473278 2545 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7436547-622e-49df-afc9-c12b4886dd85-service-ca\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\"" Jun 02 12:41:21.473281 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:21.473287 2545 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c7436547-622e-49df-afc9-c12b4886dd85-console-oauth-config\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\"" Jun 02 12:41:21.473504 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:21.473296 2545 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c7436547-622e-49df-afc9-c12b4886dd85-console-config\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\"" Jun 02 12:41:21.473504 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:21.473306 2545 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c7436547-622e-49df-afc9-c12b4886dd85-oauth-serving-cert\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\"" Jun 02 12:41:21.473504 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:21.473315 2545 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7436547-622e-49df-afc9-c12b4886dd85-console-serving-cert\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\"" Jun 02 12:41:22.204336 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:22.204309 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7758dbbf8b-52rx4_c7436547-622e-49df-afc9-c12b4886dd85/console/0.log" Jun 02 12:41:22.204714 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:22.204404 2545 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7758dbbf8b-52rx4" Jun 02 12:41:22.204714 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:22.204400 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7758dbbf8b-52rx4" event={"ID":"c7436547-622e-49df-afc9-c12b4886dd85","Type":"ContainerDied","Data":"09314884e215be90a6c0caac17b905eed6206e9803ea151fe4b28b440c9700be"} Jun 02 12:41:22.204714 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:22.204510 2545 scope.go:117] "RemoveContainer" containerID="8ed8fab40c9b1b60fed3d5441ad23076fb7815c9d90cb1f49c728497884a84b8" Jun 02 12:41:22.224000 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:22.223977 2545 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7758dbbf8b-52rx4"] Jun 02 12:41:22.227562 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:22.227539 2545 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7758dbbf8b-52rx4"] Jun 02 12:41:22.706521 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:22.706489 2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7436547-622e-49df-afc9-c12b4886dd85" path="/var/lib/kubelet/pods/c7436547-622e-49df-afc9-c12b4886dd85/volumes" Jun 02 12:41:37.510761 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:37.510728 2545 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:41:37.531831 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:37.531804 2545 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:41:38.270293 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:38.270268 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:41:51.302569 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:51.302537 2545 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 12:41:51.303115 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:51.303003 2545 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a90b8b35-8d21-472e-b073-a2887f5cb5cc" containerName="alertmanager" containerID="cri-o://d26bb3f76c89323d9b2133e2639ed99c049489eae4979737fab25dfe7df0cd22" gracePeriod=120 Jun 02 12:41:51.303115 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:51.303042 2545 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a90b8b35-8d21-472e-b073-a2887f5cb5cc" containerName="kube-rbac-proxy" containerID="cri-o://bacfeedc33aa634a48eaab4ec68ad6db4ba6842c8143410d690f3f4f79ae1778" gracePeriod=120 Jun 02 12:41:51.303223 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:51.303087 2545 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a90b8b35-8d21-472e-b073-a2887f5cb5cc" containerName="kube-rbac-proxy-metric" containerID="cri-o://b46fc47bfa2ab9a37ec7d46968661b2cb18e889ccbc38046a83eb96df277754c" gracePeriod=120 Jun 02 12:41:51.303223 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:51.303132 2545 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a90b8b35-8d21-472e-b073-a2887f5cb5cc" containerName="config-reloader" containerID="cri-o://d80b7e8898d7735d0f54b04d3fef16cb6779a297a609bacf410f193c764b270c" gracePeriod=120 Jun 02 12:41:51.303223 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:51.303117 2545 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a90b8b35-8d21-472e-b073-a2887f5cb5cc" containerName="prom-label-proxy" containerID="cri-o://5572b08c51789ed23c911b209ed00cbccc1389d090ae163ea7c8c8b5a4982782" gracePeriod=120 Jun 02 12:41:51.303377 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:51.303232 2545 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a90b8b35-8d21-472e-b073-a2887f5cb5cc" containerName="kube-rbac-proxy-web" containerID="cri-o://586c3b16d99f7559d8cc7185b1835e8c80d24c59c580a8705f1685aee00d1fc6" gracePeriod=120 Jun 02 12:41:52.305569 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:52.305537 2545 generic.go:358] "Generic (PLEG): container finished" podID="a90b8b35-8d21-472e-b073-a2887f5cb5cc" containerID="5572b08c51789ed23c911b209ed00cbccc1389d090ae163ea7c8c8b5a4982782" exitCode=0 Jun 02 12:41:52.305569 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:52.305560 2545 generic.go:358] "Generic (PLEG): container finished" podID="a90b8b35-8d21-472e-b073-a2887f5cb5cc" containerID="b46fc47bfa2ab9a37ec7d46968661b2cb18e889ccbc38046a83eb96df277754c" exitCode=0 Jun 02 12:41:52.305569 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:52.305565 2545 generic.go:358] "Generic (PLEG): container finished" podID="a90b8b35-8d21-472e-b073-a2887f5cb5cc" containerID="bacfeedc33aa634a48eaab4ec68ad6db4ba6842c8143410d690f3f4f79ae1778" exitCode=0 Jun 02 12:41:52.305569 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:52.305571 2545 generic.go:358] "Generic (PLEG): container finished" podID="a90b8b35-8d21-472e-b073-a2887f5cb5cc" containerID="d80b7e8898d7735d0f54b04d3fef16cb6779a297a609bacf410f193c764b270c" exitCode=0 Jun 02 12:41:52.305569 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:52.305576 2545 generic.go:358] "Generic (PLEG): container finished" podID="a90b8b35-8d21-472e-b073-a2887f5cb5cc" containerID="d26bb3f76c89323d9b2133e2639ed99c049489eae4979737fab25dfe7df0cd22" exitCode=0 Jun 02 12:41:52.306070 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:52.305606 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a90b8b35-8d21-472e-b073-a2887f5cb5cc","Type":"ContainerDied","Data":"5572b08c51789ed23c911b209ed00cbccc1389d090ae163ea7c8c8b5a4982782"} Jun 02 12:41:52.306070 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:52.305639 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a90b8b35-8d21-472e-b073-a2887f5cb5cc","Type":"ContainerDied","Data":"b46fc47bfa2ab9a37ec7d46968661b2cb18e889ccbc38046a83eb96df277754c"} Jun 02 12:41:52.306070 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:52.305648 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a90b8b35-8d21-472e-b073-a2887f5cb5cc","Type":"ContainerDied","Data":"bacfeedc33aa634a48eaab4ec68ad6db4ba6842c8143410d690f3f4f79ae1778"} Jun 02 12:41:52.306070 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:52.305657 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a90b8b35-8d21-472e-b073-a2887f5cb5cc","Type":"ContainerDied","Data":"d80b7e8898d7735d0f54b04d3fef16cb6779a297a609bacf410f193c764b270c"} Jun 02 12:41:52.306070 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:52.305665 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a90b8b35-8d21-472e-b073-a2887f5cb5cc","Type":"ContainerDied","Data":"d26bb3f76c89323d9b2133e2639ed99c049489eae4979737fab25dfe7df0cd22"} Jun 02 12:41:52.546746 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:52.546726 2545 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:41:52.646158 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:52.646128 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a90b8b35-8d21-472e-b073-a2887f5cb5cc-cluster-tls-config\") pod \"a90b8b35-8d21-472e-b073-a2887f5cb5cc\" (UID: \"a90b8b35-8d21-472e-b073-a2887f5cb5cc\") " Jun 02 12:41:52.646320 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:52.646166 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a90b8b35-8d21-472e-b073-a2887f5cb5cc-web-config\") pod \"a90b8b35-8d21-472e-b073-a2887f5cb5cc\" (UID: \"a90b8b35-8d21-472e-b073-a2887f5cb5cc\") " Jun 02 12:41:52.646320 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:52.646193 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a90b8b35-8d21-472e-b073-a2887f5cb5cc-alertmanager-main-db\") pod \"a90b8b35-8d21-472e-b073-a2887f5cb5cc\" (UID: \"a90b8b35-8d21-472e-b073-a2887f5cb5cc\") " Jun 02 12:41:52.646320 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:52.646225 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a90b8b35-8d21-472e-b073-a2887f5cb5cc-metrics-client-ca\") pod \"a90b8b35-8d21-472e-b073-a2887f5cb5cc\" (UID: \"a90b8b35-8d21-472e-b073-a2887f5cb5cc\") " Jun 02 12:41:52.646320 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:52.646246 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a90b8b35-8d21-472e-b073-a2887f5cb5cc-secret-alertmanager-kube-rbac-proxy-web\") pod \"a90b8b35-8d21-472e-b073-a2887f5cb5cc\" (UID: \"a90b8b35-8d21-472e-b073-a2887f5cb5cc\") " Jun 02 12:41:52.646320 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:52.646275 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lj2vn\" (UniqueName: \"kubernetes.io/projected/a90b8b35-8d21-472e-b073-a2887f5cb5cc-kube-api-access-lj2vn\") pod \"a90b8b35-8d21-472e-b073-a2887f5cb5cc\" (UID: \"a90b8b35-8d21-472e-b073-a2887f5cb5cc\") " Jun 02 12:41:52.646320 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:52.646295 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a90b8b35-8d21-472e-b073-a2887f5cb5cc-config-volume\") pod \"a90b8b35-8d21-472e-b073-a2887f5cb5cc\" (UID: \"a90b8b35-8d21-472e-b073-a2887f5cb5cc\") " Jun 02 12:41:52.646629 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:52.646325 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a90b8b35-8d21-472e-b073-a2887f5cb5cc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"a90b8b35-8d21-472e-b073-a2887f5cb5cc\" (UID: \"a90b8b35-8d21-472e-b073-a2887f5cb5cc\") " Jun 02 12:41:52.646629 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:52.646551 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a90b8b35-8d21-472e-b073-a2887f5cb5cc-secret-alertmanager-kube-rbac-proxy\") pod \"a90b8b35-8d21-472e-b073-a2887f5cb5cc\" (UID: \"a90b8b35-8d21-472e-b073-a2887f5cb5cc\") " Jun 02 12:41:52.646629 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:52.646610 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a90b8b35-8d21-472e-b073-a2887f5cb5cc-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "a90b8b35-8d21-472e-b073-a2887f5cb5cc" (UID: "a90b8b35-8d21-472e-b073-a2887f5cb5cc"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 12:41:52.646775 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:52.646627 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a90b8b35-8d21-472e-b073-a2887f5cb5cc-alertmanager-trusted-ca-bundle\") pod \"a90b8b35-8d21-472e-b073-a2887f5cb5cc\" (UID: \"a90b8b35-8d21-472e-b073-a2887f5cb5cc\") " Jun 02 12:41:52.646775 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:52.646625 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a90b8b35-8d21-472e-b073-a2887f5cb5cc-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "a90b8b35-8d21-472e-b073-a2887f5cb5cc" (UID: "a90b8b35-8d21-472e-b073-a2887f5cb5cc"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 12:41:52.646775 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:52.646673 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a90b8b35-8d21-472e-b073-a2887f5cb5cc-config-out\") pod \"a90b8b35-8d21-472e-b073-a2887f5cb5cc\" (UID: \"a90b8b35-8d21-472e-b073-a2887f5cb5cc\") " Jun 02 12:41:52.646775 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:52.646707 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a90b8b35-8d21-472e-b073-a2887f5cb5cc-tls-assets\") pod \"a90b8b35-8d21-472e-b073-a2887f5cb5cc\" (UID: \"a90b8b35-8d21-472e-b073-a2887f5cb5cc\") " Jun 02 12:41:52.646775 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:52.646740 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a90b8b35-8d21-472e-b073-a2887f5cb5cc-secret-alertmanager-main-tls\") pod \"a90b8b35-8d21-472e-b073-a2887f5cb5cc\" (UID: \"a90b8b35-8d21-472e-b073-a2887f5cb5cc\") " Jun 02 12:41:52.647425 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:52.647098 2545 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a90b8b35-8d21-472e-b073-a2887f5cb5cc-metrics-client-ca\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\"" Jun 02 12:41:52.647425 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:52.647125 2545 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a90b8b35-8d21-472e-b073-a2887f5cb5cc-alertmanager-main-db\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\"" Jun 02 12:41:52.647425 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:52.647149 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a90b8b35-8d21-472e-b073-a2887f5cb5cc-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "a90b8b35-8d21-472e-b073-a2887f5cb5cc" (UID: "a90b8b35-8d21-472e-b073-a2887f5cb5cc"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 12:41:52.649414 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:52.649387 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a90b8b35-8d21-472e-b073-a2887f5cb5cc-kube-api-access-lj2vn" (OuterVolumeSpecName: "kube-api-access-lj2vn") pod "a90b8b35-8d21-472e-b073-a2887f5cb5cc" (UID: "a90b8b35-8d21-472e-b073-a2887f5cb5cc"). InnerVolumeSpecName "kube-api-access-lj2vn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 12:41:52.649588 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:52.649567 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a90b8b35-8d21-472e-b073-a2887f5cb5cc-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "a90b8b35-8d21-472e-b073-a2887f5cb5cc" (UID: "a90b8b35-8d21-472e-b073-a2887f5cb5cc"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 12:41:52.649815 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:52.649785 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a90b8b35-8d21-472e-b073-a2887f5cb5cc-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "a90b8b35-8d21-472e-b073-a2887f5cb5cc" (UID: "a90b8b35-8d21-472e-b073-a2887f5cb5cc"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 12:41:52.650278 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:52.650245 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a90b8b35-8d21-472e-b073-a2887f5cb5cc-config-volume" (OuterVolumeSpecName: "config-volume") pod "a90b8b35-8d21-472e-b073-a2887f5cb5cc" (UID: "a90b8b35-8d21-472e-b073-a2887f5cb5cc"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 12:41:52.650495 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:52.650461 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a90b8b35-8d21-472e-b073-a2887f5cb5cc-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "a90b8b35-8d21-472e-b073-a2887f5cb5cc" (UID: "a90b8b35-8d21-472e-b073-a2887f5cb5cc"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 12:41:52.650599 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:52.650565 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a90b8b35-8d21-472e-b073-a2887f5cb5cc-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "a90b8b35-8d21-472e-b073-a2887f5cb5cc" (UID: "a90b8b35-8d21-472e-b073-a2887f5cb5cc"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 12:41:52.650763 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:52.650741 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a90b8b35-8d21-472e-b073-a2887f5cb5cc-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "a90b8b35-8d21-472e-b073-a2887f5cb5cc" (UID: "a90b8b35-8d21-472e-b073-a2887f5cb5cc"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 12:41:52.651061 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:52.651045 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a90b8b35-8d21-472e-b073-a2887f5cb5cc-config-out" (OuterVolumeSpecName: "config-out") pod "a90b8b35-8d21-472e-b073-a2887f5cb5cc" (UID: "a90b8b35-8d21-472e-b073-a2887f5cb5cc"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 12:41:52.653436 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:52.653415 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a90b8b35-8d21-472e-b073-a2887f5cb5cc-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "a90b8b35-8d21-472e-b073-a2887f5cb5cc" (UID: "a90b8b35-8d21-472e-b073-a2887f5cb5cc"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 12:41:52.660164 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:52.660147 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a90b8b35-8d21-472e-b073-a2887f5cb5cc-web-config" (OuterVolumeSpecName: "web-config") pod "a90b8b35-8d21-472e-b073-a2887f5cb5cc" (UID: "a90b8b35-8d21-472e-b073-a2887f5cb5cc"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 12:41:52.748265 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:52.748239 2545 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a90b8b35-8d21-472e-b073-a2887f5cb5cc-cluster-tls-config\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\"" Jun 02 12:41:52.748265 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:52.748265 2545 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a90b8b35-8d21-472e-b073-a2887f5cb5cc-web-config\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\"" Jun 02 12:41:52.748397 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:52.748275 2545 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a90b8b35-8d21-472e-b073-a2887f5cb5cc-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\"" Jun 02 12:41:52.748397 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:52.748285 2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lj2vn\" (UniqueName: \"kubernetes.io/projected/a90b8b35-8d21-472e-b073-a2887f5cb5cc-kube-api-access-lj2vn\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\"" Jun 02 12:41:52.748397 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:52.748294 2545 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a90b8b35-8d21-472e-b073-a2887f5cb5cc-config-volume\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\"" Jun 02 12:41:52.748397 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:52.748303 2545 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a90b8b35-8d21-472e-b073-a2887f5cb5cc-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\"" Jun 02 12:41:52.748397 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:52.748313 2545 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a90b8b35-8d21-472e-b073-a2887f5cb5cc-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\"" Jun 02 12:41:52.748397 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:52.748323 2545 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a90b8b35-8d21-472e-b073-a2887f5cb5cc-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\"" Jun 02 12:41:52.748397 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:52.748331 2545 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a90b8b35-8d21-472e-b073-a2887f5cb5cc-config-out\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\"" Jun 02 12:41:52.748397 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:52.748340 2545 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a90b8b35-8d21-472e-b073-a2887f5cb5cc-tls-assets\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\"" Jun 02 12:41:52.748397 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:52.748348 2545 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a90b8b35-8d21-472e-b073-a2887f5cb5cc-secret-alertmanager-main-tls\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\"" Jun 02 12:41:53.311218 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.311182 2545 generic.go:358] "Generic (PLEG): container finished" podID="a90b8b35-8d21-472e-b073-a2887f5cb5cc" containerID="586c3b16d99f7559d8cc7185b1835e8c80d24c59c580a8705f1685aee00d1fc6" exitCode=0 Jun 02 12:41:53.311659 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.311257 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a90b8b35-8d21-472e-b073-a2887f5cb5cc","Type":"ContainerDied","Data":"586c3b16d99f7559d8cc7185b1835e8c80d24c59c580a8705f1685aee00d1fc6"} Jun 02 12:41:53.311659 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.311301 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a90b8b35-8d21-472e-b073-a2887f5cb5cc","Type":"ContainerDied","Data":"e5867b4c59606778f1ae2f4a7d7f12bd4cc096ef458a4ef5d7ad73f8c5a73039"} Jun 02 12:41:53.311659 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.311322 2545 scope.go:117] "RemoveContainer" containerID="5572b08c51789ed23c911b209ed00cbccc1389d090ae163ea7c8c8b5a4982782" Jun 02 12:41:53.311659 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.311349 2545 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:41:53.319240 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.319225 2545 scope.go:117] "RemoveContainer" containerID="b46fc47bfa2ab9a37ec7d46968661b2cb18e889ccbc38046a83eb96df277754c" Jun 02 12:41:53.326650 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.326634 2545 scope.go:117] "RemoveContainer" containerID="bacfeedc33aa634a48eaab4ec68ad6db4ba6842c8143410d690f3f4f79ae1778" Jun 02 12:41:53.331676 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.331642 2545 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 12:41:53.335595 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.335575 2545 scope.go:117] "RemoveContainer" containerID="586c3b16d99f7559d8cc7185b1835e8c80d24c59c580a8705f1685aee00d1fc6" Jun 02 12:41:53.337034 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.337013 2545 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 12:41:53.343304 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.343286 2545 scope.go:117] "RemoveContainer" containerID="d80b7e8898d7735d0f54b04d3fef16cb6779a297a609bacf410f193c764b270c" Jun 02 12:41:53.350283 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.350266 2545 scope.go:117] "RemoveContainer" containerID="d26bb3f76c89323d9b2133e2639ed99c049489eae4979737fab25dfe7df0cd22" Jun 02 12:41:53.357848 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.357816 2545 scope.go:117] "RemoveContainer" containerID="2c51dd68e9f28a35c2d86bdfd0758ee1a1325f30c76dcb44852e0b207e72f331" Jun 02 12:41:53.365130 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.365107 2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 12:41:53.365672 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.365586 2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a90b8b35-8d21-472e-b073-a2887f5cb5cc" containerName="kube-rbac-proxy-metric" Jun 02 12:41:53.365672 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.365604 2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="a90b8b35-8d21-472e-b073-a2887f5cb5cc" containerName="kube-rbac-proxy-metric" Jun 02 12:41:53.365672 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.365618 2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a90b8b35-8d21-472e-b073-a2887f5cb5cc" containerName="alertmanager" Jun 02 12:41:53.365672 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.365627 2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="a90b8b35-8d21-472e-b073-a2887f5cb5cc" containerName="alertmanager" Jun 02 12:41:53.365672 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.365641 2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a90b8b35-8d21-472e-b073-a2887f5cb5cc" containerName="config-reloader" Jun 02 12:41:53.365672 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.365649 2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="a90b8b35-8d21-472e-b073-a2887f5cb5cc" containerName="config-reloader" Jun 02 12:41:53.365672 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.365664 2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7436547-622e-49df-afc9-c12b4886dd85" containerName="console" Jun 02 12:41:53.365672 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.365670 2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7436547-622e-49df-afc9-c12b4886dd85" containerName="console" Jun 02 12:41:53.366070 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.365678 2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a90b8b35-8d21-472e-b073-a2887f5cb5cc" containerName="kube-rbac-proxy-web" Jun 02 12:41:53.366070 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.365684 2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="a90b8b35-8d21-472e-b073-a2887f5cb5cc" containerName="kube-rbac-proxy-web" Jun 02 12:41:53.366070 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.365694 2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a90b8b35-8d21-472e-b073-a2887f5cb5cc" containerName="kube-rbac-proxy" Jun 02 12:41:53.366070 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.365702 2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="a90b8b35-8d21-472e-b073-a2887f5cb5cc" containerName="kube-rbac-proxy" Jun 02 12:41:53.366070 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.365711 2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a90b8b35-8d21-472e-b073-a2887f5cb5cc" containerName="prom-label-proxy" Jun 02 12:41:53.366070 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.365719 2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="a90b8b35-8d21-472e-b073-a2887f5cb5cc" containerName="prom-label-proxy" Jun 02 12:41:53.366070 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.365731 2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a90b8b35-8d21-472e-b073-a2887f5cb5cc" containerName="init-config-reloader" Jun 02 12:41:53.366070 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.365740 2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="a90b8b35-8d21-472e-b073-a2887f5cb5cc" containerName="init-config-reloader" Jun 02 12:41:53.366070 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.365783 2545 scope.go:117] "RemoveContainer" containerID="5572b08c51789ed23c911b209ed00cbccc1389d090ae163ea7c8c8b5a4982782" Jun 02 12:41:53.366070 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.365803 2545 memory_manager.go:356] "RemoveStaleState removing state" podUID="a90b8b35-8d21-472e-b073-a2887f5cb5cc" containerName="prom-label-proxy" Jun 02 12:41:53.366070 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.365813 2545 memory_manager.go:356] "RemoveStaleState removing state" podUID="a90b8b35-8d21-472e-b073-a2887f5cb5cc" containerName="kube-rbac-proxy-web" Jun 02 12:41:53.366070 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.365820 2545 memory_manager.go:356] "RemoveStaleState removing state" podUID="a90b8b35-8d21-472e-b073-a2887f5cb5cc" containerName="alertmanager" Jun 02 12:41:53.366070 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.365828 2545 memory_manager.go:356] "RemoveStaleState removing state" podUID="a90b8b35-8d21-472e-b073-a2887f5cb5cc" containerName="kube-rbac-proxy" Jun 02 12:41:53.366070 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.365853 2545 memory_manager.go:356] "RemoveStaleState removing state" podUID="c7436547-622e-49df-afc9-c12b4886dd85" containerName="console" Jun 02 12:41:53.366070 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.365861 2545 memory_manager.go:356] "RemoveStaleState removing state" podUID="a90b8b35-8d21-472e-b073-a2887f5cb5cc" containerName="kube-rbac-proxy-metric" Jun 02 12:41:53.366070 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.365870 2545 memory_manager.go:356] "RemoveStaleState removing state" podUID="a90b8b35-8d21-472e-b073-a2887f5cb5cc" containerName="config-reloader" Jun 02 12:41:53.366774 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:41:53.366099 2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5572b08c51789ed23c911b209ed00cbccc1389d090ae163ea7c8c8b5a4982782\": container with ID starting with 5572b08c51789ed23c911b209ed00cbccc1389d090ae163ea7c8c8b5a4982782 not found: ID does not exist" containerID="5572b08c51789ed23c911b209ed00cbccc1389d090ae163ea7c8c8b5a4982782" Jun 02 12:41:53.366774 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.366133 2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5572b08c51789ed23c911b209ed00cbccc1389d090ae163ea7c8c8b5a4982782"} err="failed to get container status \"5572b08c51789ed23c911b209ed00cbccc1389d090ae163ea7c8c8b5a4982782\": rpc error: code = NotFound desc = could not find container \"5572b08c51789ed23c911b209ed00cbccc1389d090ae163ea7c8c8b5a4982782\": container with ID starting with 5572b08c51789ed23c911b209ed00cbccc1389d090ae163ea7c8c8b5a4982782 not found: ID does not exist" Jun 02 12:41:53.366774 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.366173 2545 scope.go:117] "RemoveContainer" containerID="b46fc47bfa2ab9a37ec7d46968661b2cb18e889ccbc38046a83eb96df277754c" Jun 02 12:41:53.366774 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:41:53.366409 2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b46fc47bfa2ab9a37ec7d46968661b2cb18e889ccbc38046a83eb96df277754c\": container with ID starting with b46fc47bfa2ab9a37ec7d46968661b2cb18e889ccbc38046a83eb96df277754c not found: ID does not exist" containerID="b46fc47bfa2ab9a37ec7d46968661b2cb18e889ccbc38046a83eb96df277754c" Jun 02 12:41:53.366774 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.366432 2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b46fc47bfa2ab9a37ec7d46968661b2cb18e889ccbc38046a83eb96df277754c"} err="failed to get container status \"b46fc47bfa2ab9a37ec7d46968661b2cb18e889ccbc38046a83eb96df277754c\": rpc error: code = NotFound desc = could not find container \"b46fc47bfa2ab9a37ec7d46968661b2cb18e889ccbc38046a83eb96df277754c\": container with ID starting with b46fc47bfa2ab9a37ec7d46968661b2cb18e889ccbc38046a83eb96df277754c not found: ID does not exist" Jun 02 12:41:53.366774 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.366449 2545 scope.go:117] "RemoveContainer" containerID="bacfeedc33aa634a48eaab4ec68ad6db4ba6842c8143410d690f3f4f79ae1778" Jun 02 12:41:53.366774 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:41:53.366674 2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bacfeedc33aa634a48eaab4ec68ad6db4ba6842c8143410d690f3f4f79ae1778\": container with ID starting with bacfeedc33aa634a48eaab4ec68ad6db4ba6842c8143410d690f3f4f79ae1778 not found: ID does not exist" containerID="bacfeedc33aa634a48eaab4ec68ad6db4ba6842c8143410d690f3f4f79ae1778" Jun 02 12:41:53.366774 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.366700 2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bacfeedc33aa634a48eaab4ec68ad6db4ba6842c8143410d690f3f4f79ae1778"} err="failed to get container status \"bacfeedc33aa634a48eaab4ec68ad6db4ba6842c8143410d690f3f4f79ae1778\": rpc error: code = NotFound desc = could not find container \"bacfeedc33aa634a48eaab4ec68ad6db4ba6842c8143410d690f3f4f79ae1778\": container with ID starting with bacfeedc33aa634a48eaab4ec68ad6db4ba6842c8143410d690f3f4f79ae1778 not found: ID does not exist" Jun 02 12:41:53.366774 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.366730 2545 scope.go:117] "RemoveContainer" containerID="586c3b16d99f7559d8cc7185b1835e8c80d24c59c580a8705f1685aee00d1fc6" Jun 02 12:41:53.367236 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:41:53.367034 2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"586c3b16d99f7559d8cc7185b1835e8c80d24c59c580a8705f1685aee00d1fc6\": container with ID starting with 586c3b16d99f7559d8cc7185b1835e8c80d24c59c580a8705f1685aee00d1fc6 not found: ID does not exist" containerID="586c3b16d99f7559d8cc7185b1835e8c80d24c59c580a8705f1685aee00d1fc6" Jun 02 12:41:53.367236 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.367062 2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"586c3b16d99f7559d8cc7185b1835e8c80d24c59c580a8705f1685aee00d1fc6"} err="failed to get container status \"586c3b16d99f7559d8cc7185b1835e8c80d24c59c580a8705f1685aee00d1fc6\": rpc error: code = NotFound desc = could not find container \"586c3b16d99f7559d8cc7185b1835e8c80d24c59c580a8705f1685aee00d1fc6\": container with ID starting with 586c3b16d99f7559d8cc7185b1835e8c80d24c59c580a8705f1685aee00d1fc6 not found: ID does not exist" Jun 02 12:41:53.367236 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.367084 2545 scope.go:117] "RemoveContainer" containerID="d80b7e8898d7735d0f54b04d3fef16cb6779a297a609bacf410f193c764b270c" Jun 02 12:41:53.367376 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:41:53.367343 2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d80b7e8898d7735d0f54b04d3fef16cb6779a297a609bacf410f193c764b270c\": container with ID starting with d80b7e8898d7735d0f54b04d3fef16cb6779a297a609bacf410f193c764b270c not found: ID does not exist" containerID="d80b7e8898d7735d0f54b04d3fef16cb6779a297a609bacf410f193c764b270c" Jun 02 12:41:53.367425 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.367370 2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d80b7e8898d7735d0f54b04d3fef16cb6779a297a609bacf410f193c764b270c"} err="failed to get container status \"d80b7e8898d7735d0f54b04d3fef16cb6779a297a609bacf410f193c764b270c\": rpc error: code = NotFound desc = could not find container \"d80b7e8898d7735d0f54b04d3fef16cb6779a297a609bacf410f193c764b270c\": container with ID starting with d80b7e8898d7735d0f54b04d3fef16cb6779a297a609bacf410f193c764b270c not found: ID does not exist" Jun 02 12:41:53.367425 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.367391 2545 scope.go:117] "RemoveContainer" containerID="d26bb3f76c89323d9b2133e2639ed99c049489eae4979737fab25dfe7df0cd22" Jun 02 12:41:53.367627 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:41:53.367609 2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d26bb3f76c89323d9b2133e2639ed99c049489eae4979737fab25dfe7df0cd22\": container with ID starting with d26bb3f76c89323d9b2133e2639ed99c049489eae4979737fab25dfe7df0cd22 not found: ID does not exist" containerID="d26bb3f76c89323d9b2133e2639ed99c049489eae4979737fab25dfe7df0cd22" Jun 02 12:41:53.367685 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.367630 2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d26bb3f76c89323d9b2133e2639ed99c049489eae4979737fab25dfe7df0cd22"} err="failed to get container status \"d26bb3f76c89323d9b2133e2639ed99c049489eae4979737fab25dfe7df0cd22\": rpc error: code = NotFound desc = could not find container \"d26bb3f76c89323d9b2133e2639ed99c049489eae4979737fab25dfe7df0cd22\": container with ID starting with d26bb3f76c89323d9b2133e2639ed99c049489eae4979737fab25dfe7df0cd22 not found: ID does not exist" Jun 02 12:41:53.367685 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.367644 2545 scope.go:117] "RemoveContainer" containerID="2c51dd68e9f28a35c2d86bdfd0758ee1a1325f30c76dcb44852e0b207e72f331" Jun 02 12:41:53.367879 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:41:53.367862 2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c51dd68e9f28a35c2d86bdfd0758ee1a1325f30c76dcb44852e0b207e72f331\": container with ID starting with 2c51dd68e9f28a35c2d86bdfd0758ee1a1325f30c76dcb44852e0b207e72f331 not found: ID does not exist" containerID="2c51dd68e9f28a35c2d86bdfd0758ee1a1325f30c76dcb44852e0b207e72f331" Jun 02 12:41:53.367943 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.367882 2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c51dd68e9f28a35c2d86bdfd0758ee1a1325f30c76dcb44852e0b207e72f331"} err="failed to get container status \"2c51dd68e9f28a35c2d86bdfd0758ee1a1325f30c76dcb44852e0b207e72f331\": rpc error: code = NotFound desc = could not find container \"2c51dd68e9f28a35c2d86bdfd0758ee1a1325f30c76dcb44852e0b207e72f331\": container with ID starting with 2c51dd68e9f28a35c2d86bdfd0758ee1a1325f30c76dcb44852e0b207e72f331 not found: ID does not exist" Jun 02 12:41:53.371318 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.371301 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:41:53.373217 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.373197 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 02 12:41:53.373301 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.373288 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 02 12:41:53.373480 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.373467 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 02 12:41:53.373570 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.373550 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 02 12:41:53.373718 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.373704 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 02 12:41:53.373851 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.373819 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 02 12:41:53.373936 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.373850 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 02 12:41:53.373936 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.373882 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 02 12:41:53.373936 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.373910 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-v8tj5\"" Jun 02 12:41:53.381742 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.381721 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 02 12:41:53.382943 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.382923 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 12:41:53.554130 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.554092 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dec7b682-a4dc-442c-b5b6-8160cd2dde01-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dec7b682-a4dc-442c-b5b6-8160cd2dde01\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:41:53.554300 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.554146 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dec7b682-a4dc-442c-b5b6-8160cd2dde01-config-volume\") pod \"alertmanager-main-0\" (UID: \"dec7b682-a4dc-442c-b5b6-8160cd2dde01\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:41:53.554300 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.554220 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dec7b682-a4dc-442c-b5b6-8160cd2dde01-config-out\") pod \"alertmanager-main-0\" (UID: \"dec7b682-a4dc-442c-b5b6-8160cd2dde01\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:41:53.554300 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.554254 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hljwz\" (UniqueName: \"kubernetes.io/projected/dec7b682-a4dc-442c-b5b6-8160cd2dde01-kube-api-access-hljwz\") pod \"alertmanager-main-0\" (UID: \"dec7b682-a4dc-442c-b5b6-8160cd2dde01\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:41:53.554300 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.554285 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dec7b682-a4dc-442c-b5b6-8160cd2dde01-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dec7b682-a4dc-442c-b5b6-8160cd2dde01\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:41:53.554300 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.554300 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dec7b682-a4dc-442c-b5b6-8160cd2dde01-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dec7b682-a4dc-442c-b5b6-8160cd2dde01\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:41:53.554503 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.554346 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dec7b682-a4dc-442c-b5b6-8160cd2dde01-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dec7b682-a4dc-442c-b5b6-8160cd2dde01\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:41:53.554503 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.554401 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dec7b682-a4dc-442c-b5b6-8160cd2dde01-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dec7b682-a4dc-442c-b5b6-8160cd2dde01\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:41:53.554503 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.554422 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dec7b682-a4dc-442c-b5b6-8160cd2dde01-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dec7b682-a4dc-442c-b5b6-8160cd2dde01\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:41:53.554503 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.554440 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dec7b682-a4dc-442c-b5b6-8160cd2dde01-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dec7b682-a4dc-442c-b5b6-8160cd2dde01\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:41:53.554503 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.554466 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dec7b682-a4dc-442c-b5b6-8160cd2dde01-web-config\") pod \"alertmanager-main-0\" (UID: \"dec7b682-a4dc-442c-b5b6-8160cd2dde01\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:41:53.554676 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.554528 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dec7b682-a4dc-442c-b5b6-8160cd2dde01-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dec7b682-a4dc-442c-b5b6-8160cd2dde01\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:41:53.554676 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.554558 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dec7b682-a4dc-442c-b5b6-8160cd2dde01-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dec7b682-a4dc-442c-b5b6-8160cd2dde01\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:41:53.655434 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.655398 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dec7b682-a4dc-442c-b5b6-8160cd2dde01-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dec7b682-a4dc-442c-b5b6-8160cd2dde01\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:41:53.655595 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.655454 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dec7b682-a4dc-442c-b5b6-8160cd2dde01-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dec7b682-a4dc-442c-b5b6-8160cd2dde01\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:41:53.655595 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.655482 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dec7b682-a4dc-442c-b5b6-8160cd2dde01-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dec7b682-a4dc-442c-b5b6-8160cd2dde01\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:41:53.655595 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.655506 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dec7b682-a4dc-442c-b5b6-8160cd2dde01-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dec7b682-a4dc-442c-b5b6-8160cd2dde01\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:41:53.655595 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.655538 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dec7b682-a4dc-442c-b5b6-8160cd2dde01-web-config\") pod \"alertmanager-main-0\" (UID: \"dec7b682-a4dc-442c-b5b6-8160cd2dde01\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:41:53.655595 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.655570 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dec7b682-a4dc-442c-b5b6-8160cd2dde01-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dec7b682-a4dc-442c-b5b6-8160cd2dde01\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:41:53.655806 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.655705 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dec7b682-a4dc-442c-b5b6-8160cd2dde01-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dec7b682-a4dc-442c-b5b6-8160cd2dde01\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:41:53.655806 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.655750 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dec7b682-a4dc-442c-b5b6-8160cd2dde01-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dec7b682-a4dc-442c-b5b6-8160cd2dde01\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:41:53.655806 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.655799 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dec7b682-a4dc-442c-b5b6-8160cd2dde01-config-volume\") pod \"alertmanager-main-0\" (UID: \"dec7b682-a4dc-442c-b5b6-8160cd2dde01\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:41:53.656005 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.655833 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dec7b682-a4dc-442c-b5b6-8160cd2dde01-config-out\") pod \"alertmanager-main-0\" (UID: \"dec7b682-a4dc-442c-b5b6-8160cd2dde01\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:41:53.656005 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.655892 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hljwz\" (UniqueName: \"kubernetes.io/projected/dec7b682-a4dc-442c-b5b6-8160cd2dde01-kube-api-access-hljwz\") pod \"alertmanager-main-0\" (UID: \"dec7b682-a4dc-442c-b5b6-8160cd2dde01\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:41:53.656005 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.655939 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dec7b682-a4dc-442c-b5b6-8160cd2dde01-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dec7b682-a4dc-442c-b5b6-8160cd2dde01\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:41:53.656005 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.655961 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dec7b682-a4dc-442c-b5b6-8160cd2dde01-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dec7b682-a4dc-442c-b5b6-8160cd2dde01\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:41:53.656324 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.656296 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dec7b682-a4dc-442c-b5b6-8160cd2dde01-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dec7b682-a4dc-442c-b5b6-8160cd2dde01\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:41:53.656430 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.656405 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dec7b682-a4dc-442c-b5b6-8160cd2dde01-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dec7b682-a4dc-442c-b5b6-8160cd2dde01\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:41:53.657559 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.657526 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dec7b682-a4dc-442c-b5b6-8160cd2dde01-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dec7b682-a4dc-442c-b5b6-8160cd2dde01\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:41:53.658724 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.658633 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dec7b682-a4dc-442c-b5b6-8160cd2dde01-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dec7b682-a4dc-442c-b5b6-8160cd2dde01\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:41:53.658724 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.658675 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dec7b682-a4dc-442c-b5b6-8160cd2dde01-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dec7b682-a4dc-442c-b5b6-8160cd2dde01\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:41:53.658724 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.658715 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dec7b682-a4dc-442c-b5b6-8160cd2dde01-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dec7b682-a4dc-442c-b5b6-8160cd2dde01\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:41:53.658998 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.658765 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dec7b682-a4dc-442c-b5b6-8160cd2dde01-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dec7b682-a4dc-442c-b5b6-8160cd2dde01\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:41:53.658998 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.658904 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dec7b682-a4dc-442c-b5b6-8160cd2dde01-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dec7b682-a4dc-442c-b5b6-8160cd2dde01\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:41:53.658998 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.658978 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dec7b682-a4dc-442c-b5b6-8160cd2dde01-config-volume\") pod \"alertmanager-main-0\" (UID: \"dec7b682-a4dc-442c-b5b6-8160cd2dde01\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:41:53.659094 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.659073 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dec7b682-a4dc-442c-b5b6-8160cd2dde01-web-config\") pod \"alertmanager-main-0\" (UID: \"dec7b682-a4dc-442c-b5b6-8160cd2dde01\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:41:53.660340 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.660325 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dec7b682-a4dc-442c-b5b6-8160cd2dde01-config-out\") pod \"alertmanager-main-0\" (UID: \"dec7b682-a4dc-442c-b5b6-8160cd2dde01\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:41:53.660603 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.660589 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dec7b682-a4dc-442c-b5b6-8160cd2dde01-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dec7b682-a4dc-442c-b5b6-8160cd2dde01\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:41:53.665685 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.665661 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hljwz\" (UniqueName: \"kubernetes.io/projected/dec7b682-a4dc-442c-b5b6-8160cd2dde01-kube-api-access-hljwz\") pod \"alertmanager-main-0\" (UID: \"dec7b682-a4dc-442c-b5b6-8160cd2dde01\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:41:53.683721 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.683694 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 12:41:53.819528 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:53.819362 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 12:41:53.821565 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:41:53.821539 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddec7b682_a4dc_442c_b5b6_8160cd2dde01.slice/crio-15feb43c9bbb7fd526a76332ca3f91771fdacff9667d6de6f0f315e613bfc2f5 WatchSource:0}: Error finding container 15feb43c9bbb7fd526a76332ca3f91771fdacff9667d6de6f0f315e613bfc2f5: Status 404 returned error can't find the container with id 15feb43c9bbb7fd526a76332ca3f91771fdacff9667d6de6f0f315e613bfc2f5 Jun 02 12:41:54.316254 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:54.316214 2545 generic.go:358] "Generic (PLEG): container finished" podID="dec7b682-a4dc-442c-b5b6-8160cd2dde01" containerID="dda060b082295c1b50c0892919cf8ab682037694511affbe96165cf5da024bde" exitCode=0 Jun 02 12:41:54.316670 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:54.316302 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dec7b682-a4dc-442c-b5b6-8160cd2dde01","Type":"ContainerDied","Data":"dda060b082295c1b50c0892919cf8ab682037694511affbe96165cf5da024bde"} Jun 02 12:41:54.316670 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:54.316349 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dec7b682-a4dc-442c-b5b6-8160cd2dde01","Type":"ContainerStarted","Data":"15feb43c9bbb7fd526a76332ca3f91771fdacff9667d6de6f0f315e613bfc2f5"} Jun 02 12:41:54.705680 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:54.705644 2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a90b8b35-8d21-472e-b073-a2887f5cb5cc" path="/var/lib/kubelet/pods/a90b8b35-8d21-472e-b073-a2887f5cb5cc/volumes" Jun 02 12:41:55.322810 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:55.322780 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dec7b682-a4dc-442c-b5b6-8160cd2dde01","Type":"ContainerStarted","Data":"fac783619d493c081964dbdb12ca2ba2a49bc5f2d58513c7ea42a90d45e1880e"} Jun 02 12:41:55.322810 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:55.322811 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dec7b682-a4dc-442c-b5b6-8160cd2dde01","Type":"ContainerStarted","Data":"45949f803664fb8d1a7f67602273d0ae380743a391cbc9a542a04d33e0bf262f"} Jun 02 12:41:55.323228 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:55.322822 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dec7b682-a4dc-442c-b5b6-8160cd2dde01","Type":"ContainerStarted","Data":"f95207bbb7f4c83ed03e9030ec0d838f650a56da604d3fc8f1493c67ec0201fc"} Jun 02 12:41:55.323228 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:55.322831 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dec7b682-a4dc-442c-b5b6-8160cd2dde01","Type":"ContainerStarted","Data":"9c6b69c8f2c3ed5aa7d1f6156f9907d8f43c7e9d06485e4e4a7a36205a061d14"} Jun 02 12:41:55.323228 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:55.322861 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dec7b682-a4dc-442c-b5b6-8160cd2dde01","Type":"ContainerStarted","Data":"eab34798d20250e88967211e3b14272c2310853e439c4d4294ded6e443e0e359"} Jun 02 12:41:55.323228 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:55.322870 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dec7b682-a4dc-442c-b5b6-8160cd2dde01","Type":"ContainerStarted","Data":"7d164601dab51a7d20171ba082765266ad5131fad35cf73bcd49db3d9af3ab22"} Jun 02 12:41:55.352931 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:55.352866 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.35285038 podStartE2EDuration="2.35285038s" podCreationTimestamp="2026-06-02 12:41:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 12:41:55.351124629 +0000 UTC m=+145.268739723" watchObservedRunningTime="2026-06-02 12:41:55.35285038 +0000 UTC m=+145.270465467" Jun 02 12:41:55.534458 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:55.534421 2545 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 12:41:55.535061 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:55.535024 2545 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f8caf18b-5f4e-4cd3-9a55-89644414806e" containerName="prometheus" containerID="cri-o://2b27aafa01cfcf215170772a5405b6fa59348947d335a5c2a6bc7f64a96f42b0" gracePeriod=600 Jun 02 12:41:55.535210 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:55.535084 2545 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f8caf18b-5f4e-4cd3-9a55-89644414806e" containerName="kube-rbac-proxy-web" containerID="cri-o://2372cb58ce2f8ce0c65d37083fb5a83f5016e267cf4f690ec269c186d5a5edb5" gracePeriod=600 Jun 02 12:41:55.535210 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:55.535109 2545 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f8caf18b-5f4e-4cd3-9a55-89644414806e" containerName="kube-rbac-proxy-thanos" containerID="cri-o://3cf67aa2c161e883a3521262244cd04eb3af4c8be99e965bf4743275f8f456c0" gracePeriod=600 Jun 02 12:41:55.535210 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:55.535172 2545 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f8caf18b-5f4e-4cd3-9a55-89644414806e" containerName="kube-rbac-proxy" containerID="cri-o://fd989afb75a2e7696ac7f8399e9109e3cd26f6d7f061f48017ebc683588a4a72" gracePeriod=600 Jun 02 12:41:55.535374 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:55.535207 2545 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f8caf18b-5f4e-4cd3-9a55-89644414806e" containerName="thanos-sidecar" containerID="cri-o://b233d698eab4a2c5305f6cbb007f3ec6647d325a272881056f521a9b8c8db84a" gracePeriod=600 Jun 02 12:41:55.535374 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:55.535237 2545 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f8caf18b-5f4e-4cd3-9a55-89644414806e" containerName="config-reloader" containerID="cri-o://497f91848c39a3c444271d58737e0ace4a244c204719187c33874b53b87c21b1" gracePeriod=600 Jun 02 12:41:56.328761 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:56.328731 2545 generic.go:358] "Generic (PLEG): container finished" podID="f8caf18b-5f4e-4cd3-9a55-89644414806e" containerID="3cf67aa2c161e883a3521262244cd04eb3af4c8be99e965bf4743275f8f456c0" exitCode=0 Jun 02 12:41:56.328761 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:56.328757 2545 generic.go:358] "Generic (PLEG): container finished" podID="f8caf18b-5f4e-4cd3-9a55-89644414806e" containerID="fd989afb75a2e7696ac7f8399e9109e3cd26f6d7f061f48017ebc683588a4a72" exitCode=0 Jun 02 12:41:56.328761 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:56.328763 2545 generic.go:358] "Generic (PLEG): container finished" podID="f8caf18b-5f4e-4cd3-9a55-89644414806e" containerID="b233d698eab4a2c5305f6cbb007f3ec6647d325a272881056f521a9b8c8db84a" exitCode=0 Jun 02 12:41:56.328761 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:56.328770 2545 generic.go:358] "Generic (PLEG): container finished" podID="f8caf18b-5f4e-4cd3-9a55-89644414806e" containerID="497f91848c39a3c444271d58737e0ace4a244c204719187c33874b53b87c21b1" exitCode=0 Jun 02 12:41:56.329224 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:56.328776 2545 generic.go:358] "Generic (PLEG): container finished" podID="f8caf18b-5f4e-4cd3-9a55-89644414806e" containerID="2b27aafa01cfcf215170772a5405b6fa59348947d335a5c2a6bc7f64a96f42b0" exitCode=0 Jun 02 12:41:56.329224 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:56.328798 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f8caf18b-5f4e-4cd3-9a55-89644414806e","Type":"ContainerDied","Data":"3cf67aa2c161e883a3521262244cd04eb3af4c8be99e965bf4743275f8f456c0"} Jun 02 12:41:56.329224 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:56.328829 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f8caf18b-5f4e-4cd3-9a55-89644414806e","Type":"ContainerDied","Data":"fd989afb75a2e7696ac7f8399e9109e3cd26f6d7f061f48017ebc683588a4a72"} Jun 02 12:41:56.329224 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:56.328858 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f8caf18b-5f4e-4cd3-9a55-89644414806e","Type":"ContainerDied","Data":"b233d698eab4a2c5305f6cbb007f3ec6647d325a272881056f521a9b8c8db84a"} Jun 02 12:41:56.329224 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:56.328872 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f8caf18b-5f4e-4cd3-9a55-89644414806e","Type":"ContainerDied","Data":"497f91848c39a3c444271d58737e0ace4a244c204719187c33874b53b87c21b1"} Jun 02 12:41:56.329224 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:56.328883 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f8caf18b-5f4e-4cd3-9a55-89644414806e","Type":"ContainerDied","Data":"2b27aafa01cfcf215170772a5405b6fa59348947d335a5c2a6bc7f64a96f42b0"} Jun 02 12:41:56.786872 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:56.786820 2545 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:41:56.886165 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:56.886090 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8caf18b-5f4e-4cd3-9a55-89644414806e-configmap-metrics-client-ca\") pod \"f8caf18b-5f4e-4cd3-9a55-89644414806e\" (UID: \"f8caf18b-5f4e-4cd3-9a55-89644414806e\") " Jun 02 12:41:56.886165 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:56.886135 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f8caf18b-5f4e-4cd3-9a55-89644414806e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"f8caf18b-5f4e-4cd3-9a55-89644414806e\" (UID: \"f8caf18b-5f4e-4cd3-9a55-89644414806e\") " Jun 02 12:41:56.886165 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:56.886162 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f8caf18b-5f4e-4cd3-9a55-89644414806e-prometheus-k8s-rulefiles-0\") pod \"f8caf18b-5f4e-4cd3-9a55-89644414806e\" (UID: \"f8caf18b-5f4e-4cd3-9a55-89644414806e\") " Jun 02 12:41:56.886417 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:56.886196 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-67dp8\" (UniqueName: \"kubernetes.io/projected/f8caf18b-5f4e-4cd3-9a55-89644414806e-kube-api-access-67dp8\") pod \"f8caf18b-5f4e-4cd3-9a55-89644414806e\" (UID: \"f8caf18b-5f4e-4cd3-9a55-89644414806e\") " Jun 02 12:41:56.886417 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:56.886221 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f8caf18b-5f4e-4cd3-9a55-89644414806e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"f8caf18b-5f4e-4cd3-9a55-89644414806e\" (UID: \"f8caf18b-5f4e-4cd3-9a55-89644414806e\") " Jun 02 12:41:56.886417 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:56.886359 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f8caf18b-5f4e-4cd3-9a55-89644414806e-secret-grpc-tls\") pod \"f8caf18b-5f4e-4cd3-9a55-89644414806e\" (UID: \"f8caf18b-5f4e-4cd3-9a55-89644414806e\") " Jun 02 12:41:56.886576 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:56.886421 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f8caf18b-5f4e-4cd3-9a55-89644414806e-web-config\") pod \"f8caf18b-5f4e-4cd3-9a55-89644414806e\" (UID: \"f8caf18b-5f4e-4cd3-9a55-89644414806e\") " Jun 02 12:41:56.886576 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:56.886448 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8caf18b-5f4e-4cd3-9a55-89644414806e-configmap-serving-certs-ca-bundle\") pod \"f8caf18b-5f4e-4cd3-9a55-89644414806e\" (UID: \"f8caf18b-5f4e-4cd3-9a55-89644414806e\") " Jun 02 12:41:56.886576 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:56.886490 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f8caf18b-5f4e-4cd3-9a55-89644414806e-config-out\") pod \"f8caf18b-5f4e-4cd3-9a55-89644414806e\" (UID: \"f8caf18b-5f4e-4cd3-9a55-89644414806e\") " Jun 02 12:41:56.886576 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:56.886524 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f8caf18b-5f4e-4cd3-9a55-89644414806e-config\") pod \"f8caf18b-5f4e-4cd3-9a55-89644414806e\" (UID: \"f8caf18b-5f4e-4cd3-9a55-89644414806e\") " Jun 02 12:41:56.886576 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:56.886529 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8caf18b-5f4e-4cd3-9a55-89644414806e-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "f8caf18b-5f4e-4cd3-9a55-89644414806e" (UID: "f8caf18b-5f4e-4cd3-9a55-89644414806e"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 12:41:56.886576 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:56.886549 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8caf18b-5f4e-4cd3-9a55-89644414806e-configmap-kubelet-serving-ca-bundle\") pod \"f8caf18b-5f4e-4cd3-9a55-89644414806e\" (UID: \"f8caf18b-5f4e-4cd3-9a55-89644414806e\") " Jun 02 12:41:56.886898 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:56.886580 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f8caf18b-5f4e-4cd3-9a55-89644414806e-secret-kube-rbac-proxy\") pod \"f8caf18b-5f4e-4cd3-9a55-89644414806e\" (UID: \"f8caf18b-5f4e-4cd3-9a55-89644414806e\") " Jun 02 12:41:56.886898 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:56.886608 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f8caf18b-5f4e-4cd3-9a55-89644414806e-prometheus-k8s-db\") pod \"f8caf18b-5f4e-4cd3-9a55-89644414806e\" (UID: \"f8caf18b-5f4e-4cd3-9a55-89644414806e\") " Jun 02 12:41:56.886898 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:56.886632 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f8caf18b-5f4e-4cd3-9a55-89644414806e-thanos-prometheus-http-client-file\") pod \"f8caf18b-5f4e-4cd3-9a55-89644414806e\" (UID: \"f8caf18b-5f4e-4cd3-9a55-89644414806e\") " Jun 02 12:41:56.886898 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:56.886658 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f8caf18b-5f4e-4cd3-9a55-89644414806e-secret-prometheus-k8s-tls\") pod \"f8caf18b-5f4e-4cd3-9a55-89644414806e\" (UID: \"f8caf18b-5f4e-4cd3-9a55-89644414806e\") " Jun 02 12:41:56.886898 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:56.886720 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8caf18b-5f4e-4cd3-9a55-89644414806e-prometheus-trusted-ca-bundle\") pod \"f8caf18b-5f4e-4cd3-9a55-89644414806e\" (UID: \"f8caf18b-5f4e-4cd3-9a55-89644414806e\") " Jun 02 12:41:56.886898 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:56.886758 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f8caf18b-5f4e-4cd3-9a55-89644414806e-secret-metrics-client-certs\") pod \"f8caf18b-5f4e-4cd3-9a55-89644414806e\" (UID: \"f8caf18b-5f4e-4cd3-9a55-89644414806e\") " Jun 02 12:41:56.886898 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:56.886795 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f8caf18b-5f4e-4cd3-9a55-89644414806e-tls-assets\") pod \"f8caf18b-5f4e-4cd3-9a55-89644414806e\" (UID: \"f8caf18b-5f4e-4cd3-9a55-89644414806e\") " Jun 02 12:41:56.887335 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:56.887313 2545 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8caf18b-5f4e-4cd3-9a55-89644414806e-configmap-metrics-client-ca\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\"" Jun 02 12:41:56.887411 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:56.887382 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8caf18b-5f4e-4cd3-9a55-89644414806e-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "f8caf18b-5f4e-4cd3-9a55-89644414806e" (UID: "f8caf18b-5f4e-4cd3-9a55-89644414806e"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 12:41:56.887789 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:56.887515 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8caf18b-5f4e-4cd3-9a55-89644414806e-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "f8caf18b-5f4e-4cd3-9a55-89644414806e" (UID: "f8caf18b-5f4e-4cd3-9a55-89644414806e"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 12:41:56.887930 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:56.887876 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8caf18b-5f4e-4cd3-9a55-89644414806e-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "f8caf18b-5f4e-4cd3-9a55-89644414806e" (UID: "f8caf18b-5f4e-4cd3-9a55-89644414806e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 12:41:56.888073 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:56.888046 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8caf18b-5f4e-4cd3-9a55-89644414806e-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "f8caf18b-5f4e-4cd3-9a55-89644414806e" (UID: "f8caf18b-5f4e-4cd3-9a55-89644414806e"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 12:41:56.889321 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:56.889292 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8caf18b-5f4e-4cd3-9a55-89644414806e-config-out" (OuterVolumeSpecName: "config-out") pod "f8caf18b-5f4e-4cd3-9a55-89644414806e" (UID: "f8caf18b-5f4e-4cd3-9a55-89644414806e"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 12:41:56.889753 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:56.889724 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8caf18b-5f4e-4cd3-9a55-89644414806e-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "f8caf18b-5f4e-4cd3-9a55-89644414806e" (UID: "f8caf18b-5f4e-4cd3-9a55-89644414806e"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 12:41:56.891337 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:56.891311 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8caf18b-5f4e-4cd3-9a55-89644414806e-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "f8caf18b-5f4e-4cd3-9a55-89644414806e" (UID: "f8caf18b-5f4e-4cd3-9a55-89644414806e"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 12:41:56.891421 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:56.891338 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8caf18b-5f4e-4cd3-9a55-89644414806e-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "f8caf18b-5f4e-4cd3-9a55-89644414806e" (UID: "f8caf18b-5f4e-4cd3-9a55-89644414806e"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 12:41:56.891421 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:56.891384 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8caf18b-5f4e-4cd3-9a55-89644414806e-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "f8caf18b-5f4e-4cd3-9a55-89644414806e" (UID: "f8caf18b-5f4e-4cd3-9a55-89644414806e"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 12:41:56.891421 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:56.891397 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8caf18b-5f4e-4cd3-9a55-89644414806e-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "f8caf18b-5f4e-4cd3-9a55-89644414806e" (UID: "f8caf18b-5f4e-4cd3-9a55-89644414806e"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 12:41:56.891421 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:56.891395 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8caf18b-5f4e-4cd3-9a55-89644414806e-kube-api-access-67dp8" (OuterVolumeSpecName: "kube-api-access-67dp8") pod "f8caf18b-5f4e-4cd3-9a55-89644414806e" (UID: "f8caf18b-5f4e-4cd3-9a55-89644414806e"). InnerVolumeSpecName "kube-api-access-67dp8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 12:41:56.891661 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:56.891559 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8caf18b-5f4e-4cd3-9a55-89644414806e-config" (OuterVolumeSpecName: "config") pod "f8caf18b-5f4e-4cd3-9a55-89644414806e" (UID: "f8caf18b-5f4e-4cd3-9a55-89644414806e"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 12:41:56.891828 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:56.891766 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8caf18b-5f4e-4cd3-9a55-89644414806e-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "f8caf18b-5f4e-4cd3-9a55-89644414806e" (UID: "f8caf18b-5f4e-4cd3-9a55-89644414806e"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 12:41:56.891910 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:56.891865 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8caf18b-5f4e-4cd3-9a55-89644414806e-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "f8caf18b-5f4e-4cd3-9a55-89644414806e" (UID: "f8caf18b-5f4e-4cd3-9a55-89644414806e"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 12:41:56.892190 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:56.892166 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8caf18b-5f4e-4cd3-9a55-89644414806e-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "f8caf18b-5f4e-4cd3-9a55-89644414806e" (UID: "f8caf18b-5f4e-4cd3-9a55-89644414806e"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 12:41:56.892670 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:56.892651 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8caf18b-5f4e-4cd3-9a55-89644414806e-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "f8caf18b-5f4e-4cd3-9a55-89644414806e" (UID: "f8caf18b-5f4e-4cd3-9a55-89644414806e"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 12:41:56.901479 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:56.901457 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8caf18b-5f4e-4cd3-9a55-89644414806e-web-config" (OuterVolumeSpecName: "web-config") pod "f8caf18b-5f4e-4cd3-9a55-89644414806e" (UID: "f8caf18b-5f4e-4cd3-9a55-89644414806e"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 12:41:56.988552 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:56.988523 2545 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f8caf18b-5f4e-4cd3-9a55-89644414806e-config-out\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\"" Jun 02 12:41:56.988552 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:56.988547 2545 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/f8caf18b-5f4e-4cd3-9a55-89644414806e-config\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\"" Jun 02 12:41:56.988678 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:56.988557 2545 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8caf18b-5f4e-4cd3-9a55-89644414806e-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\"" Jun 02 12:41:56.988678 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:56.988567 2545 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f8caf18b-5f4e-4cd3-9a55-89644414806e-secret-kube-rbac-proxy\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\"" Jun 02 12:41:56.988678 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:56.988576 2545 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f8caf18b-5f4e-4cd3-9a55-89644414806e-prometheus-k8s-db\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\"" Jun 02 12:41:56.988678 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:56.988585 2545 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f8caf18b-5f4e-4cd3-9a55-89644414806e-thanos-prometheus-http-client-file\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\"" Jun 02 12:41:56.988678 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:56.988595 2545 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f8caf18b-5f4e-4cd3-9a55-89644414806e-secret-prometheus-k8s-tls\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\"" Jun 02 12:41:56.988678 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:56.988604 2545 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8caf18b-5f4e-4cd3-9a55-89644414806e-prometheus-trusted-ca-bundle\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\"" Jun 02 12:41:56.988678 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:56.988613 2545 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f8caf18b-5f4e-4cd3-9a55-89644414806e-secret-metrics-client-certs\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\"" Jun 02 12:41:56.988678 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:56.988623 2545 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f8caf18b-5f4e-4cd3-9a55-89644414806e-tls-assets\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\"" Jun 02 12:41:56.988678 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:56.988631 2545 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f8caf18b-5f4e-4cd3-9a55-89644414806e-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\"" Jun 02 12:41:56.988678 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:56.988640 2545 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f8caf18b-5f4e-4cd3-9a55-89644414806e-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\"" Jun 02 12:41:56.988678 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:56.988648 2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-67dp8\" (UniqueName: \"kubernetes.io/projected/f8caf18b-5f4e-4cd3-9a55-89644414806e-kube-api-access-67dp8\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\"" Jun 02 12:41:56.988678 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:56.988658 2545 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f8caf18b-5f4e-4cd3-9a55-89644414806e-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\"" Jun 02 12:41:56.988678 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:56.988667 2545 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f8caf18b-5f4e-4cd3-9a55-89644414806e-secret-grpc-tls\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\"" Jun 02 12:41:56.988678 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:56.988676 2545 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f8caf18b-5f4e-4cd3-9a55-89644414806e-web-config\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\"" Jun 02 12:41:56.988678 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:56.988684 2545 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8caf18b-5f4e-4cd3-9a55-89644414806e-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\"" Jun 02 12:41:57.339227 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.339117 2545 generic.go:358] "Generic (PLEG): container finished" podID="f8caf18b-5f4e-4cd3-9a55-89644414806e" containerID="2372cb58ce2f8ce0c65d37083fb5a83f5016e267cf4f690ec269c186d5a5edb5" exitCode=0 Jun 02 12:41:57.339628 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.339277 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f8caf18b-5f4e-4cd3-9a55-89644414806e","Type":"ContainerDied","Data":"2372cb58ce2f8ce0c65d37083fb5a83f5016e267cf4f690ec269c186d5a5edb5"} Jun 02 12:41:57.339628 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.339383 2545 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:41:57.339628 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.339387 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f8caf18b-5f4e-4cd3-9a55-89644414806e","Type":"ContainerDied","Data":"d65fbe86f360f4a1c15765cf45bca4165bb7f15f4b3654f2d6b34c4519b24f42"} Jun 02 12:41:57.339628 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.339443 2545 scope.go:117] "RemoveContainer" containerID="3cf67aa2c161e883a3521262244cd04eb3af4c8be99e965bf4743275f8f456c0" Jun 02 12:41:57.349192 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.349103 2545 scope.go:117] "RemoveContainer" containerID="fd989afb75a2e7696ac7f8399e9109e3cd26f6d7f061f48017ebc683588a4a72" Jun 02 12:41:57.356233 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.356214 2545 scope.go:117] "RemoveContainer" containerID="2372cb58ce2f8ce0c65d37083fb5a83f5016e267cf4f690ec269c186d5a5edb5" Jun 02 12:41:57.363017 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.362997 2545 scope.go:117] "RemoveContainer" containerID="b233d698eab4a2c5305f6cbb007f3ec6647d325a272881056f521a9b8c8db84a" Jun 02 12:41:57.363738 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.363717 2545 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 12:41:57.367498 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.367477 2545 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 12:41:57.377989 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.377967 2545 scope.go:117] "RemoveContainer" containerID="497f91848c39a3c444271d58737e0ace4a244c204719187c33874b53b87c21b1" Jun 02 12:41:57.384299 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.384274 2545 scope.go:117] "RemoveContainer" containerID="2b27aafa01cfcf215170772a5405b6fa59348947d335a5c2a6bc7f64a96f42b0" Jun 02 12:41:57.391340 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.391319 2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 12:41:57.391631 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.391611 2545 scope.go:117] "RemoveContainer" containerID="1ffc76a8c308c8dd9a20b884dec13c5ac3318c22fbe92ddd9631aa675e0daad1" Jun 02 12:41:57.391766 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.391752 2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8caf18b-5f4e-4cd3-9a55-89644414806e" containerName="kube-rbac-proxy-thanos" Jun 02 12:41:57.391766 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.391765 2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8caf18b-5f4e-4cd3-9a55-89644414806e" containerName="kube-rbac-proxy-thanos" Jun 02 12:41:57.391869 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.391775 2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8caf18b-5f4e-4cd3-9a55-89644414806e" containerName="config-reloader" Jun 02 12:41:57.391869 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.391781 2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8caf18b-5f4e-4cd3-9a55-89644414806e" containerName="config-reloader" Jun 02 12:41:57.391869 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.391788 2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8caf18b-5f4e-4cd3-9a55-89644414806e" containerName="thanos-sidecar" Jun 02 12:41:57.391869 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.391796 2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8caf18b-5f4e-4cd3-9a55-89644414806e" containerName="thanos-sidecar" Jun 02 12:41:57.391869 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.391817 2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8caf18b-5f4e-4cd3-9a55-89644414806e" containerName="prometheus" Jun 02 12:41:57.391869 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.391823 2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8caf18b-5f4e-4cd3-9a55-89644414806e" containerName="prometheus" Jun 02 12:41:57.391869 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.391829 2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8caf18b-5f4e-4cd3-9a55-89644414806e" containerName="init-config-reloader" Jun 02 12:41:57.392091 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.391880 2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8caf18b-5f4e-4cd3-9a55-89644414806e" containerName="init-config-reloader" Jun 02 12:41:57.392091 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.391902 2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8caf18b-5f4e-4cd3-9a55-89644414806e" containerName="kube-rbac-proxy-web" Jun 02 12:41:57.392091 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.391910 2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8caf18b-5f4e-4cd3-9a55-89644414806e" containerName="kube-rbac-proxy-web" Jun 02 12:41:57.392091 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.391918 2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8caf18b-5f4e-4cd3-9a55-89644414806e" containerName="kube-rbac-proxy" Jun 02 12:41:57.392091 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.391923 2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8caf18b-5f4e-4cd3-9a55-89644414806e" containerName="kube-rbac-proxy" Jun 02 12:41:57.392091 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.391996 2545 memory_manager.go:356] "RemoveStaleState removing state" podUID="f8caf18b-5f4e-4cd3-9a55-89644414806e" containerName="config-reloader" Jun 02 12:41:57.392091 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.392009 2545 memory_manager.go:356] "RemoveStaleState removing state" podUID="f8caf18b-5f4e-4cd3-9a55-89644414806e" containerName="kube-rbac-proxy" Jun 02 12:41:57.392091 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.392016 2545 memory_manager.go:356] "RemoveStaleState removing state" podUID="f8caf18b-5f4e-4cd3-9a55-89644414806e" containerName="kube-rbac-proxy-web" Jun 02 12:41:57.392091 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.392023 2545 memory_manager.go:356] "RemoveStaleState removing state" podUID="f8caf18b-5f4e-4cd3-9a55-89644414806e" containerName="thanos-sidecar" Jun 02 12:41:57.392091 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.392030 2545 memory_manager.go:356] "RemoveStaleState removing state" podUID="f8caf18b-5f4e-4cd3-9a55-89644414806e" containerName="kube-rbac-proxy-thanos" Jun 02 12:41:57.392091 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.392036 2545 memory_manager.go:356] "RemoveStaleState removing state" podUID="f8caf18b-5f4e-4cd3-9a55-89644414806e" containerName="prometheus" Jun 02 12:41:57.398514 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.398493 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:41:57.399936 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.399921 2545 scope.go:117] "RemoveContainer" containerID="3cf67aa2c161e883a3521262244cd04eb3af4c8be99e965bf4743275f8f456c0" Jun 02 12:41:57.400228 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:41:57.400202 2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3cf67aa2c161e883a3521262244cd04eb3af4c8be99e965bf4743275f8f456c0\": container with ID starting with 3cf67aa2c161e883a3521262244cd04eb3af4c8be99e965bf4743275f8f456c0 not found: ID does not exist" containerID="3cf67aa2c161e883a3521262244cd04eb3af4c8be99e965bf4743275f8f456c0" Jun 02 12:41:57.400349 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.400230 2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3cf67aa2c161e883a3521262244cd04eb3af4c8be99e965bf4743275f8f456c0"} err="failed to get container status \"3cf67aa2c161e883a3521262244cd04eb3af4c8be99e965bf4743275f8f456c0\": rpc error: code = NotFound desc = could not find container \"3cf67aa2c161e883a3521262244cd04eb3af4c8be99e965bf4743275f8f456c0\": container with ID starting with 3cf67aa2c161e883a3521262244cd04eb3af4c8be99e965bf4743275f8f456c0 not found: ID does not exist" Jun 02 12:41:57.400349 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.400251 2545 scope.go:117] "RemoveContainer" containerID="fd989afb75a2e7696ac7f8399e9109e3cd26f6d7f061f48017ebc683588a4a72" Jun 02 12:41:57.400510 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.400475 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-8p2nh\"" Jun 02 12:41:57.400510 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:41:57.400487 2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd989afb75a2e7696ac7f8399e9109e3cd26f6d7f061f48017ebc683588a4a72\": container with ID starting with fd989afb75a2e7696ac7f8399e9109e3cd26f6d7f061f48017ebc683588a4a72 not found: ID does not exist" containerID="fd989afb75a2e7696ac7f8399e9109e3cd26f6d7f061f48017ebc683588a4a72" Jun 02 12:41:57.400619 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.400516 2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd989afb75a2e7696ac7f8399e9109e3cd26f6d7f061f48017ebc683588a4a72"} err="failed to get container status \"fd989afb75a2e7696ac7f8399e9109e3cd26f6d7f061f48017ebc683588a4a72\": rpc error: code = NotFound desc = could not find container \"fd989afb75a2e7696ac7f8399e9109e3cd26f6d7f061f48017ebc683588a4a72\": container with ID starting with fd989afb75a2e7696ac7f8399e9109e3cd26f6d7f061f48017ebc683588a4a72 not found: ID does not exist" Jun 02 12:41:57.400619 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.400534 2545 scope.go:117] "RemoveContainer" containerID="2372cb58ce2f8ce0c65d37083fb5a83f5016e267cf4f690ec269c186d5a5edb5" Jun 02 12:41:57.400619 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.400543 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 02 12:41:57.400821 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:41:57.400796 2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2372cb58ce2f8ce0c65d37083fb5a83f5016e267cf4f690ec269c186d5a5edb5\": container with ID starting with 2372cb58ce2f8ce0c65d37083fb5a83f5016e267cf4f690ec269c186d5a5edb5 not found: ID does not exist" containerID="2372cb58ce2f8ce0c65d37083fb5a83f5016e267cf4f690ec269c186d5a5edb5" Jun 02 12:41:57.400821 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.400817 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 02 12:41:57.401011 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.400829 2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2372cb58ce2f8ce0c65d37083fb5a83f5016e267cf4f690ec269c186d5a5edb5"} err="failed to get container status \"2372cb58ce2f8ce0c65d37083fb5a83f5016e267cf4f690ec269c186d5a5edb5\": rpc error: code = NotFound desc = could not find container \"2372cb58ce2f8ce0c65d37083fb5a83f5016e267cf4f690ec269c186d5a5edb5\": container with ID starting with 2372cb58ce2f8ce0c65d37083fb5a83f5016e267cf4f690ec269c186d5a5edb5 not found: ID does not exist" Jun 02 12:41:57.401011 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.400870 2545 scope.go:117] "RemoveContainer" containerID="b233d698eab4a2c5305f6cbb007f3ec6647d325a272881056f521a9b8c8db84a" Jun 02 12:41:57.401168 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:41:57.401150 2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b233d698eab4a2c5305f6cbb007f3ec6647d325a272881056f521a9b8c8db84a\": container with ID starting with b233d698eab4a2c5305f6cbb007f3ec6647d325a272881056f521a9b8c8db84a not found: ID does not exist" containerID="b233d698eab4a2c5305f6cbb007f3ec6647d325a272881056f521a9b8c8db84a" Jun 02 12:41:57.401258 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.401172 2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b233d698eab4a2c5305f6cbb007f3ec6647d325a272881056f521a9b8c8db84a"} err="failed to get container status \"b233d698eab4a2c5305f6cbb007f3ec6647d325a272881056f521a9b8c8db84a\": rpc error: code = NotFound desc = could not find container \"b233d698eab4a2c5305f6cbb007f3ec6647d325a272881056f521a9b8c8db84a\": container with ID starting with b233d698eab4a2c5305f6cbb007f3ec6647d325a272881056f521a9b8c8db84a not found: ID does not exist" Jun 02 12:41:57.401258 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.401192 2545 scope.go:117] "RemoveContainer" containerID="497f91848c39a3c444271d58737e0ace4a244c204719187c33874b53b87c21b1" Jun 02 12:41:57.401395 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.401258 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 02 12:41:57.401395 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.401316 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 02 12:41:57.401395 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.401324 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 02 12:41:57.401560 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:41:57.401511 2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"497f91848c39a3c444271d58737e0ace4a244c204719187c33874b53b87c21b1\": container with ID starting with 497f91848c39a3c444271d58737e0ace4a244c204719187c33874b53b87c21b1 not found: ID does not exist" containerID="497f91848c39a3c444271d58737e0ace4a244c204719187c33874b53b87c21b1" Jun 02 12:41:57.401560 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.401545 2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"497f91848c39a3c444271d58737e0ace4a244c204719187c33874b53b87c21b1"} err="failed to get container status \"497f91848c39a3c444271d58737e0ace4a244c204719187c33874b53b87c21b1\": rpc error: code = NotFound desc = could not find container \"497f91848c39a3c444271d58737e0ace4a244c204719187c33874b53b87c21b1\": container with ID starting with 497f91848c39a3c444271d58737e0ace4a244c204719187c33874b53b87c21b1 not found: ID does not exist" Jun 02 12:41:57.401669 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.401570 2545 scope.go:117] "RemoveContainer" containerID="2b27aafa01cfcf215170772a5405b6fa59348947d335a5c2a6bc7f64a96f42b0" Jun 02 12:41:57.401902 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:41:57.401874 2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b27aafa01cfcf215170772a5405b6fa59348947d335a5c2a6bc7f64a96f42b0\": container with ID starting with 2b27aafa01cfcf215170772a5405b6fa59348947d335a5c2a6bc7f64a96f42b0 not found: ID does not exist" containerID="2b27aafa01cfcf215170772a5405b6fa59348947d335a5c2a6bc7f64a96f42b0" Jun 02 12:41:57.402036 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.401911 2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b27aafa01cfcf215170772a5405b6fa59348947d335a5c2a6bc7f64a96f42b0"} err="failed to get container status \"2b27aafa01cfcf215170772a5405b6fa59348947d335a5c2a6bc7f64a96f42b0\": rpc error: code = NotFound desc = could not find container \"2b27aafa01cfcf215170772a5405b6fa59348947d335a5c2a6bc7f64a96f42b0\": container with ID starting with 2b27aafa01cfcf215170772a5405b6fa59348947d335a5c2a6bc7f64a96f42b0 not found: ID does not exist" Jun 02 12:41:57.402036 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.401933 2545 scope.go:117] "RemoveContainer" containerID="1ffc76a8c308c8dd9a20b884dec13c5ac3318c22fbe92ddd9631aa675e0daad1" Jun 02 12:41:57.402698 ip-10-0-128-229 kubenswrapper[2545]: E0602 12:41:57.402228 2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ffc76a8c308c8dd9a20b884dec13c5ac3318c22fbe92ddd9631aa675e0daad1\": container with ID starting with 1ffc76a8c308c8dd9a20b884dec13c5ac3318c22fbe92ddd9631aa675e0daad1 not found: ID does not exist" containerID="1ffc76a8c308c8dd9a20b884dec13c5ac3318c22fbe92ddd9631aa675e0daad1" Jun 02 12:41:57.402698 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.402259 2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ffc76a8c308c8dd9a20b884dec13c5ac3318c22fbe92ddd9631aa675e0daad1"} err="failed to get container status \"1ffc76a8c308c8dd9a20b884dec13c5ac3318c22fbe92ddd9631aa675e0daad1\": rpc error: code = NotFound desc = could not find container \"1ffc76a8c308c8dd9a20b884dec13c5ac3318c22fbe92ddd9631aa675e0daad1\": container with ID starting with 1ffc76a8c308c8dd9a20b884dec13c5ac3318c22fbe92ddd9631aa675e0daad1 not found: ID does not exist" Jun 02 12:41:57.402698 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.402579 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 02 12:41:57.403146 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.403120 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 02 12:41:57.403258 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.403165 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-72ehf7uv8sfqn\"" Jun 02 12:41:57.403258 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.403253 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 02 12:41:57.403379 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.403310 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 02 12:41:57.403434 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.403379 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 02 12:41:57.404040 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.404020 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 02 12:41:57.408138 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.408114 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 02 12:41:57.409753 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.409733 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 12:41:57.592503 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.592403 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8-config\") pod \"prometheus-k8s-0\" (UID: \"de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:41:57.592503 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.592455 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:41:57.592503 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.592475 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:41:57.592779 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.592518 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8-config-out\") pod \"prometheus-k8s-0\" (UID: \"de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:41:57.592779 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.592538 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:41:57.592779 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.592562 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8-web-config\") pod \"prometheus-k8s-0\" (UID: \"de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:41:57.592779 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.592579 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:41:57.592779 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.592599 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:41:57.592779 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.592614 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:41:57.592779 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.592637 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:41:57.592779 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.592700 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:41:57.592779 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.592749 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:41:57.593154 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.592790 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:41:57.593154 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.592823 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:41:57.593154 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.592890 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:41:57.593154 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.592936 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:41:57.593154 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.592961 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkfbf\" (UniqueName: \"kubernetes.io/projected/de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8-kube-api-access-rkfbf\") pod \"prometheus-k8s-0\" (UID: \"de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:41:57.593154 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.592997 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:41:57.693658 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.693621 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8-config\") pod \"prometheus-k8s-0\" (UID: \"de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:41:57.693658 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.693659 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:41:57.693918 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.693678 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:41:57.693918 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.693698 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8-config-out\") pod \"prometheus-k8s-0\" (UID: \"de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:41:57.693918 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.693811 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:41:57.693918 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.693873 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8-web-config\") pod \"prometheus-k8s-0\" (UID: \"de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:41:57.693918 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.693900 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:41:57.694158 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.693934 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:41:57.694158 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.693959 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:41:57.694158 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.693991 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:41:57.694158 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.694019 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:41:57.694158 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.694048 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:41:57.694158 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.694077 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:41:57.694158 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.694116 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:41:57.694158 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.694145 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:41:57.694556 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.694188 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:41:57.694556 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.694212 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rkfbf\" (UniqueName: \"kubernetes.io/projected/de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8-kube-api-access-rkfbf\") pod \"prometheus-k8s-0\" (UID: \"de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:41:57.694556 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.694250 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:41:57.696971 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.696929 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:41:57.697971 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.697207 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8-config\") pod \"prometheus-k8s-0\" (UID: \"de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:41:57.697971 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.697220 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:41:57.697971 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.697327 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:41:57.697971 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.697860 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:41:57.697971 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.698032 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:41:57.697971 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.698032 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:41:57.697971 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.698272 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8-config-out\") pod \"prometheus-k8s-0\" (UID: \"de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:41:57.699270 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.698563 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:41:57.699270 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.698644 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:41:57.699270 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.699215 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8-web-config\") pod \"prometheus-k8s-0\" (UID: \"de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:41:57.699882 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.699659 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:41:57.699882 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.699830 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:41:57.700505 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.700484 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:41:57.700682 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.700659 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:41:57.701102 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.701080 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:41:57.701420 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.701403 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:41:57.706857 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.706816 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkfbf\" (UniqueName: \"kubernetes.io/projected/de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8-kube-api-access-rkfbf\") pod \"prometheus-k8s-0\" (UID: \"de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:41:57.709855 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.709815 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:41:57.862343 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:57.862318 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 12:41:57.864993 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:41:57.864963 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde1ef2f2_ab7a_4bd4_9b52_ee0e3633c1f8.slice/crio-9dbeafcbeb4add8fd4e88c6bb0165369846080859fae303b388053fe7f0169e7 WatchSource:0}: Error finding container 9dbeafcbeb4add8fd4e88c6bb0165369846080859fae303b388053fe7f0169e7: Status 404 returned error can't find the container with id 9dbeafcbeb4add8fd4e88c6bb0165369846080859fae303b388053fe7f0169e7 Jun 02 12:41:58.343897 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:58.343797 2545 generic.go:358] "Generic (PLEG): container finished" podID="de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8" containerID="0213d75d71a584be1f9dd2a8e5676553520c3f44cf9568fc22eb5dfc61aa4efc" exitCode=0 Jun 02 12:41:58.343897 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:58.343884 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8","Type":"ContainerDied","Data":"0213d75d71a584be1f9dd2a8e5676553520c3f44cf9568fc22eb5dfc61aa4efc"} Jun 02 12:41:58.344247 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:58.343917 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8","Type":"ContainerStarted","Data":"9dbeafcbeb4add8fd4e88c6bb0165369846080859fae303b388053fe7f0169e7"} Jun 02 12:41:58.708813 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:58.708776 2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8caf18b-5f4e-4cd3-9a55-89644414806e" path="/var/lib/kubelet/pods/f8caf18b-5f4e-4cd3-9a55-89644414806e/volumes" Jun 02 12:41:59.350915 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:59.350883 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8","Type":"ContainerStarted","Data":"9b959bdf9f91fa687208d180ac53908c54a46b04d51d4f60fcb7c21a4b4d47f4"} Jun 02 12:41:59.350915 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:59.350920 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8","Type":"ContainerStarted","Data":"be13397b46ad121100688afcdd8f5b3ef63e32c7785a14d6306a48a784170a45"} Jun 02 12:41:59.351337 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:59.350936 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8","Type":"ContainerStarted","Data":"428c810f399f8935dd72051e51562e967b8555a2f0505d0eb45aaab4aa2fcfa4"} Jun 02 12:41:59.351337 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:59.350947 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8","Type":"ContainerStarted","Data":"65c302aec90e5735b2b87100c08c91e6c35921ee6bb020a3c223e93535aab46c"} Jun 02 12:41:59.351337 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:59.350957 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8","Type":"ContainerStarted","Data":"6ef4fd857f4c15a30b034646b126d4315c27f89bb6561c7066f7f741a43f092c"} Jun 02 12:41:59.351337 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:59.350965 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8","Type":"ContainerStarted","Data":"059512d18d8eb1ebf29b768edef0016d221dd1268975579c320d078e3d04053f"} Jun 02 12:41:59.378118 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:41:59.378064 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.378050467 podStartE2EDuration="2.378050467s" podCreationTimestamp="2026-06-02 12:41:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 12:41:59.376952817 +0000 UTC m=+149.294567915" watchObservedRunningTime="2026-06-02 12:41:59.378050467 +0000 UTC m=+149.295665563" Jun 02 12:42:02.709937 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:42:02.709901 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:42:39.113193 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:42:39.113155 2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-grnzw"] Jun 02 12:42:39.117826 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:42:39.117808 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-grnzw" Jun 02 12:42:39.119914 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:42:39.119891 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 02 12:42:39.124104 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:42:39.124082 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-grnzw"] Jun 02 12:42:39.241093 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:42:39.241064 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0d9a2489-eb98-43c1-9313-de439b59ff7f-dbus\") pod \"global-pull-secret-syncer-grnzw\" (UID: \"0d9a2489-eb98-43c1-9313-de439b59ff7f\") " pod="kube-system/global-pull-secret-syncer-grnzw" Jun 02 12:42:39.241245 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:42:39.241101 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0d9a2489-eb98-43c1-9313-de439b59ff7f-kubelet-config\") pod \"global-pull-secret-syncer-grnzw\" (UID: \"0d9a2489-eb98-43c1-9313-de439b59ff7f\") " pod="kube-system/global-pull-secret-syncer-grnzw" Jun 02 12:42:39.241245 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:42:39.241158 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0d9a2489-eb98-43c1-9313-de439b59ff7f-original-pull-secret\") pod \"global-pull-secret-syncer-grnzw\" (UID: \"0d9a2489-eb98-43c1-9313-de439b59ff7f\") " pod="kube-system/global-pull-secret-syncer-grnzw" Jun 02 12:42:39.342056 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:42:39.342029 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0d9a2489-eb98-43c1-9313-de439b59ff7f-dbus\") pod \"global-pull-secret-syncer-grnzw\" (UID: \"0d9a2489-eb98-43c1-9313-de439b59ff7f\") " pod="kube-system/global-pull-secret-syncer-grnzw" Jun 02 12:42:39.342209 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:42:39.342066 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0d9a2489-eb98-43c1-9313-de439b59ff7f-kubelet-config\") pod \"global-pull-secret-syncer-grnzw\" (UID: \"0d9a2489-eb98-43c1-9313-de439b59ff7f\") " pod="kube-system/global-pull-secret-syncer-grnzw" Jun 02 12:42:39.342209 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:42:39.342108 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0d9a2489-eb98-43c1-9313-de439b59ff7f-original-pull-secret\") pod \"global-pull-secret-syncer-grnzw\" (UID: \"0d9a2489-eb98-43c1-9313-de439b59ff7f\") " pod="kube-system/global-pull-secret-syncer-grnzw" Jun 02 12:42:39.342279 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:42:39.342220 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0d9a2489-eb98-43c1-9313-de439b59ff7f-dbus\") pod \"global-pull-secret-syncer-grnzw\" (UID: \"0d9a2489-eb98-43c1-9313-de439b59ff7f\") " pod="kube-system/global-pull-secret-syncer-grnzw" Jun 02 12:42:39.342279 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:42:39.342229 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0d9a2489-eb98-43c1-9313-de439b59ff7f-kubelet-config\") pod \"global-pull-secret-syncer-grnzw\" (UID: \"0d9a2489-eb98-43c1-9313-de439b59ff7f\") " pod="kube-system/global-pull-secret-syncer-grnzw" Jun 02 12:42:39.344275 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:42:39.344255 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0d9a2489-eb98-43c1-9313-de439b59ff7f-original-pull-secret\") pod \"global-pull-secret-syncer-grnzw\" (UID: \"0d9a2489-eb98-43c1-9313-de439b59ff7f\") " pod="kube-system/global-pull-secret-syncer-grnzw" Jun 02 12:42:39.427833 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:42:39.427775 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-grnzw" Jun 02 12:42:39.547880 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:42:39.547849 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-grnzw"] Jun 02 12:42:39.550469 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:42:39.550441 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d9a2489_eb98_43c1_9313_de439b59ff7f.slice/crio-d06f0ec85834c6627af11efcb6206430ff74cc9e2aa642e60a3bbf870b04dbbb WatchSource:0}: Error finding container d06f0ec85834c6627af11efcb6206430ff74cc9e2aa642e60a3bbf870b04dbbb: Status 404 returned error can't find the container with id d06f0ec85834c6627af11efcb6206430ff74cc9e2aa642e60a3bbf870b04dbbb Jun 02 12:42:40.467865 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:42:40.467820 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-grnzw" event={"ID":"0d9a2489-eb98-43c1-9313-de439b59ff7f","Type":"ContainerStarted","Data":"d06f0ec85834c6627af11efcb6206430ff74cc9e2aa642e60a3bbf870b04dbbb"} Jun 02 12:42:45.483389 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:42:45.483349 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-grnzw" event={"ID":"0d9a2489-eb98-43c1-9313-de439b59ff7f","Type":"ContainerStarted","Data":"d1bfc5fe8de7100ce9769a68c6917feaeab5b38621247746f42aabdf0eff5da4"} Jun 02 12:42:45.498120 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:42:45.498074 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-grnzw" podStartSLOduration=1.372685124 podStartE2EDuration="6.498060957s" podCreationTimestamp="2026-06-02 12:42:39 +0000 UTC" firstStartedPulling="2026-06-02 12:42:39.55231998 +0000 UTC m=+189.469935052" lastFinishedPulling="2026-06-02 12:42:44.677695808 +0000 UTC m=+194.595310885" observedRunningTime="2026-06-02 12:42:45.496426939 +0000 UTC m=+195.414042034" watchObservedRunningTime="2026-06-02 12:42:45.498060957 +0000 UTC m=+195.415676051" Jun 02 12:42:57.711006 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:42:57.710977 2545 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:42:57.725761 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:42:57.725735 2545 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:42:58.533910 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:42:58.533884 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 12:43:43.899654 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:43:43.899616 2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-h8546"] Jun 02 12:43:43.902579 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:43:43.902562 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-h8546" Jun 02 12:43:43.905384 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:43:43.905366 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 02 12:43:43.905480 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:43:43.905398 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 02 12:43:43.905997 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:43:43.905983 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-mmgx8\"" Jun 02 12:43:43.915375 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:43:43.915354 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-h8546"] Jun 02 12:43:44.085265 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:43:44.085232 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c3212c6-4232-4c48-8999-b285b2187755-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-h8546\" (UID: \"2c3212c6-4232-4c48-8999-b285b2187755\") " pod="cert-manager/cert-manager-cainjector-68b757865b-h8546" Jun 02 12:43:44.085464 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:43:44.085293 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2g2ff\" (UniqueName: \"kubernetes.io/projected/2c3212c6-4232-4c48-8999-b285b2187755-kube-api-access-2g2ff\") pod \"cert-manager-cainjector-68b757865b-h8546\" (UID: \"2c3212c6-4232-4c48-8999-b285b2187755\") " pod="cert-manager/cert-manager-cainjector-68b757865b-h8546" Jun 02 12:43:44.185977 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:43:44.185900 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2g2ff\" (UniqueName: \"kubernetes.io/projected/2c3212c6-4232-4c48-8999-b285b2187755-kube-api-access-2g2ff\") pod \"cert-manager-cainjector-68b757865b-h8546\" (UID: \"2c3212c6-4232-4c48-8999-b285b2187755\") " pod="cert-manager/cert-manager-cainjector-68b757865b-h8546" Jun 02 12:43:44.185977 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:43:44.185964 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c3212c6-4232-4c48-8999-b285b2187755-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-h8546\" (UID: \"2c3212c6-4232-4c48-8999-b285b2187755\") " pod="cert-manager/cert-manager-cainjector-68b757865b-h8546" Jun 02 12:43:44.194234 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:43:44.194206 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c3212c6-4232-4c48-8999-b285b2187755-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-h8546\" (UID: \"2c3212c6-4232-4c48-8999-b285b2187755\") " pod="cert-manager/cert-manager-cainjector-68b757865b-h8546" Jun 02 12:43:44.194362 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:43:44.194345 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2g2ff\" (UniqueName: \"kubernetes.io/projected/2c3212c6-4232-4c48-8999-b285b2187755-kube-api-access-2g2ff\") pod \"cert-manager-cainjector-68b757865b-h8546\" (UID: \"2c3212c6-4232-4c48-8999-b285b2187755\") " pod="cert-manager/cert-manager-cainjector-68b757865b-h8546" Jun 02 12:43:44.224691 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:43:44.224666 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-h8546" Jun 02 12:43:44.349901 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:43:44.349878 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-h8546"] Jun 02 12:43:44.352581 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:43:44.352531 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2c3212c6_4232_4c48_8999_b285b2187755.slice/crio-7b83cc8b1391af74c60b46bbe43eb270989c9762e2842b56dda5815ceb335ca4 WatchSource:0}: Error finding container 7b83cc8b1391af74c60b46bbe43eb270989c9762e2842b56dda5815ceb335ca4: Status 404 returned error can't find the container with id 7b83cc8b1391af74c60b46bbe43eb270989c9762e2842b56dda5815ceb335ca4 Jun 02 12:43:44.649870 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:43:44.649812 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-h8546" event={"ID":"2c3212c6-4232-4c48-8999-b285b2187755","Type":"ContainerStarted","Data":"7b83cc8b1391af74c60b46bbe43eb270989c9762e2842b56dda5815ceb335ca4"} Jun 02 12:43:45.977812 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:43:45.977728 2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-4dfs7"] Jun 02 12:43:45.988674 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:43:45.988643 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-4dfs7" Jun 02 12:43:45.988946 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:43:45.988910 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-4dfs7"] Jun 02 12:43:45.990994 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:43:45.990688 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-2v8gg\"" Jun 02 12:43:46.005214 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:43:46.005181 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9gpm\" (UniqueName: \"kubernetes.io/projected/b85a8018-a5d0-4c3c-abeb-32839b8877f5-kube-api-access-l9gpm\") pod \"cert-manager-webhook-587ccfb98-4dfs7\" (UID: \"b85a8018-a5d0-4c3c-abeb-32839b8877f5\") " pod="cert-manager/cert-manager-webhook-587ccfb98-4dfs7" Jun 02 12:43:46.005331 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:43:46.005307 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b85a8018-a5d0-4c3c-abeb-32839b8877f5-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-4dfs7\" (UID: \"b85a8018-a5d0-4c3c-abeb-32839b8877f5\") " pod="cert-manager/cert-manager-webhook-587ccfb98-4dfs7" Jun 02 12:43:46.106742 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:43:46.106689 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l9gpm\" (UniqueName: \"kubernetes.io/projected/b85a8018-a5d0-4c3c-abeb-32839b8877f5-kube-api-access-l9gpm\") pod \"cert-manager-webhook-587ccfb98-4dfs7\" (UID: \"b85a8018-a5d0-4c3c-abeb-32839b8877f5\") " pod="cert-manager/cert-manager-webhook-587ccfb98-4dfs7" Jun 02 12:43:46.106932 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:43:46.106779 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b85a8018-a5d0-4c3c-abeb-32839b8877f5-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-4dfs7\" (UID: \"b85a8018-a5d0-4c3c-abeb-32839b8877f5\") " pod="cert-manager/cert-manager-webhook-587ccfb98-4dfs7" Jun 02 12:43:46.114159 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:43:46.114127 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b85a8018-a5d0-4c3c-abeb-32839b8877f5-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-4dfs7\" (UID: \"b85a8018-a5d0-4c3c-abeb-32839b8877f5\") " pod="cert-manager/cert-manager-webhook-587ccfb98-4dfs7" Jun 02 12:43:46.114328 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:43:46.114311 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9gpm\" (UniqueName: \"kubernetes.io/projected/b85a8018-a5d0-4c3c-abeb-32839b8877f5-kube-api-access-l9gpm\") pod \"cert-manager-webhook-587ccfb98-4dfs7\" (UID: \"b85a8018-a5d0-4c3c-abeb-32839b8877f5\") " pod="cert-manager/cert-manager-webhook-587ccfb98-4dfs7" Jun 02 12:43:46.301885 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:43:46.301795 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-4dfs7" Jun 02 12:43:46.430568 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:43:46.430539 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-4dfs7"] Jun 02 12:43:46.433612 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:43:46.433581 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb85a8018_a5d0_4c3c_abeb_32839b8877f5.slice/crio-256e5d63013edef07c9f8c7c717879447923c6689e989634f24d4ee6c1db6af5 WatchSource:0}: Error finding container 256e5d63013edef07c9f8c7c717879447923c6689e989634f24d4ee6c1db6af5: Status 404 returned error can't find the container with id 256e5d63013edef07c9f8c7c717879447923c6689e989634f24d4ee6c1db6af5 Jun 02 12:43:46.657233 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:43:46.657198 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-4dfs7" event={"ID":"b85a8018-a5d0-4c3c-abeb-32839b8877f5","Type":"ContainerStarted","Data":"256e5d63013edef07c9f8c7c717879447923c6689e989634f24d4ee6c1db6af5"} Jun 02 12:43:48.665267 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:43:48.665222 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-h8546" event={"ID":"2c3212c6-4232-4c48-8999-b285b2187755","Type":"ContainerStarted","Data":"eb68395aa8b60f970f81001be2b60d37d9f1092122c0cd7dcbe9910068f92fac"} Jun 02 12:43:48.666510 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:43:48.666490 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-4dfs7" event={"ID":"b85a8018-a5d0-4c3c-abeb-32839b8877f5","Type":"ContainerStarted","Data":"344c420e01e90be2d38011f6f13331def98cb6994cf84dc0809e32d81c8510ed"} Jun 02 12:43:48.666586 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:43:48.666536 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-4dfs7" Jun 02 12:43:48.680251 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:43:48.680183 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-h8546" podStartSLOduration=2.093230338 podStartE2EDuration="5.680171465s" podCreationTimestamp="2026-06-02 12:43:43 +0000 UTC" firstStartedPulling="2026-06-02 12:43:44.354387532 +0000 UTC m=+254.272002604" lastFinishedPulling="2026-06-02 12:43:47.941328656 +0000 UTC m=+257.858943731" observedRunningTime="2026-06-02 12:43:48.679266936 +0000 UTC m=+258.596882032" watchObservedRunningTime="2026-06-02 12:43:48.680171465 +0000 UTC m=+258.597786560" Jun 02 12:43:48.693553 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:43:48.693504 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-4dfs7" podStartSLOduration=2.115035335 podStartE2EDuration="3.693491174s" podCreationTimestamp="2026-06-02 12:43:45 +0000 UTC" firstStartedPulling="2026-06-02 12:43:46.435990961 +0000 UTC m=+256.353606034" lastFinishedPulling="2026-06-02 12:43:48.014446785 +0000 UTC m=+257.932061873" observedRunningTime="2026-06-02 12:43:48.692962225 +0000 UTC m=+258.610577331" watchObservedRunningTime="2026-06-02 12:43:48.693491174 +0000 UTC m=+258.611106270" Jun 02 12:43:54.672811 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:43:54.672780 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-4dfs7" Jun 02 12:44:30.599892 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:44:30.599865 2545 kubelet.go:1628] "Image garbage collection succeeded" Jun 02 12:46:09.240938 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:46:09.240902 2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-646657454-9fjlh"] Jun 02 12:46:09.244388 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:46:09.244370 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-646657454-9fjlh" Jun 02 12:46:09.246375 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:46:09.246353 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 02 12:46:09.247013 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:46:09.246994 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 02 12:46:09.247122 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:46:09.247109 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-cjngn\"" Jun 02 12:46:09.247192 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:46:09.247045 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 02 12:46:09.247192 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:46:09.247064 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 02 12:46:09.247192 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:46:09.247081 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 02 12:46:09.247329 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:46:09.247085 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 02 12:46:09.247329 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:46:09.247064 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 02 12:46:09.252120 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:46:09.252100 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 02 12:46:09.257604 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:46:09.257582 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-646657454-9fjlh"] Jun 02 12:46:09.354418 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:46:09.354385 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4fa70586-2354-407c-bd79-5a7983421d7a-service-ca\") pod \"console-646657454-9fjlh\" (UID: \"4fa70586-2354-407c-bd79-5a7983421d7a\") " pod="openshift-console/console-646657454-9fjlh" Jun 02 12:46:09.354559 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:46:09.354429 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4fa70586-2354-407c-bd79-5a7983421d7a-console-config\") pod \"console-646657454-9fjlh\" (UID: \"4fa70586-2354-407c-bd79-5a7983421d7a\") " pod="openshift-console/console-646657454-9fjlh" Jun 02 12:46:09.354559 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:46:09.354447 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4fa70586-2354-407c-bd79-5a7983421d7a-oauth-serving-cert\") pod \"console-646657454-9fjlh\" (UID: \"4fa70586-2354-407c-bd79-5a7983421d7a\") " pod="openshift-console/console-646657454-9fjlh" Jun 02 12:46:09.354559 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:46:09.354469 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fa70586-2354-407c-bd79-5a7983421d7a-trusted-ca-bundle\") pod \"console-646657454-9fjlh\" (UID: \"4fa70586-2354-407c-bd79-5a7983421d7a\") " pod="openshift-console/console-646657454-9fjlh" Jun 02 12:46:09.354559 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:46:09.354493 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qw5wz\" (UniqueName: \"kubernetes.io/projected/4fa70586-2354-407c-bd79-5a7983421d7a-kube-api-access-qw5wz\") pod \"console-646657454-9fjlh\" (UID: \"4fa70586-2354-407c-bd79-5a7983421d7a\") " pod="openshift-console/console-646657454-9fjlh" Jun 02 12:46:09.354559 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:46:09.354519 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4fa70586-2354-407c-bd79-5a7983421d7a-console-oauth-config\") pod \"console-646657454-9fjlh\" (UID: \"4fa70586-2354-407c-bd79-5a7983421d7a\") " pod="openshift-console/console-646657454-9fjlh" Jun 02 12:46:09.354766 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:46:09.354592 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4fa70586-2354-407c-bd79-5a7983421d7a-console-serving-cert\") pod \"console-646657454-9fjlh\" (UID: \"4fa70586-2354-407c-bd79-5a7983421d7a\") " pod="openshift-console/console-646657454-9fjlh" Jun 02 12:46:09.455239 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:46:09.455200 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fa70586-2354-407c-bd79-5a7983421d7a-trusted-ca-bundle\") pod \"console-646657454-9fjlh\" (UID: \"4fa70586-2354-407c-bd79-5a7983421d7a\") " pod="openshift-console/console-646657454-9fjlh" Jun 02 12:46:09.455355 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:46:09.455248 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qw5wz\" (UniqueName: \"kubernetes.io/projected/4fa70586-2354-407c-bd79-5a7983421d7a-kube-api-access-qw5wz\") pod \"console-646657454-9fjlh\" (UID: \"4fa70586-2354-407c-bd79-5a7983421d7a\") " pod="openshift-console/console-646657454-9fjlh" Jun 02 12:46:09.455392 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:46:09.455367 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4fa70586-2354-407c-bd79-5a7983421d7a-console-oauth-config\") pod \"console-646657454-9fjlh\" (UID: \"4fa70586-2354-407c-bd79-5a7983421d7a\") " pod="openshift-console/console-646657454-9fjlh" Jun 02 12:46:09.455428 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:46:09.455414 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4fa70586-2354-407c-bd79-5a7983421d7a-console-serving-cert\") pod \"console-646657454-9fjlh\" (UID: \"4fa70586-2354-407c-bd79-5a7983421d7a\") " pod="openshift-console/console-646657454-9fjlh" Jun 02 12:46:09.455468 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:46:09.455458 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4fa70586-2354-407c-bd79-5a7983421d7a-service-ca\") pod \"console-646657454-9fjlh\" (UID: \"4fa70586-2354-407c-bd79-5a7983421d7a\") " pod="openshift-console/console-646657454-9fjlh" Jun 02 12:46:09.455506 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:46:09.455496 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4fa70586-2354-407c-bd79-5a7983421d7a-console-config\") pod \"console-646657454-9fjlh\" (UID: \"4fa70586-2354-407c-bd79-5a7983421d7a\") " pod="openshift-console/console-646657454-9fjlh" Jun 02 12:46:09.455553 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:46:09.455513 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4fa70586-2354-407c-bd79-5a7983421d7a-oauth-serving-cert\") pod \"console-646657454-9fjlh\" (UID: \"4fa70586-2354-407c-bd79-5a7983421d7a\") " pod="openshift-console/console-646657454-9fjlh" Jun 02 12:46:09.456154 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:46:09.456128 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fa70586-2354-407c-bd79-5a7983421d7a-trusted-ca-bundle\") pod \"console-646657454-9fjlh\" (UID: \"4fa70586-2354-407c-bd79-5a7983421d7a\") " pod="openshift-console/console-646657454-9fjlh" Jun 02 12:46:09.456272 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:46:09.456160 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4fa70586-2354-407c-bd79-5a7983421d7a-console-config\") pod \"console-646657454-9fjlh\" (UID: \"4fa70586-2354-407c-bd79-5a7983421d7a\") " pod="openshift-console/console-646657454-9fjlh" Jun 02 12:46:09.456272 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:46:09.456221 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4fa70586-2354-407c-bd79-5a7983421d7a-oauth-serving-cert\") pod \"console-646657454-9fjlh\" (UID: \"4fa70586-2354-407c-bd79-5a7983421d7a\") " pod="openshift-console/console-646657454-9fjlh" Jun 02 12:46:09.456272 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:46:09.456265 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4fa70586-2354-407c-bd79-5a7983421d7a-service-ca\") pod \"console-646657454-9fjlh\" (UID: \"4fa70586-2354-407c-bd79-5a7983421d7a\") " pod="openshift-console/console-646657454-9fjlh" Jun 02 12:46:09.457804 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:46:09.457774 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4fa70586-2354-407c-bd79-5a7983421d7a-console-oauth-config\") pod \"console-646657454-9fjlh\" (UID: \"4fa70586-2354-407c-bd79-5a7983421d7a\") " pod="openshift-console/console-646657454-9fjlh" Jun 02 12:46:09.457978 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:46:09.457957 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4fa70586-2354-407c-bd79-5a7983421d7a-console-serving-cert\") pod \"console-646657454-9fjlh\" (UID: \"4fa70586-2354-407c-bd79-5a7983421d7a\") " pod="openshift-console/console-646657454-9fjlh" Jun 02 12:46:09.462604 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:46:09.462584 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qw5wz\" (UniqueName: \"kubernetes.io/projected/4fa70586-2354-407c-bd79-5a7983421d7a-kube-api-access-qw5wz\") pod \"console-646657454-9fjlh\" (UID: \"4fa70586-2354-407c-bd79-5a7983421d7a\") " pod="openshift-console/console-646657454-9fjlh" Jun 02 12:46:09.554531 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:46:09.554462 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-646657454-9fjlh" Jun 02 12:46:09.680976 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:46:09.680952 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-646657454-9fjlh"] Jun 02 12:46:09.683408 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:46:09.683382 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fa70586_2354_407c_bd79_5a7983421d7a.slice/crio-b7d22d6abad31361dea6feaf30c427bfe3499124658fac9cda4f59fb670de517 WatchSource:0}: Error finding container b7d22d6abad31361dea6feaf30c427bfe3499124658fac9cda4f59fb670de517: Status 404 returned error can't find the container with id b7d22d6abad31361dea6feaf30c427bfe3499124658fac9cda4f59fb670de517 Jun 02 12:46:09.685107 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:46:09.685090 2545 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 12:46:10.078593 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:46:10.078556 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-646657454-9fjlh" event={"ID":"4fa70586-2354-407c-bd79-5a7983421d7a","Type":"ContainerStarted","Data":"af7a420ecbd29c419011f049fbeaac78d67e1ab8edf32d899304bafdec041a49"} Jun 02 12:46:10.078800 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:46:10.078600 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-646657454-9fjlh" event={"ID":"4fa70586-2354-407c-bd79-5a7983421d7a","Type":"ContainerStarted","Data":"b7d22d6abad31361dea6feaf30c427bfe3499124658fac9cda4f59fb670de517"} Jun 02 12:46:10.095785 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:46:10.095725 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-646657454-9fjlh" podStartSLOduration=1.095711056 podStartE2EDuration="1.095711056s" podCreationTimestamp="2026-06-02 12:46:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 12:46:10.095270915 +0000 UTC m=+400.012886011" watchObservedRunningTime="2026-06-02 12:46:10.095711056 +0000 UTC m=+400.013326150" Jun 02 12:46:19.555347 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:46:19.555312 2545 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-646657454-9fjlh" Jun 02 12:46:19.555347 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:46:19.555352 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-646657454-9fjlh" Jun 02 12:46:19.560155 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:46:19.560134 2545 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-646657454-9fjlh" Jun 02 12:46:20.113483 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:46:20.113457 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-646657454-9fjlh" Jun 02 12:46:42.825414 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:46:42.825376 2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-t6f2r/test-trainjob-78qnd-node-0-0-kt98z"] Jun 02 12:46:42.828929 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:46:42.828912 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-t6f2r/test-trainjob-78qnd-node-0-0-kt98z" Jun 02 12:46:42.830743 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:46:42.830725 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-t6f2r\"/\"default-dockercfg-4n85x\"" Jun 02 12:46:42.830857 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:46:42.830728 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-t6f2r\"/\"kube-root-ca.crt\"" Jun 02 12:46:42.831310 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:46:42.831292 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-t6f2r\"/\"openshift-service-ca.crt\"" Jun 02 12:46:42.836644 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:46:42.836623 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-t6f2r/test-trainjob-78qnd-node-0-0-kt98z"] Jun 02 12:46:42.851913 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:46:42.851891 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8t6m\" (UniqueName: \"kubernetes.io/projected/8d58aaa9-527f-4394-9161-aa13871db750-kube-api-access-k8t6m\") pod \"test-trainjob-78qnd-node-0-0-kt98z\" (UID: \"8d58aaa9-527f-4394-9161-aa13871db750\") " pod="test-ns-t6f2r/test-trainjob-78qnd-node-0-0-kt98z" Jun 02 12:46:42.952341 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:46:42.952309 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k8t6m\" (UniqueName: \"kubernetes.io/projected/8d58aaa9-527f-4394-9161-aa13871db750-kube-api-access-k8t6m\") pod \"test-trainjob-78qnd-node-0-0-kt98z\" (UID: \"8d58aaa9-527f-4394-9161-aa13871db750\") " pod="test-ns-t6f2r/test-trainjob-78qnd-node-0-0-kt98z" Jun 02 12:46:42.960137 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:46:42.960114 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8t6m\" (UniqueName: \"kubernetes.io/projected/8d58aaa9-527f-4394-9161-aa13871db750-kube-api-access-k8t6m\") pod \"test-trainjob-78qnd-node-0-0-kt98z\" (UID: \"8d58aaa9-527f-4394-9161-aa13871db750\") " pod="test-ns-t6f2r/test-trainjob-78qnd-node-0-0-kt98z" Jun 02 12:46:43.138601 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:46:43.138553 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-t6f2r/test-trainjob-78qnd-node-0-0-kt98z" Jun 02 12:46:43.263501 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:46:43.263474 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-t6f2r/test-trainjob-78qnd-node-0-0-kt98z"] Jun 02 12:46:43.266109 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:46:43.266080 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8d58aaa9_527f_4394_9161_aa13871db750.slice/crio-65ab891e05d8c3cc0b42952cafb4274c3f7cac71ed306f387a792e941e082f02 WatchSource:0}: Error finding container 65ab891e05d8c3cc0b42952cafb4274c3f7cac71ed306f387a792e941e082f02: Status 404 returned error can't find the container with id 65ab891e05d8c3cc0b42952cafb4274c3f7cac71ed306f387a792e941e082f02 Jun 02 12:46:44.187856 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:46:44.187805 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-t6f2r/test-trainjob-78qnd-node-0-0-kt98z" event={"ID":"8d58aaa9-527f-4394-9161-aa13871db750","Type":"ContainerStarted","Data":"65ab891e05d8c3cc0b42952cafb4274c3f7cac71ed306f387a792e941e082f02"} Jun 02 12:50:46.001559 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:50:46.001469 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-t6f2r/test-trainjob-78qnd-node-0-0-kt98z" event={"ID":"8d58aaa9-527f-4394-9161-aa13871db750","Type":"ContainerStarted","Data":"d4ca2a4e5c78cd9faf365e980650098be52f5499539eff9e1b8a681dd4b0e069"} Jun 02 12:50:46.026113 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:50:46.026056 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-t6f2r/test-trainjob-78qnd-node-0-0-kt98z" podStartSLOduration=1.668952845 podStartE2EDuration="4m4.02603619s" podCreationTimestamp="2026-06-02 12:46:42 +0000 UTC" firstStartedPulling="2026-06-02 12:46:43.268414332 +0000 UTC m=+433.186029405" lastFinishedPulling="2026-06-02 12:50:45.625497678 +0000 UTC m=+675.543112750" observedRunningTime="2026-06-02 12:50:46.025176262 +0000 UTC m=+675.942791358" watchObservedRunningTime="2026-06-02 12:50:46.02603619 +0000 UTC m=+675.943651287" Jun 02 12:50:48.686427 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:50:48.686390 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-t6f2r_test-trainjob-78qnd-node-0-0-kt98z_8d58aaa9-527f-4394-9161-aa13871db750/node/0.log" Jun 02 12:50:51.686859 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:50:51.686808 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-t6f2r_test-trainjob-78qnd-node-0-0-kt98z_8d58aaa9-527f-4394-9161-aa13871db750/node/0.log" Jun 02 12:50:53.023756 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:50:53.023725 2545 generic.go:358] "Generic (PLEG): container finished" podID="8d58aaa9-527f-4394-9161-aa13871db750" containerID="d4ca2a4e5c78cd9faf365e980650098be52f5499539eff9e1b8a681dd4b0e069" exitCode=0 Jun 02 12:50:53.024151 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:50:53.023779 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-t6f2r/test-trainjob-78qnd-node-0-0-kt98z" event={"ID":"8d58aaa9-527f-4394-9161-aa13871db750","Type":"ContainerDied","Data":"d4ca2a4e5c78cd9faf365e980650098be52f5499539eff9e1b8a681dd4b0e069"} Jun 02 12:50:54.155480 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:50:54.155458 2545 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-t6f2r/test-trainjob-78qnd-node-0-0-kt98z" Jun 02 12:50:54.292206 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:50:54.292134 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k8t6m\" (UniqueName: \"kubernetes.io/projected/8d58aaa9-527f-4394-9161-aa13871db750-kube-api-access-k8t6m\") pod \"8d58aaa9-527f-4394-9161-aa13871db750\" (UID: \"8d58aaa9-527f-4394-9161-aa13871db750\") " Jun 02 12:50:54.294109 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:50:54.294086 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d58aaa9-527f-4394-9161-aa13871db750-kube-api-access-k8t6m" (OuterVolumeSpecName: "kube-api-access-k8t6m") pod "8d58aaa9-527f-4394-9161-aa13871db750" (UID: "8d58aaa9-527f-4394-9161-aa13871db750"). InnerVolumeSpecName "kube-api-access-k8t6m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 12:50:54.393759 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:50:54.393728 2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k8t6m\" (UniqueName: \"kubernetes.io/projected/8d58aaa9-527f-4394-9161-aa13871db750-kube-api-access-k8t6m\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\"" Jun 02 12:50:54.685854 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:50:54.685824 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-t6f2r_test-trainjob-78qnd-node-0-0-kt98z_8d58aaa9-527f-4394-9161-aa13871db750/node/0.log" Jun 02 12:50:55.030962 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:50:55.030880 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-t6f2r/test-trainjob-78qnd-node-0-0-kt98z" event={"ID":"8d58aaa9-527f-4394-9161-aa13871db750","Type":"ContainerDied","Data":"65ab891e05d8c3cc0b42952cafb4274c3f7cac71ed306f387a792e941e082f02"} Jun 02 12:50:55.030962 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:50:55.030913 2545 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="65ab891e05d8c3cc0b42952cafb4274c3f7cac71ed306f387a792e941e082f02" Jun 02 12:50:55.030962 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:50:55.030892 2545 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-t6f2r/test-trainjob-78qnd-node-0-0-kt98z" Jun 02 12:50:55.869319 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:50:55.869292 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-t6f2r_test-trainjob-78qnd-node-0-0-kt98z_8d58aaa9-527f-4394-9161-aa13871db750/node/0.log" Jun 02 12:51:00.911013 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:51:00.910973 2545 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-t6f2r/test-trainjob-78qnd-node-0-0-kt98z"] Jun 02 12:51:00.914407 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:51:00.914383 2545 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-t6f2r/test-trainjob-78qnd-node-0-0-kt98z"] Jun 02 12:51:02.706282 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:51:02.706250 2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d58aaa9-527f-4394-9161-aa13871db750" path="/var/lib/kubelet/pods/8d58aaa9-527f-4394-9161-aa13871db750/volumes" Jun 02 12:51:51.395186 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:51:51.395107 2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-nfhkx/must-gather-62cnn"] Jun 02 12:51:51.395623 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:51:51.395474 2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d58aaa9-527f-4394-9161-aa13871db750" containerName="node" Jun 02 12:51:51.395623 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:51:51.395488 2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d58aaa9-527f-4394-9161-aa13871db750" containerName="node" Jun 02 12:51:51.395623 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:51:51.395560 2545 memory_manager.go:356] "RemoveStaleState removing state" podUID="8d58aaa9-527f-4394-9161-aa13871db750" containerName="node" Jun 02 12:51:51.398713 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:51:51.398695 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nfhkx/must-gather-62cnn" Jun 02 12:51:51.400915 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:51:51.400894 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nfhkx\"/\"kube-root-ca.crt\"" Jun 02 12:51:51.401279 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:51:51.401259 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-nfhkx\"/\"default-dockercfg-pkv99\"" Jun 02 12:51:51.401279 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:51:51.401272 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nfhkx\"/\"openshift-service-ca.crt\"" Jun 02 12:51:51.406123 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:51:51.406101 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nfhkx/must-gather-62cnn"] Jun 02 12:51:51.500788 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:51:51.500760 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/09837e25-1f92-4dba-a6eb-53503e785140-must-gather-output\") pod \"must-gather-62cnn\" (UID: \"09837e25-1f92-4dba-a6eb-53503e785140\") " pod="openshift-must-gather-nfhkx/must-gather-62cnn" Jun 02 12:51:51.500944 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:51:51.500794 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6gdn\" (UniqueName: \"kubernetes.io/projected/09837e25-1f92-4dba-a6eb-53503e785140-kube-api-access-x6gdn\") pod \"must-gather-62cnn\" (UID: \"09837e25-1f92-4dba-a6eb-53503e785140\") " pod="openshift-must-gather-nfhkx/must-gather-62cnn" Jun 02 12:51:51.602054 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:51:51.602026 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/09837e25-1f92-4dba-a6eb-53503e785140-must-gather-output\") pod \"must-gather-62cnn\" (UID: \"09837e25-1f92-4dba-a6eb-53503e785140\") " pod="openshift-must-gather-nfhkx/must-gather-62cnn" Jun 02 12:51:51.602131 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:51:51.602061 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x6gdn\" (UniqueName: \"kubernetes.io/projected/09837e25-1f92-4dba-a6eb-53503e785140-kube-api-access-x6gdn\") pod \"must-gather-62cnn\" (UID: \"09837e25-1f92-4dba-a6eb-53503e785140\") " pod="openshift-must-gather-nfhkx/must-gather-62cnn" Jun 02 12:51:51.602340 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:51:51.602322 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/09837e25-1f92-4dba-a6eb-53503e785140-must-gather-output\") pod \"must-gather-62cnn\" (UID: \"09837e25-1f92-4dba-a6eb-53503e785140\") " pod="openshift-must-gather-nfhkx/must-gather-62cnn" Jun 02 12:51:51.609755 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:51:51.609732 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6gdn\" (UniqueName: \"kubernetes.io/projected/09837e25-1f92-4dba-a6eb-53503e785140-kube-api-access-x6gdn\") pod \"must-gather-62cnn\" (UID: \"09837e25-1f92-4dba-a6eb-53503e785140\") " pod="openshift-must-gather-nfhkx/must-gather-62cnn" Jun 02 12:51:51.709408 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:51:51.709340 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nfhkx/must-gather-62cnn" Jun 02 12:51:51.833033 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:51:51.832956 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nfhkx/must-gather-62cnn"] Jun 02 12:51:51.835208 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:51:51.835182 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod09837e25_1f92_4dba_a6eb_53503e785140.slice/crio-3f1f74178659f742fc24ed1559f3d20e97d5c692e786fa08efd1e817a258d32a WatchSource:0}: Error finding container 3f1f74178659f742fc24ed1559f3d20e97d5c692e786fa08efd1e817a258d32a: Status 404 returned error can't find the container with id 3f1f74178659f742fc24ed1559f3d20e97d5c692e786fa08efd1e817a258d32a Jun 02 12:51:51.836822 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:51:51.836807 2545 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 12:51:52.203187 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:51:52.203149 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nfhkx/must-gather-62cnn" event={"ID":"09837e25-1f92-4dba-a6eb-53503e785140","Type":"ContainerStarted","Data":"3f1f74178659f742fc24ed1559f3d20e97d5c692e786fa08efd1e817a258d32a"} Jun 02 12:51:53.209020 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:51:53.208982 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nfhkx/must-gather-62cnn" event={"ID":"09837e25-1f92-4dba-a6eb-53503e785140","Type":"ContainerStarted","Data":"e5f329a46f9a72e795a70054ac508d148a1925be59a2af20742291cf879872e3"} Jun 02 12:51:53.209020 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:51:53.209022 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nfhkx/must-gather-62cnn" event={"ID":"09837e25-1f92-4dba-a6eb-53503e785140","Type":"ContainerStarted","Data":"071bc26377e4ccc4444864ff612a45d6f4c4b64b939b4e83398e837c2887f0e1"} Jun 02 12:51:53.224211 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:51:53.224155 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-nfhkx/must-gather-62cnn" podStartSLOduration=1.236203035 podStartE2EDuration="2.22413536s" podCreationTimestamp="2026-06-02 12:51:51 +0000 UTC" firstStartedPulling="2026-06-02 12:51:51.836943676 +0000 UTC m=+741.754558749" lastFinishedPulling="2026-06-02 12:51:52.824875994 +0000 UTC m=+742.742491074" observedRunningTime="2026-06-02 12:51:53.223155015 +0000 UTC m=+743.140770109" watchObservedRunningTime="2026-06-02 12:51:53.22413536 +0000 UTC m=+743.141750455" Jun 02 12:51:54.266086 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:51:54.266057 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-grnzw_0d9a2489-eb98-43c1-9313-de439b59ff7f/global-pull-secret-syncer/0.log" Jun 02 12:51:54.386243 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:51:54.386215 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-hv55n_c11a5292-1287-4f12-b1db-c31517a0ddc6/konnectivity-agent/0.log" Jun 02 12:51:54.451379 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:51:54.451349 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-229.ec2.internal_3baf4d93838fc3d664a8a17cf60359ce/haproxy/0.log" Jun 02 12:51:57.614895 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:51:57.614862 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_dec7b682-a4dc-442c-b5b6-8160cd2dde01/alertmanager/0.log" Jun 02 12:51:57.640034 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:51:57.640012 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_dec7b682-a4dc-442c-b5b6-8160cd2dde01/config-reloader/0.log" Jun 02 12:51:57.662962 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:51:57.662938 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_dec7b682-a4dc-442c-b5b6-8160cd2dde01/kube-rbac-proxy-web/0.log" Jun 02 12:51:57.686879 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:51:57.686852 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_dec7b682-a4dc-442c-b5b6-8160cd2dde01/kube-rbac-proxy/0.log" Jun 02 12:51:57.707793 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:51:57.707769 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_dec7b682-a4dc-442c-b5b6-8160cd2dde01/kube-rbac-proxy-metric/0.log" Jun 02 12:51:57.730527 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:51:57.730494 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_dec7b682-a4dc-442c-b5b6-8160cd2dde01/prom-label-proxy/0.log" Jun 02 12:51:57.752781 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:51:57.752747 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_dec7b682-a4dc-442c-b5b6-8160cd2dde01/init-config-reloader/0.log" Jun 02 12:51:57.808630 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:51:57.808573 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-mfc4d_2cbe8332-2bf5-4725-8973-310bfeae787b/kube-state-metrics/0.log" Jun 02 12:51:57.833403 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:51:57.833370 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-mfc4d_2cbe8332-2bf5-4725-8973-310bfeae787b/kube-rbac-proxy-main/0.log" Jun 02 12:51:57.852631 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:51:57.852605 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-mfc4d_2cbe8332-2bf5-4725-8973-310bfeae787b/kube-rbac-proxy-self/0.log" Jun 02 12:51:57.879527 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:51:57.879428 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5c6c7d459-l4vwr_ac4a9cbe-a8e7-43b7-bed7-493148569aba/metrics-server/0.log" Jun 02 12:51:57.903783 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:51:57.903756 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5768fcc9dd-w4p9l_10cd3d70-24b5-490f-a286-3c506f225186/monitoring-plugin/0.log" Jun 02 12:51:58.076666 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:51:58.076632 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v5cjj_2a5c8f65-1825-4ccb-88b6-806b2203fca0/node-exporter/0.log" Jun 02 12:51:58.097200 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:51:58.097174 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v5cjj_2a5c8f65-1825-4ccb-88b6-806b2203fca0/kube-rbac-proxy/0.log" Jun 02 12:51:58.117141 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:51:58.117109 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v5cjj_2a5c8f65-1825-4ccb-88b6-806b2203fca0/init-textfile/0.log" Jun 02 12:51:58.143562 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:51:58.143500 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-46jp4_c6fe1151-3fa5-45d6-baf6-773d6dbcc40d/kube-rbac-proxy-main/0.log" Jun 02 12:51:58.163784 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:51:58.163753 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-46jp4_c6fe1151-3fa5-45d6-baf6-773d6dbcc40d/kube-rbac-proxy-self/0.log" Jun 02 12:51:58.183853 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:51:58.183813 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-46jp4_c6fe1151-3fa5-45d6-baf6-773d6dbcc40d/openshift-state-metrics/0.log" Jun 02 12:51:58.216743 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:51:58.216713 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8/prometheus/0.log" Jun 02 12:51:58.239397 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:51:58.239368 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8/config-reloader/0.log" Jun 02 12:51:58.261719 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:51:58.261692 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8/thanos-sidecar/0.log" Jun 02 12:51:58.283502 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:51:58.283474 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8/kube-rbac-proxy-web/0.log" Jun 02 12:51:58.303544 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:51:58.303511 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8/kube-rbac-proxy/0.log" Jun 02 12:51:58.325490 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:51:58.325462 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8/kube-rbac-proxy-thanos/0.log" Jun 02 12:51:58.348290 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:51:58.348264 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_de1ef2f2-ab7a-4bd4-9b52-ee0e3633c1f8/init-config-reloader/0.log" Jun 02 12:51:58.380668 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:51:58.380634 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-gtpdx_813e7359-d285-4204-ac7f-ac6ff4f6584c/prometheus-operator/0.log" Jun 02 12:51:58.401596 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:51:58.401512 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-gtpdx_813e7359-d285-4204-ac7f-ac6ff4f6584c/kube-rbac-proxy/0.log" Jun 02 12:51:58.423601 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:51:58.423579 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-59b7f8756b-rjkpk_33545b63-c529-43d7-87b3-dbf1c2cf7526/prometheus-operator-admission-webhook/0.log" Jun 02 12:51:58.457958 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:51:58.457927 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7cdbfff797-bhlnw_f12e91cc-0524-40d7-9dd3-1360f8095dd3/telemeter-client/0.log" Jun 02 12:51:58.481975 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:51:58.481945 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7cdbfff797-bhlnw_f12e91cc-0524-40d7-9dd3-1360f8095dd3/reload/0.log" Jun 02 12:51:58.502848 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:51:58.502803 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7cdbfff797-bhlnw_f12e91cc-0524-40d7-9dd3-1360f8095dd3/kube-rbac-proxy/0.log" Jun 02 12:51:58.535278 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:51:58.535222 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6896675589-25jf5_a55432b3-ae2e-47a6-a79e-ee36eddcd330/thanos-query/0.log" Jun 02 12:51:58.556183 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:51:58.556154 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6896675589-25jf5_a55432b3-ae2e-47a6-a79e-ee36eddcd330/kube-rbac-proxy-web/0.log" Jun 02 12:51:58.578453 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:51:58.578428 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6896675589-25jf5_a55432b3-ae2e-47a6-a79e-ee36eddcd330/kube-rbac-proxy/0.log" Jun 02 12:51:58.603067 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:51:58.603032 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6896675589-25jf5_a55432b3-ae2e-47a6-a79e-ee36eddcd330/prom-label-proxy/0.log" Jun 02 12:51:58.625374 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:51:58.625342 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6896675589-25jf5_a55432b3-ae2e-47a6-a79e-ee36eddcd330/kube-rbac-proxy-rules/0.log" Jun 02 12:51:58.647808 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:51:58.647771 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6896675589-25jf5_a55432b3-ae2e-47a6-a79e-ee36eddcd330/kube-rbac-proxy-metrics/0.log" Jun 02 12:52:00.659440 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:52:00.659413 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-646657454-9fjlh_4fa70586-2354-407c-bd79-5a7983421d7a/console/0.log" Jun 02 12:52:01.172618 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:52:01.172583 2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-nfhkx/perf-node-gather-daemonset-w24ww"] Jun 02 12:52:01.177635 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:52:01.177609 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nfhkx/perf-node-gather-daemonset-w24ww" Jun 02 12:52:01.185425 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:52:01.185245 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nfhkx/perf-node-gather-daemonset-w24ww"] Jun 02 12:52:01.296811 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:52:01.296778 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/136de025-86de-4da2-b25e-0b6cb7bc934a-sys\") pod \"perf-node-gather-daemonset-w24ww\" (UID: \"136de025-86de-4da2-b25e-0b6cb7bc934a\") " pod="openshift-must-gather-nfhkx/perf-node-gather-daemonset-w24ww" Jun 02 12:52:01.297001 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:52:01.296823 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdddk\" (UniqueName: \"kubernetes.io/projected/136de025-86de-4da2-b25e-0b6cb7bc934a-kube-api-access-wdddk\") pod \"perf-node-gather-daemonset-w24ww\" (UID: \"136de025-86de-4da2-b25e-0b6cb7bc934a\") " pod="openshift-must-gather-nfhkx/perf-node-gather-daemonset-w24ww" Jun 02 12:52:01.297001 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:52:01.296869 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/136de025-86de-4da2-b25e-0b6cb7bc934a-proc\") pod \"perf-node-gather-daemonset-w24ww\" (UID: \"136de025-86de-4da2-b25e-0b6cb7bc934a\") " pod="openshift-must-gather-nfhkx/perf-node-gather-daemonset-w24ww" Jun 02 12:52:01.297001 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:52:01.296940 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/136de025-86de-4da2-b25e-0b6cb7bc934a-podres\") pod \"perf-node-gather-daemonset-w24ww\" (UID: \"136de025-86de-4da2-b25e-0b6cb7bc934a\") " pod="openshift-must-gather-nfhkx/perf-node-gather-daemonset-w24ww" Jun 02 12:52:01.297138 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:52:01.297014 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/136de025-86de-4da2-b25e-0b6cb7bc934a-lib-modules\") pod \"perf-node-gather-daemonset-w24ww\" (UID: \"136de025-86de-4da2-b25e-0b6cb7bc934a\") " pod="openshift-must-gather-nfhkx/perf-node-gather-daemonset-w24ww" Jun 02 12:52:01.397667 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:52:01.397613 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wdddk\" (UniqueName: \"kubernetes.io/projected/136de025-86de-4da2-b25e-0b6cb7bc934a-kube-api-access-wdddk\") pod \"perf-node-gather-daemonset-w24ww\" (UID: \"136de025-86de-4da2-b25e-0b6cb7bc934a\") " pod="openshift-must-gather-nfhkx/perf-node-gather-daemonset-w24ww" Jun 02 12:52:01.398075 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:52:01.398043 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/136de025-86de-4da2-b25e-0b6cb7bc934a-proc\") pod \"perf-node-gather-daemonset-w24ww\" (UID: \"136de025-86de-4da2-b25e-0b6cb7bc934a\") " pod="openshift-must-gather-nfhkx/perf-node-gather-daemonset-w24ww" Jun 02 12:52:01.398193 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:52:01.398097 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/136de025-86de-4da2-b25e-0b6cb7bc934a-podres\") pod \"perf-node-gather-daemonset-w24ww\" (UID: \"136de025-86de-4da2-b25e-0b6cb7bc934a\") " pod="openshift-must-gather-nfhkx/perf-node-gather-daemonset-w24ww" Jun 02 12:52:01.398193 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:52:01.398127 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/136de025-86de-4da2-b25e-0b6cb7bc934a-proc\") pod \"perf-node-gather-daemonset-w24ww\" (UID: \"136de025-86de-4da2-b25e-0b6cb7bc934a\") " pod="openshift-must-gather-nfhkx/perf-node-gather-daemonset-w24ww" Jun 02 12:52:01.398193 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:52:01.398185 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/136de025-86de-4da2-b25e-0b6cb7bc934a-lib-modules\") pod \"perf-node-gather-daemonset-w24ww\" (UID: \"136de025-86de-4da2-b25e-0b6cb7bc934a\") " pod="openshift-must-gather-nfhkx/perf-node-gather-daemonset-w24ww" Jun 02 12:52:01.398347 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:52:01.398272 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/136de025-86de-4da2-b25e-0b6cb7bc934a-sys\") pod \"perf-node-gather-daemonset-w24ww\" (UID: \"136de025-86de-4da2-b25e-0b6cb7bc934a\") " pod="openshift-must-gather-nfhkx/perf-node-gather-daemonset-w24ww" Jun 02 12:52:01.398347 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:52:01.398299 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/136de025-86de-4da2-b25e-0b6cb7bc934a-podres\") pod \"perf-node-gather-daemonset-w24ww\" (UID: \"136de025-86de-4da2-b25e-0b6cb7bc934a\") " pod="openshift-must-gather-nfhkx/perf-node-gather-daemonset-w24ww" Jun 02 12:52:01.398424 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:52:01.398351 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/136de025-86de-4da2-b25e-0b6cb7bc934a-sys\") pod \"perf-node-gather-daemonset-w24ww\" (UID: \"136de025-86de-4da2-b25e-0b6cb7bc934a\") " pod="openshift-must-gather-nfhkx/perf-node-gather-daemonset-w24ww" Jun 02 12:52:01.398424 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:52:01.398376 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/136de025-86de-4da2-b25e-0b6cb7bc934a-lib-modules\") pod \"perf-node-gather-daemonset-w24ww\" (UID: \"136de025-86de-4da2-b25e-0b6cb7bc934a\") " pod="openshift-must-gather-nfhkx/perf-node-gather-daemonset-w24ww" Jun 02 12:52:01.404875 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:52:01.404853 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdddk\" (UniqueName: \"kubernetes.io/projected/136de025-86de-4da2-b25e-0b6cb7bc934a-kube-api-access-wdddk\") pod \"perf-node-gather-daemonset-w24ww\" (UID: \"136de025-86de-4da2-b25e-0b6cb7bc934a\") " pod="openshift-must-gather-nfhkx/perf-node-gather-daemonset-w24ww" Jun 02 12:52:01.489310 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:52:01.489230 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nfhkx/perf-node-gather-daemonset-w24ww" Jun 02 12:52:01.623885 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:52:01.623833 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nfhkx/perf-node-gather-daemonset-w24ww"] Jun 02 12:52:01.628278 ip-10-0-128-229 kubenswrapper[2545]: W0602 12:52:01.627076 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod136de025_86de_4da2_b25e_0b6cb7bc934a.slice/crio-5de9ebfdc83225aef0e3abd0889cd7b046be86cba4302f90311510317027d4ef WatchSource:0}: Error finding container 5de9ebfdc83225aef0e3abd0889cd7b046be86cba4302f90311510317027d4ef: Status 404 returned error can't find the container with id 5de9ebfdc83225aef0e3abd0889cd7b046be86cba4302f90311510317027d4ef Jun 02 12:52:01.774235 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:52:01.774145 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-q84kk_36675602-1c0b-494f-95b0-72b7a7fa5381/dns/0.log" Jun 02 12:52:01.794005 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:52:01.793980 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-q84kk_36675602-1c0b-494f-95b0-72b7a7fa5381/kube-rbac-proxy/0.log" Jun 02 12:52:01.907928 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:52:01.907896 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zg55p_bad7a9bf-61a6-4668-82c3-4f7e819472b9/dns-node-resolver/0.log" Jun 02 12:52:02.250812 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:52:02.250248 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nfhkx/perf-node-gather-daemonset-w24ww" event={"ID":"136de025-86de-4da2-b25e-0b6cb7bc934a","Type":"ContainerStarted","Data":"31f49d1e4b296b03356ccfdf45ec56a89c7882b653ab4882da04527d098abe8b"} Jun 02 12:52:02.250812 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:52:02.250291 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nfhkx/perf-node-gather-daemonset-w24ww" event={"ID":"136de025-86de-4da2-b25e-0b6cb7bc934a","Type":"ContainerStarted","Data":"5de9ebfdc83225aef0e3abd0889cd7b046be86cba4302f90311510317027d4ef"} Jun 02 12:52:02.250812 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:52:02.250802 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-nfhkx/perf-node-gather-daemonset-w24ww" Jun 02 12:52:02.265828 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:52:02.265779 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-nfhkx/perf-node-gather-daemonset-w24ww" podStartSLOduration=1.265763851 podStartE2EDuration="1.265763851s" podCreationTimestamp="2026-06-02 12:52:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 12:52:02.263786577 +0000 UTC m=+752.181401672" watchObservedRunningTime="2026-06-02 12:52:02.265763851 +0000 UTC m=+752.183378946" Jun 02 12:52:02.319687 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:52:02.319657 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jcwvf_e0da3dd7-3e7d-4873-9be6-1e77fce2a507/node-ca/0.log" Jun 02 12:52:03.417863 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:52:03.417817 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-st6dv_9af245f1-954a-426a-94b6-a8969279cadb/serve-healthcheck-canary/0.log" Jun 02 12:52:03.864439 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:52:03.864411 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-96cfv_8784056f-c039-4719-947a-5e3fe6ac2227/kube-rbac-proxy/0.log" Jun 02 12:52:03.883425 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:52:03.883396 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-96cfv_8784056f-c039-4719-947a-5e3fe6ac2227/exporter/0.log" Jun 02 12:52:03.902459 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:52:03.902429 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-96cfv_8784056f-c039-4719-947a-5e3fe6ac2227/extractor/0.log" Jun 02 12:52:08.266803 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:52:08.266779 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-nfhkx/perf-node-gather-daemonset-w24ww" Jun 02 12:52:10.012128 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:52:10.012051 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8qq7l_9d004590-abbc-46da-934f-471cf2c3495c/kube-multus-additional-cni-plugins/0.log" Jun 02 12:52:10.034733 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:52:10.034705 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8qq7l_9d004590-abbc-46da-934f-471cf2c3495c/egress-router-binary-copy/0.log" Jun 02 12:52:10.054646 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:52:10.054597 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8qq7l_9d004590-abbc-46da-934f-471cf2c3495c/cni-plugins/0.log" Jun 02 12:52:10.099253 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:52:10.099214 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8qq7l_9d004590-abbc-46da-934f-471cf2c3495c/bond-cni-plugin/0.log" Jun 02 12:52:10.119457 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:52:10.119428 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8qq7l_9d004590-abbc-46da-934f-471cf2c3495c/routeoverride-cni/0.log" Jun 02 12:52:10.139233 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:52:10.139205 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8qq7l_9d004590-abbc-46da-934f-471cf2c3495c/whereabouts-cni-bincopy/0.log" Jun 02 12:52:10.160917 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:52:10.160896 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8qq7l_9d004590-abbc-46da-934f-471cf2c3495c/whereabouts-cni/0.log" Jun 02 12:52:10.367736 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:52:10.367699 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-md7b9_1f5beceb-f998-436e-9b32-b72579c0ece3/kube-multus/0.log" Jun 02 12:52:10.507892 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:52:10.507829 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rvddx_10c4158d-e827-4403-8ba4-17672f978f94/network-metrics-daemon/0.log" Jun 02 12:52:10.530338 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:52:10.530315 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rvddx_10c4158d-e827-4403-8ba4-17672f978f94/kube-rbac-proxy/0.log" Jun 02 12:52:11.581356 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:52:11.581332 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mb7lb_9211a780-13da-4a76-85dc-2f0a70a65c9c/ovn-controller/0.log" Jun 02 12:52:11.605368 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:52:11.605336 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mb7lb_9211a780-13da-4a76-85dc-2f0a70a65c9c/ovn-acl-logging/0.log" Jun 02 12:52:11.622649 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:52:11.622606 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mb7lb_9211a780-13da-4a76-85dc-2f0a70a65c9c/kube-rbac-proxy-node/0.log" Jun 02 12:52:11.642475 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:52:11.642449 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mb7lb_9211a780-13da-4a76-85dc-2f0a70a65c9c/kube-rbac-proxy-ovn-metrics/0.log" Jun 02 12:52:11.661200 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:52:11.661163 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mb7lb_9211a780-13da-4a76-85dc-2f0a70a65c9c/northd/0.log" Jun 02 12:52:11.682178 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:52:11.682154 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mb7lb_9211a780-13da-4a76-85dc-2f0a70a65c9c/nbdb/0.log" Jun 02 12:52:11.701232 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:52:11.701199 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mb7lb_9211a780-13da-4a76-85dc-2f0a70a65c9c/sbdb/0.log" Jun 02 12:52:11.820566 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:52:11.820525 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mb7lb_9211a780-13da-4a76-85dc-2f0a70a65c9c/ovnkube-controller/0.log" Jun 02 12:52:13.071898 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:52:13.071815 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-q88nq_61950c4e-c9a1-4c0d-af77-980423e1d1d8/network-check-target-container/0.log" Jun 02 12:52:13.968530 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:52:13.968502 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-jj5kr_937d6529-311c-4484-b66d-e0278f105138/iptables-alerter/0.log" Jun 02 12:52:14.639251 ip-10-0-128-229 kubenswrapper[2545]: I0602 12:52:14.639224 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-x47f5_7b10a4ef-6ad1-4783-8ec7-08c41e7ab57c/tuned/0.log"