Jun 02 07:29:31.607498 ip-10-0-136-245 systemd[1]: Starting Kubernetes Kubelet... Jun 02 07:29:32.116596 ip-10-0-136-245 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 07:29:32.116596 ip-10-0-136-245 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 02 07:29:32.116596 ip-10-0-136-245 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 07:29:32.116596 ip-10-0-136-245 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 02 07:29:32.116596 ip-10-0-136-245 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 07:29:32.119420 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.119339 2580 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 02 07:29:32.124498 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124483 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 07:29:32.124498 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124497 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 07:29:32.124565 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124501 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 07:29:32.124565 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124505 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 07:29:32.124565 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124509 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 07:29:32.124565 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124512 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 07:29:32.124565 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124514 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 07:29:32.124565 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124517 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 07:29:32.124565 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124520 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 07:29:32.124565 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124522 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 07:29:32.124565 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124524 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 07:29:32.124565 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124532 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 07:29:32.124565 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124535 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 07:29:32.124565 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124539 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 07:29:32.124565 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124543 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 07:29:32.124565 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124547 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 07:29:32.124565 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124551 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 02 07:29:32.124565 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124554 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 07:29:32.124565 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124557 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 07:29:32.124565 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124559 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 07:29:32.124565 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124562 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 07:29:32.125025 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124564 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 07:29:32.125025 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124566 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 07:29:32.125025 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124569 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 07:29:32.125025 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124572 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 07:29:32.125025 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124575 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 07:29:32.125025 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124577 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 07:29:32.125025 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124580 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 07:29:32.125025 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124582 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 07:29:32.125025 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124585 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 07:29:32.125025 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124587 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 07:29:32.125025 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124590 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 07:29:32.125025 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124601 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 07:29:32.125025 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124604 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 07:29:32.125025 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124607 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 07:29:32.125025 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124609 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 07:29:32.125025 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124612 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 07:29:32.125025 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124614 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 07:29:32.125025 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124617 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 07:29:32.125025 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124619 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 07:29:32.125025 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124622 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 07:29:32.125688 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124624 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 07:29:32.125688 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124626 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 07:29:32.125688 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124629 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 07:29:32.125688 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124632 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 07:29:32.125688 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124634 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 07:29:32.125688 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124637 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 07:29:32.125688 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124641 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 07:29:32.125688 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124643 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 07:29:32.125688 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124645 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 07:29:32.125688 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124649 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 07:29:32.125688 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124651 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 07:29:32.125688 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124654 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 07:29:32.125688 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124657 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 07:29:32.125688 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124659 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 07:29:32.125688 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124662 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 07:29:32.125688 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124664 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 07:29:32.125688 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124667 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 07:29:32.125688 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124670 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 07:29:32.125688 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124672 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 07:29:32.125688 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124675 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 07:29:32.126391 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124677 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 07:29:32.126391 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124679 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 07:29:32.126391 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124682 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 07:29:32.126391 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124684 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 07:29:32.126391 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124687 2580 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 07:29:32.126391 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124689 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 07:29:32.126391 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124692 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 07:29:32.126391 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124694 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 07:29:32.126391 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124697 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 07:29:32.126391 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124700 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 07:29:32.126391 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124703 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 07:29:32.126391 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124705 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 07:29:32.126391 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124707 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 07:29:32.126391 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124710 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 07:29:32.126391 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124713 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 07:29:32.126391 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124715 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 07:29:32.126391 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124718 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 07:29:32.126391 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124720 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 07:29:32.126391 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124723 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 07:29:32.126391 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124726 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 07:29:32.127076 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124728 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 07:29:32.127076 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124731 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 07:29:32.127076 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124733 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 07:29:32.127076 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124736 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 07:29:32.127076 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.124738 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 07:29:32.127076 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.126994 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 07:29:32.127076 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127015 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 07:29:32.127076 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127025 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 07:29:32.127076 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127029 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 07:29:32.127076 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127035 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 07:29:32.127076 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127039 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 07:29:32.127076 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127043 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 07:29:32.127076 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127048 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 07:29:32.127076 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127052 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 07:29:32.127076 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127056 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 07:29:32.127076 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127060 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 07:29:32.127076 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127064 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 07:29:32.127076 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127068 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 07:29:32.127076 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127072 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 07:29:32.127600 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127076 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 07:29:32.127600 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127086 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 07:29:32.127600 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127091 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 07:29:32.127600 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127095 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 07:29:32.127600 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127100 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 07:29:32.127600 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127104 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 07:29:32.127600 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127107 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 07:29:32.127600 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127112 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 07:29:32.127600 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127116 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 07:29:32.127600 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127120 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 02 07:29:32.127600 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127124 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 07:29:32.127600 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127128 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 07:29:32.127600 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127132 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 07:29:32.127600 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127136 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 07:29:32.127600 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127145 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 07:29:32.127600 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127148 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 07:29:32.127600 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127152 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 07:29:32.127600 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127156 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 07:29:32.127600 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127160 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 07:29:32.127600 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127165 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 07:29:32.128089 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127170 2580 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 07:29:32.128089 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127174 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 07:29:32.128089 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127180 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 07:29:32.128089 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127186 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 07:29:32.128089 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127191 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 07:29:32.128089 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127195 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 07:29:32.128089 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127204 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 07:29:32.128089 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127208 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 07:29:32.128089 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127229 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 07:29:32.128089 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127234 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 07:29:32.128089 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127239 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 07:29:32.128089 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127243 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 07:29:32.128089 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127251 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 07:29:32.128089 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127364 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 07:29:32.128089 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127370 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 07:29:32.128089 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127374 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 07:29:32.128089 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127378 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 07:29:32.128089 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127382 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 07:29:32.128089 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127390 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 07:29:32.128565 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127395 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 07:29:32.128565 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127399 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 07:29:32.128565 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127402 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 07:29:32.128565 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127406 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 07:29:32.128565 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127410 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 07:29:32.128565 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127414 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 07:29:32.128565 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127418 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 07:29:32.128565 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127422 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 07:29:32.128565 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127426 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 07:29:32.128565 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127430 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 07:29:32.128565 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127433 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 07:29:32.128565 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127438 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 07:29:32.128565 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127442 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 07:29:32.128565 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127445 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 07:29:32.128565 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127450 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 07:29:32.128565 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127453 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 07:29:32.128565 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127457 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 07:29:32.128565 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127461 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 07:29:32.128565 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127465 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 07:29:32.128565 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127469 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 07:29:32.129058 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127473 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 07:29:32.129058 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127476 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 07:29:32.129058 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127481 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 07:29:32.129058 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127485 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 07:29:32.129058 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127489 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 07:29:32.129058 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127496 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 07:29:32.129058 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127500 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 07:29:32.129058 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127505 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 07:29:32.129058 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127509 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 07:29:32.129058 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127513 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 07:29:32.129058 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127517 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 07:29:32.129058 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127521 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 07:29:32.129058 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.127525 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 07:29:32.129058 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127602 2580 flags.go:64] FLAG: --address="0.0.0.0" Jun 02 07:29:32.129058 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127613 2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 02 07:29:32.129058 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127622 2580 flags.go:64] FLAG: --anonymous-auth="true" Jun 02 07:29:32.129058 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127629 2580 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 02 07:29:32.129058 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127633 2580 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 02 07:29:32.129058 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127637 2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 02 07:29:32.129058 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127641 2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 02 07:29:32.129058 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127645 2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 02 07:29:32.129581 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127648 2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 02 07:29:32.129581 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127652 2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 02 07:29:32.129581 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127655 2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 02 07:29:32.129581 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127659 2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 02 07:29:32.129581 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127662 2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 02 07:29:32.129581 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127665 2580 flags.go:64] FLAG: --cgroup-root="" Jun 02 07:29:32.129581 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127668 2580 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 02 07:29:32.129581 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127670 2580 flags.go:64] FLAG: --client-ca-file="" Jun 02 07:29:32.129581 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127674 2580 flags.go:64] FLAG: --cloud-config="" Jun 02 07:29:32.129581 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127676 2580 flags.go:64] FLAG: --cloud-provider="external" Jun 02 07:29:32.129581 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127680 2580 flags.go:64] FLAG: --cluster-dns="[]" Jun 02 07:29:32.129581 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127684 2580 flags.go:64] FLAG: --cluster-domain="" Jun 02 07:29:32.129581 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127687 2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 02 07:29:32.129581 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127690 2580 flags.go:64] FLAG: --config-dir="" Jun 02 07:29:32.129581 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127692 2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 02 07:29:32.129581 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127696 2580 flags.go:64] FLAG: --container-log-max-files="5" Jun 02 07:29:32.129581 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127699 2580 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 02 07:29:32.129581 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127703 2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 02 07:29:32.129581 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127706 2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 02 07:29:32.129581 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127709 2580 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 02 07:29:32.129581 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127712 2580 flags.go:64] FLAG: --contention-profiling="false" Jun 02 07:29:32.129581 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127715 2580 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 02 07:29:32.129581 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127718 2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 02 07:29:32.129581 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127721 2580 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 02 07:29:32.129581 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127724 2580 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 02 07:29:32.130189 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127728 2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 02 07:29:32.130189 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127731 2580 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 02 07:29:32.130189 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127734 2580 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 02 07:29:32.130189 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127737 2580 flags.go:64] FLAG: --enable-load-reader="false" Jun 02 07:29:32.130189 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127740 2580 flags.go:64] FLAG: --enable-server="true" Jun 02 07:29:32.130189 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127743 2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 02 07:29:32.130189 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127748 2580 flags.go:64] FLAG: --event-burst="100" Jun 02 07:29:32.130189 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127751 2580 flags.go:64] FLAG: --event-qps="50" Jun 02 07:29:32.130189 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127754 2580 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 02 07:29:32.130189 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127757 2580 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 02 07:29:32.130189 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127760 2580 flags.go:64] FLAG: --eviction-hard="" Jun 02 07:29:32.130189 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127764 2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 02 07:29:32.130189 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127767 2580 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 02 07:29:32.130189 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127770 2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 02 07:29:32.130189 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127772 2580 flags.go:64] FLAG: --eviction-soft="" Jun 02 07:29:32.130189 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127775 2580 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 02 07:29:32.130189 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127778 2580 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 02 07:29:32.130189 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127781 2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 02 07:29:32.130189 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127784 2580 flags.go:64] FLAG: --experimental-mounter-path="" Jun 02 07:29:32.130189 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127786 2580 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 02 07:29:32.130189 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127789 2580 flags.go:64] FLAG: --fail-swap-on="true" Jun 02 07:29:32.130189 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127792 2580 flags.go:64] FLAG: --feature-gates="" Jun 02 07:29:32.130189 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127795 2580 flags.go:64] FLAG: --file-check-frequency="20s" Jun 02 07:29:32.130189 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127798 2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 02 07:29:32.130189 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127802 2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 02 07:29:32.130807 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127806 2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 02 07:29:32.130807 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127809 2580 flags.go:64] FLAG: --healthz-port="10248" Jun 02 07:29:32.130807 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127812 2580 flags.go:64] FLAG: --help="false" Jun 02 07:29:32.130807 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127815 2580 flags.go:64] FLAG: --hostname-override="ip-10-0-136-245.ec2.internal" Jun 02 07:29:32.130807 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127818 2580 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 02 07:29:32.130807 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127821 2580 flags.go:64] FLAG: --http-check-frequency="20s" Jun 02 07:29:32.130807 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127824 2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 02 07:29:32.130807 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127827 2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 02 07:29:32.130807 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127830 2580 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 02 07:29:32.130807 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127832 2580 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 02 07:29:32.130807 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127835 2580 flags.go:64] FLAG: --image-service-endpoint="" Jun 02 07:29:32.130807 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127838 2580 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 02 07:29:32.130807 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127840 2580 flags.go:64] FLAG: --kube-api-burst="100" Jun 02 07:29:32.130807 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127843 2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 02 07:29:32.130807 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127846 2580 flags.go:64] FLAG: --kube-api-qps="50" Jun 02 07:29:32.130807 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127849 2580 flags.go:64] FLAG: --kube-reserved="" Jun 02 07:29:32.130807 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127852 2580 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 02 07:29:32.130807 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127854 2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 02 07:29:32.130807 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127857 2580 flags.go:64] FLAG: --kubelet-cgroups="" Jun 02 07:29:32.130807 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127860 2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 02 07:29:32.130807 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127862 2580 flags.go:64] FLAG: --lock-file="" Jun 02 07:29:32.130807 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127865 2580 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 02 07:29:32.130807 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127868 2580 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 02 07:29:32.130807 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127873 2580 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 02 07:29:32.131427 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127879 2580 flags.go:64] FLAG: --log-json-split-stream="false" Jun 02 07:29:32.131427 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127881 2580 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 02 07:29:32.131427 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127884 2580 flags.go:64] FLAG: --log-text-split-stream="false" Jun 02 07:29:32.131427 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127887 2580 flags.go:64] FLAG: --logging-format="text" Jun 02 07:29:32.131427 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127890 2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 02 07:29:32.131427 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127893 2580 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 02 07:29:32.131427 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127895 2580 flags.go:64] FLAG: --manifest-url="" Jun 02 07:29:32.131427 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127900 2580 flags.go:64] FLAG: --manifest-url-header="" Jun 02 07:29:32.131427 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127904 2580 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 02 07:29:32.131427 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127908 2580 flags.go:64] FLAG: --max-open-files="1000000" Jun 02 07:29:32.131427 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127912 2580 flags.go:64] FLAG: --max-pods="110" Jun 02 07:29:32.131427 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127915 2580 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 02 07:29:32.131427 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127918 2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 02 07:29:32.131427 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127921 2580 flags.go:64] FLAG: --memory-manager-policy="None" Jun 02 07:29:32.131427 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127923 2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 02 07:29:32.131427 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127926 2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 02 07:29:32.131427 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127929 2580 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 02 07:29:32.131427 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127932 2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 02 07:29:32.131427 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127939 2580 flags.go:64] FLAG: --node-status-max-images="50" Jun 02 07:29:32.131427 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127942 2580 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 02 07:29:32.131427 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127945 2580 flags.go:64] FLAG: --oom-score-adj="-999" Jun 02 07:29:32.131427 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127948 2580 flags.go:64] FLAG: --pod-cidr="" Jun 02 07:29:32.131427 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127951 2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 02 07:29:32.131967 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127956 2580 flags.go:64] FLAG: --pod-manifest-path="" Jun 02 07:29:32.131967 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127959 2580 flags.go:64] FLAG: --pod-max-pids="-1" Jun 02 07:29:32.131967 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127962 2580 flags.go:64] FLAG: --pods-per-core="0" Jun 02 07:29:32.131967 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127965 2580 flags.go:64] FLAG: --port="10250" Jun 02 07:29:32.131967 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127968 2580 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 02 07:29:32.131967 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127971 2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-097bad64af6efb942" Jun 02 07:29:32.131967 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127974 2580 flags.go:64] FLAG: --qos-reserved="" Jun 02 07:29:32.131967 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127977 2580 flags.go:64] FLAG: --read-only-port="10255" Jun 02 07:29:32.131967 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127981 2580 flags.go:64] FLAG: --register-node="true" Jun 02 07:29:32.131967 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127984 2580 flags.go:64] FLAG: --register-schedulable="true" Jun 02 07:29:32.131967 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127987 2580 flags.go:64] FLAG: --register-with-taints="" Jun 02 07:29:32.131967 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127990 2580 flags.go:64] FLAG: --registry-burst="10" Jun 02 07:29:32.131967 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127993 2580 flags.go:64] FLAG: --registry-qps="5" Jun 02 07:29:32.131967 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127995 2580 flags.go:64] FLAG: --reserved-cpus="" Jun 02 07:29:32.131967 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.127998 2580 flags.go:64] FLAG: --reserved-memory="" Jun 02 07:29:32.131967 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.128002 2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 02 07:29:32.131967 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.128005 2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 02 07:29:32.131967 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.128009 2580 flags.go:64] FLAG: --rotate-certificates="false" Jun 02 07:29:32.131967 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.128012 2580 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 02 07:29:32.131967 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.128015 2580 flags.go:64] FLAG: --runonce="false" Jun 02 07:29:32.131967 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.128018 2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 02 07:29:32.131967 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.128021 2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 02 07:29:32.131967 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.128024 2580 flags.go:64] FLAG: --seccomp-default="false" Jun 02 07:29:32.131967 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.128026 2580 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 02 07:29:32.131967 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.128029 2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 02 07:29:32.131967 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.128032 2580 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 02 07:29:32.132648 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.128035 2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 02 07:29:32.132648 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.128038 2580 flags.go:64] FLAG: --storage-driver-password="root" Jun 02 07:29:32.132648 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.128040 2580 flags.go:64] FLAG: --storage-driver-secure="false" Jun 02 07:29:32.132648 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.128043 2580 flags.go:64] FLAG: --storage-driver-table="stats" Jun 02 07:29:32.132648 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.128046 2580 flags.go:64] FLAG: --storage-driver-user="root" Jun 02 07:29:32.132648 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.128048 2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 02 07:29:32.132648 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.128051 2580 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 02 07:29:32.132648 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.128054 2580 flags.go:64] FLAG: --system-cgroups="" Jun 02 07:29:32.132648 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.128056 2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 02 07:29:32.132648 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.128062 2580 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 02 07:29:32.132648 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.128065 2580 flags.go:64] FLAG: --tls-cert-file="" Jun 02 07:29:32.132648 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.128067 2580 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 02 07:29:32.132648 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.128072 2580 flags.go:64] FLAG: --tls-min-version="" Jun 02 07:29:32.132648 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.128074 2580 flags.go:64] FLAG: --tls-private-key-file="" Jun 02 07:29:32.132648 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.128078 2580 flags.go:64] FLAG: --topology-manager-policy="none" Jun 02 07:29:32.132648 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.128081 2580 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 02 07:29:32.132648 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.128084 2580 flags.go:64] FLAG: --topology-manager-scope="container" Jun 02 07:29:32.132648 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.128087 2580 flags.go:64] FLAG: --v="2" Jun 02 07:29:32.132648 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.128091 2580 flags.go:64] FLAG: --version="false" Jun 02 07:29:32.132648 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.128099 2580 flags.go:64] FLAG: --vmodule="" Jun 02 07:29:32.132648 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.128103 2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 02 07:29:32.132648 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.128106 2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 02 07:29:32.132648 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128198 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 07:29:32.132648 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128202 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 07:29:32.133241 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128205 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 07:29:32.133241 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128208 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 07:29:32.133241 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128227 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 07:29:32.133241 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128230 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 07:29:32.133241 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128232 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 07:29:32.133241 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128235 2580 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 07:29:32.133241 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128238 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 07:29:32.133241 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128240 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 07:29:32.133241 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128243 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 07:29:32.133241 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128245 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 07:29:32.133241 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128247 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 07:29:32.133241 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128250 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 07:29:32.133241 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128252 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 07:29:32.133241 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128254 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 02 07:29:32.133241 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128257 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 07:29:32.133241 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128259 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 07:29:32.133241 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128262 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 07:29:32.133241 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128265 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 07:29:32.133241 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128267 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 07:29:32.133241 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128269 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 07:29:32.133744 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128271 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 07:29:32.133744 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128274 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 07:29:32.133744 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128277 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 07:29:32.133744 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128279 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 07:29:32.133744 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128282 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 07:29:32.133744 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128284 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 07:29:32.133744 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128286 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 07:29:32.133744 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128289 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 07:29:32.133744 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128291 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 07:29:32.133744 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128294 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 07:29:32.133744 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128296 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 07:29:32.133744 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128299 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 07:29:32.133744 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128301 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 07:29:32.133744 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128304 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 07:29:32.133744 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128306 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 07:29:32.133744 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128310 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 07:29:32.133744 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128312 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 07:29:32.133744 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128316 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 07:29:32.133744 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128320 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 07:29:32.133744 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128323 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 07:29:32.134277 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128326 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 07:29:32.134277 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128328 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 07:29:32.134277 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128330 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 07:29:32.134277 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128333 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 07:29:32.134277 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128335 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 07:29:32.134277 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128337 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 07:29:32.134277 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128341 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 07:29:32.134277 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128345 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 07:29:32.134277 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128347 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 07:29:32.134277 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128350 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 07:29:32.134277 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128353 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 07:29:32.134277 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128355 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 07:29:32.134277 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128358 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 07:29:32.134277 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128360 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 07:29:32.134277 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128363 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 07:29:32.134277 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128365 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 07:29:32.134277 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128368 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 07:29:32.134277 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128370 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 07:29:32.134277 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128372 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 07:29:32.134783 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128375 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 07:29:32.134783 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128377 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 07:29:32.134783 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128380 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 07:29:32.134783 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128382 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 07:29:32.134783 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128385 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 07:29:32.134783 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128387 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 07:29:32.134783 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128389 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 07:29:32.134783 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128392 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 07:29:32.134783 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128394 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 07:29:32.134783 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128397 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 07:29:32.134783 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128400 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 07:29:32.134783 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128403 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 07:29:32.134783 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128405 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 07:29:32.134783 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128407 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 07:29:32.134783 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128410 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 07:29:32.134783 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128412 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 07:29:32.134783 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128414 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 07:29:32.134783 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128417 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 07:29:32.134783 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128419 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 07:29:32.134783 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128422 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 07:29:32.135274 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128424 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 07:29:32.135274 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128426 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 07:29:32.135274 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128429 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 07:29:32.135274 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128431 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 07:29:32.135274 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.128433 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 07:29:32.135274 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.129100 2580 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 07:29:32.135730 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.135711 2580 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 02 07:29:32.135763 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.135732 2580 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 02 07:29:32.135792 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135775 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 07:29:32.135792 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135781 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 07:29:32.135792 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135784 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 07:29:32.135792 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135787 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 07:29:32.135792 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135789 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 02 07:29:32.135792 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135792 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 07:29:32.135792 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135795 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 07:29:32.135969 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135798 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 07:29:32.135969 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135800 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 07:29:32.135969 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135803 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 07:29:32.135969 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135806 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 07:29:32.135969 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135808 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 07:29:32.135969 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135811 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 07:29:32.135969 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135813 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 07:29:32.135969 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135816 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 07:29:32.135969 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135818 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 07:29:32.135969 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135821 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 07:29:32.135969 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135824 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 07:29:32.135969 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135826 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 07:29:32.135969 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135829 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 07:29:32.135969 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135831 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 07:29:32.135969 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135834 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 07:29:32.135969 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135836 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 07:29:32.135969 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135839 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 07:29:32.135969 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135841 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 07:29:32.135969 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135844 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 07:29:32.135969 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135846 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 07:29:32.136471 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135848 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 07:29:32.136471 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135851 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 07:29:32.136471 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135853 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 07:29:32.136471 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135856 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 07:29:32.136471 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135859 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 07:29:32.136471 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135861 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 07:29:32.136471 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135863 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 07:29:32.136471 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135866 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 07:29:32.136471 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135868 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 07:29:32.136471 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135870 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 07:29:32.136471 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135873 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 07:29:32.136471 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135875 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 07:29:32.136471 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135877 2580 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 07:29:32.136471 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135881 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 07:29:32.136471 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135884 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 07:29:32.136471 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135886 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 07:29:32.136471 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135889 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 07:29:32.136471 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135891 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 07:29:32.136471 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135894 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 07:29:32.136471 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135896 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 07:29:32.136959 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135899 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 07:29:32.136959 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135901 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 07:29:32.136959 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135904 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 07:29:32.136959 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135906 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 07:29:32.136959 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135909 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 07:29:32.136959 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135911 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 07:29:32.136959 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135914 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 07:29:32.136959 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135916 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 07:29:32.136959 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135918 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 07:29:32.136959 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135921 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 07:29:32.136959 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135923 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 07:29:32.136959 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135926 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 07:29:32.136959 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135928 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 07:29:32.136959 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135931 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 07:29:32.136959 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135933 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 07:29:32.136959 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135935 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 07:29:32.136959 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135938 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 07:29:32.136959 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135942 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 07:29:32.136959 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135945 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 07:29:32.137518 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135949 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 07:29:32.137518 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135953 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 07:29:32.137518 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135956 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 07:29:32.137518 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135960 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 07:29:32.137518 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135964 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 07:29:32.137518 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135967 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 07:29:32.137518 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135970 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 07:29:32.137518 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135973 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 07:29:32.137518 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135976 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 07:29:32.137518 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135978 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 07:29:32.137518 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135981 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 07:29:32.137518 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135983 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 07:29:32.137518 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135986 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 07:29:32.137518 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135989 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 07:29:32.137518 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135992 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 07:29:32.137518 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135994 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 07:29:32.137518 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135997 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 07:29:32.137518 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.135999 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 07:29:32.137956 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136001 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 07:29:32.137956 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136004 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 07:29:32.137956 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.136009 2580 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 07:29:32.137956 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136103 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 02 07:29:32.137956 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136108 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 07:29:32.137956 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136111 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 07:29:32.137956 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136114 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 07:29:32.137956 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136117 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 07:29:32.137956 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136121 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 07:29:32.137956 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136125 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 07:29:32.137956 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136128 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 07:29:32.137956 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136130 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 07:29:32.137956 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136133 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 07:29:32.137956 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136136 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 07:29:32.137956 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136139 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 07:29:32.137956 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136142 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 07:29:32.138396 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136144 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 07:29:32.138396 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136146 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 07:29:32.138396 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136149 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 07:29:32.138396 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136151 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 07:29:32.138396 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136153 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 07:29:32.138396 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136156 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 07:29:32.138396 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136158 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 07:29:32.138396 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136162 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 07:29:32.138396 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136165 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 07:29:32.138396 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136168 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 07:29:32.138396 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136171 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 07:29:32.138396 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136173 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 07:29:32.138396 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136176 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 07:29:32.138396 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136179 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 07:29:32.138396 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136182 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 07:29:32.138396 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136184 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 07:29:32.138396 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136187 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 07:29:32.138396 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136190 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 07:29:32.138396 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136193 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 07:29:32.138851 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136195 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 07:29:32.138851 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136198 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 07:29:32.138851 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136201 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 07:29:32.138851 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136203 2580 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 07:29:32.138851 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136206 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 07:29:32.138851 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136209 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 07:29:32.138851 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136226 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 07:29:32.138851 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136229 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 07:29:32.138851 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136231 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 07:29:32.138851 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136234 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 07:29:32.138851 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136236 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 07:29:32.138851 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136240 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 07:29:32.138851 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136242 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 07:29:32.138851 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136245 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 07:29:32.138851 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136247 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 07:29:32.138851 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136250 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 07:29:32.138851 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136252 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 07:29:32.138851 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136254 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 07:29:32.138851 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136257 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 07:29:32.138851 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136259 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 07:29:32.139399 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136261 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 07:29:32.139399 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136264 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 07:29:32.139399 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136266 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 07:29:32.139399 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136269 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 07:29:32.139399 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136271 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 07:29:32.139399 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136274 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 07:29:32.139399 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136276 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 07:29:32.139399 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136279 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 07:29:32.139399 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136281 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 07:29:32.139399 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136283 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 07:29:32.139399 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136286 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 07:29:32.139399 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136288 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 07:29:32.139399 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136290 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 07:29:32.139399 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136293 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 07:29:32.139399 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136295 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 07:29:32.139399 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136297 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 07:29:32.139399 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136300 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 07:29:32.139399 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136302 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 07:29:32.139399 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136305 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 07:29:32.139399 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136307 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 07:29:32.139909 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136310 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 07:29:32.139909 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136312 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 07:29:32.139909 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136315 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 07:29:32.139909 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136318 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 07:29:32.139909 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136329 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 07:29:32.139909 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136331 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 07:29:32.139909 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136334 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 07:29:32.139909 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136336 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 07:29:32.139909 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136338 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 07:29:32.139909 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136341 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 07:29:32.139909 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136343 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 07:29:32.139909 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136346 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 07:29:32.139909 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136348 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 07:29:32.139909 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:32.136351 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 07:29:32.139909 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.136356 2580 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 07:29:32.139909 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.136992 2580 server.go:962] "Client rotation is on, will bootstrap in background" Jun 02 07:29:32.140441 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.138994 2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 02 07:29:32.140441 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.140008 2580 server.go:1019] "Starting client certificate rotation" Jun 02 07:29:32.140441 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.140148 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 07:29:32.140441 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.140202 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 07:29:32.168146 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.168119 2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 07:29:32.170000 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.169975 2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 07:29:32.184252 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.184231 2580 log.go:25] "Validated CRI v1 runtime API" Jun 02 07:29:32.193933 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.193918 2580 log.go:25] "Validated CRI v1 image API" Jun 02 07:29:32.196872 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.196856 2580 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 02 07:29:32.202640 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.202618 2580 fs.go:135] Filesystem UUIDs: map[0e026559-a9e1-433f-a794-d3bacb92ebfb:/dev/nvme0n1p3 30225cee-3199-466f-a5f0-866fc2508503:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jun 02 07:29:32.202722 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.202638 2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 02 07:29:32.205411 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.205393 2580 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 07:29:32.207000 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.206899 2580 manager.go:217] Machine: {Timestamp:2026-06-02 07:29:32.206399347 +0000 UTC m=+0.470381404 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097844 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2da3a0812a113dbf823d433b347a2d SystemUUID:ec2da3a0-812a-113d-bf82-3d433b347a2d BootID:e18d0dd0-f6b8-4840-9b82-2ac5d8b3c577 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:3c:9f:ea:47 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:3c:9f:ea:47 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:7a:2d:c0:7e:f8:ff Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 02 07:29:32.207772 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.207760 2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 02 07:29:32.207861 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.207849 2580 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 02 07:29:32.209921 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.209893 2580 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 02 07:29:32.210061 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.209924 2580 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-245.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 02 07:29:32.210113 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.210072 2580 topology_manager.go:138] "Creating topology manager with none policy" Jun 02 07:29:32.210113 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.210080 2580 container_manager_linux.go:306] "Creating device plugin manager" Jun 02 07:29:32.210113 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.210087 2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 07:29:32.211803 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.211792 2580 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 07:29:32.213841 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.213830 2580 state_mem.go:36] "Initialized new in-memory state store" Jun 02 07:29:32.214122 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.214111 2580 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 02 07:29:32.216665 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.216655 2580 kubelet.go:491] "Attempting to sync node with API server" Jun 02 07:29:32.216706 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.216668 2580 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 02 07:29:32.216706 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.216681 2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 02 07:29:32.216706 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.216691 2580 kubelet.go:397] "Adding apiserver pod source" Jun 02 07:29:32.216706 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.216700 2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 02 07:29:32.218446 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.218433 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 07:29:32.218503 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.218451 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 07:29:32.221785 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.221772 2580 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 02 07:29:32.223726 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.223712 2580 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 02 07:29:32.225037 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.225018 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5r954" Jun 02 07:29:32.225687 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.225674 2580 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 02 07:29:32.225746 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.225691 2580 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 02 07:29:32.225746 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.225698 2580 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 02 07:29:32.225746 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.225705 2580 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 02 07:29:32.225746 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.225714 2580 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 02 07:29:32.225746 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.225720 2580 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 02 07:29:32.225746 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.225728 2580 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 02 07:29:32.225746 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.225733 2580 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 02 07:29:32.225746 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.225739 2580 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 02 07:29:32.225746 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.225746 2580 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 02 07:29:32.226002 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.225763 2580 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 02 07:29:32.226002 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.225769 2580 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 02 07:29:32.226624 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.226610 2580 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 02 07:29:32.226624 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.226621 2580 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 02 07:29:32.227547 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.227533 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5r954" Jun 02 07:29:32.229990 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.229976 2580 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 02 07:29:32.230072 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.230017 2580 server.go:1295] "Started kubelet" Jun 02 07:29:32.230252 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.230233 2580 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-245.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 02 07:29:32.230315 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.230200 2580 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 02 07:29:32.230315 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.230290 2580 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 02 07:29:32.230387 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:32.230324 2580 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 02 07:29:32.230387 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:32.230236 2580 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-245.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 02 07:29:32.230387 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.230371 2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 02 07:29:32.230874 ip-10-0-136-245 systemd[1]: Started Kubernetes Kubelet. Jun 02 07:29:32.233604 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.233585 2580 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 02 07:29:32.233748 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.233736 2580 server.go:317] "Adding debug handlers to kubelet server" Jun 02 07:29:32.237323 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.237303 2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 02 07:29:32.237833 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.237812 2580 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 02 07:29:32.237833 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.237831 2580 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 02 07:29:32.238076 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.238060 2580 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 02 07:29:32.238725 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.238599 2580 reconstruct.go:97] "Volume reconstruction finished" Jun 02 07:29:32.238725 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.238612 2580 reconciler.go:26] "Reconciler: start to sync state" Jun 02 07:29:32.238928 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:32.238906 2580 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-245.ec2.internal\" not found" Jun 02 07:29:32.239018 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.237311 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 02 07:29:32.239814 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.239796 2580 factory.go:153] Registering CRI-O factory Jun 02 07:29:32.239889 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.239819 2580 factory.go:223] Registration of the crio container factory successfully Jun 02 07:29:32.239889 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.239870 2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 02 07:29:32.239889 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.239879 2580 factory.go:55] Registering systemd factory Jun 02 07:29:32.239889 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.239887 2580 factory.go:223] Registration of the systemd container factory successfully Jun 02 07:29:32.240067 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.239909 2580 factory.go:103] Registering Raw factory Jun 02 07:29:32.240067 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.239923 2580 manager.go:1196] Started watching for new ooms in manager Jun 02 07:29:32.240909 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.240894 2580 manager.go:319] Starting recovery of all containers Jun 02 07:29:32.242428 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:32.242404 2580 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 02 07:29:32.244440 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.244420 2580 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 07:29:32.247195 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:32.247161 2580 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-136-245.ec2.internal\" not found" node="ip-10-0-136-245.ec2.internal" Jun 02 07:29:32.252174 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.252023 2580 manager.go:324] Recovery completed Jun 02 07:29:32.256262 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.256250 2580 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 07:29:32.258103 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.258087 2580 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-245.ec2.internal" event="NodeHasSufficientMemory" Jun 02 07:29:32.258185 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.258120 2580 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-245.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 07:29:32.258185 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.258134 2580 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-245.ec2.internal" event="NodeHasSufficientPID" Jun 02 07:29:32.258714 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.258701 2580 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 02 07:29:32.258714 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.258712 2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 02 07:29:32.258780 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.258728 2580 state_mem.go:36] "Initialized new in-memory state store" Jun 02 07:29:32.261079 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.261067 2580 policy_none.go:49] "None policy: Start" Jun 02 07:29:32.261119 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.261083 2580 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 02 07:29:32.261119 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.261093 2580 state_mem.go:35] "Initializing new in-memory state store" Jun 02 07:29:32.306763 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.306749 2580 manager.go:341] "Starting Device Plugin manager" Jun 02 07:29:32.317016 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:32.306778 2580 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 02 07:29:32.317016 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.306788 2580 server.go:85] "Starting device plugin registration server" Jun 02 07:29:32.317016 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.307013 2580 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 02 07:29:32.317016 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.307025 2580 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 02 07:29:32.317016 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.307156 2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 02 07:29:32.317016 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.307250 2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 02 07:29:32.317016 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.307257 2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 02 07:29:32.317016 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:32.308009 2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 02 07:29:32.317016 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:32.308045 2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-245.ec2.internal\" not found" Jun 02 07:29:32.372919 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.372855 2580 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 02 07:29:32.374164 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.374148 2580 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 02 07:29:32.374231 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.374173 2580 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 02 07:29:32.374231 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.374194 2580 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 02 07:29:32.374231 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.374201 2580 kubelet.go:2451] "Starting kubelet main sync loop" Jun 02 07:29:32.374342 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:32.374260 2580 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 02 07:29:32.377538 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.377520 2580 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 07:29:32.407337 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.407310 2580 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 07:29:32.408839 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.408824 2580 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-245.ec2.internal" event="NodeHasSufficientMemory" Jun 02 07:29:32.408943 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.408857 2580 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-245.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 07:29:32.408943 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.408872 2580 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-245.ec2.internal" event="NodeHasSufficientPID" Jun 02 07:29:32.408943 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.408901 2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-245.ec2.internal" Jun 02 07:29:32.418653 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.418637 2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-245.ec2.internal" Jun 02 07:29:32.418735 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:32.418659 2580 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-245.ec2.internal\": node \"ip-10-0-136-245.ec2.internal\" not found" Jun 02 07:29:32.435579 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:32.435553 2580 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-245.ec2.internal\" not found" Jun 02 07:29:32.474867 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.474842 2580 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-245.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-245.ec2.internal"] Jun 02 07:29:32.474941 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.474930 2580 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 07:29:32.481133 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.481116 2580 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-245.ec2.internal" event="NodeHasSufficientMemory" Jun 02 07:29:32.481253 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.481145 2580 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-245.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 07:29:32.481253 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.481155 2580 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-245.ec2.internal" event="NodeHasSufficientPID" Jun 02 07:29:32.482468 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.482456 2580 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 07:29:32.482633 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.482618 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-245.ec2.internal" Jun 02 07:29:32.482690 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.482654 2580 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 07:29:32.483140 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.483127 2580 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-245.ec2.internal" event="NodeHasSufficientMemory" Jun 02 07:29:32.483243 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.483158 2580 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-245.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 07:29:32.483243 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.483174 2580 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-245.ec2.internal" event="NodeHasSufficientPID" Jun 02 07:29:32.483243 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.483207 2580 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-245.ec2.internal" event="NodeHasSufficientMemory" Jun 02 07:29:32.483393 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.483250 2580 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-245.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 07:29:32.483393 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.483264 2580 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-245.ec2.internal" event="NodeHasSufficientPID" Jun 02 07:29:32.484440 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.484423 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-245.ec2.internal" Jun 02 07:29:32.484524 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.484454 2580 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 07:29:32.485094 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.485078 2580 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-245.ec2.internal" event="NodeHasSufficientMemory" Jun 02 07:29:32.485196 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.485108 2580 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-245.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 07:29:32.485196 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.485121 2580 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-245.ec2.internal" event="NodeHasSufficientPID" Jun 02 07:29:32.514042 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:32.514022 2580 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-245.ec2.internal\" not found" node="ip-10-0-136-245.ec2.internal" Jun 02 07:29:32.520055 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:32.520035 2580 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-245.ec2.internal\" not found" node="ip-10-0-136-245.ec2.internal" Jun 02 07:29:32.535957 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:32.535921 2580 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-245.ec2.internal\" not found" Jun 02 07:29:32.540000 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.539984 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7fa10af19a20d160fb343b8315376b17-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-245.ec2.internal\" (UID: \"7fa10af19a20d160fb343b8315376b17\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-245.ec2.internal" Jun 02 07:29:32.540065 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.540008 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7fa10af19a20d160fb343b8315376b17-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-245.ec2.internal\" (UID: \"7fa10af19a20d160fb343b8315376b17\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-245.ec2.internal" Jun 02 07:29:32.540065 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.540026 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/80331574f62266c7e335acd657e0cebc-config\") pod \"kube-apiserver-proxy-ip-10-0-136-245.ec2.internal\" (UID: \"80331574f62266c7e335acd657e0cebc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-245.ec2.internal" Jun 02 07:29:32.636087 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:32.636005 2580 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-245.ec2.internal\" not found" Jun 02 07:29:32.640332 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.640313 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7fa10af19a20d160fb343b8315376b17-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-245.ec2.internal\" (UID: \"7fa10af19a20d160fb343b8315376b17\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-245.ec2.internal" Jun 02 07:29:32.640386 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.640343 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7fa10af19a20d160fb343b8315376b17-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-245.ec2.internal\" (UID: \"7fa10af19a20d160fb343b8315376b17\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-245.ec2.internal" Jun 02 07:29:32.640421 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.640393 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7fa10af19a20d160fb343b8315376b17-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-245.ec2.internal\" (UID: \"7fa10af19a20d160fb343b8315376b17\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-245.ec2.internal" Jun 02 07:29:32.640453 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.640414 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/80331574f62266c7e335acd657e0cebc-config\") pod \"kube-apiserver-proxy-ip-10-0-136-245.ec2.internal\" (UID: \"80331574f62266c7e335acd657e0cebc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-245.ec2.internal" Jun 02 07:29:32.640484 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.640464 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/80331574f62266c7e335acd657e0cebc-config\") pod \"kube-apiserver-proxy-ip-10-0-136-245.ec2.internal\" (UID: \"80331574f62266c7e335acd657e0cebc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-245.ec2.internal" Jun 02 07:29:32.640529 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.640488 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7fa10af19a20d160fb343b8315376b17-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-245.ec2.internal\" (UID: \"7fa10af19a20d160fb343b8315376b17\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-245.ec2.internal" Jun 02 07:29:32.736712 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:32.736681 2580 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-245.ec2.internal\" not found" Jun 02 07:29:32.817190 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.817153 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-245.ec2.internal" Jun 02 07:29:32.823729 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:32.823711 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-245.ec2.internal" Jun 02 07:29:32.837619 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:32.837600 2580 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-245.ec2.internal\" not found" Jun 02 07:29:32.938178 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:32.938086 2580 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-245.ec2.internal\" not found" Jun 02 07:29:33.038534 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:33.038508 2580 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-245.ec2.internal\" not found" Jun 02 07:29:33.138959 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:33.138925 2580 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-245.ec2.internal\" not found" Jun 02 07:29:33.141119 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:33.141099 2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 02 07:29:33.141266 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:33.141250 2580 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 07:29:33.141308 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:33.141264 2580 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 07:29:33.229994 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:33.229950 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-01 07:24:32 +0000 UTC" deadline="2027-12-07 01:56:52.303019041 +0000 UTC" Jun 02 07:29:33.229994 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:33.229993 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13266h27m19.073030369s" Jun 02 07:29:33.239056 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:33.239029 2580 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-245.ec2.internal\" not found" Jun 02 07:29:33.239928 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:33.239909 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 02 07:29:33.249490 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:33.249469 2580 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 07:29:33.268773 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:33.268748 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-4l7hd" Jun 02 07:29:33.274851 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:33.274835 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-4l7hd" Jun 02 07:29:33.310820 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:33.310793 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80331574f62266c7e335acd657e0cebc.slice/crio-c8043b7ce88e989e76e9d9c9480253d573941879dfe08f7efe5fe11f875e2f18 WatchSource:0}: Error finding container c8043b7ce88e989e76e9d9c9480253d573941879dfe08f7efe5fe11f875e2f18: Status 404 returned error can't find the container with id c8043b7ce88e989e76e9d9c9480253d573941879dfe08f7efe5fe11f875e2f18 Jun 02 07:29:33.310958 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:33.310944 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fa10af19a20d160fb343b8315376b17.slice/crio-b66580048749d27dabaf68cc6ea5f8bf9b23f88930c8fb771f88008ccc59f7bb WatchSource:0}: Error finding container b66580048749d27dabaf68cc6ea5f8bf9b23f88930c8fb771f88008ccc59f7bb: Status 404 returned error can't find the container with id b66580048749d27dabaf68cc6ea5f8bf9b23f88930c8fb771f88008ccc59f7bb Jun 02 07:29:33.314644 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:33.314626 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 07:29:33.339687 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:33.339660 2580 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-245.ec2.internal\" not found" Jun 02 07:29:33.354465 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:33.354441 2580 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 07:29:33.376980 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:33.376937 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-245.ec2.internal" event={"ID":"7fa10af19a20d160fb343b8315376b17","Type":"ContainerStarted","Data":"b66580048749d27dabaf68cc6ea5f8bf9b23f88930c8fb771f88008ccc59f7bb"} Jun 02 07:29:33.377837 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:33.377817 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-245.ec2.internal" event={"ID":"80331574f62266c7e335acd657e0cebc","Type":"ContainerStarted","Data":"c8043b7ce88e989e76e9d9c9480253d573941879dfe08f7efe5fe11f875e2f18"} Jun 02 07:29:33.439022 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:33.438991 2580 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-245.ec2.internal" Jun 02 07:29:33.450877 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:33.450854 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 07:29:33.452668 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:33.452630 2580 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-245.ec2.internal" Jun 02 07:29:33.460775 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:33.460758 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 07:29:33.575515 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:33.575488 2580 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 07:29:34.194418 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.194387 2580 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 07:29:34.218202 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.218175 2580 apiserver.go:52] "Watching apiserver" Jun 02 07:29:34.226500 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.226480 2580 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 02 07:29:34.226849 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.226826 2580 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-m8rd6","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j67fw","openshift-image-registry/node-ca-9bbts","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-245.ec2.internal","openshift-multus/multus-additional-cni-plugins-8nv4p","openshift-multus/network-metrics-daemon-rgk46","openshift-network-diagnostics/network-check-target-wp2df","openshift-network-operator/iptables-alerter-nng4s","kube-system/kube-apiserver-proxy-ip-10-0-136-245.ec2.internal","openshift-cluster-node-tuning-operator/tuned-67gkk","openshift-dns/node-resolver-2krhv","openshift-multus/multus-kf8mm","openshift-ovn-kubernetes/ovnkube-node-tjvw4"] Jun 02 07:29:34.228475 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.228448 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-67gkk" Jun 02 07:29:34.229841 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.229815 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j67fw" Jun 02 07:29:34.230587 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.230561 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 02 07:29:34.230792 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.230775 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9x52l\"" Jun 02 07:29:34.230883 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.230783 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 02 07:29:34.231762 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.231742 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 02 07:29:34.231981 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.231961 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 02 07:29:34.232047 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.231997 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8nv4p" Jun 02 07:29:34.232416 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.232343 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 02 07:29:34.234538 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.234250 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-cntp5\"" Jun 02 07:29:34.235470 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.235446 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 02 07:29:34.235906 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.235890 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 02 07:29:34.235998 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.235954 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 02 07:29:34.236954 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.236845 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rgk46" Jun 02 07:29:34.237042 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.236986 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 02 07:29:34.237042 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:34.237003 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rgk46" podUID="56bb33da-8c46-4433-8b45-f6fe098c4d25" Jun 02 07:29:34.237154 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.237105 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-mrtj4\"" Jun 02 07:29:34.237454 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.237432 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 02 07:29:34.238360 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.238342 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9bbts" Jun 02 07:29:34.239395 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.239376 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wp2df" Jun 02 07:29:34.239504 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:34.239440 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wp2df" podUID="f60cac34-93f5-4439-b197-17a7283b4599" Jun 02 07:29:34.240457 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.240247 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 02 07:29:34.240457 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.240323 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 02 07:29:34.240457 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.240328 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-4qpgd\"" Jun 02 07:29:34.240653 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.240545 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nng4s" Jun 02 07:29:34.240653 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.240638 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-m8rd6" Jun 02 07:29:34.240755 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.240694 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 02 07:29:34.242989 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.242970 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 02 07:29:34.243078 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.243063 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 02 07:29:34.243267 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.243251 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2krhv" Jun 02 07:29:34.243649 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.243633 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 02 07:29:34.243720 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.243662 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 02 07:29:34.243902 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.243890 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 02 07:29:34.243963 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.243951 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-tl87c\"" Jun 02 07:29:34.244042 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.243892 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-ts762\"" Jun 02 07:29:34.244444 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.244429 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kf8mm" Jun 02 07:29:34.244524 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.244446 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" Jun 02 07:29:34.245557 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.245410 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 02 07:29:34.245557 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.245425 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-tpnrs\"" Jun 02 07:29:34.245557 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.245470 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 02 07:29:34.246379 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.246359 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 02 07:29:34.246379 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.246371 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 02 07:29:34.246621 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.246603 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-v4jqr\"" Jun 02 07:29:34.246680 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.246653 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 02 07:29:34.246737 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.246723 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 02 07:29:34.247752 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.247732 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 02 07:29:34.247824 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.247756 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-ggvmd\"" Jun 02 07:29:34.247824 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.247773 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 02 07:29:34.247824 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.247738 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 02 07:29:34.248633 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.248615 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32c32725-d170-41c3-82f8-78900f6220c2-tmp\") pod \"tuned-67gkk\" (UID: \"32c32725-d170-41c3-82f8-78900f6220c2\") " pod="openshift-cluster-node-tuning-operator/tuned-67gkk" Jun 02 07:29:34.248722 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.248644 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8479fba7-d0c6-4c26-82cd-44cff52ef948-serviceca\") pod \"node-ca-9bbts\" (UID: \"8479fba7-d0c6-4c26-82cd-44cff52ef948\") " pod="openshift-image-registry/node-ca-9bbts" Jun 02 07:29:34.248722 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.248668 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/63f72893-abb3-493b-a512-9e9bd17b76a4-host-slash\") pod \"iptables-alerter-nng4s\" (UID: \"63f72893-abb3-493b-a512-9e9bd17b76a4\") " pod="openshift-network-operator/iptables-alerter-nng4s" Jun 02 07:29:34.248722 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.248691 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8479fba7-d0c6-4c26-82cd-44cff52ef948-host\") pod \"node-ca-9bbts\" (UID: \"8479fba7-d0c6-4c26-82cd-44cff52ef948\") " pod="openshift-image-registry/node-ca-9bbts" Jun 02 07:29:34.248722 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.248714 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/32c32725-d170-41c3-82f8-78900f6220c2-run\") pod \"tuned-67gkk\" (UID: \"32c32725-d170-41c3-82f8-78900f6220c2\") " pod="openshift-cluster-node-tuning-operator/tuned-67gkk" Jun 02 07:29:34.248878 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.248730 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/32c32725-d170-41c3-82f8-78900f6220c2-lib-modules\") pod \"tuned-67gkk\" (UID: \"32c32725-d170-41c3-82f8-78900f6220c2\") " pod="openshift-cluster-node-tuning-operator/tuned-67gkk" Jun 02 07:29:34.248878 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.248748 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7048ef29-aba3-4c8b-b38a-b02c615a3ec7-socket-dir\") pod \"aws-ebs-csi-driver-node-j67fw\" (UID: \"7048ef29-aba3-4c8b-b38a-b02c615a3ec7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j67fw" Jun 02 07:29:34.248878 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.248762 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7048ef29-aba3-4c8b-b38a-b02c615a3ec7-registration-dir\") pod \"aws-ebs-csi-driver-node-j67fw\" (UID: \"7048ef29-aba3-4c8b-b38a-b02c615a3ec7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j67fw" Jun 02 07:29:34.248878 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.248778 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a28eec73-4627-4d20-925e-23fb8e998a96-os-release\") pod \"multus-additional-cni-plugins-8nv4p\" (UID: \"a28eec73-4627-4d20-925e-23fb8e998a96\") " pod="openshift-multus/multus-additional-cni-plugins-8nv4p" Jun 02 07:29:34.248878 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.248792 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a28eec73-4627-4d20-925e-23fb8e998a96-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8nv4p\" (UID: \"a28eec73-4627-4d20-925e-23fb8e998a96\") " pod="openshift-multus/multus-additional-cni-plugins-8nv4p" Jun 02 07:29:34.248878 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.248810 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7048ef29-aba3-4c8b-b38a-b02c615a3ec7-device-dir\") pod \"aws-ebs-csi-driver-node-j67fw\" (UID: \"7048ef29-aba3-4c8b-b38a-b02c615a3ec7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j67fw" Jun 02 07:29:34.248878 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.248826 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/32c32725-d170-41c3-82f8-78900f6220c2-sys\") pod \"tuned-67gkk\" (UID: \"32c32725-d170-41c3-82f8-78900f6220c2\") " pod="openshift-cluster-node-tuning-operator/tuned-67gkk" Jun 02 07:29:34.248878 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.248842 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/32c32725-d170-41c3-82f8-78900f6220c2-etc-sysconfig\") pod \"tuned-67gkk\" (UID: \"32c32725-d170-41c3-82f8-78900f6220c2\") " pod="openshift-cluster-node-tuning-operator/tuned-67gkk" Jun 02 07:29:34.248878 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.248854 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/32c32725-d170-41c3-82f8-78900f6220c2-etc-kubernetes\") pod \"tuned-67gkk\" (UID: \"32c32725-d170-41c3-82f8-78900f6220c2\") " pod="openshift-cluster-node-tuning-operator/tuned-67gkk" Jun 02 07:29:34.248878 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.248873 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/32c32725-d170-41c3-82f8-78900f6220c2-etc-sysctl-d\") pod \"tuned-67gkk\" (UID: \"32c32725-d170-41c3-82f8-78900f6220c2\") " pod="openshift-cluster-node-tuning-operator/tuned-67gkk" Jun 02 07:29:34.249265 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.248890 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/32c32725-d170-41c3-82f8-78900f6220c2-etc-systemd\") pod \"tuned-67gkk\" (UID: \"32c32725-d170-41c3-82f8-78900f6220c2\") " pod="openshift-cluster-node-tuning-operator/tuned-67gkk" Jun 02 07:29:34.249265 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.248912 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/32c32725-d170-41c3-82f8-78900f6220c2-etc-tuned\") pod \"tuned-67gkk\" (UID: \"32c32725-d170-41c3-82f8-78900f6220c2\") " pod="openshift-cluster-node-tuning-operator/tuned-67gkk" Jun 02 07:29:34.249265 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.248931 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a28eec73-4627-4d20-925e-23fb8e998a96-cni-binary-copy\") pod \"multus-additional-cni-plugins-8nv4p\" (UID: \"a28eec73-4627-4d20-925e-23fb8e998a96\") " pod="openshift-multus/multus-additional-cni-plugins-8nv4p" Jun 02 07:29:34.249265 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.248958 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/63f72893-abb3-493b-a512-9e9bd17b76a4-iptables-alerter-script\") pod \"iptables-alerter-nng4s\" (UID: \"63f72893-abb3-493b-a512-9e9bd17b76a4\") " pod="openshift-network-operator/iptables-alerter-nng4s" Jun 02 07:29:34.249265 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.248978 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnmdv\" (UniqueName: \"kubernetes.io/projected/32c32725-d170-41c3-82f8-78900f6220c2-kube-api-access-pnmdv\") pod \"tuned-67gkk\" (UID: \"32c32725-d170-41c3-82f8-78900f6220c2\") " pod="openshift-cluster-node-tuning-operator/tuned-67gkk" Jun 02 07:29:34.249265 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.248997 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7048ef29-aba3-4c8b-b38a-b02c615a3ec7-sys-fs\") pod \"aws-ebs-csi-driver-node-j67fw\" (UID: \"7048ef29-aba3-4c8b-b38a-b02c615a3ec7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j67fw" Jun 02 07:29:34.249265 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.249017 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/32c32725-d170-41c3-82f8-78900f6220c2-etc-modprobe-d\") pod \"tuned-67gkk\" (UID: \"32c32725-d170-41c3-82f8-78900f6220c2\") " pod="openshift-cluster-node-tuning-operator/tuned-67gkk" Jun 02 07:29:34.249265 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.249046 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/32c32725-d170-41c3-82f8-78900f6220c2-var-lib-kubelet\") pod \"tuned-67gkk\" (UID: \"32c32725-d170-41c3-82f8-78900f6220c2\") " pod="openshift-cluster-node-tuning-operator/tuned-67gkk" Jun 02 07:29:34.249265 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.249069 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/32c32725-d170-41c3-82f8-78900f6220c2-host\") pod \"tuned-67gkk\" (UID: \"32c32725-d170-41c3-82f8-78900f6220c2\") " pod="openshift-cluster-node-tuning-operator/tuned-67gkk" Jun 02 07:29:34.249265 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.249092 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7048ef29-aba3-4c8b-b38a-b02c615a3ec7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j67fw\" (UID: \"7048ef29-aba3-4c8b-b38a-b02c615a3ec7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j67fw" Jun 02 07:29:34.249265 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.249109 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7048ef29-aba3-4c8b-b38a-b02c615a3ec7-etc-selinux\") pod \"aws-ebs-csi-driver-node-j67fw\" (UID: \"7048ef29-aba3-4c8b-b38a-b02c615a3ec7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j67fw" Jun 02 07:29:34.249265 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.249128 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hbb6\" (UniqueName: \"kubernetes.io/projected/7048ef29-aba3-4c8b-b38a-b02c615a3ec7-kube-api-access-7hbb6\") pod \"aws-ebs-csi-driver-node-j67fw\" (UID: \"7048ef29-aba3-4c8b-b38a-b02c615a3ec7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j67fw" Jun 02 07:29:34.249265 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.249143 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nbxm\" (UniqueName: \"kubernetes.io/projected/8479fba7-d0c6-4c26-82cd-44cff52ef948-kube-api-access-7nbxm\") pod \"node-ca-9bbts\" (UID: \"8479fba7-d0c6-4c26-82cd-44cff52ef948\") " pod="openshift-image-registry/node-ca-9bbts" Jun 02 07:29:34.249265 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.249160 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/32c32725-d170-41c3-82f8-78900f6220c2-etc-sysctl-conf\") pod \"tuned-67gkk\" (UID: \"32c32725-d170-41c3-82f8-78900f6220c2\") " pod="openshift-cluster-node-tuning-operator/tuned-67gkk" Jun 02 07:29:34.249265 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.249174 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a28eec73-4627-4d20-925e-23fb8e998a96-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8nv4p\" (UID: \"a28eec73-4627-4d20-925e-23fb8e998a96\") " pod="openshift-multus/multus-additional-cni-plugins-8nv4p" Jun 02 07:29:34.249265 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.249191 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bq76b\" (UniqueName: \"kubernetes.io/projected/a28eec73-4627-4d20-925e-23fb8e998a96-kube-api-access-bq76b\") pod \"multus-additional-cni-plugins-8nv4p\" (UID: \"a28eec73-4627-4d20-925e-23fb8e998a96\") " pod="openshift-multus/multus-additional-cni-plugins-8nv4p" Jun 02 07:29:34.249988 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.249234 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsbdt\" (UniqueName: \"kubernetes.io/projected/56bb33da-8c46-4433-8b45-f6fe098c4d25-kube-api-access-fsbdt\") pod \"network-metrics-daemon-rgk46\" (UID: \"56bb33da-8c46-4433-8b45-f6fe098c4d25\") " pod="openshift-multus/network-metrics-daemon-rgk46" Jun 02 07:29:34.249988 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.249268 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a28eec73-4627-4d20-925e-23fb8e998a96-system-cni-dir\") pod \"multus-additional-cni-plugins-8nv4p\" (UID: \"a28eec73-4627-4d20-925e-23fb8e998a96\") " pod="openshift-multus/multus-additional-cni-plugins-8nv4p" Jun 02 07:29:34.249988 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.249295 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a28eec73-4627-4d20-925e-23fb8e998a96-cnibin\") pod \"multus-additional-cni-plugins-8nv4p\" (UID: \"a28eec73-4627-4d20-925e-23fb8e998a96\") " pod="openshift-multus/multus-additional-cni-plugins-8nv4p" Jun 02 07:29:34.249988 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.249418 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a28eec73-4627-4d20-925e-23fb8e998a96-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8nv4p\" (UID: \"a28eec73-4627-4d20-925e-23fb8e998a96\") " pod="openshift-multus/multus-additional-cni-plugins-8nv4p" Jun 02 07:29:34.249988 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.249454 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56bb33da-8c46-4433-8b45-f6fe098c4d25-metrics-certs\") pod \"network-metrics-daemon-rgk46\" (UID: \"56bb33da-8c46-4433-8b45-f6fe098c4d25\") " pod="openshift-multus/network-metrics-daemon-rgk46" Jun 02 07:29:34.249988 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.249510 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8m79x\" (UniqueName: \"kubernetes.io/projected/f60cac34-93f5-4439-b197-17a7283b4599-kube-api-access-8m79x\") pod \"network-check-target-wp2df\" (UID: \"f60cac34-93f5-4439-b197-17a7283b4599\") " pod="openshift-network-diagnostics/network-check-target-wp2df" Jun 02 07:29:34.249988 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.249567 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtbbk\" (UniqueName: \"kubernetes.io/projected/63f72893-abb3-493b-a512-9e9bd17b76a4-kube-api-access-wtbbk\") pod \"iptables-alerter-nng4s\" (UID: \"63f72893-abb3-493b-a512-9e9bd17b76a4\") " pod="openshift-network-operator/iptables-alerter-nng4s" Jun 02 07:29:34.275516 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.275482 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 07:24:33 +0000 UTC" deadline="2027-12-18 03:00:46.665155529 +0000 UTC" Jun 02 07:29:34.275516 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.275512 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13531h31m12.389647341s" Jun 02 07:29:34.334797 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.334773 2580 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 07:29:34.339578 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.339558 2580 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 02 07:29:34.350721 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.350696 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8479fba7-d0c6-4c26-82cd-44cff52ef948-host\") pod \"node-ca-9bbts\" (UID: \"8479fba7-d0c6-4c26-82cd-44cff52ef948\") " pod="openshift-image-registry/node-ca-9bbts" Jun 02 07:29:34.350721 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.350726 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/32c32725-d170-41c3-82f8-78900f6220c2-run\") pod \"tuned-67gkk\" (UID: \"32c32725-d170-41c3-82f8-78900f6220c2\") " pod="openshift-cluster-node-tuning-operator/tuned-67gkk" Jun 02 07:29:34.350898 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.350740 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/32c32725-d170-41c3-82f8-78900f6220c2-lib-modules\") pod \"tuned-67gkk\" (UID: \"32c32725-d170-41c3-82f8-78900f6220c2\") " pod="openshift-cluster-node-tuning-operator/tuned-67gkk" Jun 02 07:29:34.350898 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.350756 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7048ef29-aba3-4c8b-b38a-b02c615a3ec7-socket-dir\") pod \"aws-ebs-csi-driver-node-j67fw\" (UID: \"7048ef29-aba3-4c8b-b38a-b02c615a3ec7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j67fw" Jun 02 07:29:34.350898 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.350771 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7048ef29-aba3-4c8b-b38a-b02c615a3ec7-registration-dir\") pod \"aws-ebs-csi-driver-node-j67fw\" (UID: \"7048ef29-aba3-4c8b-b38a-b02c615a3ec7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j67fw" Jun 02 07:29:34.350898 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.350847 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8479fba7-d0c6-4c26-82cd-44cff52ef948-host\") pod \"node-ca-9bbts\" (UID: \"8479fba7-d0c6-4c26-82cd-44cff52ef948\") " pod="openshift-image-registry/node-ca-9bbts" Jun 02 07:29:34.350898 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.350847 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f3415efe-20d6-430a-8501-c8c2d2709d7e-host-cni-bin\") pod \"ovnkube-node-tjvw4\" (UID: \"f3415efe-20d6-430a-8501-c8c2d2709d7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" Jun 02 07:29:34.350898 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.350870 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/32c32725-d170-41c3-82f8-78900f6220c2-run\") pod \"tuned-67gkk\" (UID: \"32c32725-d170-41c3-82f8-78900f6220c2\") " pod="openshift-cluster-node-tuning-operator/tuned-67gkk" Jun 02 07:29:34.350898 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.350886 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/065f3e32-54af-4094-bdd9-2aa60ae8cb83-etc-kubernetes\") pod \"multus-kf8mm\" (UID: \"065f3e32-54af-4094-bdd9-2aa60ae8cb83\") " pod="openshift-multus/multus-kf8mm" Jun 02 07:29:34.350898 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.350856 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7048ef29-aba3-4c8b-b38a-b02c615a3ec7-registration-dir\") pod \"aws-ebs-csi-driver-node-j67fw\" (UID: \"7048ef29-aba3-4c8b-b38a-b02c615a3ec7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j67fw" Jun 02 07:29:34.350898 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.350896 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/32c32725-d170-41c3-82f8-78900f6220c2-lib-modules\") pod \"tuned-67gkk\" (UID: \"32c32725-d170-41c3-82f8-78900f6220c2\") " pod="openshift-cluster-node-tuning-operator/tuned-67gkk" Jun 02 07:29:34.351190 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.350912 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7048ef29-aba3-4c8b-b38a-b02c615a3ec7-socket-dir\") pod \"aws-ebs-csi-driver-node-j67fw\" (UID: \"7048ef29-aba3-4c8b-b38a-b02c615a3ec7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j67fw" Jun 02 07:29:34.351190 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.350917 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/32c32725-d170-41c3-82f8-78900f6220c2-sys\") pod \"tuned-67gkk\" (UID: \"32c32725-d170-41c3-82f8-78900f6220c2\") " pod="openshift-cluster-node-tuning-operator/tuned-67gkk" Jun 02 07:29:34.351190 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.350962 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/32c32725-d170-41c3-82f8-78900f6220c2-etc-sysconfig\") pod \"tuned-67gkk\" (UID: \"32c32725-d170-41c3-82f8-78900f6220c2\") " pod="openshift-cluster-node-tuning-operator/tuned-67gkk" Jun 02 07:29:34.351190 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.350990 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f3415efe-20d6-430a-8501-c8c2d2709d7e-ovnkube-config\") pod \"ovnkube-node-tjvw4\" (UID: \"f3415efe-20d6-430a-8501-c8c2d2709d7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" Jun 02 07:29:34.351190 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.351006 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/32c32725-d170-41c3-82f8-78900f6220c2-etc-sysconfig\") pod \"tuned-67gkk\" (UID: \"32c32725-d170-41c3-82f8-78900f6220c2\") " pod="openshift-cluster-node-tuning-operator/tuned-67gkk" Jun 02 07:29:34.351190 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.351014 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a28eec73-4627-4d20-925e-23fb8e998a96-cni-binary-copy\") pod \"multus-additional-cni-plugins-8nv4p\" (UID: \"a28eec73-4627-4d20-925e-23fb8e998a96\") " pod="openshift-multus/multus-additional-cni-plugins-8nv4p" Jun 02 07:29:34.351190 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.350965 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/32c32725-d170-41c3-82f8-78900f6220c2-sys\") pod \"tuned-67gkk\" (UID: \"32c32725-d170-41c3-82f8-78900f6220c2\") " pod="openshift-cluster-node-tuning-operator/tuned-67gkk" Jun 02 07:29:34.351190 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.351040 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f3415efe-20d6-430a-8501-c8c2d2709d7e-etc-openvswitch\") pod \"ovnkube-node-tjvw4\" (UID: \"f3415efe-20d6-430a-8501-c8c2d2709d7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" Jun 02 07:29:34.351190 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.351074 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f3415efe-20d6-430a-8501-c8c2d2709d7e-node-log\") pod \"ovnkube-node-tjvw4\" (UID: \"f3415efe-20d6-430a-8501-c8c2d2709d7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" Jun 02 07:29:34.351190 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.351095 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/065f3e32-54af-4094-bdd9-2aa60ae8cb83-system-cni-dir\") pod \"multus-kf8mm\" (UID: \"065f3e32-54af-4094-bdd9-2aa60ae8cb83\") " pod="openshift-multus/multus-kf8mm" Jun 02 07:29:34.351190 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.351115 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/065f3e32-54af-4094-bdd9-2aa60ae8cb83-host-var-lib-cni-bin\") pod \"multus-kf8mm\" (UID: \"065f3e32-54af-4094-bdd9-2aa60ae8cb83\") " pod="openshift-multus/multus-kf8mm" Jun 02 07:29:34.351190 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.351137 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7048ef29-aba3-4c8b-b38a-b02c615a3ec7-sys-fs\") pod \"aws-ebs-csi-driver-node-j67fw\" (UID: \"7048ef29-aba3-4c8b-b38a-b02c615a3ec7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j67fw" Jun 02 07:29:34.351190 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.351159 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f3415efe-20d6-430a-8501-c8c2d2709d7e-host-run-netns\") pod \"ovnkube-node-tjvw4\" (UID: \"f3415efe-20d6-430a-8501-c8c2d2709d7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" Jun 02 07:29:34.351190 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.351183 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/eee91b43-4311-42b2-aa7b-e1ad62724d7d-konnectivity-ca\") pod \"konnectivity-agent-m8rd6\" (UID: \"eee91b43-4311-42b2-aa7b-e1ad62724d7d\") " pod="kube-system/konnectivity-agent-m8rd6" Jun 02 07:29:34.351704 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.351208 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/32c32725-d170-41c3-82f8-78900f6220c2-etc-modprobe-d\") pod \"tuned-67gkk\" (UID: \"32c32725-d170-41c3-82f8-78900f6220c2\") " pod="openshift-cluster-node-tuning-operator/tuned-67gkk" Jun 02 07:29:34.351704 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.351238 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7048ef29-aba3-4c8b-b38a-b02c615a3ec7-sys-fs\") pod \"aws-ebs-csi-driver-node-j67fw\" (UID: \"7048ef29-aba3-4c8b-b38a-b02c615a3ec7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j67fw" Jun 02 07:29:34.351704 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.351246 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/32c32725-d170-41c3-82f8-78900f6220c2-host\") pod \"tuned-67gkk\" (UID: \"32c32725-d170-41c3-82f8-78900f6220c2\") " pod="openshift-cluster-node-tuning-operator/tuned-67gkk" Jun 02 07:29:34.351704 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.351267 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f3415efe-20d6-430a-8501-c8c2d2709d7e-run-systemd\") pod \"ovnkube-node-tjvw4\" (UID: \"f3415efe-20d6-430a-8501-c8c2d2709d7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" Jun 02 07:29:34.351704 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.351288 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f3415efe-20d6-430a-8501-c8c2d2709d7e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tjvw4\" (UID: \"f3415efe-20d6-430a-8501-c8c2d2709d7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" Jun 02 07:29:34.351704 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.351306 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/32c32725-d170-41c3-82f8-78900f6220c2-etc-modprobe-d\") pod \"tuned-67gkk\" (UID: \"32c32725-d170-41c3-82f8-78900f6220c2\") " pod="openshift-cluster-node-tuning-operator/tuned-67gkk" Jun 02 07:29:34.351704 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.351310 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2gv5\" (UniqueName: \"kubernetes.io/projected/a731c005-ed09-4135-9776-d885682e8200-kube-api-access-l2gv5\") pod \"node-resolver-2krhv\" (UID: \"a731c005-ed09-4135-9776-d885682e8200\") " pod="openshift-dns/node-resolver-2krhv" Jun 02 07:29:34.351704 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.351330 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/065f3e32-54af-4094-bdd9-2aa60ae8cb83-host-run-k8s-cni-cncf-io\") pod \"multus-kf8mm\" (UID: \"065f3e32-54af-4094-bdd9-2aa60ae8cb83\") " pod="openshift-multus/multus-kf8mm" Jun 02 07:29:34.351704 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.351336 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/32c32725-d170-41c3-82f8-78900f6220c2-host\") pod \"tuned-67gkk\" (UID: \"32c32725-d170-41c3-82f8-78900f6220c2\") " pod="openshift-cluster-node-tuning-operator/tuned-67gkk" Jun 02 07:29:34.351704 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.351353 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7048ef29-aba3-4c8b-b38a-b02c615a3ec7-etc-selinux\") pod \"aws-ebs-csi-driver-node-j67fw\" (UID: \"7048ef29-aba3-4c8b-b38a-b02c615a3ec7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j67fw" Jun 02 07:29:34.351704 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.351376 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7nbxm\" (UniqueName: \"kubernetes.io/projected/8479fba7-d0c6-4c26-82cd-44cff52ef948-kube-api-access-7nbxm\") pod \"node-ca-9bbts\" (UID: \"8479fba7-d0c6-4c26-82cd-44cff52ef948\") " pod="openshift-image-registry/node-ca-9bbts" Jun 02 07:29:34.351704 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.351397 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bq76b\" (UniqueName: \"kubernetes.io/projected/a28eec73-4627-4d20-925e-23fb8e998a96-kube-api-access-bq76b\") pod \"multus-additional-cni-plugins-8nv4p\" (UID: \"a28eec73-4627-4d20-925e-23fb8e998a96\") " pod="openshift-multus/multus-additional-cni-plugins-8nv4p" Jun 02 07:29:34.351704 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.351418 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f3415efe-20d6-430a-8501-c8c2d2709d7e-ovnkube-script-lib\") pod \"ovnkube-node-tjvw4\" (UID: \"f3415efe-20d6-430a-8501-c8c2d2709d7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" Jun 02 07:29:34.351704 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.351444 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7048ef29-aba3-4c8b-b38a-b02c615a3ec7-etc-selinux\") pod \"aws-ebs-csi-driver-node-j67fw\" (UID: \"7048ef29-aba3-4c8b-b38a-b02c615a3ec7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j67fw" Jun 02 07:29:34.351704 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.351520 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a28eec73-4627-4d20-925e-23fb8e998a96-cni-binary-copy\") pod \"multus-additional-cni-plugins-8nv4p\" (UID: \"a28eec73-4627-4d20-925e-23fb8e998a96\") " pod="openshift-multus/multus-additional-cni-plugins-8nv4p" Jun 02 07:29:34.351704 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.351535 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a731c005-ed09-4135-9776-d885682e8200-tmp-dir\") pod \"node-resolver-2krhv\" (UID: \"a731c005-ed09-4135-9776-d885682e8200\") " pod="openshift-dns/node-resolver-2krhv" Jun 02 07:29:34.351704 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.351553 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/065f3e32-54af-4094-bdd9-2aa60ae8cb83-host-run-netns\") pod \"multus-kf8mm\" (UID: \"065f3e32-54af-4094-bdd9-2aa60ae8cb83\") " pod="openshift-multus/multus-kf8mm" Jun 02 07:29:34.352332 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.351568 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/065f3e32-54af-4094-bdd9-2aa60ae8cb83-host-var-lib-cni-multus\") pod \"multus-kf8mm\" (UID: \"065f3e32-54af-4094-bdd9-2aa60ae8cb83\") " pod="openshift-multus/multus-kf8mm" Jun 02 07:29:34.352332 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.351606 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2w2v5\" (UniqueName: \"kubernetes.io/projected/065f3e32-54af-4094-bdd9-2aa60ae8cb83-kube-api-access-2w2v5\") pod \"multus-kf8mm\" (UID: \"065f3e32-54af-4094-bdd9-2aa60ae8cb83\") " pod="openshift-multus/multus-kf8mm" Jun 02 07:29:34.352332 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.351637 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a28eec73-4627-4d20-925e-23fb8e998a96-cnibin\") pod \"multus-additional-cni-plugins-8nv4p\" (UID: \"a28eec73-4627-4d20-925e-23fb8e998a96\") " pod="openshift-multus/multus-additional-cni-plugins-8nv4p" Jun 02 07:29:34.352332 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.351661 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3415efe-20d6-430a-8501-c8c2d2709d7e-host-kubelet\") pod \"ovnkube-node-tjvw4\" (UID: \"f3415efe-20d6-430a-8501-c8c2d2709d7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" Jun 02 07:29:34.352332 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.351683 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a28eec73-4627-4d20-925e-23fb8e998a96-cnibin\") pod \"multus-additional-cni-plugins-8nv4p\" (UID: \"a28eec73-4627-4d20-925e-23fb8e998a96\") " pod="openshift-multus/multus-additional-cni-plugins-8nv4p" Jun 02 07:29:34.352332 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.351689 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/065f3e32-54af-4094-bdd9-2aa60ae8cb83-os-release\") pod \"multus-kf8mm\" (UID: \"065f3e32-54af-4094-bdd9-2aa60ae8cb83\") " pod="openshift-multus/multus-kf8mm" Jun 02 07:29:34.352332 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.351713 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32c32725-d170-41c3-82f8-78900f6220c2-tmp\") pod \"tuned-67gkk\" (UID: \"32c32725-d170-41c3-82f8-78900f6220c2\") " pod="openshift-cluster-node-tuning-operator/tuned-67gkk" Jun 02 07:29:34.352332 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.351733 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8479fba7-d0c6-4c26-82cd-44cff52ef948-serviceca\") pod \"node-ca-9bbts\" (UID: \"8479fba7-d0c6-4c26-82cd-44cff52ef948\") " pod="openshift-image-registry/node-ca-9bbts" Jun 02 07:29:34.352332 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.351748 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/63f72893-abb3-493b-a512-9e9bd17b76a4-host-slash\") pod \"iptables-alerter-nng4s\" (UID: \"63f72893-abb3-493b-a512-9e9bd17b76a4\") " pod="openshift-network-operator/iptables-alerter-nng4s" Jun 02 07:29:34.352332 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.351771 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f3415efe-20d6-430a-8501-c8c2d2709d7e-host-slash\") pod \"ovnkube-node-tjvw4\" (UID: \"f3415efe-20d6-430a-8501-c8c2d2709d7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" Jun 02 07:29:34.352332 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.351794 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f3415efe-20d6-430a-8501-c8c2d2709d7e-var-lib-openvswitch\") pod \"ovnkube-node-tjvw4\" (UID: \"f3415efe-20d6-430a-8501-c8c2d2709d7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" Jun 02 07:29:34.352332 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.351817 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/065f3e32-54af-4094-bdd9-2aa60ae8cb83-cnibin\") pod \"multus-kf8mm\" (UID: \"065f3e32-54af-4094-bdd9-2aa60ae8cb83\") " pod="openshift-multus/multus-kf8mm" Jun 02 07:29:34.352332 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.351822 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/63f72893-abb3-493b-a512-9e9bd17b76a4-host-slash\") pod \"iptables-alerter-nng4s\" (UID: \"63f72893-abb3-493b-a512-9e9bd17b76a4\") " pod="openshift-network-operator/iptables-alerter-nng4s" Jun 02 07:29:34.352332 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.351841 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a28eec73-4627-4d20-925e-23fb8e998a96-os-release\") pod \"multus-additional-cni-plugins-8nv4p\" (UID: \"a28eec73-4627-4d20-925e-23fb8e998a96\") " pod="openshift-multus/multus-additional-cni-plugins-8nv4p" Jun 02 07:29:34.352332 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.351868 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a28eec73-4627-4d20-925e-23fb8e998a96-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8nv4p\" (UID: \"a28eec73-4627-4d20-925e-23fb8e998a96\") " pod="openshift-multus/multus-additional-cni-plugins-8nv4p" Jun 02 07:29:34.352332 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.351922 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a28eec73-4627-4d20-925e-23fb8e998a96-os-release\") pod \"multus-additional-cni-plugins-8nv4p\" (UID: \"a28eec73-4627-4d20-925e-23fb8e998a96\") " pod="openshift-multus/multus-additional-cni-plugins-8nv4p" Jun 02 07:29:34.352332 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.351944 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/065f3e32-54af-4094-bdd9-2aa60ae8cb83-cni-binary-copy\") pod \"multus-kf8mm\" (UID: \"065f3e32-54af-4094-bdd9-2aa60ae8cb83\") " pod="openshift-multus/multus-kf8mm" Jun 02 07:29:34.353096 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.351962 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/065f3e32-54af-4094-bdd9-2aa60ae8cb83-hostroot\") pod \"multus-kf8mm\" (UID: \"065f3e32-54af-4094-bdd9-2aa60ae8cb83\") " pod="openshift-multus/multus-kf8mm" Jun 02 07:29:34.353096 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.351989 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7048ef29-aba3-4c8b-b38a-b02c615a3ec7-device-dir\") pod \"aws-ebs-csi-driver-node-j67fw\" (UID: \"7048ef29-aba3-4c8b-b38a-b02c615a3ec7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j67fw" Jun 02 07:29:34.353096 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.352009 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/32c32725-d170-41c3-82f8-78900f6220c2-etc-kubernetes\") pod \"tuned-67gkk\" (UID: \"32c32725-d170-41c3-82f8-78900f6220c2\") " pod="openshift-cluster-node-tuning-operator/tuned-67gkk" Jun 02 07:29:34.353096 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.352024 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/32c32725-d170-41c3-82f8-78900f6220c2-etc-sysctl-d\") pod \"tuned-67gkk\" (UID: \"32c32725-d170-41c3-82f8-78900f6220c2\") " pod="openshift-cluster-node-tuning-operator/tuned-67gkk" Jun 02 07:29:34.353096 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.352041 2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 02 07:29:34.353096 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.352061 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/32c32725-d170-41c3-82f8-78900f6220c2-etc-systemd\") pod \"tuned-67gkk\" (UID: \"32c32725-d170-41c3-82f8-78900f6220c2\") " pod="openshift-cluster-node-tuning-operator/tuned-67gkk" Jun 02 07:29:34.353096 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.352082 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7048ef29-aba3-4c8b-b38a-b02c615a3ec7-device-dir\") pod \"aws-ebs-csi-driver-node-j67fw\" (UID: \"7048ef29-aba3-4c8b-b38a-b02c615a3ec7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j67fw" Jun 02 07:29:34.353096 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.352085 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/32c32725-d170-41c3-82f8-78900f6220c2-etc-tuned\") pod \"tuned-67gkk\" (UID: \"32c32725-d170-41c3-82f8-78900f6220c2\") " pod="openshift-cluster-node-tuning-operator/tuned-67gkk" Jun 02 07:29:34.353096 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.352101 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/32c32725-d170-41c3-82f8-78900f6220c2-etc-kubernetes\") pod \"tuned-67gkk\" (UID: \"32c32725-d170-41c3-82f8-78900f6220c2\") " pod="openshift-cluster-node-tuning-operator/tuned-67gkk" Jun 02 07:29:34.353096 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.352124 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/065f3e32-54af-4094-bdd9-2aa60ae8cb83-host-run-multus-certs\") pod \"multus-kf8mm\" (UID: \"065f3e32-54af-4094-bdd9-2aa60ae8cb83\") " pod="openshift-multus/multus-kf8mm" Jun 02 07:29:34.353096 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.352152 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/63f72893-abb3-493b-a512-9e9bd17b76a4-iptables-alerter-script\") pod \"iptables-alerter-nng4s\" (UID: \"63f72893-abb3-493b-a512-9e9bd17b76a4\") " pod="openshift-network-operator/iptables-alerter-nng4s" Jun 02 07:29:34.353096 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.352177 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f3415efe-20d6-430a-8501-c8c2d2709d7e-run-ovn\") pod \"ovnkube-node-tjvw4\" (UID: \"f3415efe-20d6-430a-8501-c8c2d2709d7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" Jun 02 07:29:34.353096 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.352197 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/32c32725-d170-41c3-82f8-78900f6220c2-etc-systemd\") pod \"tuned-67gkk\" (UID: \"32c32725-d170-41c3-82f8-78900f6220c2\") " pod="openshift-cluster-node-tuning-operator/tuned-67gkk" Jun 02 07:29:34.353096 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.352203 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f3415efe-20d6-430a-8501-c8c2d2709d7e-host-run-ovn-kubernetes\") pod \"ovnkube-node-tjvw4\" (UID: \"f3415efe-20d6-430a-8501-c8c2d2709d7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" Jun 02 07:29:34.353096 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.352153 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8479fba7-d0c6-4c26-82cd-44cff52ef948-serviceca\") pod \"node-ca-9bbts\" (UID: \"8479fba7-d0c6-4c26-82cd-44cff52ef948\") " pod="openshift-image-registry/node-ca-9bbts" Jun 02 07:29:34.353096 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.352243 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/32c32725-d170-41c3-82f8-78900f6220c2-etc-sysctl-d\") pod \"tuned-67gkk\" (UID: \"32c32725-d170-41c3-82f8-78900f6220c2\") " pod="openshift-cluster-node-tuning-operator/tuned-67gkk" Jun 02 07:29:34.353096 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.352245 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a731c005-ed09-4135-9776-d885682e8200-hosts-file\") pod \"node-resolver-2krhv\" (UID: \"a731c005-ed09-4135-9776-d885682e8200\") " pod="openshift-dns/node-resolver-2krhv" Jun 02 07:29:34.353096 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.352280 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/065f3e32-54af-4094-bdd9-2aa60ae8cb83-multus-socket-dir-parent\") pod \"multus-kf8mm\" (UID: \"065f3e32-54af-4094-bdd9-2aa60ae8cb83\") " pod="openshift-multus/multus-kf8mm" Jun 02 07:29:34.353816 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.352312 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a28eec73-4627-4d20-925e-23fb8e998a96-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8nv4p\" (UID: \"a28eec73-4627-4d20-925e-23fb8e998a96\") " pod="openshift-multus/multus-additional-cni-plugins-8nv4p" Jun 02 07:29:34.353816 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.352329 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/065f3e32-54af-4094-bdd9-2aa60ae8cb83-multus-daemon-config\") pod \"multus-kf8mm\" (UID: \"065f3e32-54af-4094-bdd9-2aa60ae8cb83\") " pod="openshift-multus/multus-kf8mm" Jun 02 07:29:34.353816 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.352413 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pnmdv\" (UniqueName: \"kubernetes.io/projected/32c32725-d170-41c3-82f8-78900f6220c2-kube-api-access-pnmdv\") pod \"tuned-67gkk\" (UID: \"32c32725-d170-41c3-82f8-78900f6220c2\") " pod="openshift-cluster-node-tuning-operator/tuned-67gkk" Jun 02 07:29:34.353816 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.352440 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f3415efe-20d6-430a-8501-c8c2d2709d7e-log-socket\") pod \"ovnkube-node-tjvw4\" (UID: \"f3415efe-20d6-430a-8501-c8c2d2709d7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" Jun 02 07:29:34.353816 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.352479 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f3415efe-20d6-430a-8501-c8c2d2709d7e-ovn-node-metrics-cert\") pod \"ovnkube-node-tjvw4\" (UID: \"f3415efe-20d6-430a-8501-c8c2d2709d7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" Jun 02 07:29:34.353816 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.352502 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47l5s\" (UniqueName: \"kubernetes.io/projected/f3415efe-20d6-430a-8501-c8c2d2709d7e-kube-api-access-47l5s\") pod \"ovnkube-node-tjvw4\" (UID: \"f3415efe-20d6-430a-8501-c8c2d2709d7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" Jun 02 07:29:34.353816 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.352520 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/065f3e32-54af-4094-bdd9-2aa60ae8cb83-multus-conf-dir\") pod \"multus-kf8mm\" (UID: \"065f3e32-54af-4094-bdd9-2aa60ae8cb83\") " pod="openshift-multus/multus-kf8mm" Jun 02 07:29:34.353816 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.352537 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/32c32725-d170-41c3-82f8-78900f6220c2-var-lib-kubelet\") pod \"tuned-67gkk\" (UID: \"32c32725-d170-41c3-82f8-78900f6220c2\") " pod="openshift-cluster-node-tuning-operator/tuned-67gkk" Jun 02 07:29:34.353816 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.352554 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7048ef29-aba3-4c8b-b38a-b02c615a3ec7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j67fw\" (UID: \"7048ef29-aba3-4c8b-b38a-b02c615a3ec7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j67fw" Jun 02 07:29:34.353816 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.352579 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/065f3e32-54af-4094-bdd9-2aa60ae8cb83-host-var-lib-kubelet\") pod \"multus-kf8mm\" (UID: \"065f3e32-54af-4094-bdd9-2aa60ae8cb83\") " pod="openshift-multus/multus-kf8mm" Jun 02 07:29:34.353816 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.352615 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7hbb6\" (UniqueName: \"kubernetes.io/projected/7048ef29-aba3-4c8b-b38a-b02c615a3ec7-kube-api-access-7hbb6\") pod \"aws-ebs-csi-driver-node-j67fw\" (UID: \"7048ef29-aba3-4c8b-b38a-b02c615a3ec7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j67fw" Jun 02 07:29:34.353816 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.352624 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/32c32725-d170-41c3-82f8-78900f6220c2-var-lib-kubelet\") pod \"tuned-67gkk\" (UID: \"32c32725-d170-41c3-82f8-78900f6220c2\") " pod="openshift-cluster-node-tuning-operator/tuned-67gkk" Jun 02 07:29:34.353816 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.352642 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/32c32725-d170-41c3-82f8-78900f6220c2-etc-sysctl-conf\") pod \"tuned-67gkk\" (UID: \"32c32725-d170-41c3-82f8-78900f6220c2\") " pod="openshift-cluster-node-tuning-operator/tuned-67gkk" Jun 02 07:29:34.353816 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.352668 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a28eec73-4627-4d20-925e-23fb8e998a96-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8nv4p\" (UID: \"a28eec73-4627-4d20-925e-23fb8e998a96\") " pod="openshift-multus/multus-additional-cni-plugins-8nv4p" Jun 02 07:29:34.353816 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.352679 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7048ef29-aba3-4c8b-b38a-b02c615a3ec7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j67fw\" (UID: \"7048ef29-aba3-4c8b-b38a-b02c615a3ec7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j67fw" Jun 02 07:29:34.353816 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.352695 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fsbdt\" (UniqueName: \"kubernetes.io/projected/56bb33da-8c46-4433-8b45-f6fe098c4d25-kube-api-access-fsbdt\") pod \"network-metrics-daemon-rgk46\" (UID: \"56bb33da-8c46-4433-8b45-f6fe098c4d25\") " pod="openshift-multus/network-metrics-daemon-rgk46" Jun 02 07:29:34.353816 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.352719 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f3415efe-20d6-430a-8501-c8c2d2709d7e-env-overrides\") pod \"ovnkube-node-tjvw4\" (UID: \"f3415efe-20d6-430a-8501-c8c2d2709d7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" Jun 02 07:29:34.354354 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.352754 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/065f3e32-54af-4094-bdd9-2aa60ae8cb83-multus-cni-dir\") pod \"multus-kf8mm\" (UID: \"065f3e32-54af-4094-bdd9-2aa60ae8cb83\") " pod="openshift-multus/multus-kf8mm" Jun 02 07:29:34.354354 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.352777 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a28eec73-4627-4d20-925e-23fb8e998a96-system-cni-dir\") pod \"multus-additional-cni-plugins-8nv4p\" (UID: \"a28eec73-4627-4d20-925e-23fb8e998a96\") " pod="openshift-multus/multus-additional-cni-plugins-8nv4p" Jun 02 07:29:34.354354 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.352786 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/63f72893-abb3-493b-a512-9e9bd17b76a4-iptables-alerter-script\") pod \"iptables-alerter-nng4s\" (UID: \"63f72893-abb3-493b-a512-9e9bd17b76a4\") " pod="openshift-network-operator/iptables-alerter-nng4s" Jun 02 07:29:34.354354 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.352792 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/32c32725-d170-41c3-82f8-78900f6220c2-etc-sysctl-conf\") pod \"tuned-67gkk\" (UID: \"32c32725-d170-41c3-82f8-78900f6220c2\") " pod="openshift-cluster-node-tuning-operator/tuned-67gkk" Jun 02 07:29:34.354354 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.352822 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a28eec73-4627-4d20-925e-23fb8e998a96-system-cni-dir\") pod \"multus-additional-cni-plugins-8nv4p\" (UID: \"a28eec73-4627-4d20-925e-23fb8e998a96\") " pod="openshift-multus/multus-additional-cni-plugins-8nv4p" Jun 02 07:29:34.354354 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.352913 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a28eec73-4627-4d20-925e-23fb8e998a96-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8nv4p\" (UID: \"a28eec73-4627-4d20-925e-23fb8e998a96\") " pod="openshift-multus/multus-additional-cni-plugins-8nv4p" Jun 02 07:29:34.354354 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.352935 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a28eec73-4627-4d20-925e-23fb8e998a96-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8nv4p\" (UID: \"a28eec73-4627-4d20-925e-23fb8e998a96\") " pod="openshift-multus/multus-additional-cni-plugins-8nv4p" Jun 02 07:29:34.354354 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.352954 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56bb33da-8c46-4433-8b45-f6fe098c4d25-metrics-certs\") pod \"network-metrics-daemon-rgk46\" (UID: \"56bb33da-8c46-4433-8b45-f6fe098c4d25\") " pod="openshift-multus/network-metrics-daemon-rgk46" Jun 02 07:29:34.354354 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.352969 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8m79x\" (UniqueName: \"kubernetes.io/projected/f60cac34-93f5-4439-b197-17a7283b4599-kube-api-access-8m79x\") pod \"network-check-target-wp2df\" (UID: \"f60cac34-93f5-4439-b197-17a7283b4599\") " pod="openshift-network-diagnostics/network-check-target-wp2df" Jun 02 07:29:34.354354 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.352990 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wtbbk\" (UniqueName: \"kubernetes.io/projected/63f72893-abb3-493b-a512-9e9bd17b76a4-kube-api-access-wtbbk\") pod \"iptables-alerter-nng4s\" (UID: \"63f72893-abb3-493b-a512-9e9bd17b76a4\") " pod="openshift-network-operator/iptables-alerter-nng4s" Jun 02 07:29:34.354354 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.353016 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f3415efe-20d6-430a-8501-c8c2d2709d7e-systemd-units\") pod \"ovnkube-node-tjvw4\" (UID: \"f3415efe-20d6-430a-8501-c8c2d2709d7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" Jun 02 07:29:34.354354 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.353039 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/eee91b43-4311-42b2-aa7b-e1ad62724d7d-agent-certs\") pod \"konnectivity-agent-m8rd6\" (UID: \"eee91b43-4311-42b2-aa7b-e1ad62724d7d\") " pod="kube-system/konnectivity-agent-m8rd6" Jun 02 07:29:34.354354 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:34.353055 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 07:29:34.354354 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.353062 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f3415efe-20d6-430a-8501-c8c2d2709d7e-run-openvswitch\") pod \"ovnkube-node-tjvw4\" (UID: \"f3415efe-20d6-430a-8501-c8c2d2709d7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" Jun 02 07:29:34.354354 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.353087 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f3415efe-20d6-430a-8501-c8c2d2709d7e-host-cni-netd\") pod \"ovnkube-node-tjvw4\" (UID: \"f3415efe-20d6-430a-8501-c8c2d2709d7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" Jun 02 07:29:34.354354 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:34.353168 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56bb33da-8c46-4433-8b45-f6fe098c4d25-metrics-certs podName:56bb33da-8c46-4433-8b45-f6fe098c4d25 nodeName:}" failed. No retries permitted until 2026-06-02 07:29:34.853128006 +0000 UTC m=+3.117110068 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/56bb33da-8c46-4433-8b45-f6fe098c4d25-metrics-certs") pod "network-metrics-daemon-rgk46" (UID: "56bb33da-8c46-4433-8b45-f6fe098c4d25") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 07:29:34.354926 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.353487 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a28eec73-4627-4d20-925e-23fb8e998a96-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8nv4p\" (UID: \"a28eec73-4627-4d20-925e-23fb8e998a96\") " pod="openshift-multus/multus-additional-cni-plugins-8nv4p" Jun 02 07:29:34.355150 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.355134 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/32c32725-d170-41c3-82f8-78900f6220c2-etc-tuned\") pod \"tuned-67gkk\" (UID: \"32c32725-d170-41c3-82f8-78900f6220c2\") " pod="openshift-cluster-node-tuning-operator/tuned-67gkk" Jun 02 07:29:34.355258 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.355239 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32c32725-d170-41c3-82f8-78900f6220c2-tmp\") pod \"tuned-67gkk\" (UID: \"32c32725-d170-41c3-82f8-78900f6220c2\") " pod="openshift-cluster-node-tuning-operator/tuned-67gkk" Jun 02 07:29:34.361912 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:34.361889 2580 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 07:29:34.361912 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:34.361911 2580 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 07:29:34.362070 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:34.361923 2580 projected.go:194] Error preparing data for projected volume kube-api-access-8m79x for pod openshift-network-diagnostics/network-check-target-wp2df: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 07:29:34.362070 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:34.361992 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f60cac34-93f5-4439-b197-17a7283b4599-kube-api-access-8m79x podName:f60cac34-93f5-4439-b197-17a7283b4599 nodeName:}" failed. No retries permitted until 2026-06-02 07:29:34.861972708 +0000 UTC m=+3.125954769 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-8m79x" (UniqueName: "kubernetes.io/projected/f60cac34-93f5-4439-b197-17a7283b4599-kube-api-access-8m79x") pod "network-check-target-wp2df" (UID: "f60cac34-93f5-4439-b197-17a7283b4599") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 07:29:34.365401 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.365377 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bq76b\" (UniqueName: \"kubernetes.io/projected/a28eec73-4627-4d20-925e-23fb8e998a96-kube-api-access-bq76b\") pod \"multus-additional-cni-plugins-8nv4p\" (UID: \"a28eec73-4627-4d20-925e-23fb8e998a96\") " pod="openshift-multus/multus-additional-cni-plugins-8nv4p" Jun 02 07:29:34.365496 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.365469 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtbbk\" (UniqueName: \"kubernetes.io/projected/63f72893-abb3-493b-a512-9e9bd17b76a4-kube-api-access-wtbbk\") pod \"iptables-alerter-nng4s\" (UID: \"63f72893-abb3-493b-a512-9e9bd17b76a4\") " pod="openshift-network-operator/iptables-alerter-nng4s" Jun 02 07:29:34.369688 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.369670 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnmdv\" (UniqueName: \"kubernetes.io/projected/32c32725-d170-41c3-82f8-78900f6220c2-kube-api-access-pnmdv\") pod \"tuned-67gkk\" (UID: \"32c32725-d170-41c3-82f8-78900f6220c2\") " pod="openshift-cluster-node-tuning-operator/tuned-67gkk" Jun 02 07:29:34.370272 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.370256 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nbxm\" (UniqueName: \"kubernetes.io/projected/8479fba7-d0c6-4c26-82cd-44cff52ef948-kube-api-access-7nbxm\") pod \"node-ca-9bbts\" (UID: \"8479fba7-d0c6-4c26-82cd-44cff52ef948\") " pod="openshift-image-registry/node-ca-9bbts" Jun 02 07:29:34.374628 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.374608 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsbdt\" (UniqueName: \"kubernetes.io/projected/56bb33da-8c46-4433-8b45-f6fe098c4d25-kube-api-access-fsbdt\") pod \"network-metrics-daemon-rgk46\" (UID: \"56bb33da-8c46-4433-8b45-f6fe098c4d25\") " pod="openshift-multus/network-metrics-daemon-rgk46" Jun 02 07:29:34.374914 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.374895 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hbb6\" (UniqueName: \"kubernetes.io/projected/7048ef29-aba3-4c8b-b38a-b02c615a3ec7-kube-api-access-7hbb6\") pod \"aws-ebs-csi-driver-node-j67fw\" (UID: \"7048ef29-aba3-4c8b-b38a-b02c615a3ec7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j67fw" Jun 02 07:29:34.454305 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.454186 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f3415efe-20d6-430a-8501-c8c2d2709d7e-host-run-netns\") pod \"ovnkube-node-tjvw4\" (UID: \"f3415efe-20d6-430a-8501-c8c2d2709d7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" Jun 02 07:29:34.454305 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.454237 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/eee91b43-4311-42b2-aa7b-e1ad62724d7d-konnectivity-ca\") pod \"konnectivity-agent-m8rd6\" (UID: \"eee91b43-4311-42b2-aa7b-e1ad62724d7d\") " pod="kube-system/konnectivity-agent-m8rd6" Jun 02 07:29:34.454305 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.454266 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f3415efe-20d6-430a-8501-c8c2d2709d7e-run-systemd\") pod \"ovnkube-node-tjvw4\" (UID: \"f3415efe-20d6-430a-8501-c8c2d2709d7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" Jun 02 07:29:34.454305 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.454291 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f3415efe-20d6-430a-8501-c8c2d2709d7e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tjvw4\" (UID: \"f3415efe-20d6-430a-8501-c8c2d2709d7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" Jun 02 07:29:34.454305 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.454309 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l2gv5\" (UniqueName: \"kubernetes.io/projected/a731c005-ed09-4135-9776-d885682e8200-kube-api-access-l2gv5\") pod \"node-resolver-2krhv\" (UID: \"a731c005-ed09-4135-9776-d885682e8200\") " pod="openshift-dns/node-resolver-2krhv" Jun 02 07:29:34.454621 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.454319 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f3415efe-20d6-430a-8501-c8c2d2709d7e-host-run-netns\") pod \"ovnkube-node-tjvw4\" (UID: \"f3415efe-20d6-430a-8501-c8c2d2709d7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" Jun 02 07:29:34.454621 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.454332 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/065f3e32-54af-4094-bdd9-2aa60ae8cb83-host-run-k8s-cni-cncf-io\") pod \"multus-kf8mm\" (UID: \"065f3e32-54af-4094-bdd9-2aa60ae8cb83\") " pod="openshift-multus/multus-kf8mm" Jun 02 07:29:34.454621 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.454377 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f3415efe-20d6-430a-8501-c8c2d2709d7e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tjvw4\" (UID: \"f3415efe-20d6-430a-8501-c8c2d2709d7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" Jun 02 07:29:34.454621 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.454393 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/065f3e32-54af-4094-bdd9-2aa60ae8cb83-host-run-k8s-cni-cncf-io\") pod \"multus-kf8mm\" (UID: \"065f3e32-54af-4094-bdd9-2aa60ae8cb83\") " pod="openshift-multus/multus-kf8mm" Jun 02 07:29:34.454621 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.454410 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f3415efe-20d6-430a-8501-c8c2d2709d7e-ovnkube-script-lib\") pod \"ovnkube-node-tjvw4\" (UID: \"f3415efe-20d6-430a-8501-c8c2d2709d7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" Jun 02 07:29:34.454621 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.454422 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f3415efe-20d6-430a-8501-c8c2d2709d7e-run-systemd\") pod \"ovnkube-node-tjvw4\" (UID: \"f3415efe-20d6-430a-8501-c8c2d2709d7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" Jun 02 07:29:34.454621 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.454438 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a731c005-ed09-4135-9776-d885682e8200-tmp-dir\") pod \"node-resolver-2krhv\" (UID: \"a731c005-ed09-4135-9776-d885682e8200\") " pod="openshift-dns/node-resolver-2krhv" Jun 02 07:29:34.454621 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.454466 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/065f3e32-54af-4094-bdd9-2aa60ae8cb83-host-run-netns\") pod \"multus-kf8mm\" (UID: \"065f3e32-54af-4094-bdd9-2aa60ae8cb83\") " pod="openshift-multus/multus-kf8mm" Jun 02 07:29:34.454621 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.454491 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/065f3e32-54af-4094-bdd9-2aa60ae8cb83-host-var-lib-cni-multus\") pod \"multus-kf8mm\" (UID: \"065f3e32-54af-4094-bdd9-2aa60ae8cb83\") " pod="openshift-multus/multus-kf8mm" Jun 02 07:29:34.454621 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.454514 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2w2v5\" (UniqueName: \"kubernetes.io/projected/065f3e32-54af-4094-bdd9-2aa60ae8cb83-kube-api-access-2w2v5\") pod \"multus-kf8mm\" (UID: \"065f3e32-54af-4094-bdd9-2aa60ae8cb83\") " pod="openshift-multus/multus-kf8mm" Jun 02 07:29:34.454621 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.454539 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3415efe-20d6-430a-8501-c8c2d2709d7e-host-kubelet\") pod \"ovnkube-node-tjvw4\" (UID: \"f3415efe-20d6-430a-8501-c8c2d2709d7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" Jun 02 07:29:34.454621 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.454563 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/065f3e32-54af-4094-bdd9-2aa60ae8cb83-os-release\") pod \"multus-kf8mm\" (UID: \"065f3e32-54af-4094-bdd9-2aa60ae8cb83\") " pod="openshift-multus/multus-kf8mm" Jun 02 07:29:34.454621 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.454586 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f3415efe-20d6-430a-8501-c8c2d2709d7e-host-slash\") pod \"ovnkube-node-tjvw4\" (UID: \"f3415efe-20d6-430a-8501-c8c2d2709d7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" Jun 02 07:29:34.454621 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.454594 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/065f3e32-54af-4094-bdd9-2aa60ae8cb83-host-var-lib-cni-multus\") pod \"multus-kf8mm\" (UID: \"065f3e32-54af-4094-bdd9-2aa60ae8cb83\") " pod="openshift-multus/multus-kf8mm" Jun 02 07:29:34.454621 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.454608 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f3415efe-20d6-430a-8501-c8c2d2709d7e-var-lib-openvswitch\") pod \"ovnkube-node-tjvw4\" (UID: \"f3415efe-20d6-430a-8501-c8c2d2709d7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" Jun 02 07:29:34.455251 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.454647 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f3415efe-20d6-430a-8501-c8c2d2709d7e-var-lib-openvswitch\") pod \"ovnkube-node-tjvw4\" (UID: \"f3415efe-20d6-430a-8501-c8c2d2709d7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" Jun 02 07:29:34.455251 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.454656 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/065f3e32-54af-4094-bdd9-2aa60ae8cb83-cnibin\") pod \"multus-kf8mm\" (UID: \"065f3e32-54af-4094-bdd9-2aa60ae8cb83\") " pod="openshift-multus/multus-kf8mm" Jun 02 07:29:34.455251 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.454686 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/065f3e32-54af-4094-bdd9-2aa60ae8cb83-cni-binary-copy\") pod \"multus-kf8mm\" (UID: \"065f3e32-54af-4094-bdd9-2aa60ae8cb83\") " pod="openshift-multus/multus-kf8mm" Jun 02 07:29:34.455251 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.454696 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/065f3e32-54af-4094-bdd9-2aa60ae8cb83-host-run-netns\") pod \"multus-kf8mm\" (UID: \"065f3e32-54af-4094-bdd9-2aa60ae8cb83\") " pod="openshift-multus/multus-kf8mm" Jun 02 07:29:34.455251 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.454715 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/065f3e32-54af-4094-bdd9-2aa60ae8cb83-hostroot\") pod \"multus-kf8mm\" (UID: \"065f3e32-54af-4094-bdd9-2aa60ae8cb83\") " pod="openshift-multus/multus-kf8mm" Jun 02 07:29:34.455251 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.454720 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/065f3e32-54af-4094-bdd9-2aa60ae8cb83-os-release\") pod \"multus-kf8mm\" (UID: \"065f3e32-54af-4094-bdd9-2aa60ae8cb83\") " pod="openshift-multus/multus-kf8mm" Jun 02 07:29:34.455251 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.454735 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f3415efe-20d6-430a-8501-c8c2d2709d7e-host-slash\") pod \"ovnkube-node-tjvw4\" (UID: \"f3415efe-20d6-430a-8501-c8c2d2709d7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" Jun 02 07:29:34.455251 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.454735 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3415efe-20d6-430a-8501-c8c2d2709d7e-host-kubelet\") pod \"ovnkube-node-tjvw4\" (UID: \"f3415efe-20d6-430a-8501-c8c2d2709d7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" Jun 02 07:29:34.455251 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.454749 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/065f3e32-54af-4094-bdd9-2aa60ae8cb83-host-run-multus-certs\") pod \"multus-kf8mm\" (UID: \"065f3e32-54af-4094-bdd9-2aa60ae8cb83\") " pod="openshift-multus/multus-kf8mm" Jun 02 07:29:34.455251 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.454778 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/065f3e32-54af-4094-bdd9-2aa60ae8cb83-hostroot\") pod \"multus-kf8mm\" (UID: \"065f3e32-54af-4094-bdd9-2aa60ae8cb83\") " pod="openshift-multus/multus-kf8mm" Jun 02 07:29:34.455251 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.454791 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a731c005-ed09-4135-9776-d885682e8200-tmp-dir\") pod \"node-resolver-2krhv\" (UID: \"a731c005-ed09-4135-9776-d885682e8200\") " pod="openshift-dns/node-resolver-2krhv" Jun 02 07:29:34.455251 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.455188 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f3415efe-20d6-430a-8501-c8c2d2709d7e-run-ovn\") pod \"ovnkube-node-tjvw4\" (UID: \"f3415efe-20d6-430a-8501-c8c2d2709d7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" Jun 02 07:29:34.455575 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.455296 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f3415efe-20d6-430a-8501-c8c2d2709d7e-host-run-ovn-kubernetes\") pod \"ovnkube-node-tjvw4\" (UID: \"f3415efe-20d6-430a-8501-c8c2d2709d7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" Jun 02 07:29:34.455575 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.455323 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a731c005-ed09-4135-9776-d885682e8200-hosts-file\") pod \"node-resolver-2krhv\" (UID: \"a731c005-ed09-4135-9776-d885682e8200\") " pod="openshift-dns/node-resolver-2krhv" Jun 02 07:29:34.455575 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.455366 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/065f3e32-54af-4094-bdd9-2aa60ae8cb83-multus-socket-dir-parent\") pod \"multus-kf8mm\" (UID: \"065f3e32-54af-4094-bdd9-2aa60ae8cb83\") " pod="openshift-multus/multus-kf8mm" Jun 02 07:29:34.455575 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.455404 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/065f3e32-54af-4094-bdd9-2aa60ae8cb83-multus-daemon-config\") pod \"multus-kf8mm\" (UID: \"065f3e32-54af-4094-bdd9-2aa60ae8cb83\") " pod="openshift-multus/multus-kf8mm" Jun 02 07:29:34.455575 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.455431 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f3415efe-20d6-430a-8501-c8c2d2709d7e-log-socket\") pod \"ovnkube-node-tjvw4\" (UID: \"f3415efe-20d6-430a-8501-c8c2d2709d7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" Jun 02 07:29:34.455713 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.455618 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/065f3e32-54af-4094-bdd9-2aa60ae8cb83-cni-binary-copy\") pod \"multus-kf8mm\" (UID: \"065f3e32-54af-4094-bdd9-2aa60ae8cb83\") " pod="openshift-multus/multus-kf8mm" Jun 02 07:29:34.455713 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.455687 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/eee91b43-4311-42b2-aa7b-e1ad62724d7d-konnectivity-ca\") pod \"konnectivity-agent-m8rd6\" (UID: \"eee91b43-4311-42b2-aa7b-e1ad62724d7d\") " pod="kube-system/konnectivity-agent-m8rd6" Jun 02 07:29:34.455923 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.455903 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/065f3e32-54af-4094-bdd9-2aa60ae8cb83-cnibin\") pod \"multus-kf8mm\" (UID: \"065f3e32-54af-4094-bdd9-2aa60ae8cb83\") " pod="openshift-multus/multus-kf8mm" Jun 02 07:29:34.456064 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.456048 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f3415efe-20d6-430a-8501-c8c2d2709d7e-ovnkube-script-lib\") pod \"ovnkube-node-tjvw4\" (UID: \"f3415efe-20d6-430a-8501-c8c2d2709d7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" Jun 02 07:29:34.457357 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.456263 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f3415efe-20d6-430a-8501-c8c2d2709d7e-host-run-ovn-kubernetes\") pod \"ovnkube-node-tjvw4\" (UID: \"f3415efe-20d6-430a-8501-c8c2d2709d7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" Jun 02 07:29:34.457357 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.456291 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a731c005-ed09-4135-9776-d885682e8200-hosts-file\") pod \"node-resolver-2krhv\" (UID: \"a731c005-ed09-4135-9776-d885682e8200\") " pod="openshift-dns/node-resolver-2krhv" Jun 02 07:29:34.457357 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.456351 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f3415efe-20d6-430a-8501-c8c2d2709d7e-run-ovn\") pod \"ovnkube-node-tjvw4\" (UID: \"f3415efe-20d6-430a-8501-c8c2d2709d7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" Jun 02 07:29:34.457357 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.456360 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f3415efe-20d6-430a-8501-c8c2d2709d7e-log-socket\") pod \"ovnkube-node-tjvw4\" (UID: \"f3415efe-20d6-430a-8501-c8c2d2709d7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" Jun 02 07:29:34.457357 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.456397 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/065f3e32-54af-4094-bdd9-2aa60ae8cb83-host-run-multus-certs\") pod \"multus-kf8mm\" (UID: \"065f3e32-54af-4094-bdd9-2aa60ae8cb83\") " pod="openshift-multus/multus-kf8mm" Jun 02 07:29:34.457357 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.455477 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f3415efe-20d6-430a-8501-c8c2d2709d7e-ovn-node-metrics-cert\") pod \"ovnkube-node-tjvw4\" (UID: \"f3415efe-20d6-430a-8501-c8c2d2709d7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" Jun 02 07:29:34.457357 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.456438 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-47l5s\" (UniqueName: \"kubernetes.io/projected/f3415efe-20d6-430a-8501-c8c2d2709d7e-kube-api-access-47l5s\") pod \"ovnkube-node-tjvw4\" (UID: \"f3415efe-20d6-430a-8501-c8c2d2709d7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" Jun 02 07:29:34.457357 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.456462 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/065f3e32-54af-4094-bdd9-2aa60ae8cb83-multus-conf-dir\") pod \"multus-kf8mm\" (UID: \"065f3e32-54af-4094-bdd9-2aa60ae8cb83\") " pod="openshift-multus/multus-kf8mm" Jun 02 07:29:34.457357 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.456510 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/065f3e32-54af-4094-bdd9-2aa60ae8cb83-host-var-lib-kubelet\") pod \"multus-kf8mm\" (UID: \"065f3e32-54af-4094-bdd9-2aa60ae8cb83\") " pod="openshift-multus/multus-kf8mm" Jun 02 07:29:34.457357 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.456533 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f3415efe-20d6-430a-8501-c8c2d2709d7e-env-overrides\") pod \"ovnkube-node-tjvw4\" (UID: \"f3415efe-20d6-430a-8501-c8c2d2709d7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" Jun 02 07:29:34.457357 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.456553 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/065f3e32-54af-4094-bdd9-2aa60ae8cb83-multus-cni-dir\") pod \"multus-kf8mm\" (UID: \"065f3e32-54af-4094-bdd9-2aa60ae8cb83\") " pod="openshift-multus/multus-kf8mm" Jun 02 07:29:34.457357 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.456630 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f3415efe-20d6-430a-8501-c8c2d2709d7e-systemd-units\") pod \"ovnkube-node-tjvw4\" (UID: \"f3415efe-20d6-430a-8501-c8c2d2709d7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" Jun 02 07:29:34.457357 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.456652 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/eee91b43-4311-42b2-aa7b-e1ad62724d7d-agent-certs\") pod \"konnectivity-agent-m8rd6\" (UID: \"eee91b43-4311-42b2-aa7b-e1ad62724d7d\") " pod="kube-system/konnectivity-agent-m8rd6" Jun 02 07:29:34.457357 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.456659 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/065f3e32-54af-4094-bdd9-2aa60ae8cb83-multus-daemon-config\") pod \"multus-kf8mm\" (UID: \"065f3e32-54af-4094-bdd9-2aa60ae8cb83\") " pod="openshift-multus/multus-kf8mm" Jun 02 07:29:34.457357 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.456672 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f3415efe-20d6-430a-8501-c8c2d2709d7e-run-openvswitch\") pod \"ovnkube-node-tjvw4\" (UID: \"f3415efe-20d6-430a-8501-c8c2d2709d7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" Jun 02 07:29:34.457357 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.456705 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f3415efe-20d6-430a-8501-c8c2d2709d7e-run-openvswitch\") pod \"ovnkube-node-tjvw4\" (UID: \"f3415efe-20d6-430a-8501-c8c2d2709d7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" Jun 02 07:29:34.457357 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.456712 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f3415efe-20d6-430a-8501-c8c2d2709d7e-host-cni-netd\") pod \"ovnkube-node-tjvw4\" (UID: \"f3415efe-20d6-430a-8501-c8c2d2709d7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" Jun 02 07:29:34.457357 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.456753 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f3415efe-20d6-430a-8501-c8c2d2709d7e-host-cni-bin\") pod \"ovnkube-node-tjvw4\" (UID: \"f3415efe-20d6-430a-8501-c8c2d2709d7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" Jun 02 07:29:34.457937 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.456784 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/065f3e32-54af-4094-bdd9-2aa60ae8cb83-etc-kubernetes\") pod \"multus-kf8mm\" (UID: \"065f3e32-54af-4094-bdd9-2aa60ae8cb83\") " pod="openshift-multus/multus-kf8mm" Jun 02 07:29:34.457937 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.456828 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f3415efe-20d6-430a-8501-c8c2d2709d7e-ovnkube-config\") pod \"ovnkube-node-tjvw4\" (UID: \"f3415efe-20d6-430a-8501-c8c2d2709d7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" Jun 02 07:29:34.457937 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.456832 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/065f3e32-54af-4094-bdd9-2aa60ae8cb83-host-var-lib-kubelet\") pod \"multus-kf8mm\" (UID: \"065f3e32-54af-4094-bdd9-2aa60ae8cb83\") " pod="openshift-multus/multus-kf8mm" Jun 02 07:29:34.457937 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.456865 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f3415efe-20d6-430a-8501-c8c2d2709d7e-etc-openvswitch\") pod \"ovnkube-node-tjvw4\" (UID: \"f3415efe-20d6-430a-8501-c8c2d2709d7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" Jun 02 07:29:34.457937 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.456898 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f3415efe-20d6-430a-8501-c8c2d2709d7e-node-log\") pod \"ovnkube-node-tjvw4\" (UID: \"f3415efe-20d6-430a-8501-c8c2d2709d7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" Jun 02 07:29:34.457937 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.456925 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/065f3e32-54af-4094-bdd9-2aa60ae8cb83-system-cni-dir\") pod \"multus-kf8mm\" (UID: \"065f3e32-54af-4094-bdd9-2aa60ae8cb83\") " pod="openshift-multus/multus-kf8mm" Jun 02 07:29:34.457937 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.456956 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/065f3e32-54af-4094-bdd9-2aa60ae8cb83-host-var-lib-cni-bin\") pod \"multus-kf8mm\" (UID: \"065f3e32-54af-4094-bdd9-2aa60ae8cb83\") " pod="openshift-multus/multus-kf8mm" Jun 02 07:29:34.457937 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.456984 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f3415efe-20d6-430a-8501-c8c2d2709d7e-env-overrides\") pod \"ovnkube-node-tjvw4\" (UID: \"f3415efe-20d6-430a-8501-c8c2d2709d7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" Jun 02 07:29:34.457937 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.457038 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/065f3e32-54af-4094-bdd9-2aa60ae8cb83-multus-cni-dir\") pod \"multus-kf8mm\" (UID: \"065f3e32-54af-4094-bdd9-2aa60ae8cb83\") " pod="openshift-multus/multus-kf8mm" Jun 02 07:29:34.457937 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.457043 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/065f3e32-54af-4094-bdd9-2aa60ae8cb83-host-var-lib-cni-bin\") pod \"multus-kf8mm\" (UID: \"065f3e32-54af-4094-bdd9-2aa60ae8cb83\") " pod="openshift-multus/multus-kf8mm" Jun 02 07:29:34.457937 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.457081 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/065f3e32-54af-4094-bdd9-2aa60ae8cb83-multus-conf-dir\") pod \"multus-kf8mm\" (UID: \"065f3e32-54af-4094-bdd9-2aa60ae8cb83\") " pod="openshift-multus/multus-kf8mm" Jun 02 07:29:34.457937 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.457131 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f3415efe-20d6-430a-8501-c8c2d2709d7e-systemd-units\") pod \"ovnkube-node-tjvw4\" (UID: \"f3415efe-20d6-430a-8501-c8c2d2709d7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" Jun 02 07:29:34.457937 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.457172 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f3415efe-20d6-430a-8501-c8c2d2709d7e-host-cni-netd\") pod \"ovnkube-node-tjvw4\" (UID: \"f3415efe-20d6-430a-8501-c8c2d2709d7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" Jun 02 07:29:34.457937 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.457239 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f3415efe-20d6-430a-8501-c8c2d2709d7e-host-cni-bin\") pod \"ovnkube-node-tjvw4\" (UID: \"f3415efe-20d6-430a-8501-c8c2d2709d7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" Jun 02 07:29:34.457937 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.457274 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f3415efe-20d6-430a-8501-c8c2d2709d7e-etc-openvswitch\") pod \"ovnkube-node-tjvw4\" (UID: \"f3415efe-20d6-430a-8501-c8c2d2709d7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" Jun 02 07:29:34.457937 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.457287 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f3415efe-20d6-430a-8501-c8c2d2709d7e-node-log\") pod \"ovnkube-node-tjvw4\" (UID: \"f3415efe-20d6-430a-8501-c8c2d2709d7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" Jun 02 07:29:34.457937 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.457339 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/065f3e32-54af-4094-bdd9-2aa60ae8cb83-etc-kubernetes\") pod \"multus-kf8mm\" (UID: \"065f3e32-54af-4094-bdd9-2aa60ae8cb83\") " pod="openshift-multus/multus-kf8mm" Jun 02 07:29:34.457937 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.457343 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/065f3e32-54af-4094-bdd9-2aa60ae8cb83-system-cni-dir\") pod \"multus-kf8mm\" (UID: \"065f3e32-54af-4094-bdd9-2aa60ae8cb83\") " pod="openshift-multus/multus-kf8mm" Jun 02 07:29:34.458550 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.457448 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/065f3e32-54af-4094-bdd9-2aa60ae8cb83-multus-socket-dir-parent\") pod \"multus-kf8mm\" (UID: \"065f3e32-54af-4094-bdd9-2aa60ae8cb83\") " pod="openshift-multus/multus-kf8mm" Jun 02 07:29:34.458550 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.457772 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f3415efe-20d6-430a-8501-c8c2d2709d7e-ovnkube-config\") pod \"ovnkube-node-tjvw4\" (UID: \"f3415efe-20d6-430a-8501-c8c2d2709d7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" Jun 02 07:29:34.458697 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.458679 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f3415efe-20d6-430a-8501-c8c2d2709d7e-ovn-node-metrics-cert\") pod \"ovnkube-node-tjvw4\" (UID: \"f3415efe-20d6-430a-8501-c8c2d2709d7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" Jun 02 07:29:34.459648 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.459610 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/eee91b43-4311-42b2-aa7b-e1ad62724d7d-agent-certs\") pod \"konnectivity-agent-m8rd6\" (UID: \"eee91b43-4311-42b2-aa7b-e1ad62724d7d\") " pod="kube-system/konnectivity-agent-m8rd6" Jun 02 07:29:34.462779 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.462752 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2gv5\" (UniqueName: \"kubernetes.io/projected/a731c005-ed09-4135-9776-d885682e8200-kube-api-access-l2gv5\") pod \"node-resolver-2krhv\" (UID: \"a731c005-ed09-4135-9776-d885682e8200\") " pod="openshift-dns/node-resolver-2krhv" Jun 02 07:29:34.463020 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.462998 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2w2v5\" (UniqueName: \"kubernetes.io/projected/065f3e32-54af-4094-bdd9-2aa60ae8cb83-kube-api-access-2w2v5\") pod \"multus-kf8mm\" (UID: \"065f3e32-54af-4094-bdd9-2aa60ae8cb83\") " pod="openshift-multus/multus-kf8mm" Jun 02 07:29:34.467334 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.467313 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-47l5s\" (UniqueName: \"kubernetes.io/projected/f3415efe-20d6-430a-8501-c8c2d2709d7e-kube-api-access-47l5s\") pod \"ovnkube-node-tjvw4\" (UID: \"f3415efe-20d6-430a-8501-c8c2d2709d7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" Jun 02 07:29:34.542419 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.542389 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-67gkk" Jun 02 07:29:34.550141 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.550114 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j67fw" Jun 02 07:29:34.557770 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.557744 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8nv4p" Jun 02 07:29:34.564826 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.564806 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9bbts" Jun 02 07:29:34.572355 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.572338 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nng4s" Jun 02 07:29:34.578897 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.578879 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-m8rd6" Jun 02 07:29:34.586443 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.586424 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2krhv" Jun 02 07:29:34.593950 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.593934 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kf8mm" Jun 02 07:29:34.598502 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.598484 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" Jun 02 07:29:34.859611 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.859526 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56bb33da-8c46-4433-8b45-f6fe098c4d25-metrics-certs\") pod \"network-metrics-daemon-rgk46\" (UID: \"56bb33da-8c46-4433-8b45-f6fe098c4d25\") " pod="openshift-multus/network-metrics-daemon-rgk46" Jun 02 07:29:34.859758 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:34.859687 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 07:29:34.859866 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:34.859771 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56bb33da-8c46-4433-8b45-f6fe098c4d25-metrics-certs podName:56bb33da-8c46-4433-8b45-f6fe098c4d25 nodeName:}" failed. No retries permitted until 2026-06-02 07:29:35.859750332 +0000 UTC m=+4.123732394 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/56bb33da-8c46-4433-8b45-f6fe098c4d25-metrics-certs") pod "network-metrics-daemon-rgk46" (UID: "56bb33da-8c46-4433-8b45-f6fe098c4d25") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 07:29:34.876552 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:34.876525 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod065f3e32_54af_4094_bdd9_2aa60ae8cb83.slice/crio-9dc6201f10955fc9d35238fa79ef4337c9550603b721be1b13995c1f76ca8292 WatchSource:0}: Error finding container 9dc6201f10955fc9d35238fa79ef4337c9550603b721be1b13995c1f76ca8292: Status 404 returned error can't find the container with id 9dc6201f10955fc9d35238fa79ef4337c9550603b721be1b13995c1f76ca8292 Jun 02 07:29:34.878032 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:34.877975 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8479fba7_d0c6_4c26_82cd_44cff52ef948.slice/crio-a6a2ef4b329eee9b99ccb007bf045b4f06dea4483a7900f0c8667049427e9ec5 WatchSource:0}: Error finding container a6a2ef4b329eee9b99ccb007bf045b4f06dea4483a7900f0c8667049427e9ec5: Status 404 returned error can't find the container with id a6a2ef4b329eee9b99ccb007bf045b4f06dea4483a7900f0c8667049427e9ec5 Jun 02 07:29:34.878892 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:34.878825 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda731c005_ed09_4135_9776_d885682e8200.slice/crio-4db6ce5bb1175ed82a38068d0f6437f08c830cb5254b490ba1bdb58fd318ed1e WatchSource:0}: Error finding container 4db6ce5bb1175ed82a38068d0f6437f08c830cb5254b490ba1bdb58fd318ed1e: Status 404 returned error can't find the container with id 4db6ce5bb1175ed82a38068d0f6437f08c830cb5254b490ba1bdb58fd318ed1e Jun 02 07:29:34.879352 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:34.879284 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63f72893_abb3_493b_a512_9e9bd17b76a4.slice/crio-75a12e5e11844e6b47164116528d164e6d5eac2fd90fafbda56ccb0d056fa15c WatchSource:0}: Error finding container 75a12e5e11844e6b47164116528d164e6d5eac2fd90fafbda56ccb0d056fa15c: Status 404 returned error can't find the container with id 75a12e5e11844e6b47164116528d164e6d5eac2fd90fafbda56ccb0d056fa15c Jun 02 07:29:34.880370 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:34.880341 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeee91b43_4311_42b2_aa7b_e1ad62724d7d.slice/crio-665f6f8f444f4b827ef45aca5d5d096470dfbb1315ac4930831d2a563b2959fa WatchSource:0}: Error finding container 665f6f8f444f4b827ef45aca5d5d096470dfbb1315ac4930831d2a563b2959fa: Status 404 returned error can't find the container with id 665f6f8f444f4b827ef45aca5d5d096470dfbb1315ac4930831d2a563b2959fa Jun 02 07:29:34.882920 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:34.881984 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda28eec73_4627_4d20_925e_23fb8e998a96.slice/crio-3cde651d980adb2e09dfc3ed1236683817a982b06218e2ddef725a9534c200c5 WatchSource:0}: Error finding container 3cde651d980adb2e09dfc3ed1236683817a982b06218e2ddef725a9534c200c5: Status 404 returned error can't find the container with id 3cde651d980adb2e09dfc3ed1236683817a982b06218e2ddef725a9534c200c5 Jun 02 07:29:34.884050 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:34.884029 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3415efe_20d6_430a_8501_c8c2d2709d7e.slice/crio-d0660dc9cdf31cd88495ba1afd8beb64cc5deac49e5f164652443d1f06d51740 WatchSource:0}: Error finding container d0660dc9cdf31cd88495ba1afd8beb64cc5deac49e5f164652443d1f06d51740: Status 404 returned error can't find the container with id d0660dc9cdf31cd88495ba1afd8beb64cc5deac49e5f164652443d1f06d51740 Jun 02 07:29:34.885101 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:34.884982 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32c32725_d170_41c3_82f8_78900f6220c2.slice/crio-d1729d29da2188ec0eae37b7aec159ac255cef9ad5d413a1b9add6dfffaad889 WatchSource:0}: Error finding container d1729d29da2188ec0eae37b7aec159ac255cef9ad5d413a1b9add6dfffaad889: Status 404 returned error can't find the container with id d1729d29da2188ec0eae37b7aec159ac255cef9ad5d413a1b9add6dfffaad889 Jun 02 07:29:34.887450 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:29:34.887428 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7048ef29_aba3_4c8b_b38a_b02c615a3ec7.slice/crio-8de494d154bafcc188f4fc30491b10a2e733b71053e7d32cec5fd87a359ce7bf WatchSource:0}: Error finding container 8de494d154bafcc188f4fc30491b10a2e733b71053e7d32cec5fd87a359ce7bf: Status 404 returned error can't find the container with id 8de494d154bafcc188f4fc30491b10a2e733b71053e7d32cec5fd87a359ce7bf Jun 02 07:29:34.960397 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:34.960187 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8m79x\" (UniqueName: \"kubernetes.io/projected/f60cac34-93f5-4439-b197-17a7283b4599-kube-api-access-8m79x\") pod \"network-check-target-wp2df\" (UID: \"f60cac34-93f5-4439-b197-17a7283b4599\") " pod="openshift-network-diagnostics/network-check-target-wp2df" Jun 02 07:29:34.960494 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:34.960333 2580 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 07:29:34.960494 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:34.960449 2580 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 07:29:34.960494 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:34.960463 2580 projected.go:194] Error preparing data for projected volume kube-api-access-8m79x for pod openshift-network-diagnostics/network-check-target-wp2df: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 07:29:34.960612 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:34.960511 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f60cac34-93f5-4439-b197-17a7283b4599-kube-api-access-8m79x podName:f60cac34-93f5-4439-b197-17a7283b4599 nodeName:}" failed. No retries permitted until 2026-06-02 07:29:35.960495884 +0000 UTC m=+4.224477933 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-8m79x" (UniqueName: "kubernetes.io/projected/f60cac34-93f5-4439-b197-17a7283b4599-kube-api-access-8m79x") pod "network-check-target-wp2df" (UID: "f60cac34-93f5-4439-b197-17a7283b4599") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 07:29:35.275691 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:35.275649 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 07:24:33 +0000 UTC" deadline="2028-02-10 14:12:59.942615996 +0000 UTC" Jun 02 07:29:35.275691 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:35.275689 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14838h43m24.666930634s" Jun 02 07:29:35.375724 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:35.375116 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wp2df" Jun 02 07:29:35.375724 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:35.375122 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rgk46" Jun 02 07:29:35.375724 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:35.375322 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wp2df" podUID="f60cac34-93f5-4439-b197-17a7283b4599" Jun 02 07:29:35.375724 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:35.375340 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rgk46" podUID="56bb33da-8c46-4433-8b45-f6fe098c4d25" Jun 02 07:29:35.394248 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:35.394148 2580 generic.go:358] "Generic (PLEG): container finished" podID="7fa10af19a20d160fb343b8315376b17" containerID="9eaacca6ee4c4258dd1a738f325fc8d345d4cdc341290e1e92060f80d05d1e15" exitCode=0 Jun 02 07:29:35.394493 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:35.394439 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-245.ec2.internal" event={"ID":"7fa10af19a20d160fb343b8315376b17","Type":"ContainerDied","Data":"9eaacca6ee4c4258dd1a738f325fc8d345d4cdc341290e1e92060f80d05d1e15"} Jun 02 07:29:35.398456 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:35.398354 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" event={"ID":"f3415efe-20d6-430a-8501-c8c2d2709d7e","Type":"ContainerStarted","Data":"d0660dc9cdf31cd88495ba1afd8beb64cc5deac49e5f164652443d1f06d51740"} Jun 02 07:29:35.427849 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:35.427803 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8nv4p" event={"ID":"a28eec73-4627-4d20-925e-23fb8e998a96","Type":"ContainerStarted","Data":"3cde651d980adb2e09dfc3ed1236683817a982b06218e2ddef725a9534c200c5"} Jun 02 07:29:35.431077 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:35.431046 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nng4s" event={"ID":"63f72893-abb3-493b-a512-9e9bd17b76a4","Type":"ContainerStarted","Data":"75a12e5e11844e6b47164116528d164e6d5eac2fd90fafbda56ccb0d056fa15c"} Jun 02 07:29:35.460621 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:35.460569 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9bbts" event={"ID":"8479fba7-d0c6-4c26-82cd-44cff52ef948","Type":"ContainerStarted","Data":"a6a2ef4b329eee9b99ccb007bf045b4f06dea4483a7900f0c8667049427e9ec5"} Jun 02 07:29:35.482905 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:35.482845 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kf8mm" event={"ID":"065f3e32-54af-4094-bdd9-2aa60ae8cb83","Type":"ContainerStarted","Data":"9dc6201f10955fc9d35238fa79ef4337c9550603b721be1b13995c1f76ca8292"} Jun 02 07:29:35.512773 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:35.511992 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-245.ec2.internal" event={"ID":"80331574f62266c7e335acd657e0cebc","Type":"ContainerStarted","Data":"52dc073f4034bb2e528549477c2d19fde2e2996f2bf30a6b5b40821d27a53b42"} Jun 02 07:29:35.526812 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:35.526666 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j67fw" event={"ID":"7048ef29-aba3-4c8b-b38a-b02c615a3ec7","Type":"ContainerStarted","Data":"8de494d154bafcc188f4fc30491b10a2e733b71053e7d32cec5fd87a359ce7bf"} Jun 02 07:29:35.527236 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:35.527168 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-245.ec2.internal" podStartSLOduration=2.527153545 podStartE2EDuration="2.527153545s" podCreationTimestamp="2026-06-02 07:29:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 07:29:35.527099262 +0000 UTC m=+3.791081329" watchObservedRunningTime="2026-06-02 07:29:35.527153545 +0000 UTC m=+3.791135613" Jun 02 07:29:35.532142 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:35.532113 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-67gkk" event={"ID":"32c32725-d170-41c3-82f8-78900f6220c2","Type":"ContainerStarted","Data":"d1729d29da2188ec0eae37b7aec159ac255cef9ad5d413a1b9add6dfffaad889"} Jun 02 07:29:35.553129 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:35.553090 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2krhv" event={"ID":"a731c005-ed09-4135-9776-d885682e8200","Type":"ContainerStarted","Data":"4db6ce5bb1175ed82a38068d0f6437f08c830cb5254b490ba1bdb58fd318ed1e"} Jun 02 07:29:35.569100 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:35.569047 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-m8rd6" event={"ID":"eee91b43-4311-42b2-aa7b-e1ad62724d7d","Type":"ContainerStarted","Data":"665f6f8f444f4b827ef45aca5d5d096470dfbb1315ac4930831d2a563b2959fa"} Jun 02 07:29:35.868000 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:35.867960 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56bb33da-8c46-4433-8b45-f6fe098c4d25-metrics-certs\") pod \"network-metrics-daemon-rgk46\" (UID: \"56bb33da-8c46-4433-8b45-f6fe098c4d25\") " pod="openshift-multus/network-metrics-daemon-rgk46" Jun 02 07:29:35.868176 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:35.868114 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 07:29:35.868269 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:35.868177 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56bb33da-8c46-4433-8b45-f6fe098c4d25-metrics-certs podName:56bb33da-8c46-4433-8b45-f6fe098c4d25 nodeName:}" failed. No retries permitted until 2026-06-02 07:29:37.868159107 +0000 UTC m=+6.132141154 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/56bb33da-8c46-4433-8b45-f6fe098c4d25-metrics-certs") pod "network-metrics-daemon-rgk46" (UID: "56bb33da-8c46-4433-8b45-f6fe098c4d25") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 07:29:35.969415 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:35.969330 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8m79x\" (UniqueName: \"kubernetes.io/projected/f60cac34-93f5-4439-b197-17a7283b4599-kube-api-access-8m79x\") pod \"network-check-target-wp2df\" (UID: \"f60cac34-93f5-4439-b197-17a7283b4599\") " pod="openshift-network-diagnostics/network-check-target-wp2df" Jun 02 07:29:35.969575 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:35.969524 2580 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 07:29:35.969575 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:35.969544 2580 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 07:29:35.969575 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:35.969558 2580 projected.go:194] Error preparing data for projected volume kube-api-access-8m79x for pod openshift-network-diagnostics/network-check-target-wp2df: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 07:29:35.969727 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:35.969615 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f60cac34-93f5-4439-b197-17a7283b4599-kube-api-access-8m79x podName:f60cac34-93f5-4439-b197-17a7283b4599 nodeName:}" failed. No retries permitted until 2026-06-02 07:29:37.969597842 +0000 UTC m=+6.233579904 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-8m79x" (UniqueName: "kubernetes.io/projected/f60cac34-93f5-4439-b197-17a7283b4599-kube-api-access-8m79x") pod "network-check-target-wp2df" (UID: "f60cac34-93f5-4439-b197-17a7283b4599") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 07:29:36.591143 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:36.591025 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-245.ec2.internal" event={"ID":"7fa10af19a20d160fb343b8315376b17","Type":"ContainerStarted","Data":"7d02dcc54c54004e61e0c9e5ba38dca55a6b11ee1d0185fb49d5ca1ca1bfc16f"} Jun 02 07:29:37.375069 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:37.374991 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wp2df" Jun 02 07:29:37.375255 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:37.375127 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wp2df" podUID="f60cac34-93f5-4439-b197-17a7283b4599" Jun 02 07:29:37.375470 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:37.375318 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rgk46" Jun 02 07:29:37.375470 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:37.375413 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rgk46" podUID="56bb33da-8c46-4433-8b45-f6fe098c4d25" Jun 02 07:29:37.886868 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:37.886317 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56bb33da-8c46-4433-8b45-f6fe098c4d25-metrics-certs\") pod \"network-metrics-daemon-rgk46\" (UID: \"56bb33da-8c46-4433-8b45-f6fe098c4d25\") " pod="openshift-multus/network-metrics-daemon-rgk46" Jun 02 07:29:37.886868 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:37.886490 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 07:29:37.886868 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:37.886550 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56bb33da-8c46-4433-8b45-f6fe098c4d25-metrics-certs podName:56bb33da-8c46-4433-8b45-f6fe098c4d25 nodeName:}" failed. No retries permitted until 2026-06-02 07:29:41.886530746 +0000 UTC m=+10.150512805 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/56bb33da-8c46-4433-8b45-f6fe098c4d25-metrics-certs") pod "network-metrics-daemon-rgk46" (UID: "56bb33da-8c46-4433-8b45-f6fe098c4d25") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 07:29:37.987523 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:37.987487 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8m79x\" (UniqueName: \"kubernetes.io/projected/f60cac34-93f5-4439-b197-17a7283b4599-kube-api-access-8m79x\") pod \"network-check-target-wp2df\" (UID: \"f60cac34-93f5-4439-b197-17a7283b4599\") " pod="openshift-network-diagnostics/network-check-target-wp2df" Jun 02 07:29:37.987717 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:37.987676 2580 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 07:29:37.987717 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:37.987706 2580 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 07:29:37.987717 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:37.987720 2580 projected.go:194] Error preparing data for projected volume kube-api-access-8m79x for pod openshift-network-diagnostics/network-check-target-wp2df: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 07:29:37.987936 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:37.987787 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f60cac34-93f5-4439-b197-17a7283b4599-kube-api-access-8m79x podName:f60cac34-93f5-4439-b197-17a7283b4599 nodeName:}" failed. No retries permitted until 2026-06-02 07:29:41.987766038 +0000 UTC m=+10.251748105 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-8m79x" (UniqueName: "kubernetes.io/projected/f60cac34-93f5-4439-b197-17a7283b4599-kube-api-access-8m79x") pod "network-check-target-wp2df" (UID: "f60cac34-93f5-4439-b197-17a7283b4599") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 07:29:39.375377 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:39.375342 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wp2df" Jun 02 07:29:39.375831 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:39.375475 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wp2df" podUID="f60cac34-93f5-4439-b197-17a7283b4599" Jun 02 07:29:39.375831 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:39.375489 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rgk46" Jun 02 07:29:39.375831 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:39.375612 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rgk46" podUID="56bb33da-8c46-4433-8b45-f6fe098c4d25" Jun 02 07:29:39.779114 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:39.779005 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-245.ec2.internal" podStartSLOduration=6.778986869 podStartE2EDuration="6.778986869s" podCreationTimestamp="2026-06-02 07:29:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 07:29:36.60567287 +0000 UTC m=+4.869654938" watchObservedRunningTime="2026-06-02 07:29:39.778986869 +0000 UTC m=+8.042968938" Jun 02 07:29:39.779434 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:39.779414 2580 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-jh96t"] Jun 02 07:29:39.781644 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:39.781443 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jh96t" Jun 02 07:29:39.781644 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:39.781520 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jh96t" podUID="f3cc7d61-5de3-4982-9b2e-5dec00a1659d" Jun 02 07:29:39.905494 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:39.905459 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f3cc7d61-5de3-4982-9b2e-5dec00a1659d-original-pull-secret\") pod \"global-pull-secret-syncer-jh96t\" (UID: \"f3cc7d61-5de3-4982-9b2e-5dec00a1659d\") " pod="kube-system/global-pull-secret-syncer-jh96t" Jun 02 07:29:39.905680 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:39.905563 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f3cc7d61-5de3-4982-9b2e-5dec00a1659d-kubelet-config\") pod \"global-pull-secret-syncer-jh96t\" (UID: \"f3cc7d61-5de3-4982-9b2e-5dec00a1659d\") " pod="kube-system/global-pull-secret-syncer-jh96t" Jun 02 07:29:39.905680 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:39.905618 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f3cc7d61-5de3-4982-9b2e-5dec00a1659d-dbus\") pod \"global-pull-secret-syncer-jh96t\" (UID: \"f3cc7d61-5de3-4982-9b2e-5dec00a1659d\") " pod="kube-system/global-pull-secret-syncer-jh96t" Jun 02 07:29:40.006805 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:40.006766 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f3cc7d61-5de3-4982-9b2e-5dec00a1659d-kubelet-config\") pod \"global-pull-secret-syncer-jh96t\" (UID: \"f3cc7d61-5de3-4982-9b2e-5dec00a1659d\") " pod="kube-system/global-pull-secret-syncer-jh96t" Jun 02 07:29:40.006977 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:40.006842 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f3cc7d61-5de3-4982-9b2e-5dec00a1659d-dbus\") pod \"global-pull-secret-syncer-jh96t\" (UID: \"f3cc7d61-5de3-4982-9b2e-5dec00a1659d\") " pod="kube-system/global-pull-secret-syncer-jh96t" Jun 02 07:29:40.006977 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:40.006874 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f3cc7d61-5de3-4982-9b2e-5dec00a1659d-original-pull-secret\") pod \"global-pull-secret-syncer-jh96t\" (UID: \"f3cc7d61-5de3-4982-9b2e-5dec00a1659d\") " pod="kube-system/global-pull-secret-syncer-jh96t" Jun 02 07:29:40.007078 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:40.006979 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 07:29:40.007078 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:40.007030 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3cc7d61-5de3-4982-9b2e-5dec00a1659d-original-pull-secret podName:f3cc7d61-5de3-4982-9b2e-5dec00a1659d nodeName:}" failed. No retries permitted until 2026-06-02 07:29:40.507017198 +0000 UTC m=+8.770999242 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f3cc7d61-5de3-4982-9b2e-5dec00a1659d-original-pull-secret") pod "global-pull-secret-syncer-jh96t" (UID: "f3cc7d61-5de3-4982-9b2e-5dec00a1659d") : object "kube-system"/"original-pull-secret" not registered Jun 02 07:29:40.007627 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:40.007286 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f3cc7d61-5de3-4982-9b2e-5dec00a1659d-kubelet-config\") pod \"global-pull-secret-syncer-jh96t\" (UID: \"f3cc7d61-5de3-4982-9b2e-5dec00a1659d\") " pod="kube-system/global-pull-secret-syncer-jh96t" Jun 02 07:29:40.007627 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:40.007433 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f3cc7d61-5de3-4982-9b2e-5dec00a1659d-dbus\") pod \"global-pull-secret-syncer-jh96t\" (UID: \"f3cc7d61-5de3-4982-9b2e-5dec00a1659d\") " pod="kube-system/global-pull-secret-syncer-jh96t" Jun 02 07:29:40.511207 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:40.511171 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f3cc7d61-5de3-4982-9b2e-5dec00a1659d-original-pull-secret\") pod \"global-pull-secret-syncer-jh96t\" (UID: \"f3cc7d61-5de3-4982-9b2e-5dec00a1659d\") " pod="kube-system/global-pull-secret-syncer-jh96t" Jun 02 07:29:40.511642 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:40.511418 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 07:29:40.511642 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:40.511504 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3cc7d61-5de3-4982-9b2e-5dec00a1659d-original-pull-secret podName:f3cc7d61-5de3-4982-9b2e-5dec00a1659d nodeName:}" failed. No retries permitted until 2026-06-02 07:29:41.511483528 +0000 UTC m=+9.775465595 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f3cc7d61-5de3-4982-9b2e-5dec00a1659d-original-pull-secret") pod "global-pull-secret-syncer-jh96t" (UID: "f3cc7d61-5de3-4982-9b2e-5dec00a1659d") : object "kube-system"/"original-pull-secret" not registered Jun 02 07:29:41.374597 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:41.374561 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wp2df" Jun 02 07:29:41.374778 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:41.374690 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wp2df" podUID="f60cac34-93f5-4439-b197-17a7283b4599" Jun 02 07:29:41.375147 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:41.375124 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jh96t" Jun 02 07:29:41.375282 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:41.375238 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jh96t" podUID="f3cc7d61-5de3-4982-9b2e-5dec00a1659d" Jun 02 07:29:41.375359 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:41.375321 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rgk46" Jun 02 07:29:41.375431 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:41.375410 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rgk46" podUID="56bb33da-8c46-4433-8b45-f6fe098c4d25" Jun 02 07:29:41.521418 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:41.521373 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f3cc7d61-5de3-4982-9b2e-5dec00a1659d-original-pull-secret\") pod \"global-pull-secret-syncer-jh96t\" (UID: \"f3cc7d61-5de3-4982-9b2e-5dec00a1659d\") " pod="kube-system/global-pull-secret-syncer-jh96t" Jun 02 07:29:41.521913 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:41.521613 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 07:29:41.521913 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:41.521679 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3cc7d61-5de3-4982-9b2e-5dec00a1659d-original-pull-secret podName:f3cc7d61-5de3-4982-9b2e-5dec00a1659d nodeName:}" failed. No retries permitted until 2026-06-02 07:29:43.521660802 +0000 UTC m=+11.785642846 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f3cc7d61-5de3-4982-9b2e-5dec00a1659d-original-pull-secret") pod "global-pull-secret-syncer-jh96t" (UID: "f3cc7d61-5de3-4982-9b2e-5dec00a1659d") : object "kube-system"/"original-pull-secret" not registered Jun 02 07:29:41.925097 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:41.924990 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56bb33da-8c46-4433-8b45-f6fe098c4d25-metrics-certs\") pod \"network-metrics-daemon-rgk46\" (UID: \"56bb33da-8c46-4433-8b45-f6fe098c4d25\") " pod="openshift-multus/network-metrics-daemon-rgk46" Jun 02 07:29:41.925315 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:41.925123 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 07:29:41.925315 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:41.925189 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56bb33da-8c46-4433-8b45-f6fe098c4d25-metrics-certs podName:56bb33da-8c46-4433-8b45-f6fe098c4d25 nodeName:}" failed. No retries permitted until 2026-06-02 07:29:49.925170986 +0000 UTC m=+18.189153043 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/56bb33da-8c46-4433-8b45-f6fe098c4d25-metrics-certs") pod "network-metrics-daemon-rgk46" (UID: "56bb33da-8c46-4433-8b45-f6fe098c4d25") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 07:29:42.025577 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:42.025534 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8m79x\" (UniqueName: \"kubernetes.io/projected/f60cac34-93f5-4439-b197-17a7283b4599-kube-api-access-8m79x\") pod \"network-check-target-wp2df\" (UID: \"f60cac34-93f5-4439-b197-17a7283b4599\") " pod="openshift-network-diagnostics/network-check-target-wp2df" Jun 02 07:29:42.025771 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:42.025705 2580 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 07:29:42.025771 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:42.025724 2580 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 07:29:42.025771 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:42.025734 2580 projected.go:194] Error preparing data for projected volume kube-api-access-8m79x for pod openshift-network-diagnostics/network-check-target-wp2df: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 07:29:42.025903 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:42.025778 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f60cac34-93f5-4439-b197-17a7283b4599-kube-api-access-8m79x podName:f60cac34-93f5-4439-b197-17a7283b4599 nodeName:}" failed. No retries permitted until 2026-06-02 07:29:50.025764328 +0000 UTC m=+18.289746371 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-8m79x" (UniqueName: "kubernetes.io/projected/f60cac34-93f5-4439-b197-17a7283b4599-kube-api-access-8m79x") pod "network-check-target-wp2df" (UID: "f60cac34-93f5-4439-b197-17a7283b4599") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 07:29:43.374664 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:43.374569 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wp2df" Jun 02 07:29:43.374664 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:43.374596 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jh96t" Jun 02 07:29:43.375098 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:43.374698 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rgk46" Jun 02 07:29:43.375098 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:43.374704 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wp2df" podUID="f60cac34-93f5-4439-b197-17a7283b4599" Jun 02 07:29:43.375098 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:43.374787 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jh96t" podUID="f3cc7d61-5de3-4982-9b2e-5dec00a1659d" Jun 02 07:29:43.375098 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:43.374884 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rgk46" podUID="56bb33da-8c46-4433-8b45-f6fe098c4d25" Jun 02 07:29:43.538095 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:43.538057 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f3cc7d61-5de3-4982-9b2e-5dec00a1659d-original-pull-secret\") pod \"global-pull-secret-syncer-jh96t\" (UID: \"f3cc7d61-5de3-4982-9b2e-5dec00a1659d\") " pod="kube-system/global-pull-secret-syncer-jh96t" Jun 02 07:29:43.538281 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:43.538202 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 07:29:43.538281 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:43.538269 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3cc7d61-5de3-4982-9b2e-5dec00a1659d-original-pull-secret podName:f3cc7d61-5de3-4982-9b2e-5dec00a1659d nodeName:}" failed. No retries permitted until 2026-06-02 07:29:47.538255263 +0000 UTC m=+15.802237306 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f3cc7d61-5de3-4982-9b2e-5dec00a1659d-original-pull-secret") pod "global-pull-secret-syncer-jh96t" (UID: "f3cc7d61-5de3-4982-9b2e-5dec00a1659d") : object "kube-system"/"original-pull-secret" not registered Jun 02 07:29:45.375089 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:45.375009 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jh96t" Jun 02 07:29:45.375089 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:45.375046 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wp2df" Jun 02 07:29:45.375578 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:45.375007 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rgk46" Jun 02 07:29:45.375578 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:45.375152 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jh96t" podUID="f3cc7d61-5de3-4982-9b2e-5dec00a1659d" Jun 02 07:29:45.375578 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:45.375243 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rgk46" podUID="56bb33da-8c46-4433-8b45-f6fe098c4d25" Jun 02 07:29:45.375578 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:45.375284 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wp2df" podUID="f60cac34-93f5-4439-b197-17a7283b4599" Jun 02 07:29:47.375283 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:47.375244 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jh96t" Jun 02 07:29:47.375736 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:47.375244 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wp2df" Jun 02 07:29:47.375736 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:47.375369 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jh96t" podUID="f3cc7d61-5de3-4982-9b2e-5dec00a1659d" Jun 02 07:29:47.375736 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:47.375480 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wp2df" podUID="f60cac34-93f5-4439-b197-17a7283b4599" Jun 02 07:29:47.375736 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:47.375265 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rgk46" Jun 02 07:29:47.375736 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:47.375601 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rgk46" podUID="56bb33da-8c46-4433-8b45-f6fe098c4d25" Jun 02 07:29:47.570833 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:47.570794 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f3cc7d61-5de3-4982-9b2e-5dec00a1659d-original-pull-secret\") pod \"global-pull-secret-syncer-jh96t\" (UID: \"f3cc7d61-5de3-4982-9b2e-5dec00a1659d\") " pod="kube-system/global-pull-secret-syncer-jh96t" Jun 02 07:29:47.571013 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:47.570953 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 07:29:47.571069 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:47.571034 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3cc7d61-5de3-4982-9b2e-5dec00a1659d-original-pull-secret podName:f3cc7d61-5de3-4982-9b2e-5dec00a1659d nodeName:}" failed. No retries permitted until 2026-06-02 07:29:55.57101 +0000 UTC m=+23.834992077 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f3cc7d61-5de3-4982-9b2e-5dec00a1659d-original-pull-secret") pod "global-pull-secret-syncer-jh96t" (UID: "f3cc7d61-5de3-4982-9b2e-5dec00a1659d") : object "kube-system"/"original-pull-secret" not registered Jun 02 07:29:49.374727 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:49.374694 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rgk46" Jun 02 07:29:49.374727 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:49.374730 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jh96t" Jun 02 07:29:49.375279 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:49.374737 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wp2df" Jun 02 07:29:49.375279 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:49.374829 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rgk46" podUID="56bb33da-8c46-4433-8b45-f6fe098c4d25" Jun 02 07:29:49.375279 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:49.374932 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jh96t" podUID="f3cc7d61-5de3-4982-9b2e-5dec00a1659d" Jun 02 07:29:49.375279 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:49.374992 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wp2df" podUID="f60cac34-93f5-4439-b197-17a7283b4599" Jun 02 07:29:49.987052 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:49.986966 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56bb33da-8c46-4433-8b45-f6fe098c4d25-metrics-certs\") pod \"network-metrics-daemon-rgk46\" (UID: \"56bb33da-8c46-4433-8b45-f6fe098c4d25\") " pod="openshift-multus/network-metrics-daemon-rgk46" Jun 02 07:29:49.987210 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:49.987139 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 07:29:49.987281 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:49.987228 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56bb33da-8c46-4433-8b45-f6fe098c4d25-metrics-certs podName:56bb33da-8c46-4433-8b45-f6fe098c4d25 nodeName:}" failed. No retries permitted until 2026-06-02 07:30:05.987194838 +0000 UTC m=+34.251176906 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/56bb33da-8c46-4433-8b45-f6fe098c4d25-metrics-certs") pod "network-metrics-daemon-rgk46" (UID: "56bb33da-8c46-4433-8b45-f6fe098c4d25") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 07:29:50.088152 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:50.088123 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8m79x\" (UniqueName: \"kubernetes.io/projected/f60cac34-93f5-4439-b197-17a7283b4599-kube-api-access-8m79x\") pod \"network-check-target-wp2df\" (UID: \"f60cac34-93f5-4439-b197-17a7283b4599\") " pod="openshift-network-diagnostics/network-check-target-wp2df" Jun 02 07:29:50.088344 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:50.088274 2580 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 07:29:50.088344 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:50.088300 2580 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 07:29:50.088344 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:50.088313 2580 projected.go:194] Error preparing data for projected volume kube-api-access-8m79x for pod openshift-network-diagnostics/network-check-target-wp2df: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 07:29:50.088465 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:50.088377 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f60cac34-93f5-4439-b197-17a7283b4599-kube-api-access-8m79x podName:f60cac34-93f5-4439-b197-17a7283b4599 nodeName:}" failed. No retries permitted until 2026-06-02 07:30:06.088358843 +0000 UTC m=+34.352340900 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-8m79x" (UniqueName: "kubernetes.io/projected/f60cac34-93f5-4439-b197-17a7283b4599-kube-api-access-8m79x") pod "network-check-target-wp2df" (UID: "f60cac34-93f5-4439-b197-17a7283b4599") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 07:29:51.375229 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:51.375174 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jh96t" Jun 02 07:29:51.375229 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:51.375185 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rgk46" Jun 02 07:29:51.375745 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:51.375319 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jh96t" podUID="f3cc7d61-5de3-4982-9b2e-5dec00a1659d" Jun 02 07:29:51.375745 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:51.375350 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wp2df" Jun 02 07:29:51.375745 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:51.375425 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wp2df" podUID="f60cac34-93f5-4439-b197-17a7283b4599" Jun 02 07:29:51.375745 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:51.375511 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rgk46" podUID="56bb33da-8c46-4433-8b45-f6fe098c4d25" Jun 02 07:29:53.375010 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:53.374985 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jh96t" Jun 02 07:29:53.375294 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:53.375094 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jh96t" podUID="f3cc7d61-5de3-4982-9b2e-5dec00a1659d" Jun 02 07:29:53.375294 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:53.375178 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rgk46" Jun 02 07:29:53.375294 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:53.375256 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rgk46" podUID="56bb33da-8c46-4433-8b45-f6fe098c4d25" Jun 02 07:29:53.375420 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:53.375323 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wp2df" Jun 02 07:29:53.375420 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:53.375382 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wp2df" podUID="f60cac34-93f5-4439-b197-17a7283b4599" Jun 02 07:29:53.621776 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:53.621344 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-67gkk" event={"ID":"32c32725-d170-41c3-82f8-78900f6220c2","Type":"ContainerStarted","Data":"df561b1199b7501f8cc4ae84a5b02eb6c4965a2bb0832f79482be8ee12b581d5"} Jun 02 07:29:53.622990 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:53.622940 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2krhv" event={"ID":"a731c005-ed09-4135-9776-d885682e8200","Type":"ContainerStarted","Data":"3bb0b45546fb147676d5d9aa6d0da04aa081c690cb1924deb32f36c112d3d234"} Jun 02 07:29:53.624948 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:53.624925 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-m8rd6" event={"ID":"eee91b43-4311-42b2-aa7b-e1ad62724d7d","Type":"ContainerStarted","Data":"420e04b86a810bc69e55b473a59a0c80f94901f56a45e26f1c9517c536d373cf"} Jun 02 07:29:53.627530 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:53.627475 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" event={"ID":"f3415efe-20d6-430a-8501-c8c2d2709d7e","Type":"ContainerStarted","Data":"d2cde547a82d9747e64e7615fa165ede7b360ac2d691b6ec66588997830cc421"} Jun 02 07:29:53.629344 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:53.629324 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8nv4p" event={"ID":"a28eec73-4627-4d20-925e-23fb8e998a96","Type":"ContainerStarted","Data":"ef287e5e00d86f36e31ef4767bc1576c227e38722c13638d1ff3596b28047c5d"} Jun 02 07:29:53.630576 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:53.630544 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9bbts" event={"ID":"8479fba7-d0c6-4c26-82cd-44cff52ef948","Type":"ContainerStarted","Data":"8d71a9e2bd75d21a4c05f87fe16e384429e2722dff8f061977a7001a10cc5618"} Jun 02 07:29:53.659492 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:53.659443 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-67gkk" podStartSLOduration=3.243378556 podStartE2EDuration="21.65942845s" podCreationTimestamp="2026-06-02 07:29:32 +0000 UTC" firstStartedPulling="2026-06-02 07:29:34.888762828 +0000 UTC m=+3.152744873" lastFinishedPulling="2026-06-02 07:29:53.304812706 +0000 UTC m=+21.568794767" observedRunningTime="2026-06-02 07:29:53.639888188 +0000 UTC m=+21.903870254" watchObservedRunningTime="2026-06-02 07:29:53.65942845 +0000 UTC m=+21.923410516" Jun 02 07:29:53.688970 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:53.688926 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-m8rd6" podStartSLOduration=3.352883417 podStartE2EDuration="21.688911058s" podCreationTimestamp="2026-06-02 07:29:32 +0000 UTC" firstStartedPulling="2026-06-02 07:29:34.883754322 +0000 UTC m=+3.147736378" lastFinishedPulling="2026-06-02 07:29:53.21978196 +0000 UTC m=+21.483764019" observedRunningTime="2026-06-02 07:29:53.688427576 +0000 UTC m=+21.952409642" watchObservedRunningTime="2026-06-02 07:29:53.688911058 +0000 UTC m=+21.952893124" Jun 02 07:29:53.689141 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:53.689086 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9bbts" podStartSLOduration=3.273044556 podStartE2EDuration="21.689079254s" podCreationTimestamp="2026-06-02 07:29:32 +0000 UTC" firstStartedPulling="2026-06-02 07:29:34.879874345 +0000 UTC m=+3.143856403" lastFinishedPulling="2026-06-02 07:29:53.295909057 +0000 UTC m=+21.559891101" observedRunningTime="2026-06-02 07:29:53.670281975 +0000 UTC m=+21.934264043" watchObservedRunningTime="2026-06-02 07:29:53.689079254 +0000 UTC m=+21.953061320" Jun 02 07:29:53.701588 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:53.701549 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-2krhv" podStartSLOduration=3.363948386 podStartE2EDuration="21.701535655s" podCreationTimestamp="2026-06-02 07:29:32 +0000 UTC" firstStartedPulling="2026-06-02 07:29:34.882197759 +0000 UTC m=+3.146179802" lastFinishedPulling="2026-06-02 07:29:53.21978502 +0000 UTC m=+21.483767071" observedRunningTime="2026-06-02 07:29:53.701503705 +0000 UTC m=+21.965485772" watchObservedRunningTime="2026-06-02 07:29:53.701535655 +0000 UTC m=+21.965517718" Jun 02 07:29:54.635561 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:54.635347 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tjvw4_f3415efe-20d6-430a-8501-c8c2d2709d7e/ovn-acl-logging/0.log" Jun 02 07:29:54.636375 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:54.635768 2580 generic.go:358] "Generic (PLEG): container finished" podID="f3415efe-20d6-430a-8501-c8c2d2709d7e" containerID="bd295d8dd468781abd640a0dd0feec01c87362d81a8b5552b5336b6f59cb7cc2" exitCode=1 Jun 02 07:29:54.636375 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:54.635831 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" event={"ID":"f3415efe-20d6-430a-8501-c8c2d2709d7e","Type":"ContainerStarted","Data":"ee723b25a5e7d2115f91657a4bbe8561e12c6cce18c86c47f22ff911ef93cf7a"} Jun 02 07:29:54.636375 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:54.635855 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" event={"ID":"f3415efe-20d6-430a-8501-c8c2d2709d7e","Type":"ContainerStarted","Data":"d0338344b8dc5f839aceb3790b215238bee3ba648e0120dbca2dda9b6fcbfd7c"} Jun 02 07:29:54.636375 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:54.635864 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" event={"ID":"f3415efe-20d6-430a-8501-c8c2d2709d7e","Type":"ContainerStarted","Data":"01c3cecd4b8cbba4e46df77d69dd7b20f4517a87bf110098846ef058bbbc8169"} Jun 02 07:29:54.636375 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:54.635872 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" event={"ID":"f3415efe-20d6-430a-8501-c8c2d2709d7e","Type":"ContainerStarted","Data":"5d150f8592c20d47cd50c00dd434d1dcc95712bdd66fd7e67dda0b3ea5c9a0a8"} Jun 02 07:29:54.636375 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:54.635879 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" event={"ID":"f3415efe-20d6-430a-8501-c8c2d2709d7e","Type":"ContainerDied","Data":"bd295d8dd468781abd640a0dd0feec01c87362d81a8b5552b5336b6f59cb7cc2"} Jun 02 07:29:54.637044 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:54.637020 2580 generic.go:358] "Generic (PLEG): container finished" podID="a28eec73-4627-4d20-925e-23fb8e998a96" containerID="ef287e5e00d86f36e31ef4767bc1576c227e38722c13638d1ff3596b28047c5d" exitCode=0 Jun 02 07:29:54.637186 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:54.637078 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8nv4p" event={"ID":"a28eec73-4627-4d20-925e-23fb8e998a96","Type":"ContainerDied","Data":"ef287e5e00d86f36e31ef4767bc1576c227e38722c13638d1ff3596b28047c5d"} Jun 02 07:29:54.638522 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:54.638504 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kf8mm" event={"ID":"065f3e32-54af-4094-bdd9-2aa60ae8cb83","Type":"ContainerStarted","Data":"e103386ac2bb934ec7c7d8fb42c11f149288d60cf12d2b21e76544ccb92363a6"} Jun 02 07:29:54.639764 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:54.639743 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j67fw" event={"ID":"7048ef29-aba3-4c8b-b38a-b02c615a3ec7","Type":"ContainerStarted","Data":"9081a872d952ef6881e3f408ef1ae0705cebc01f2ef6b6b933088cb2e84d9da7"} Jun 02 07:29:54.674271 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:54.674234 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-kf8mm" podStartSLOduration=4.030212139 podStartE2EDuration="22.674208856s" podCreationTimestamp="2026-06-02 07:29:32 +0000 UTC" firstStartedPulling="2026-06-02 07:29:34.878419456 +0000 UTC m=+3.142401500" lastFinishedPulling="2026-06-02 07:29:53.522416163 +0000 UTC m=+21.786398217" observedRunningTime="2026-06-02 07:29:54.673135678 +0000 UTC m=+22.937117743" watchObservedRunningTime="2026-06-02 07:29:54.674208856 +0000 UTC m=+22.938190921" Jun 02 07:29:54.803790 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:54.803767 2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 02 07:29:54.876128 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:54.876102 2580 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-m8rd6" Jun 02 07:29:54.876709 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:54.876692 2580 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-m8rd6" Jun 02 07:29:55.320336 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:55.320179 2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-02T07:29:54.803786245Z","UUID":"704d1292-214b-46ef-867c-2d1eff14edfd","Handler":null,"Name":"","Endpoint":""} Jun 02 07:29:55.322725 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:55.322361 2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 02 07:29:55.322725 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:55.322398 2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 02 07:29:55.375169 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:55.375136 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rgk46" Jun 02 07:29:55.375350 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:55.375255 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rgk46" podUID="56bb33da-8c46-4433-8b45-f6fe098c4d25" Jun 02 07:29:55.375666 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:55.375644 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wp2df" Jun 02 07:29:55.375791 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:55.375726 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wp2df" podUID="f60cac34-93f5-4439-b197-17a7283b4599" Jun 02 07:29:55.375791 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:55.375775 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jh96t" Jun 02 07:29:55.375882 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:55.375854 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jh96t" podUID="f3cc7d61-5de3-4982-9b2e-5dec00a1659d" Jun 02 07:29:55.628584 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:55.628511 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f3cc7d61-5de3-4982-9b2e-5dec00a1659d-original-pull-secret\") pod \"global-pull-secret-syncer-jh96t\" (UID: \"f3cc7d61-5de3-4982-9b2e-5dec00a1659d\") " pod="kube-system/global-pull-secret-syncer-jh96t" Jun 02 07:29:55.628732 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:55.628679 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 07:29:55.628790 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:55.628748 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3cc7d61-5de3-4982-9b2e-5dec00a1659d-original-pull-secret podName:f3cc7d61-5de3-4982-9b2e-5dec00a1659d nodeName:}" failed. No retries permitted until 2026-06-02 07:30:11.628731623 +0000 UTC m=+39.892713667 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f3cc7d61-5de3-4982-9b2e-5dec00a1659d-original-pull-secret") pod "global-pull-secret-syncer-jh96t" (UID: "f3cc7d61-5de3-4982-9b2e-5dec00a1659d") : object "kube-system"/"original-pull-secret" not registered Jun 02 07:29:55.643178 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:55.643142 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nng4s" event={"ID":"63f72893-abb3-493b-a512-9e9bd17b76a4","Type":"ContainerStarted","Data":"0da71d8e9bb2c0ca0f83128e3c7252bbbe2d3107abc71036e44fada9dd52e43f"} Jun 02 07:29:55.644978 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:55.644926 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j67fw" event={"ID":"7048ef29-aba3-4c8b-b38a-b02c615a3ec7","Type":"ContainerStarted","Data":"84d0f01cfb8dbac69b80a7f9b0444d891d25ca1894355f50e3e344fdfcbbb431"} Jun 02 07:29:55.645595 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:55.645574 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-m8rd6" Jun 02 07:29:55.651548 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:55.651529 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-m8rd6" Jun 02 07:29:55.657573 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:55.657526 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-nng4s" podStartSLOduration=5.24277729 podStartE2EDuration="23.657515826s" podCreationTimestamp="2026-06-02 07:29:32 +0000 UTC" firstStartedPulling="2026-06-02 07:29:34.882972451 +0000 UTC m=+3.146954508" lastFinishedPulling="2026-06-02 07:29:53.297711 +0000 UTC m=+21.561693044" observedRunningTime="2026-06-02 07:29:55.657164319 +0000 UTC m=+23.921146387" watchObservedRunningTime="2026-06-02 07:29:55.657515826 +0000 UTC m=+23.921497892" Jun 02 07:29:56.649398 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:56.649096 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j67fw" event={"ID":"7048ef29-aba3-4c8b-b38a-b02c615a3ec7","Type":"ContainerStarted","Data":"3e7b25dc73e0633a58d1a81c680a251607748946319bd27b3069860d46a28227"} Jun 02 07:29:56.652093 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:56.652073 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tjvw4_f3415efe-20d6-430a-8501-c8c2d2709d7e/ovn-acl-logging/0.log" Jun 02 07:29:56.652451 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:56.652412 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" event={"ID":"f3415efe-20d6-430a-8501-c8c2d2709d7e","Type":"ContainerStarted","Data":"ffe4de9fa5c2faeabeeae839754376b9561d6dff098fe3958323f8c2784d20e5"} Jun 02 07:29:56.665485 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:56.665432 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j67fw" podStartSLOduration=3.788635055 podStartE2EDuration="24.665415544s" podCreationTimestamp="2026-06-02 07:29:32 +0000 UTC" firstStartedPulling="2026-06-02 07:29:34.889730795 +0000 UTC m=+3.153712840" lastFinishedPulling="2026-06-02 07:29:55.76651128 +0000 UTC m=+24.030493329" observedRunningTime="2026-06-02 07:29:56.664725118 +0000 UTC m=+24.928707195" watchObservedRunningTime="2026-06-02 07:29:56.665415544 +0000 UTC m=+24.929397611" Jun 02 07:29:57.375310 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:57.375271 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rgk46" Jun 02 07:29:57.375310 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:57.375309 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jh96t" Jun 02 07:29:57.375574 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:57.375268 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wp2df" Jun 02 07:29:57.375574 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:57.375393 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rgk46" podUID="56bb33da-8c46-4433-8b45-f6fe098c4d25" Jun 02 07:29:57.375574 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:57.375492 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jh96t" podUID="f3cc7d61-5de3-4982-9b2e-5dec00a1659d" Jun 02 07:29:57.375574 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:57.375552 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wp2df" podUID="f60cac34-93f5-4439-b197-17a7283b4599" Jun 02 07:29:59.375623 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:59.375384 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wp2df" Jun 02 07:29:59.376287 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:59.375443 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jh96t" Jun 02 07:29:59.376287 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:59.375651 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wp2df" podUID="f60cac34-93f5-4439-b197-17a7283b4599" Jun 02 07:29:59.376287 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:59.375736 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jh96t" podUID="f3cc7d61-5de3-4982-9b2e-5dec00a1659d" Jun 02 07:29:59.376287 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:59.375462 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rgk46" Jun 02 07:29:59.376287 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:29:59.375831 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rgk46" podUID="56bb33da-8c46-4433-8b45-f6fe098c4d25" Jun 02 07:29:59.660652 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:59.660574 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tjvw4_f3415efe-20d6-430a-8501-c8c2d2709d7e/ovn-acl-logging/0.log" Jun 02 07:29:59.660902 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:59.660880 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" event={"ID":"f3415efe-20d6-430a-8501-c8c2d2709d7e","Type":"ContainerStarted","Data":"505c146d136a58bfc970eb8b4f03441c3f62341ab85a735d815b526da9945908"} Jun 02 07:29:59.661575 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:59.661240 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" Jun 02 07:29:59.661575 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:59.661391 2580 scope.go:117] "RemoveContainer" containerID="bd295d8dd468781abd640a0dd0feec01c87362d81a8b5552b5336b6f59cb7cc2" Jun 02 07:29:59.662556 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:59.662489 2580 generic.go:358] "Generic (PLEG): container finished" podID="a28eec73-4627-4d20-925e-23fb8e998a96" containerID="8320a1aaf100da40e53c7646e20eb4ee47c8429f0f8f0ce55c89e40d1a94e636" exitCode=0 Jun 02 07:29:59.662556 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:59.662520 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8nv4p" event={"ID":"a28eec73-4627-4d20-925e-23fb8e998a96","Type":"ContainerDied","Data":"8320a1aaf100da40e53c7646e20eb4ee47c8429f0f8f0ce55c89e40d1a94e636"} Jun 02 07:29:59.677756 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:29:59.677738 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" Jun 02 07:30:00.667343 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:00.667322 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tjvw4_f3415efe-20d6-430a-8501-c8c2d2709d7e/ovn-acl-logging/0.log" Jun 02 07:30:00.667712 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:00.667680 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" event={"ID":"f3415efe-20d6-430a-8501-c8c2d2709d7e","Type":"ContainerStarted","Data":"5d60c397c6d4c16a5838096980d421d3aa9e1ffae7fedc22737d679207a8e21c"} Jun 02 07:30:00.667924 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:00.667909 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" Jun 02 07:30:00.667988 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:00.667931 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" Jun 02 07:30:00.683797 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:00.683774 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" Jun 02 07:30:00.694390 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:00.694341 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" podStartSLOduration=10.22258484 podStartE2EDuration="28.694329081s" podCreationTimestamp="2026-06-02 07:29:32 +0000 UTC" firstStartedPulling="2026-06-02 07:29:34.886123642 +0000 UTC m=+3.150105691" lastFinishedPulling="2026-06-02 07:29:53.357867875 +0000 UTC m=+21.621849932" observedRunningTime="2026-06-02 07:30:00.692542919 +0000 UTC m=+28.956524986" watchObservedRunningTime="2026-06-02 07:30:00.694329081 +0000 UTC m=+28.958311351" Jun 02 07:30:00.961973 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:00.961892 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jh96t"] Jun 02 07:30:00.962128 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:00.962029 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jh96t" Jun 02 07:30:00.962184 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:30:00.962134 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jh96t" podUID="f3cc7d61-5de3-4982-9b2e-5dec00a1659d" Jun 02 07:30:00.965524 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:00.965500 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rgk46"] Jun 02 07:30:00.965637 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:00.965622 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rgk46" Jun 02 07:30:00.965722 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:30:00.965705 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rgk46" podUID="56bb33da-8c46-4433-8b45-f6fe098c4d25" Jun 02 07:30:00.966352 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:00.966332 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wp2df"] Jun 02 07:30:00.966455 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:00.966407 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wp2df" Jun 02 07:30:00.966505 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:30:00.966472 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wp2df" podUID="f60cac34-93f5-4439-b197-17a7283b4599" Jun 02 07:30:01.671443 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:01.671408 2580 generic.go:358] "Generic (PLEG): container finished" podID="a28eec73-4627-4d20-925e-23fb8e998a96" containerID="d0099d57b876bfd6a3596b14056f05142702729815bc43c0ffdaec8d8068e300" exitCode=0 Jun 02 07:30:01.671827 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:01.671493 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8nv4p" event={"ID":"a28eec73-4627-4d20-925e-23fb8e998a96","Type":"ContainerDied","Data":"d0099d57b876bfd6a3596b14056f05142702729815bc43c0ffdaec8d8068e300"} Jun 02 07:30:02.375657 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:02.375616 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jh96t" Jun 02 07:30:02.375829 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:30:02.375733 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jh96t" podUID="f3cc7d61-5de3-4982-9b2e-5dec00a1659d" Jun 02 07:30:02.375829 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:02.375765 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wp2df" Jun 02 07:30:02.375934 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:30:02.375870 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wp2df" podUID="f60cac34-93f5-4439-b197-17a7283b4599" Jun 02 07:30:03.375068 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:03.375033 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rgk46" Jun 02 07:30:03.375726 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:30:03.375168 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rgk46" podUID="56bb33da-8c46-4433-8b45-f6fe098c4d25" Jun 02 07:30:03.680392 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:03.680309 2580 generic.go:358] "Generic (PLEG): container finished" podID="a28eec73-4627-4d20-925e-23fb8e998a96" containerID="821bf7712050d78f22be6dee0c3093b7ebe38314bcee3e8a62357c41df1f1c36" exitCode=0 Jun 02 07:30:03.680392 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:03.680348 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8nv4p" event={"ID":"a28eec73-4627-4d20-925e-23fb8e998a96","Type":"ContainerDied","Data":"821bf7712050d78f22be6dee0c3093b7ebe38314bcee3e8a62357c41df1f1c36"} Jun 02 07:30:04.374967 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:04.374936 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jh96t" Jun 02 07:30:04.375138 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:04.374936 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wp2df" Jun 02 07:30:04.375138 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:30:04.375082 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jh96t" podUID="f3cc7d61-5de3-4982-9b2e-5dec00a1659d" Jun 02 07:30:04.375138 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:30:04.375123 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wp2df" podUID="f60cac34-93f5-4439-b197-17a7283b4599" Jun 02 07:30:05.375320 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:05.375280 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rgk46" Jun 02 07:30:05.375821 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:30:05.375424 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rgk46" podUID="56bb33da-8c46-4433-8b45-f6fe098c4d25" Jun 02 07:30:06.011058 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:06.011020 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56bb33da-8c46-4433-8b45-f6fe098c4d25-metrics-certs\") pod \"network-metrics-daemon-rgk46\" (UID: \"56bb33da-8c46-4433-8b45-f6fe098c4d25\") " pod="openshift-multus/network-metrics-daemon-rgk46" Jun 02 07:30:06.011251 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:30:06.011194 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 07:30:06.011304 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:30:06.011279 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56bb33da-8c46-4433-8b45-f6fe098c4d25-metrics-certs podName:56bb33da-8c46-4433-8b45-f6fe098c4d25 nodeName:}" failed. No retries permitted until 2026-06-02 07:30:38.011263103 +0000 UTC m=+66.275245147 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/56bb33da-8c46-4433-8b45-f6fe098c4d25-metrics-certs") pod "network-metrics-daemon-rgk46" (UID: "56bb33da-8c46-4433-8b45-f6fe098c4d25") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 07:30:06.016881 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:06.016857 2580 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-245.ec2.internal" event="NodeReady" Jun 02 07:30:06.017009 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:06.016994 2580 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 02 07:30:06.059833 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:06.059795 2580 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-svfjd"] Jun 02 07:30:06.068458 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:06.068434 2580 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-bg26p"] Jun 02 07:30:06.068625 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:06.068607 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-svfjd" Jun 02 07:30:06.070979 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:06.070949 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 02 07:30:06.071141 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:06.070962 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 02 07:30:06.071255 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:06.071238 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-t285j\"" Jun 02 07:30:06.080679 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:06.077432 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bg26p"] Jun 02 07:30:06.080679 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:06.077462 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-svfjd"] Jun 02 07:30:06.080679 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:06.077588 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bg26p" Jun 02 07:30:06.081251 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:06.081202 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 02 07:30:06.081415 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:06.081277 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 02 07:30:06.081563 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:06.081344 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 02 07:30:06.081641 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:06.081401 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-kkvxj\"" Jun 02 07:30:06.112085 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:06.112052 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8m79x\" (UniqueName: \"kubernetes.io/projected/f60cac34-93f5-4439-b197-17a7283b4599-kube-api-access-8m79x\") pod \"network-check-target-wp2df\" (UID: \"f60cac34-93f5-4439-b197-17a7283b4599\") " pod="openshift-network-diagnostics/network-check-target-wp2df" Jun 02 07:30:06.112260 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:30:06.112241 2580 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 07:30:06.112321 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:30:06.112266 2580 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 07:30:06.112321 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:30:06.112280 2580 projected.go:194] Error preparing data for projected volume kube-api-access-8m79x for pod openshift-network-diagnostics/network-check-target-wp2df: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 07:30:06.112409 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:30:06.112336 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f60cac34-93f5-4439-b197-17a7283b4599-kube-api-access-8m79x podName:f60cac34-93f5-4439-b197-17a7283b4599 nodeName:}" failed. No retries permitted until 2026-06-02 07:30:38.11232171 +0000 UTC m=+66.376303754 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-8m79x" (UniqueName: "kubernetes.io/projected/f60cac34-93f5-4439-b197-17a7283b4599-kube-api-access-8m79x") pod "network-check-target-wp2df" (UID: "f60cac34-93f5-4439-b197-17a7283b4599") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 07:30:06.212651 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:06.212562 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d835e1ce-7985-432d-809d-d71b36a13093-cert\") pod \"ingress-canary-bg26p\" (UID: \"d835e1ce-7985-432d-809d-d71b36a13093\") " pod="openshift-ingress-canary/ingress-canary-bg26p" Jun 02 07:30:06.212651 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:06.212624 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/54c378b4-2d76-430f-b245-7cd764b8dfc1-config-volume\") pod \"dns-default-svfjd\" (UID: \"54c378b4-2d76-430f-b245-7cd764b8dfc1\") " pod="openshift-dns/dns-default-svfjd" Jun 02 07:30:06.212832 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:06.212706 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlkq2\" (UniqueName: \"kubernetes.io/projected/d835e1ce-7985-432d-809d-d71b36a13093-kube-api-access-dlkq2\") pod \"ingress-canary-bg26p\" (UID: \"d835e1ce-7985-432d-809d-d71b36a13093\") " pod="openshift-ingress-canary/ingress-canary-bg26p" Jun 02 07:30:06.212832 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:06.212797 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54c378b4-2d76-430f-b245-7cd764b8dfc1-tmp-dir\") pod \"dns-default-svfjd\" (UID: \"54c378b4-2d76-430f-b245-7cd764b8dfc1\") " pod="openshift-dns/dns-default-svfjd" Jun 02 07:30:06.212832 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:06.212822 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5l6v6\" (UniqueName: \"kubernetes.io/projected/54c378b4-2d76-430f-b245-7cd764b8dfc1-kube-api-access-5l6v6\") pod \"dns-default-svfjd\" (UID: \"54c378b4-2d76-430f-b245-7cd764b8dfc1\") " pod="openshift-dns/dns-default-svfjd" Jun 02 07:30:06.212990 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:06.212845 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/54c378b4-2d76-430f-b245-7cd764b8dfc1-metrics-tls\") pod \"dns-default-svfjd\" (UID: \"54c378b4-2d76-430f-b245-7cd764b8dfc1\") " pod="openshift-dns/dns-default-svfjd" Jun 02 07:30:06.314254 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:06.314201 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/54c378b4-2d76-430f-b245-7cd764b8dfc1-metrics-tls\") pod \"dns-default-svfjd\" (UID: \"54c378b4-2d76-430f-b245-7cd764b8dfc1\") " pod="openshift-dns/dns-default-svfjd" Jun 02 07:30:06.314254 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:30:06.314249 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 07:30:06.314470 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:06.314282 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d835e1ce-7985-432d-809d-d71b36a13093-cert\") pod \"ingress-canary-bg26p\" (UID: \"d835e1ce-7985-432d-809d-d71b36a13093\") " pod="openshift-ingress-canary/ingress-canary-bg26p" Jun 02 07:30:06.314470 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:30:06.314323 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54c378b4-2d76-430f-b245-7cd764b8dfc1-metrics-tls podName:54c378b4-2d76-430f-b245-7cd764b8dfc1 nodeName:}" failed. No retries permitted until 2026-06-02 07:30:06.814300237 +0000 UTC m=+35.078282284 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/54c378b4-2d76-430f-b245-7cd764b8dfc1-metrics-tls") pod "dns-default-svfjd" (UID: "54c378b4-2d76-430f-b245-7cd764b8dfc1") : secret "dns-default-metrics-tls" not found Jun 02 07:30:06.314470 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:06.314344 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/54c378b4-2d76-430f-b245-7cd764b8dfc1-config-volume\") pod \"dns-default-svfjd\" (UID: \"54c378b4-2d76-430f-b245-7cd764b8dfc1\") " pod="openshift-dns/dns-default-svfjd" Jun 02 07:30:06.314470 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:30:06.314374 2580 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 07:30:06.314470 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:06.314382 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dlkq2\" (UniqueName: \"kubernetes.io/projected/d835e1ce-7985-432d-809d-d71b36a13093-kube-api-access-dlkq2\") pod \"ingress-canary-bg26p\" (UID: \"d835e1ce-7985-432d-809d-d71b36a13093\") " pod="openshift-ingress-canary/ingress-canary-bg26p" Jun 02 07:30:06.314470 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:30:06.314424 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d835e1ce-7985-432d-809d-d71b36a13093-cert podName:d835e1ce-7985-432d-809d-d71b36a13093 nodeName:}" failed. No retries permitted until 2026-06-02 07:30:06.814406264 +0000 UTC m=+35.078388311 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d835e1ce-7985-432d-809d-d71b36a13093-cert") pod "ingress-canary-bg26p" (UID: "d835e1ce-7985-432d-809d-d71b36a13093") : secret "canary-serving-cert" not found Jun 02 07:30:06.314765 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:06.314510 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54c378b4-2d76-430f-b245-7cd764b8dfc1-tmp-dir\") pod \"dns-default-svfjd\" (UID: \"54c378b4-2d76-430f-b245-7cd764b8dfc1\") " pod="openshift-dns/dns-default-svfjd" Jun 02 07:30:06.314765 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:06.314536 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5l6v6\" (UniqueName: \"kubernetes.io/projected/54c378b4-2d76-430f-b245-7cd764b8dfc1-kube-api-access-5l6v6\") pod \"dns-default-svfjd\" (UID: \"54c378b4-2d76-430f-b245-7cd764b8dfc1\") " pod="openshift-dns/dns-default-svfjd" Jun 02 07:30:06.325165 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:06.325139 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlkq2\" (UniqueName: \"kubernetes.io/projected/d835e1ce-7985-432d-809d-d71b36a13093-kube-api-access-dlkq2\") pod \"ingress-canary-bg26p\" (UID: \"d835e1ce-7985-432d-809d-d71b36a13093\") " pod="openshift-ingress-canary/ingress-canary-bg26p" Jun 02 07:30:06.330296 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:06.330266 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54c378b4-2d76-430f-b245-7cd764b8dfc1-tmp-dir\") pod \"dns-default-svfjd\" (UID: \"54c378b4-2d76-430f-b245-7cd764b8dfc1\") " pod="openshift-dns/dns-default-svfjd" Jun 02 07:30:06.330421 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:06.330401 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/54c378b4-2d76-430f-b245-7cd764b8dfc1-config-volume\") pod \"dns-default-svfjd\" (UID: \"54c378b4-2d76-430f-b245-7cd764b8dfc1\") " pod="openshift-dns/dns-default-svfjd" Jun 02 07:30:06.332405 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:06.332385 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5l6v6\" (UniqueName: \"kubernetes.io/projected/54c378b4-2d76-430f-b245-7cd764b8dfc1-kube-api-access-5l6v6\") pod \"dns-default-svfjd\" (UID: \"54c378b4-2d76-430f-b245-7cd764b8dfc1\") " pod="openshift-dns/dns-default-svfjd" Jun 02 07:30:06.375420 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:06.375392 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jh96t" Jun 02 07:30:06.376045 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:06.375539 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wp2df" Jun 02 07:30:06.379063 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:06.379041 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 07:30:06.379181 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:06.379041 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 02 07:30:06.379181 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:06.379041 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 07:30:06.379181 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:06.379137 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-85gjv\"" Jun 02 07:30:06.819997 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:06.819961 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/54c378b4-2d76-430f-b245-7cd764b8dfc1-metrics-tls\") pod \"dns-default-svfjd\" (UID: \"54c378b4-2d76-430f-b245-7cd764b8dfc1\") " pod="openshift-dns/dns-default-svfjd" Jun 02 07:30:06.819997 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:06.820000 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d835e1ce-7985-432d-809d-d71b36a13093-cert\") pod \"ingress-canary-bg26p\" (UID: \"d835e1ce-7985-432d-809d-d71b36a13093\") " pod="openshift-ingress-canary/ingress-canary-bg26p" Jun 02 07:30:06.820256 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:30:06.820119 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 07:30:06.820256 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:30:06.820183 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54c378b4-2d76-430f-b245-7cd764b8dfc1-metrics-tls podName:54c378b4-2d76-430f-b245-7cd764b8dfc1 nodeName:}" failed. No retries permitted until 2026-06-02 07:30:07.820169743 +0000 UTC m=+36.084151788 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/54c378b4-2d76-430f-b245-7cd764b8dfc1-metrics-tls") pod "dns-default-svfjd" (UID: "54c378b4-2d76-430f-b245-7cd764b8dfc1") : secret "dns-default-metrics-tls" not found Jun 02 07:30:06.820256 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:30:06.820119 2580 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 07:30:06.820256 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:30:06.820250 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d835e1ce-7985-432d-809d-d71b36a13093-cert podName:d835e1ce-7985-432d-809d-d71b36a13093 nodeName:}" failed. No retries permitted until 2026-06-02 07:30:07.820239022 +0000 UTC m=+36.084221067 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d835e1ce-7985-432d-809d-d71b36a13093-cert") pod "ingress-canary-bg26p" (UID: "d835e1ce-7985-432d-809d-d71b36a13093") : secret "canary-serving-cert" not found Jun 02 07:30:07.375326 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:07.375283 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rgk46" Jun 02 07:30:07.377992 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:07.377968 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zbw2q\"" Jun 02 07:30:07.378408 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:07.377968 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 07:30:07.828877 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:07.828841 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/54c378b4-2d76-430f-b245-7cd764b8dfc1-metrics-tls\") pod \"dns-default-svfjd\" (UID: \"54c378b4-2d76-430f-b245-7cd764b8dfc1\") " pod="openshift-dns/dns-default-svfjd" Jun 02 07:30:07.828877 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:07.828883 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d835e1ce-7985-432d-809d-d71b36a13093-cert\") pod \"ingress-canary-bg26p\" (UID: \"d835e1ce-7985-432d-809d-d71b36a13093\") " pod="openshift-ingress-canary/ingress-canary-bg26p" Jun 02 07:30:07.829125 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:30:07.829001 2580 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 07:30:07.829125 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:30:07.829005 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 07:30:07.829125 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:30:07.829069 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d835e1ce-7985-432d-809d-d71b36a13093-cert podName:d835e1ce-7985-432d-809d-d71b36a13093 nodeName:}" failed. No retries permitted until 2026-06-02 07:30:09.829049426 +0000 UTC m=+38.093031490 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d835e1ce-7985-432d-809d-d71b36a13093-cert") pod "ingress-canary-bg26p" (UID: "d835e1ce-7985-432d-809d-d71b36a13093") : secret "canary-serving-cert" not found Jun 02 07:30:07.829125 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:30:07.829090 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54c378b4-2d76-430f-b245-7cd764b8dfc1-metrics-tls podName:54c378b4-2d76-430f-b245-7cd764b8dfc1 nodeName:}" failed. No retries permitted until 2026-06-02 07:30:09.829079485 +0000 UTC m=+38.093061530 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/54c378b4-2d76-430f-b245-7cd764b8dfc1-metrics-tls") pod "dns-default-svfjd" (UID: "54c378b4-2d76-430f-b245-7cd764b8dfc1") : secret "dns-default-metrics-tls" not found Jun 02 07:30:09.696568 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:09.696405 2580 generic.go:358] "Generic (PLEG): container finished" podID="a28eec73-4627-4d20-925e-23fb8e998a96" containerID="4b2d34e40f586757721be14ddf85dc74f5144d6ae81cf39e30402e1e13a10a80" exitCode=0 Jun 02 07:30:09.696568 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:09.696488 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8nv4p" event={"ID":"a28eec73-4627-4d20-925e-23fb8e998a96","Type":"ContainerDied","Data":"4b2d34e40f586757721be14ddf85dc74f5144d6ae81cf39e30402e1e13a10a80"} Jun 02 07:30:09.840829 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:09.840801 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/54c378b4-2d76-430f-b245-7cd764b8dfc1-metrics-tls\") pod \"dns-default-svfjd\" (UID: \"54c378b4-2d76-430f-b245-7cd764b8dfc1\") " pod="openshift-dns/dns-default-svfjd" Jun 02 07:30:09.840966 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:09.840842 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d835e1ce-7985-432d-809d-d71b36a13093-cert\") pod \"ingress-canary-bg26p\" (UID: \"d835e1ce-7985-432d-809d-d71b36a13093\") " pod="openshift-ingress-canary/ingress-canary-bg26p" Jun 02 07:30:09.840966 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:30:09.840932 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 07:30:09.840966 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:30:09.840949 2580 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 07:30:09.841083 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:30:09.840994 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54c378b4-2d76-430f-b245-7cd764b8dfc1-metrics-tls podName:54c378b4-2d76-430f-b245-7cd764b8dfc1 nodeName:}" failed. No retries permitted until 2026-06-02 07:30:13.840979963 +0000 UTC m=+42.104962008 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/54c378b4-2d76-430f-b245-7cd764b8dfc1-metrics-tls") pod "dns-default-svfjd" (UID: "54c378b4-2d76-430f-b245-7cd764b8dfc1") : secret "dns-default-metrics-tls" not found Jun 02 07:30:09.841083 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:30:09.841008 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d835e1ce-7985-432d-809d-d71b36a13093-cert podName:d835e1ce-7985-432d-809d-d71b36a13093 nodeName:}" failed. No retries permitted until 2026-06-02 07:30:13.841002305 +0000 UTC m=+42.104984349 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d835e1ce-7985-432d-809d-d71b36a13093-cert") pod "ingress-canary-bg26p" (UID: "d835e1ce-7985-432d-809d-d71b36a13093") : secret "canary-serving-cert" not found Jun 02 07:30:10.700575 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:10.700545 2580 generic.go:358] "Generic (PLEG): container finished" podID="a28eec73-4627-4d20-925e-23fb8e998a96" containerID="5cf41555462478c83efbf53b7a7121e9c89ce6d8ebd6fa94cd9d8adf063ffc3b" exitCode=0 Jun 02 07:30:10.700905 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:10.700619 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8nv4p" event={"ID":"a28eec73-4627-4d20-925e-23fb8e998a96","Type":"ContainerDied","Data":"5cf41555462478c83efbf53b7a7121e9c89ce6d8ebd6fa94cd9d8adf063ffc3b"} Jun 02 07:30:11.651927 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:11.651870 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f3cc7d61-5de3-4982-9b2e-5dec00a1659d-original-pull-secret\") pod \"global-pull-secret-syncer-jh96t\" (UID: \"f3cc7d61-5de3-4982-9b2e-5dec00a1659d\") " pod="kube-system/global-pull-secret-syncer-jh96t" Jun 02 07:30:11.655558 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:11.655523 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f3cc7d61-5de3-4982-9b2e-5dec00a1659d-original-pull-secret\") pod \"global-pull-secret-syncer-jh96t\" (UID: \"f3cc7d61-5de3-4982-9b2e-5dec00a1659d\") " pod="kube-system/global-pull-secret-syncer-jh96t" Jun 02 07:30:11.705512 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:11.705486 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8nv4p" event={"ID":"a28eec73-4627-4d20-925e-23fb8e998a96","Type":"ContainerStarted","Data":"bfde87c56b9afca205dd848e5c1db805b52158daa0bb032ecbd4e4a2e8c6dda5"} Jun 02 07:30:11.727814 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:11.727769 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8nv4p" podStartSLOduration=5.324173699 podStartE2EDuration="39.727753973s" podCreationTimestamp="2026-06-02 07:29:32 +0000 UTC" firstStartedPulling="2026-06-02 07:29:34.884825002 +0000 UTC m=+3.148807047" lastFinishedPulling="2026-06-02 07:30:09.28840526 +0000 UTC m=+37.552387321" observedRunningTime="2026-06-02 07:30:11.726359835 +0000 UTC m=+39.990341901" watchObservedRunningTime="2026-06-02 07:30:11.727753973 +0000 UTC m=+39.991736038" Jun 02 07:30:11.787836 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:11.787802 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jh96t" Jun 02 07:30:11.916790 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:11.916719 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jh96t"] Jun 02 07:30:11.921395 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:30:11.921363 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3cc7d61_5de3_4982_9b2e_5dec00a1659d.slice/crio-73e4b9bc61fb98fff81779191e4304ea8f6d49fe612b93c8c1f558135519dd35 WatchSource:0}: Error finding container 73e4b9bc61fb98fff81779191e4304ea8f6d49fe612b93c8c1f558135519dd35: Status 404 returned error can't find the container with id 73e4b9bc61fb98fff81779191e4304ea8f6d49fe612b93c8c1f558135519dd35 Jun 02 07:30:12.708865 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:12.708820 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jh96t" event={"ID":"f3cc7d61-5de3-4982-9b2e-5dec00a1659d","Type":"ContainerStarted","Data":"73e4b9bc61fb98fff81779191e4304ea8f6d49fe612b93c8c1f558135519dd35"} Jun 02 07:30:13.868778 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:13.868746 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/54c378b4-2d76-430f-b245-7cd764b8dfc1-metrics-tls\") pod \"dns-default-svfjd\" (UID: \"54c378b4-2d76-430f-b245-7cd764b8dfc1\") " pod="openshift-dns/dns-default-svfjd" Jun 02 07:30:13.868778 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:13.868784 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d835e1ce-7985-432d-809d-d71b36a13093-cert\") pod \"ingress-canary-bg26p\" (UID: \"d835e1ce-7985-432d-809d-d71b36a13093\") " pod="openshift-ingress-canary/ingress-canary-bg26p" Jun 02 07:30:13.869200 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:30:13.868888 2580 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 07:30:13.869200 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:30:13.868891 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 07:30:13.869200 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:30:13.868938 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d835e1ce-7985-432d-809d-d71b36a13093-cert podName:d835e1ce-7985-432d-809d-d71b36a13093 nodeName:}" failed. No retries permitted until 2026-06-02 07:30:21.868923798 +0000 UTC m=+50.132905842 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d835e1ce-7985-432d-809d-d71b36a13093-cert") pod "ingress-canary-bg26p" (UID: "d835e1ce-7985-432d-809d-d71b36a13093") : secret "canary-serving-cert" not found Jun 02 07:30:13.869200 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:30:13.868952 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54c378b4-2d76-430f-b245-7cd764b8dfc1-metrics-tls podName:54c378b4-2d76-430f-b245-7cd764b8dfc1 nodeName:}" failed. No retries permitted until 2026-06-02 07:30:21.868945518 +0000 UTC m=+50.132927561 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/54c378b4-2d76-430f-b245-7cd764b8dfc1-metrics-tls") pod "dns-default-svfjd" (UID: "54c378b4-2d76-430f-b245-7cd764b8dfc1") : secret "dns-default-metrics-tls" not found Jun 02 07:30:17.722950 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:17.722910 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jh96t" event={"ID":"f3cc7d61-5de3-4982-9b2e-5dec00a1659d","Type":"ContainerStarted","Data":"c5bfdbc9fa7681b13233ecb422b4c3a9389ee40825485e491b6abc63a7f7a3b4"} Jun 02 07:30:17.737612 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:17.737566 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-jh96t" podStartSLOduration=33.952263515 podStartE2EDuration="38.737552564s" podCreationTimestamp="2026-06-02 07:29:39 +0000 UTC" firstStartedPulling="2026-06-02 07:30:11.92341529 +0000 UTC m=+40.187397334" lastFinishedPulling="2026-06-02 07:30:16.70870433 +0000 UTC m=+44.972686383" observedRunningTime="2026-06-02 07:30:17.736649075 +0000 UTC m=+46.000631142" watchObservedRunningTime="2026-06-02 07:30:17.737552564 +0000 UTC m=+46.001534630" Jun 02 07:30:21.927120 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:21.927085 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/54c378b4-2d76-430f-b245-7cd764b8dfc1-metrics-tls\") pod \"dns-default-svfjd\" (UID: \"54c378b4-2d76-430f-b245-7cd764b8dfc1\") " pod="openshift-dns/dns-default-svfjd" Jun 02 07:30:21.927120 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:21.927124 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d835e1ce-7985-432d-809d-d71b36a13093-cert\") pod \"ingress-canary-bg26p\" (UID: \"d835e1ce-7985-432d-809d-d71b36a13093\") " pod="openshift-ingress-canary/ingress-canary-bg26p" Jun 02 07:30:21.927641 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:30:21.927244 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 07:30:21.927641 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:30:21.927256 2580 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 07:30:21.927641 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:30:21.927309 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54c378b4-2d76-430f-b245-7cd764b8dfc1-metrics-tls podName:54c378b4-2d76-430f-b245-7cd764b8dfc1 nodeName:}" failed. No retries permitted until 2026-06-02 07:30:37.927293621 +0000 UTC m=+66.191275665 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/54c378b4-2d76-430f-b245-7cd764b8dfc1-metrics-tls") pod "dns-default-svfjd" (UID: "54c378b4-2d76-430f-b245-7cd764b8dfc1") : secret "dns-default-metrics-tls" not found Jun 02 07:30:21.927641 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:30:21.927324 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d835e1ce-7985-432d-809d-d71b36a13093-cert podName:d835e1ce-7985-432d-809d-d71b36a13093 nodeName:}" failed. No retries permitted until 2026-06-02 07:30:37.927317092 +0000 UTC m=+66.191299136 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d835e1ce-7985-432d-809d-d71b36a13093-cert") pod "ingress-canary-bg26p" (UID: "d835e1ce-7985-432d-809d-d71b36a13093") : secret "canary-serving-cert" not found Jun 02 07:30:32.684365 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:32.684335 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tjvw4" Jun 02 07:30:37.939578 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:37.939539 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/54c378b4-2d76-430f-b245-7cd764b8dfc1-metrics-tls\") pod \"dns-default-svfjd\" (UID: \"54c378b4-2d76-430f-b245-7cd764b8dfc1\") " pod="openshift-dns/dns-default-svfjd" Jun 02 07:30:37.939578 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:37.939583 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d835e1ce-7985-432d-809d-d71b36a13093-cert\") pod \"ingress-canary-bg26p\" (UID: \"d835e1ce-7985-432d-809d-d71b36a13093\") " pod="openshift-ingress-canary/ingress-canary-bg26p" Jun 02 07:30:37.940054 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:30:37.939698 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 07:30:37.940054 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:30:37.939754 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54c378b4-2d76-430f-b245-7cd764b8dfc1-metrics-tls podName:54c378b4-2d76-430f-b245-7cd764b8dfc1 nodeName:}" failed. No retries permitted until 2026-06-02 07:31:09.939740175 +0000 UTC m=+98.203722219 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/54c378b4-2d76-430f-b245-7cd764b8dfc1-metrics-tls") pod "dns-default-svfjd" (UID: "54c378b4-2d76-430f-b245-7cd764b8dfc1") : secret "dns-default-metrics-tls" not found Jun 02 07:30:37.940054 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:30:37.939698 2580 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 07:30:37.940054 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:30:37.939818 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d835e1ce-7985-432d-809d-d71b36a13093-cert podName:d835e1ce-7985-432d-809d-d71b36a13093 nodeName:}" failed. No retries permitted until 2026-06-02 07:31:09.939806772 +0000 UTC m=+98.203788819 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d835e1ce-7985-432d-809d-d71b36a13093-cert") pod "ingress-canary-bg26p" (UID: "d835e1ce-7985-432d-809d-d71b36a13093") : secret "canary-serving-cert" not found Jun 02 07:30:38.040229 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:38.040179 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56bb33da-8c46-4433-8b45-f6fe098c4d25-metrics-certs\") pod \"network-metrics-daemon-rgk46\" (UID: \"56bb33da-8c46-4433-8b45-f6fe098c4d25\") " pod="openshift-multus/network-metrics-daemon-rgk46" Jun 02 07:30:38.042628 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:38.042608 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 07:30:38.051402 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:30:38.051373 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 02 07:30:38.051463 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:30:38.051437 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56bb33da-8c46-4433-8b45-f6fe098c4d25-metrics-certs podName:56bb33da-8c46-4433-8b45-f6fe098c4d25 nodeName:}" failed. No retries permitted until 2026-06-02 07:31:42.051421162 +0000 UTC m=+130.315403212 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/56bb33da-8c46-4433-8b45-f6fe098c4d25-metrics-certs") pod "network-metrics-daemon-rgk46" (UID: "56bb33da-8c46-4433-8b45-f6fe098c4d25") : secret "metrics-daemon-secret" not found Jun 02 07:30:38.141338 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:38.141310 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8m79x\" (UniqueName: \"kubernetes.io/projected/f60cac34-93f5-4439-b197-17a7283b4599-kube-api-access-8m79x\") pod \"network-check-target-wp2df\" (UID: \"f60cac34-93f5-4439-b197-17a7283b4599\") " pod="openshift-network-diagnostics/network-check-target-wp2df" Jun 02 07:30:38.144316 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:38.144301 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 07:30:38.154599 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:38.154585 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 07:30:38.165892 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:38.165870 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8m79x\" (UniqueName: \"kubernetes.io/projected/f60cac34-93f5-4439-b197-17a7283b4599-kube-api-access-8m79x\") pod \"network-check-target-wp2df\" (UID: \"f60cac34-93f5-4439-b197-17a7283b4599\") " pod="openshift-network-diagnostics/network-check-target-wp2df" Jun 02 07:30:38.195340 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:38.195268 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-85gjv\"" Jun 02 07:30:38.202890 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:38.202867 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wp2df" Jun 02 07:30:38.340907 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:38.340877 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wp2df"] Jun 02 07:30:38.343588 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:30:38.343561 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf60cac34_93f5_4439_b197_17a7283b4599.slice/crio-a1903f77c083c6f39e6f601a6f355af106e531f5734d3efa129e08c0f5b7ae18 WatchSource:0}: Error finding container a1903f77c083c6f39e6f601a6f355af106e531f5734d3efa129e08c0f5b7ae18: Status 404 returned error can't find the container with id a1903f77c083c6f39e6f601a6f355af106e531f5734d3efa129e08c0f5b7ae18 Jun 02 07:30:38.652608 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:38.652570 2580 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-fh28g"] Jun 02 07:30:38.655279 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:38.655264 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-fh28g" Jun 02 07:30:38.657693 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:38.657661 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-tgfxk\"" Jun 02 07:30:38.657693 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:38.657683 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 02 07:30:38.657868 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:38.657731 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 02 07:30:38.663341 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:38.663319 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-fh28g"] Jun 02 07:30:38.739682 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:38.739650 2580 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-cdswh"] Jun 02 07:30:38.741583 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:38.741562 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-cdswh" Jun 02 07:30:38.743933 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:38.743903 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 02 07:30:38.744045 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:38.743955 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 02 07:30:38.744101 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:38.744040 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-fkmb4\"" Jun 02 07:30:38.744101 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:38.744040 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 02 07:30:38.744181 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:38.744133 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 02 07:30:38.744423 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:38.744402 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmvnp\" (UniqueName: \"kubernetes.io/projected/8991f6ba-2f47-4e62-a524-a6181441c3b6-kube-api-access-wmvnp\") pod \"volume-data-source-validator-7598fd5bd-fh28g\" (UID: \"8991f6ba-2f47-4e62-a524-a6181441c3b6\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-fh28g" Jun 02 07:30:38.751895 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:38.751873 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-cdswh"] Jun 02 07:30:38.767036 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:38.767003 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wp2df" event={"ID":"f60cac34-93f5-4439-b197-17a7283b4599","Type":"ContainerStarted","Data":"a1903f77c083c6f39e6f601a6f355af106e531f5734d3efa129e08c0f5b7ae18"} Jun 02 07:30:38.841988 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:38.841958 2580 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-lngdw"] Jun 02 07:30:38.844001 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:38.843979 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-lngdw" Jun 02 07:30:38.845360 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:38.845340 2580 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5986fdf9f-6j9sv"] Jun 02 07:30:38.845468 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:38.845333 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8a4e587e-c21b-4884-ba83-60768b7b2bc0-serving-cert\") pod \"service-ca-operator-69877444c-cdswh\" (UID: \"8a4e587e-c21b-4884-ba83-60768b7b2bc0\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-cdswh" Jun 02 07:30:38.845539 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:38.845497 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8a4e587e-c21b-4884-ba83-60768b7b2bc0-config\") pod \"service-ca-operator-69877444c-cdswh\" (UID: \"8a4e587e-c21b-4884-ba83-60768b7b2bc0\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-cdswh" Jun 02 07:30:38.845539 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:38.845531 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zv8dg\" (UniqueName: \"kubernetes.io/projected/8a4e587e-c21b-4884-ba83-60768b7b2bc0-kube-api-access-zv8dg\") pod \"service-ca-operator-69877444c-cdswh\" (UID: \"8a4e587e-c21b-4884-ba83-60768b7b2bc0\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-cdswh" Jun 02 07:30:38.845637 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:38.845596 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wmvnp\" (UniqueName: \"kubernetes.io/projected/8991f6ba-2f47-4e62-a524-a6181441c3b6-kube-api-access-wmvnp\") pod \"volume-data-source-validator-7598fd5bd-fh28g\" (UID: \"8991f6ba-2f47-4e62-a524-a6181441c3b6\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-fh28g" Jun 02 07:30:38.846509 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:38.846489 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 02 07:30:38.846617 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:38.846513 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 02 07:30:38.846617 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:38.846495 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 02 07:30:38.846737 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:38.846672 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-jxpf6\"" Jun 02 07:30:38.846933 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:38.846917 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 02 07:30:38.847407 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:38.847390 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5986fdf9f-6j9sv" Jun 02 07:30:38.853507 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:38.853271 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 02 07:30:38.853507 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:38.853477 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 02 07:30:38.853786 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:38.853767 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-df5qd\"" Jun 02 07:30:38.854008 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:38.853934 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 02 07:30:38.854170 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:38.854151 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 02 07:30:38.861647 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:38.861625 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 02 07:30:38.865597 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:38.865575 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-lngdw"] Jun 02 07:30:38.873361 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:38.873334 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmvnp\" (UniqueName: \"kubernetes.io/projected/8991f6ba-2f47-4e62-a524-a6181441c3b6-kube-api-access-wmvnp\") pod \"volume-data-source-validator-7598fd5bd-fh28g\" (UID: \"8991f6ba-2f47-4e62-a524-a6181441c3b6\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-fh28g" Jun 02 07:30:38.884892 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:38.884858 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5986fdf9f-6j9sv"] Jun 02 07:30:38.946662 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:38.946579 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b17d2e19-f3da-4433-9d16-476e815d5389-ca-trust-extracted\") pod \"image-registry-5986fdf9f-6j9sv\" (UID: \"b17d2e19-f3da-4433-9d16-476e815d5389\") " pod="openshift-image-registry/image-registry-5986fdf9f-6j9sv" Jun 02 07:30:38.946662 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:38.946631 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b17d2e19-f3da-4433-9d16-476e815d5389-image-registry-private-configuration\") pod \"image-registry-5986fdf9f-6j9sv\" (UID: \"b17d2e19-f3da-4433-9d16-476e815d5389\") " pod="openshift-image-registry/image-registry-5986fdf9f-6j9sv" Jun 02 07:30:38.947103 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:38.946674 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cgml\" (UniqueName: \"kubernetes.io/projected/18c75b48-f630-4be5-9c30-58062558248d-kube-api-access-9cgml\") pod \"console-operator-86d7c6cc77-lngdw\" (UID: \"18c75b48-f630-4be5-9c30-58062558248d\") " pod="openshift-console-operator/console-operator-86d7c6cc77-lngdw" Jun 02 07:30:38.947103 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:38.946738 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/18c75b48-f630-4be5-9c30-58062558248d-serving-cert\") pod \"console-operator-86d7c6cc77-lngdw\" (UID: \"18c75b48-f630-4be5-9c30-58062558248d\") " pod="openshift-console-operator/console-operator-86d7c6cc77-lngdw" Jun 02 07:30:38.947103 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:38.946757 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b17d2e19-f3da-4433-9d16-476e815d5389-bound-sa-token\") pod \"image-registry-5986fdf9f-6j9sv\" (UID: \"b17d2e19-f3da-4433-9d16-476e815d5389\") " pod="openshift-image-registry/image-registry-5986fdf9f-6j9sv" Jun 02 07:30:38.947103 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:38.946803 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8a4e587e-c21b-4884-ba83-60768b7b2bc0-serving-cert\") pod \"service-ca-operator-69877444c-cdswh\" (UID: \"8a4e587e-c21b-4884-ba83-60768b7b2bc0\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-cdswh" Jun 02 07:30:38.947103 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:38.946834 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b17d2e19-f3da-4433-9d16-476e815d5389-registry-tls\") pod \"image-registry-5986fdf9f-6j9sv\" (UID: \"b17d2e19-f3da-4433-9d16-476e815d5389\") " pod="openshift-image-registry/image-registry-5986fdf9f-6j9sv" Jun 02 07:30:38.947103 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:38.946871 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8a4e587e-c21b-4884-ba83-60768b7b2bc0-config\") pod \"service-ca-operator-69877444c-cdswh\" (UID: \"8a4e587e-c21b-4884-ba83-60768b7b2bc0\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-cdswh" Jun 02 07:30:38.947103 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:38.946924 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zv8dg\" (UniqueName: \"kubernetes.io/projected/8a4e587e-c21b-4884-ba83-60768b7b2bc0-kube-api-access-zv8dg\") pod \"service-ca-operator-69877444c-cdswh\" (UID: \"8a4e587e-c21b-4884-ba83-60768b7b2bc0\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-cdswh" Jun 02 07:30:38.947103 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:38.946966 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2dbx\" (UniqueName: \"kubernetes.io/projected/b17d2e19-f3da-4433-9d16-476e815d5389-kube-api-access-g2dbx\") pod \"image-registry-5986fdf9f-6j9sv\" (UID: \"b17d2e19-f3da-4433-9d16-476e815d5389\") " pod="openshift-image-registry/image-registry-5986fdf9f-6j9sv" Jun 02 07:30:38.947103 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:38.947026 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b17d2e19-f3da-4433-9d16-476e815d5389-trusted-ca\") pod \"image-registry-5986fdf9f-6j9sv\" (UID: \"b17d2e19-f3da-4433-9d16-476e815d5389\") " pod="openshift-image-registry/image-registry-5986fdf9f-6j9sv" Jun 02 07:30:38.947103 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:38.947068 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b17d2e19-f3da-4433-9d16-476e815d5389-installation-pull-secrets\") pod \"image-registry-5986fdf9f-6j9sv\" (UID: \"b17d2e19-f3da-4433-9d16-476e815d5389\") " pod="openshift-image-registry/image-registry-5986fdf9f-6j9sv" Jun 02 07:30:38.947523 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:38.947134 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/18c75b48-f630-4be5-9c30-58062558248d-config\") pod \"console-operator-86d7c6cc77-lngdw\" (UID: \"18c75b48-f630-4be5-9c30-58062558248d\") " pod="openshift-console-operator/console-operator-86d7c6cc77-lngdw" Jun 02 07:30:38.947523 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:38.947185 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b17d2e19-f3da-4433-9d16-476e815d5389-registry-certificates\") pod \"image-registry-5986fdf9f-6j9sv\" (UID: \"b17d2e19-f3da-4433-9d16-476e815d5389\") " pod="openshift-image-registry/image-registry-5986fdf9f-6j9sv" Jun 02 07:30:38.947523 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:38.947241 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/18c75b48-f630-4be5-9c30-58062558248d-trusted-ca\") pod \"console-operator-86d7c6cc77-lngdw\" (UID: \"18c75b48-f630-4be5-9c30-58062558248d\") " pod="openshift-console-operator/console-operator-86d7c6cc77-lngdw" Jun 02 07:30:38.947523 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:38.947387 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8a4e587e-c21b-4884-ba83-60768b7b2bc0-config\") pod \"service-ca-operator-69877444c-cdswh\" (UID: \"8a4e587e-c21b-4884-ba83-60768b7b2bc0\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-cdswh" Jun 02 07:30:38.949645 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:38.949612 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8a4e587e-c21b-4884-ba83-60768b7b2bc0-serving-cert\") pod \"service-ca-operator-69877444c-cdswh\" (UID: \"8a4e587e-c21b-4884-ba83-60768b7b2bc0\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-cdswh" Jun 02 07:30:38.955948 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:38.955921 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zv8dg\" (UniqueName: \"kubernetes.io/projected/8a4e587e-c21b-4884-ba83-60768b7b2bc0-kube-api-access-zv8dg\") pod \"service-ca-operator-69877444c-cdswh\" (UID: \"8a4e587e-c21b-4884-ba83-60768b7b2bc0\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-cdswh" Jun 02 07:30:38.964811 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:38.964789 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-fh28g" Jun 02 07:30:39.047814 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:39.047760 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b17d2e19-f3da-4433-9d16-476e815d5389-registry-tls\") pod \"image-registry-5986fdf9f-6j9sv\" (UID: \"b17d2e19-f3da-4433-9d16-476e815d5389\") " pod="openshift-image-registry/image-registry-5986fdf9f-6j9sv" Jun 02 07:30:39.047946 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:39.047816 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g2dbx\" (UniqueName: \"kubernetes.io/projected/b17d2e19-f3da-4433-9d16-476e815d5389-kube-api-access-g2dbx\") pod \"image-registry-5986fdf9f-6j9sv\" (UID: \"b17d2e19-f3da-4433-9d16-476e815d5389\") " pod="openshift-image-registry/image-registry-5986fdf9f-6j9sv" Jun 02 07:30:39.047946 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:39.047861 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b17d2e19-f3da-4433-9d16-476e815d5389-trusted-ca\") pod \"image-registry-5986fdf9f-6j9sv\" (UID: \"b17d2e19-f3da-4433-9d16-476e815d5389\") " pod="openshift-image-registry/image-registry-5986fdf9f-6j9sv" Jun 02 07:30:39.047946 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:39.047896 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b17d2e19-f3da-4433-9d16-476e815d5389-installation-pull-secrets\") pod \"image-registry-5986fdf9f-6j9sv\" (UID: \"b17d2e19-f3da-4433-9d16-476e815d5389\") " pod="openshift-image-registry/image-registry-5986fdf9f-6j9sv" Jun 02 07:30:39.047946 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:39.047923 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/18c75b48-f630-4be5-9c30-58062558248d-config\") pod \"console-operator-86d7c6cc77-lngdw\" (UID: \"18c75b48-f630-4be5-9c30-58062558248d\") " pod="openshift-console-operator/console-operator-86d7c6cc77-lngdw" Jun 02 07:30:39.048147 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:39.047953 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b17d2e19-f3da-4433-9d16-476e815d5389-registry-certificates\") pod \"image-registry-5986fdf9f-6j9sv\" (UID: \"b17d2e19-f3da-4433-9d16-476e815d5389\") " pod="openshift-image-registry/image-registry-5986fdf9f-6j9sv" Jun 02 07:30:39.048147 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:39.047977 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/18c75b48-f630-4be5-9c30-58062558248d-trusted-ca\") pod \"console-operator-86d7c6cc77-lngdw\" (UID: \"18c75b48-f630-4be5-9c30-58062558248d\") " pod="openshift-console-operator/console-operator-86d7c6cc77-lngdw" Jun 02 07:30:39.048147 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:39.048009 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b17d2e19-f3da-4433-9d16-476e815d5389-ca-trust-extracted\") pod \"image-registry-5986fdf9f-6j9sv\" (UID: \"b17d2e19-f3da-4433-9d16-476e815d5389\") " pod="openshift-image-registry/image-registry-5986fdf9f-6j9sv" Jun 02 07:30:39.048147 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:39.048039 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b17d2e19-f3da-4433-9d16-476e815d5389-image-registry-private-configuration\") pod \"image-registry-5986fdf9f-6j9sv\" (UID: \"b17d2e19-f3da-4433-9d16-476e815d5389\") " pod="openshift-image-registry/image-registry-5986fdf9f-6j9sv" Jun 02 07:30:39.048147 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:39.048065 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9cgml\" (UniqueName: \"kubernetes.io/projected/18c75b48-f630-4be5-9c30-58062558248d-kube-api-access-9cgml\") pod \"console-operator-86d7c6cc77-lngdw\" (UID: \"18c75b48-f630-4be5-9c30-58062558248d\") " pod="openshift-console-operator/console-operator-86d7c6cc77-lngdw" Jun 02 07:30:39.048147 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:39.048093 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/18c75b48-f630-4be5-9c30-58062558248d-serving-cert\") pod \"console-operator-86d7c6cc77-lngdw\" (UID: \"18c75b48-f630-4be5-9c30-58062558248d\") " pod="openshift-console-operator/console-operator-86d7c6cc77-lngdw" Jun 02 07:30:39.048147 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:39.048122 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b17d2e19-f3da-4433-9d16-476e815d5389-bound-sa-token\") pod \"image-registry-5986fdf9f-6j9sv\" (UID: \"b17d2e19-f3da-4433-9d16-476e815d5389\") " pod="openshift-image-registry/image-registry-5986fdf9f-6j9sv" Jun 02 07:30:39.049261 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:39.048844 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/18c75b48-f630-4be5-9c30-58062558248d-config\") pod \"console-operator-86d7c6cc77-lngdw\" (UID: \"18c75b48-f630-4be5-9c30-58062558248d\") " pod="openshift-console-operator/console-operator-86d7c6cc77-lngdw" Jun 02 07:30:39.049261 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:30:39.048870 2580 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 07:30:39.049261 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:30:39.048891 2580 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5986fdf9f-6j9sv: secret "image-registry-tls" not found Jun 02 07:30:39.049261 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:30:39.048952 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b17d2e19-f3da-4433-9d16-476e815d5389-registry-tls podName:b17d2e19-f3da-4433-9d16-476e815d5389 nodeName:}" failed. No retries permitted until 2026-06-02 07:30:39.548931528 +0000 UTC m=+67.812913592 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b17d2e19-f3da-4433-9d16-476e815d5389-registry-tls") pod "image-registry-5986fdf9f-6j9sv" (UID: "b17d2e19-f3da-4433-9d16-476e815d5389") : secret "image-registry-tls" not found Jun 02 07:30:39.049261 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:39.049114 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/18c75b48-f630-4be5-9c30-58062558248d-trusted-ca\") pod \"console-operator-86d7c6cc77-lngdw\" (UID: \"18c75b48-f630-4be5-9c30-58062558248d\") " pod="openshift-console-operator/console-operator-86d7c6cc77-lngdw" Jun 02 07:30:39.049261 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:39.049255 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b17d2e19-f3da-4433-9d16-476e815d5389-registry-certificates\") pod \"image-registry-5986fdf9f-6j9sv\" (UID: \"b17d2e19-f3da-4433-9d16-476e815d5389\") " pod="openshift-image-registry/image-registry-5986fdf9f-6j9sv" Jun 02 07:30:39.049636 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:39.049272 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b17d2e19-f3da-4433-9d16-476e815d5389-ca-trust-extracted\") pod \"image-registry-5986fdf9f-6j9sv\" (UID: \"b17d2e19-f3da-4433-9d16-476e815d5389\") " pod="openshift-image-registry/image-registry-5986fdf9f-6j9sv" Jun 02 07:30:39.050322 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:39.050276 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b17d2e19-f3da-4433-9d16-476e815d5389-trusted-ca\") pod \"image-registry-5986fdf9f-6j9sv\" (UID: \"b17d2e19-f3da-4433-9d16-476e815d5389\") " pod="openshift-image-registry/image-registry-5986fdf9f-6j9sv" Jun 02 07:30:39.052640 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:39.052384 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-cdswh" Jun 02 07:30:39.052640 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:39.052457 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b17d2e19-f3da-4433-9d16-476e815d5389-image-registry-private-configuration\") pod \"image-registry-5986fdf9f-6j9sv\" (UID: \"b17d2e19-f3da-4433-9d16-476e815d5389\") " pod="openshift-image-registry/image-registry-5986fdf9f-6j9sv" Jun 02 07:30:39.052845 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:39.052824 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/18c75b48-f630-4be5-9c30-58062558248d-serving-cert\") pod \"console-operator-86d7c6cc77-lngdw\" (UID: \"18c75b48-f630-4be5-9c30-58062558248d\") " pod="openshift-console-operator/console-operator-86d7c6cc77-lngdw" Jun 02 07:30:39.055089 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:39.055005 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b17d2e19-f3da-4433-9d16-476e815d5389-installation-pull-secrets\") pod \"image-registry-5986fdf9f-6j9sv\" (UID: \"b17d2e19-f3da-4433-9d16-476e815d5389\") " pod="openshift-image-registry/image-registry-5986fdf9f-6j9sv" Jun 02 07:30:39.057632 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:39.057161 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cgml\" (UniqueName: \"kubernetes.io/projected/18c75b48-f630-4be5-9c30-58062558248d-kube-api-access-9cgml\") pod \"console-operator-86d7c6cc77-lngdw\" (UID: \"18c75b48-f630-4be5-9c30-58062558248d\") " pod="openshift-console-operator/console-operator-86d7c6cc77-lngdw" Jun 02 07:30:39.062126 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:39.062073 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b17d2e19-f3da-4433-9d16-476e815d5389-bound-sa-token\") pod \"image-registry-5986fdf9f-6j9sv\" (UID: \"b17d2e19-f3da-4433-9d16-476e815d5389\") " pod="openshift-image-registry/image-registry-5986fdf9f-6j9sv" Jun 02 07:30:39.062919 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:39.062737 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2dbx\" (UniqueName: \"kubernetes.io/projected/b17d2e19-f3da-4433-9d16-476e815d5389-kube-api-access-g2dbx\") pod \"image-registry-5986fdf9f-6j9sv\" (UID: \"b17d2e19-f3da-4433-9d16-476e815d5389\") " pod="openshift-image-registry/image-registry-5986fdf9f-6j9sv" Jun 02 07:30:39.098296 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:39.098249 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-fh28g"] Jun 02 07:30:39.156728 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:39.156682 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-lngdw" Jun 02 07:30:39.199050 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:39.198983 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-cdswh"] Jun 02 07:30:39.202645 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:30:39.202609 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a4e587e_c21b_4884_ba83_60768b7b2bc0.slice/crio-3c6924b27f32e91f094c03aad652131f3c0e62e06931d77b58f9c29f419d5367 WatchSource:0}: Error finding container 3c6924b27f32e91f094c03aad652131f3c0e62e06931d77b58f9c29f419d5367: Status 404 returned error can't find the container with id 3c6924b27f32e91f094c03aad652131f3c0e62e06931d77b58f9c29f419d5367 Jun 02 07:30:39.296203 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:39.296172 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-lngdw"] Jun 02 07:30:39.299929 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:30:39.299900 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18c75b48_f630_4be5_9c30_58062558248d.slice/crio-bc49c40d37686282c9a4839e1016d8668b530cc4f14e176f01a237344dd2bc6a WatchSource:0}: Error finding container bc49c40d37686282c9a4839e1016d8668b530cc4f14e176f01a237344dd2bc6a: Status 404 returned error can't find the container with id bc49c40d37686282c9a4839e1016d8668b530cc4f14e176f01a237344dd2bc6a Jun 02 07:30:39.552946 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:39.552852 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b17d2e19-f3da-4433-9d16-476e815d5389-registry-tls\") pod \"image-registry-5986fdf9f-6j9sv\" (UID: \"b17d2e19-f3da-4433-9d16-476e815d5389\") " pod="openshift-image-registry/image-registry-5986fdf9f-6j9sv" Jun 02 07:30:39.553111 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:30:39.553031 2580 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 07:30:39.553111 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:30:39.553052 2580 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5986fdf9f-6j9sv: secret "image-registry-tls" not found Jun 02 07:30:39.553244 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:30:39.553122 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b17d2e19-f3da-4433-9d16-476e815d5389-registry-tls podName:b17d2e19-f3da-4433-9d16-476e815d5389 nodeName:}" failed. No retries permitted until 2026-06-02 07:30:40.55310058 +0000 UTC m=+68.817082626 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b17d2e19-f3da-4433-9d16-476e815d5389-registry-tls") pod "image-registry-5986fdf9f-6j9sv" (UID: "b17d2e19-f3da-4433-9d16-476e815d5389") : secret "image-registry-tls" not found Jun 02 07:30:39.771165 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:39.771127 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-cdswh" event={"ID":"8a4e587e-c21b-4884-ba83-60768b7b2bc0","Type":"ContainerStarted","Data":"3c6924b27f32e91f094c03aad652131f3c0e62e06931d77b58f9c29f419d5367"} Jun 02 07:30:39.772455 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:39.772422 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-lngdw" event={"ID":"18c75b48-f630-4be5-9c30-58062558248d","Type":"ContainerStarted","Data":"bc49c40d37686282c9a4839e1016d8668b530cc4f14e176f01a237344dd2bc6a"} Jun 02 07:30:39.774080 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:39.774053 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-fh28g" event={"ID":"8991f6ba-2f47-4e62-a524-a6181441c3b6","Type":"ContainerStarted","Data":"b30eb6f71d7888e2ac20d3d70c56922b3af30fdb913205404ea0a4f742779a05"} Jun 02 07:30:40.561889 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:40.561841 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b17d2e19-f3da-4433-9d16-476e815d5389-registry-tls\") pod \"image-registry-5986fdf9f-6j9sv\" (UID: \"b17d2e19-f3da-4433-9d16-476e815d5389\") " pod="openshift-image-registry/image-registry-5986fdf9f-6j9sv" Jun 02 07:30:40.562352 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:30:40.562019 2580 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 07:30:40.562352 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:30:40.562044 2580 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5986fdf9f-6j9sv: secret "image-registry-tls" not found Jun 02 07:30:40.562352 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:30:40.562115 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b17d2e19-f3da-4433-9d16-476e815d5389-registry-tls podName:b17d2e19-f3da-4433-9d16-476e815d5389 nodeName:}" failed. No retries permitted until 2026-06-02 07:30:42.562094311 +0000 UTC m=+70.826076373 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b17d2e19-f3da-4433-9d16-476e815d5389-registry-tls") pod "image-registry-5986fdf9f-6j9sv" (UID: "b17d2e19-f3da-4433-9d16-476e815d5389") : secret "image-registry-tls" not found Jun 02 07:30:42.580096 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:42.580048 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b17d2e19-f3da-4433-9d16-476e815d5389-registry-tls\") pod \"image-registry-5986fdf9f-6j9sv\" (UID: \"b17d2e19-f3da-4433-9d16-476e815d5389\") " pod="openshift-image-registry/image-registry-5986fdf9f-6j9sv" Jun 02 07:30:42.580513 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:30:42.580206 2580 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 07:30:42.580513 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:30:42.580246 2580 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5986fdf9f-6j9sv: secret "image-registry-tls" not found Jun 02 07:30:42.580513 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:30:42.580313 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b17d2e19-f3da-4433-9d16-476e815d5389-registry-tls podName:b17d2e19-f3da-4433-9d16-476e815d5389 nodeName:}" failed. No retries permitted until 2026-06-02 07:30:46.580292619 +0000 UTC m=+74.844274685 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b17d2e19-f3da-4433-9d16-476e815d5389-registry-tls") pod "image-registry-5986fdf9f-6j9sv" (UID: "b17d2e19-f3da-4433-9d16-476e815d5389") : secret "image-registry-tls" not found Jun 02 07:30:42.782159 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:42.782123 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wp2df" event={"ID":"f60cac34-93f5-4439-b197-17a7283b4599","Type":"ContainerStarted","Data":"fe1173536aae81709aec2685657ddf099065791cba9cd07f32db5ec3915394dc"} Jun 02 07:30:42.782342 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:42.782208 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-wp2df" Jun 02 07:30:42.783558 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:42.783535 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-cdswh" event={"ID":"8a4e587e-c21b-4884-ba83-60768b7b2bc0","Type":"ContainerStarted","Data":"4712f4f83424d355008a1251b96b33e72dc0121e9683976ec2ff9e2227a41a30"} Jun 02 07:30:42.784956 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:42.784940 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-lngdw_18c75b48-f630-4be5-9c30-58062558248d/console-operator/0.log" Jun 02 07:30:42.785026 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:42.784975 2580 generic.go:358] "Generic (PLEG): container finished" podID="18c75b48-f630-4be5-9c30-58062558248d" containerID="e8e314f5990931a6bb6cced2913fad4feb620544ca50005bcbfacbb81e34fe13" exitCode=255 Jun 02 07:30:42.785026 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:42.785001 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-lngdw" event={"ID":"18c75b48-f630-4be5-9c30-58062558248d","Type":"ContainerDied","Data":"e8e314f5990931a6bb6cced2913fad4feb620544ca50005bcbfacbb81e34fe13"} Jun 02 07:30:42.785241 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:42.785205 2580 scope.go:117] "RemoveContainer" containerID="e8e314f5990931a6bb6cced2913fad4feb620544ca50005bcbfacbb81e34fe13" Jun 02 07:30:42.786578 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:42.786560 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-fh28g" event={"ID":"8991f6ba-2f47-4e62-a524-a6181441c3b6","Type":"ContainerStarted","Data":"7457b8866cffe53eeac6f5796b91739b6b2a67d990894014f8c79094e1a1bcda"} Jun 02 07:30:42.809415 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:42.809379 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-wp2df" podStartSLOduration=66.569432783 podStartE2EDuration="1m10.809367975s" podCreationTimestamp="2026-06-02 07:29:32 +0000 UTC" firstStartedPulling="2026-06-02 07:30:38.345769199 +0000 UTC m=+66.609751246" lastFinishedPulling="2026-06-02 07:30:42.585704394 +0000 UTC m=+70.849686438" observedRunningTime="2026-06-02 07:30:42.809079613 +0000 UTC m=+71.073061679" watchObservedRunningTime="2026-06-02 07:30:42.809367975 +0000 UTC m=+71.073350041" Jun 02 07:30:42.823493 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:42.823447 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-69877444c-cdswh" podStartSLOduration=1.425946396 podStartE2EDuration="4.823435498s" podCreationTimestamp="2026-06-02 07:30:38 +0000 UTC" firstStartedPulling="2026-06-02 07:30:39.204794157 +0000 UTC m=+67.468776214" lastFinishedPulling="2026-06-02 07:30:42.602283268 +0000 UTC m=+70.866265316" observedRunningTime="2026-06-02 07:30:42.82330601 +0000 UTC m=+71.087288078" watchObservedRunningTime="2026-06-02 07:30:42.823435498 +0000 UTC m=+71.087417564" Jun 02 07:30:42.837544 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:42.837495 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-fh28g" podStartSLOduration=1.354744804 podStartE2EDuration="4.837476137s" podCreationTimestamp="2026-06-02 07:30:38 +0000 UTC" firstStartedPulling="2026-06-02 07:30:39.105735424 +0000 UTC m=+67.369717470" lastFinishedPulling="2026-06-02 07:30:42.588466757 +0000 UTC m=+70.852448803" observedRunningTime="2026-06-02 07:30:42.836314967 +0000 UTC m=+71.100297032" watchObservedRunningTime="2026-06-02 07:30:42.837476137 +0000 UTC m=+71.101458205" Jun 02 07:30:43.790515 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:43.790487 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-lngdw_18c75b48-f630-4be5-9c30-58062558248d/console-operator/1.log" Jun 02 07:30:43.790940 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:43.790808 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-lngdw_18c75b48-f630-4be5-9c30-58062558248d/console-operator/0.log" Jun 02 07:30:43.790940 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:43.790839 2580 generic.go:358] "Generic (PLEG): container finished" podID="18c75b48-f630-4be5-9c30-58062558248d" containerID="23be3e5190d6a10fec0399b6f33c3aa3719397152e7c0391d7eb84e05c889895" exitCode=255 Jun 02 07:30:43.790940 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:43.790876 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-lngdw" event={"ID":"18c75b48-f630-4be5-9c30-58062558248d","Type":"ContainerDied","Data":"23be3e5190d6a10fec0399b6f33c3aa3719397152e7c0391d7eb84e05c889895"} Jun 02 07:30:43.790940 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:43.790924 2580 scope.go:117] "RemoveContainer" containerID="e8e314f5990931a6bb6cced2913fad4feb620544ca50005bcbfacbb81e34fe13" Jun 02 07:30:43.791237 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:43.791138 2580 scope.go:117] "RemoveContainer" containerID="23be3e5190d6a10fec0399b6f33c3aa3719397152e7c0391d7eb84e05c889895" Jun 02 07:30:43.791380 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:30:43.791362 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-lngdw_openshift-console-operator(18c75b48-f630-4be5-9c30-58062558248d)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-lngdw" podUID="18c75b48-f630-4be5-9c30-58062558248d" Jun 02 07:30:44.794946 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:44.794918 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-lngdw_18c75b48-f630-4be5-9c30-58062558248d/console-operator/1.log" Jun 02 07:30:44.795351 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:44.795276 2580 scope.go:117] "RemoveContainer" containerID="23be3e5190d6a10fec0399b6f33c3aa3719397152e7c0391d7eb84e05c889895" Jun 02 07:30:44.795464 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:30:44.795447 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-lngdw_openshift-console-operator(18c75b48-f630-4be5-9c30-58062558248d)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-lngdw" podUID="18c75b48-f630-4be5-9c30-58062558248d" Jun 02 07:30:45.804207 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:45.804181 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2krhv_a731c005-ed09-4135-9776-d885682e8200/dns-node-resolver/0.log" Jun 02 07:30:46.281773 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:46.281738 2580 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-685df94d57-fj22f"] Jun 02 07:30:46.287751 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:46.287733 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-685df94d57-fj22f" Jun 02 07:30:46.290061 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:46.290043 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 02 07:30:46.290299 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:46.290283 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 02 07:30:46.290365 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:46.290322 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 02 07:30:46.290936 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:46.290914 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 02 07:30:46.291061 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:46.291047 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-9j9fx\"" Jun 02 07:30:46.294021 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:46.293899 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-685df94d57-fj22f"] Jun 02 07:30:46.412026 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:46.411994 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/39618d7f-d8f7-4b24-b8ed-6db29cab47fb-signing-cabundle\") pod \"service-ca-685df94d57-fj22f\" (UID: \"39618d7f-d8f7-4b24-b8ed-6db29cab47fb\") " pod="openshift-service-ca/service-ca-685df94d57-fj22f" Jun 02 07:30:46.412026 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:46.412026 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjwdm\" (UniqueName: \"kubernetes.io/projected/39618d7f-d8f7-4b24-b8ed-6db29cab47fb-kube-api-access-fjwdm\") pod \"service-ca-685df94d57-fj22f\" (UID: \"39618d7f-d8f7-4b24-b8ed-6db29cab47fb\") " pod="openshift-service-ca/service-ca-685df94d57-fj22f" Jun 02 07:30:46.412258 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:46.412084 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/39618d7f-d8f7-4b24-b8ed-6db29cab47fb-signing-key\") pod \"service-ca-685df94d57-fj22f\" (UID: \"39618d7f-d8f7-4b24-b8ed-6db29cab47fb\") " pod="openshift-service-ca/service-ca-685df94d57-fj22f" Jun 02 07:30:46.513408 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:46.513369 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/39618d7f-d8f7-4b24-b8ed-6db29cab47fb-signing-cabundle\") pod \"service-ca-685df94d57-fj22f\" (UID: \"39618d7f-d8f7-4b24-b8ed-6db29cab47fb\") " pod="openshift-service-ca/service-ca-685df94d57-fj22f" Jun 02 07:30:46.513408 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:46.513412 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fjwdm\" (UniqueName: \"kubernetes.io/projected/39618d7f-d8f7-4b24-b8ed-6db29cab47fb-kube-api-access-fjwdm\") pod \"service-ca-685df94d57-fj22f\" (UID: \"39618d7f-d8f7-4b24-b8ed-6db29cab47fb\") " pod="openshift-service-ca/service-ca-685df94d57-fj22f" Jun 02 07:30:46.513654 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:46.513485 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/39618d7f-d8f7-4b24-b8ed-6db29cab47fb-signing-key\") pod \"service-ca-685df94d57-fj22f\" (UID: \"39618d7f-d8f7-4b24-b8ed-6db29cab47fb\") " pod="openshift-service-ca/service-ca-685df94d57-fj22f" Jun 02 07:30:46.514026 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:46.514004 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/39618d7f-d8f7-4b24-b8ed-6db29cab47fb-signing-cabundle\") pod \"service-ca-685df94d57-fj22f\" (UID: \"39618d7f-d8f7-4b24-b8ed-6db29cab47fb\") " pod="openshift-service-ca/service-ca-685df94d57-fj22f" Jun 02 07:30:46.516027 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:46.516005 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/39618d7f-d8f7-4b24-b8ed-6db29cab47fb-signing-key\") pod \"service-ca-685df94d57-fj22f\" (UID: \"39618d7f-d8f7-4b24-b8ed-6db29cab47fb\") " pod="openshift-service-ca/service-ca-685df94d57-fj22f" Jun 02 07:30:46.521446 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:46.521422 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjwdm\" (UniqueName: \"kubernetes.io/projected/39618d7f-d8f7-4b24-b8ed-6db29cab47fb-kube-api-access-fjwdm\") pod \"service-ca-685df94d57-fj22f\" (UID: \"39618d7f-d8f7-4b24-b8ed-6db29cab47fb\") " pod="openshift-service-ca/service-ca-685df94d57-fj22f" Jun 02 07:30:46.596855 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:46.596775 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-685df94d57-fj22f" Jun 02 07:30:46.614715 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:46.614684 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b17d2e19-f3da-4433-9d16-476e815d5389-registry-tls\") pod \"image-registry-5986fdf9f-6j9sv\" (UID: \"b17d2e19-f3da-4433-9d16-476e815d5389\") " pod="openshift-image-registry/image-registry-5986fdf9f-6j9sv" Jun 02 07:30:46.614830 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:30:46.614814 2580 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 07:30:46.614830 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:30:46.614826 2580 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5986fdf9f-6j9sv: secret "image-registry-tls" not found Jun 02 07:30:46.614952 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:30:46.614875 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b17d2e19-f3da-4433-9d16-476e815d5389-registry-tls podName:b17d2e19-f3da-4433-9d16-476e815d5389 nodeName:}" failed. No retries permitted until 2026-06-02 07:30:54.614861518 +0000 UTC m=+82.878843562 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b17d2e19-f3da-4433-9d16-476e815d5389-registry-tls") pod "image-registry-5986fdf9f-6j9sv" (UID: "b17d2e19-f3da-4433-9d16-476e815d5389") : secret "image-registry-tls" not found Jun 02 07:30:46.712926 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:46.712892 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-685df94d57-fj22f"] Jun 02 07:30:46.715631 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:30:46.715600 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39618d7f_d8f7_4b24_b8ed_6db29cab47fb.slice/crio-0f45744d1d32e799302b81413a9720ec29340e4559786886a723f68e6c473507 WatchSource:0}: Error finding container 0f45744d1d32e799302b81413a9720ec29340e4559786886a723f68e6c473507: Status 404 returned error can't find the container with id 0f45744d1d32e799302b81413a9720ec29340e4559786886a723f68e6c473507 Jun 02 07:30:46.803475 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:46.803447 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-685df94d57-fj22f" event={"ID":"39618d7f-d8f7-4b24-b8ed-6db29cab47fb","Type":"ContainerStarted","Data":"fd8321bad6f44f21cd8e328d86af0d5c3a5a1d5aa57747bb045301dbc596ef0c"} Jun 02 07:30:46.803583 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:46.803486 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-685df94d57-fj22f" event={"ID":"39618d7f-d8f7-4b24-b8ed-6db29cab47fb","Type":"ContainerStarted","Data":"0f45744d1d32e799302b81413a9720ec29340e4559786886a723f68e6c473507"} Jun 02 07:30:46.804628 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:46.804606 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9bbts_8479fba7-d0c6-4c26-82cd-44cff52ef948/node-ca/0.log" Jun 02 07:30:47.824750 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:47.824695 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-685df94d57-fj22f" podStartSLOduration=1.8246776630000001 podStartE2EDuration="1.824677663s" podCreationTimestamp="2026-06-02 07:30:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 07:30:47.823273182 +0000 UTC m=+76.087255243" watchObservedRunningTime="2026-06-02 07:30:47.824677663 +0000 UTC m=+76.088659730" Jun 02 07:30:49.158017 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:49.157897 2580 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-86d7c6cc77-lngdw" Jun 02 07:30:49.158017 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:49.157941 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-lngdw" Jun 02 07:30:49.158514 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:49.158361 2580 scope.go:117] "RemoveContainer" containerID="23be3e5190d6a10fec0399b6f33c3aa3719397152e7c0391d7eb84e05c889895" Jun 02 07:30:49.158550 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:30:49.158520 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-lngdw_openshift-console-operator(18c75b48-f630-4be5-9c30-58062558248d)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-lngdw" podUID="18c75b48-f630-4be5-9c30-58062558248d" Jun 02 07:30:54.679024 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:54.678985 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b17d2e19-f3da-4433-9d16-476e815d5389-registry-tls\") pod \"image-registry-5986fdf9f-6j9sv\" (UID: \"b17d2e19-f3da-4433-9d16-476e815d5389\") " pod="openshift-image-registry/image-registry-5986fdf9f-6j9sv" Jun 02 07:30:54.681547 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:54.681517 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b17d2e19-f3da-4433-9d16-476e815d5389-registry-tls\") pod \"image-registry-5986fdf9f-6j9sv\" (UID: \"b17d2e19-f3da-4433-9d16-476e815d5389\") " pod="openshift-image-registry/image-registry-5986fdf9f-6j9sv" Jun 02 07:30:54.763146 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:54.763108 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5986fdf9f-6j9sv" Jun 02 07:30:54.887152 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:54.887125 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5986fdf9f-6j9sv"] Jun 02 07:30:54.890606 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:30:54.890578 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb17d2e19_f3da_4433_9d16_476e815d5389.slice/crio-795753fe496bdbfc53ba7534a1f9298ac448216ff78e80c8fbe583955e0561ff WatchSource:0}: Error finding container 795753fe496bdbfc53ba7534a1f9298ac448216ff78e80c8fbe583955e0561ff: Status 404 returned error can't find the container with id 795753fe496bdbfc53ba7534a1f9298ac448216ff78e80c8fbe583955e0561ff Jun 02 07:30:55.826399 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:55.826364 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5986fdf9f-6j9sv" event={"ID":"b17d2e19-f3da-4433-9d16-476e815d5389","Type":"ContainerStarted","Data":"8234b90abde8a16c395c6cbcc95b0040b57bf28eb8eb11d316e16f72f3ffe0cc"} Jun 02 07:30:55.826399 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:55.826399 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5986fdf9f-6j9sv" event={"ID":"b17d2e19-f3da-4433-9d16-476e815d5389","Type":"ContainerStarted","Data":"795753fe496bdbfc53ba7534a1f9298ac448216ff78e80c8fbe583955e0561ff"} Jun 02 07:30:55.826883 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:55.826487 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5986fdf9f-6j9sv" Jun 02 07:30:55.844344 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:30:55.844297 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5986fdf9f-6j9sv" podStartSLOduration=17.844279638 podStartE2EDuration="17.844279638s" podCreationTimestamp="2026-06-02 07:30:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 07:30:55.843384881 +0000 UTC m=+84.107366947" watchObservedRunningTime="2026-06-02 07:30:55.844279638 +0000 UTC m=+84.108261704" Jun 02 07:31:04.375294 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:04.375258 2580 scope.go:117] "RemoveContainer" containerID="23be3e5190d6a10fec0399b6f33c3aa3719397152e7c0391d7eb84e05c889895" Jun 02 07:31:04.849884 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:04.849803 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-lngdw_18c75b48-f630-4be5-9c30-58062558248d/console-operator/1.log" Jun 02 07:31:04.850035 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:04.849894 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-lngdw" event={"ID":"18c75b48-f630-4be5-9c30-58062558248d","Type":"ContainerStarted","Data":"de46e58c218cd4a33bff340e884b4b48a30c9b1dc564680526ea6abcf7fb5360"} Jun 02 07:31:04.850200 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:04.850177 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-lngdw" Jun 02 07:31:04.864232 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:04.864191 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-86d7c6cc77-lngdw" Jun 02 07:31:04.866507 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:04.866462 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-86d7c6cc77-lngdw" podStartSLOduration=23.560260323 podStartE2EDuration="26.86644904s" podCreationTimestamp="2026-06-02 07:30:38 +0000 UTC" firstStartedPulling="2026-06-02 07:30:39.302234889 +0000 UTC m=+67.566216947" lastFinishedPulling="2026-06-02 07:30:42.608423607 +0000 UTC m=+70.872405664" observedRunningTime="2026-06-02 07:31:04.865684313 +0000 UTC m=+93.129666380" watchObservedRunningTime="2026-06-02 07:31:04.86644904 +0000 UTC m=+93.130431105" Jun 02 07:31:06.845820 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:06.845786 2580 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-shg9w"] Jun 02 07:31:06.847720 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:06.847705 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-shg9w" Jun 02 07:31:06.850938 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:06.850916 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-hfsjv\"" Jun 02 07:31:06.851058 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:06.850947 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 02 07:31:06.851058 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:06.850961 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 02 07:31:06.859944 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:06.859923 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-shg9w"] Jun 02 07:31:06.874328 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:06.874298 2580 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-2tpsl"] Jun 02 07:31:06.876279 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:06.876262 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2tpsl" Jun 02 07:31:06.878768 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:06.878751 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 02 07:31:06.878904 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:06.878886 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-h9rdv\"" Jun 02 07:31:06.879061 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:06.879040 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 02 07:31:06.879166 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:06.879151 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 02 07:31:06.879253 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:06.879188 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 02 07:31:06.894755 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:06.894731 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2tpsl"] Jun 02 07:31:06.943729 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:06.943702 2580 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5986fdf9f-6j9sv"] Jun 02 07:31:06.974858 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:06.974827 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d8cace1c-1788-4d1d-8441-80c601fe9360-crio-socket\") pod \"insights-runtime-extractor-2tpsl\" (UID: \"d8cace1c-1788-4d1d-8441-80c601fe9360\") " pod="openshift-insights/insights-runtime-extractor-2tpsl" Jun 02 07:31:06.974858 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:06.974862 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d8cace1c-1788-4d1d-8441-80c601fe9360-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2tpsl\" (UID: \"d8cace1c-1788-4d1d-8441-80c601fe9360\") " pod="openshift-insights/insights-runtime-extractor-2tpsl" Jun 02 07:31:06.975049 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:06.974902 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5b038526-eebb-4b2b-996d-48949bb3a852-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-shg9w\" (UID: \"5b038526-eebb-4b2b-996d-48949bb3a852\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-shg9w" Jun 02 07:31:06.975049 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:06.974935 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-942rv\" (UniqueName: \"kubernetes.io/projected/d8cace1c-1788-4d1d-8441-80c601fe9360-kube-api-access-942rv\") pod \"insights-runtime-extractor-2tpsl\" (UID: \"d8cace1c-1788-4d1d-8441-80c601fe9360\") " pod="openshift-insights/insights-runtime-extractor-2tpsl" Jun 02 07:31:06.975049 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:06.975039 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5b038526-eebb-4b2b-996d-48949bb3a852-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-shg9w\" (UID: \"5b038526-eebb-4b2b-996d-48949bb3a852\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-shg9w" Jun 02 07:31:06.975199 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:06.975095 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d8cace1c-1788-4d1d-8441-80c601fe9360-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2tpsl\" (UID: \"d8cace1c-1788-4d1d-8441-80c601fe9360\") " pod="openshift-insights/insights-runtime-extractor-2tpsl" Jun 02 07:31:06.975199 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:06.975149 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d8cace1c-1788-4d1d-8441-80c601fe9360-data-volume\") pod \"insights-runtime-extractor-2tpsl\" (UID: \"d8cace1c-1788-4d1d-8441-80c601fe9360\") " pod="openshift-insights/insights-runtime-extractor-2tpsl" Jun 02 07:31:07.075876 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:07.075842 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d8cace1c-1788-4d1d-8441-80c601fe9360-crio-socket\") pod \"insights-runtime-extractor-2tpsl\" (UID: \"d8cace1c-1788-4d1d-8441-80c601fe9360\") " pod="openshift-insights/insights-runtime-extractor-2tpsl" Jun 02 07:31:07.075876 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:07.075878 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d8cace1c-1788-4d1d-8441-80c601fe9360-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2tpsl\" (UID: \"d8cace1c-1788-4d1d-8441-80c601fe9360\") " pod="openshift-insights/insights-runtime-extractor-2tpsl" Jun 02 07:31:07.076108 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:07.075915 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5b038526-eebb-4b2b-996d-48949bb3a852-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-shg9w\" (UID: \"5b038526-eebb-4b2b-996d-48949bb3a852\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-shg9w" Jun 02 07:31:07.076108 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:07.075943 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-942rv\" (UniqueName: \"kubernetes.io/projected/d8cace1c-1788-4d1d-8441-80c601fe9360-kube-api-access-942rv\") pod \"insights-runtime-extractor-2tpsl\" (UID: \"d8cace1c-1788-4d1d-8441-80c601fe9360\") " pod="openshift-insights/insights-runtime-extractor-2tpsl" Jun 02 07:31:07.076108 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:07.075965 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d8cace1c-1788-4d1d-8441-80c601fe9360-crio-socket\") pod \"insights-runtime-extractor-2tpsl\" (UID: \"d8cace1c-1788-4d1d-8441-80c601fe9360\") " pod="openshift-insights/insights-runtime-extractor-2tpsl" Jun 02 07:31:07.076108 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:07.076022 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5b038526-eebb-4b2b-996d-48949bb3a852-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-shg9w\" (UID: \"5b038526-eebb-4b2b-996d-48949bb3a852\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-shg9w" Jun 02 07:31:07.076108 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:07.076095 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d8cace1c-1788-4d1d-8441-80c601fe9360-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2tpsl\" (UID: \"d8cace1c-1788-4d1d-8441-80c601fe9360\") " pod="openshift-insights/insights-runtime-extractor-2tpsl" Jun 02 07:31:07.076398 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:07.076183 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d8cace1c-1788-4d1d-8441-80c601fe9360-data-volume\") pod \"insights-runtime-extractor-2tpsl\" (UID: \"d8cace1c-1788-4d1d-8441-80c601fe9360\") " pod="openshift-insights/insights-runtime-extractor-2tpsl" Jun 02 07:31:07.076568 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:07.076545 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d8cace1c-1788-4d1d-8441-80c601fe9360-data-volume\") pod \"insights-runtime-extractor-2tpsl\" (UID: \"d8cace1c-1788-4d1d-8441-80c601fe9360\") " pod="openshift-insights/insights-runtime-extractor-2tpsl" Jun 02 07:31:07.076711 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:07.076692 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d8cace1c-1788-4d1d-8441-80c601fe9360-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2tpsl\" (UID: \"d8cace1c-1788-4d1d-8441-80c601fe9360\") " pod="openshift-insights/insights-runtime-extractor-2tpsl" Jun 02 07:31:07.076774 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:07.076721 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5b038526-eebb-4b2b-996d-48949bb3a852-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-shg9w\" (UID: \"5b038526-eebb-4b2b-996d-48949bb3a852\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-shg9w" Jun 02 07:31:07.078386 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:07.078364 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d8cace1c-1788-4d1d-8441-80c601fe9360-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2tpsl\" (UID: \"d8cace1c-1788-4d1d-8441-80c601fe9360\") " pod="openshift-insights/insights-runtime-extractor-2tpsl" Jun 02 07:31:07.078566 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:07.078547 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5b038526-eebb-4b2b-996d-48949bb3a852-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-shg9w\" (UID: \"5b038526-eebb-4b2b-996d-48949bb3a852\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-shg9w" Jun 02 07:31:07.086906 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:07.086882 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-942rv\" (UniqueName: \"kubernetes.io/projected/d8cace1c-1788-4d1d-8441-80c601fe9360-kube-api-access-942rv\") pod \"insights-runtime-extractor-2tpsl\" (UID: \"d8cace1c-1788-4d1d-8441-80c601fe9360\") " pod="openshift-insights/insights-runtime-extractor-2tpsl" Jun 02 07:31:07.157254 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:07.157229 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-shg9w" Jun 02 07:31:07.184777 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:07.184755 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2tpsl" Jun 02 07:31:07.306568 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:07.306538 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-shg9w"] Jun 02 07:31:07.310013 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:31:07.309982 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b038526_eebb_4b2b_996d_48949bb3a852.slice/crio-c429c1f6b98a00c0bd5b3bf49b57869728d334bc956183e183cf5bcb183f2d5d WatchSource:0}: Error finding container c429c1f6b98a00c0bd5b3bf49b57869728d334bc956183e183cf5bcb183f2d5d: Status 404 returned error can't find the container with id c429c1f6b98a00c0bd5b3bf49b57869728d334bc956183e183cf5bcb183f2d5d Jun 02 07:31:07.324025 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:07.324000 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2tpsl"] Jun 02 07:31:07.327262 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:31:07.327241 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8cace1c_1788_4d1d_8441_80c601fe9360.slice/crio-50d6072aac0b8ce026923f05c9dc61a601fad5c6185d66f74411d9ae6345f67a WatchSource:0}: Error finding container 50d6072aac0b8ce026923f05c9dc61a601fad5c6185d66f74411d9ae6345f67a: Status 404 returned error can't find the container with id 50d6072aac0b8ce026923f05c9dc61a601fad5c6185d66f74411d9ae6345f67a Jun 02 07:31:07.857846 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:07.857809 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-shg9w" event={"ID":"5b038526-eebb-4b2b-996d-48949bb3a852","Type":"ContainerStarted","Data":"c429c1f6b98a00c0bd5b3bf49b57869728d334bc956183e183cf5bcb183f2d5d"} Jun 02 07:31:07.859047 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:07.859020 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2tpsl" event={"ID":"d8cace1c-1788-4d1d-8441-80c601fe9360","Type":"ContainerStarted","Data":"1187e9c9a2ac91f03690b588fe9e0be74d886b1346e65e50f8164ac14c126cf7"} Jun 02 07:31:07.859167 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:07.859053 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2tpsl" event={"ID":"d8cace1c-1788-4d1d-8441-80c601fe9360","Type":"ContainerStarted","Data":"50d6072aac0b8ce026923f05c9dc61a601fad5c6185d66f74411d9ae6345f67a"} Jun 02 07:31:08.863476 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:08.863378 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-shg9w" event={"ID":"5b038526-eebb-4b2b-996d-48949bb3a852","Type":"ContainerStarted","Data":"d3b53c8c487ebeb5274e67f6838289b9e7c06e74629ea2c044bcd72830448212"} Jun 02 07:31:08.864927 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:08.864903 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2tpsl" event={"ID":"d8cace1c-1788-4d1d-8441-80c601fe9360","Type":"ContainerStarted","Data":"db55f832f45c3f67b6341129a50ad29486a6d096713128999ed9306d5b0a722b"} Jun 02 07:31:08.877732 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:08.877681 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-shg9w" podStartSLOduration=1.618795676 podStartE2EDuration="2.877667392s" podCreationTimestamp="2026-06-02 07:31:06 +0000 UTC" firstStartedPulling="2026-06-02 07:31:07.311794687 +0000 UTC m=+95.575776732" lastFinishedPulling="2026-06-02 07:31:08.570666401 +0000 UTC m=+96.834648448" observedRunningTime="2026-06-02 07:31:08.877296743 +0000 UTC m=+97.141278808" watchObservedRunningTime="2026-06-02 07:31:08.877667392 +0000 UTC m=+97.141649459" Jun 02 07:31:09.999274 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:09.999231 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/54c378b4-2d76-430f-b245-7cd764b8dfc1-metrics-tls\") pod \"dns-default-svfjd\" (UID: \"54c378b4-2d76-430f-b245-7cd764b8dfc1\") " pod="openshift-dns/dns-default-svfjd" Jun 02 07:31:09.999738 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:09.999286 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d835e1ce-7985-432d-809d-d71b36a13093-cert\") pod \"ingress-canary-bg26p\" (UID: \"d835e1ce-7985-432d-809d-d71b36a13093\") " pod="openshift-ingress-canary/ingress-canary-bg26p" Jun 02 07:31:10.002022 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:10.001997 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/54c378b4-2d76-430f-b245-7cd764b8dfc1-metrics-tls\") pod \"dns-default-svfjd\" (UID: \"54c378b4-2d76-430f-b245-7cd764b8dfc1\") " pod="openshift-dns/dns-default-svfjd" Jun 02 07:31:10.002162 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:10.002088 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d835e1ce-7985-432d-809d-d71b36a13093-cert\") pod \"ingress-canary-bg26p\" (UID: \"d835e1ce-7985-432d-809d-d71b36a13093\") " pod="openshift-ingress-canary/ingress-canary-bg26p" Jun 02 07:31:10.287140 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:10.287071 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-t285j\"" Jun 02 07:31:10.294589 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:10.294557 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-svfjd" Jun 02 07:31:10.294739 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:10.294720 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-kkvxj\"" Jun 02 07:31:10.303667 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:10.303649 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bg26p" Jun 02 07:31:10.463458 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:10.463428 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-svfjd"] Jun 02 07:31:10.466991 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:31:10.466960 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54c378b4_2d76_430f_b245_7cd764b8dfc1.slice/crio-8411e0598349d3940a875adb7a51d75d376e7b73926269c8f54287571c4b5823 WatchSource:0}: Error finding container 8411e0598349d3940a875adb7a51d75d376e7b73926269c8f54287571c4b5823: Status 404 returned error can't find the container with id 8411e0598349d3940a875adb7a51d75d376e7b73926269c8f54287571c4b5823 Jun 02 07:31:10.476988 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:10.476965 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bg26p"] Jun 02 07:31:10.479892 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:31:10.479869 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd835e1ce_7985_432d_809d_d71b36a13093.slice/crio-78cda6cbcfe1dc340c446a0524aaecbb6fadd7fa246f6e4b865ed22782ebfac0 WatchSource:0}: Error finding container 78cda6cbcfe1dc340c446a0524aaecbb6fadd7fa246f6e4b865ed22782ebfac0: Status 404 returned error can't find the container with id 78cda6cbcfe1dc340c446a0524aaecbb6fadd7fa246f6e4b865ed22782ebfac0 Jun 02 07:31:10.770790 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:10.768968 2580 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-5755f749c7-dptlv"] Jun 02 07:31:10.772029 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:10.772005 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5755f749c7-dptlv" Jun 02 07:31:10.774526 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:10.774502 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 02 07:31:10.774627 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:10.774550 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 02 07:31:10.774673 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:10.774624 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 02 07:31:10.775416 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:10.775400 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 02 07:31:10.775523 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:10.775449 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 02 07:31:10.775582 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:10.775520 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 02 07:31:10.775582 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:10.775574 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 02 07:31:10.775709 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:10.775691 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-lpb9n\"" Jun 02 07:31:10.781917 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:10.781895 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5755f749c7-dptlv"] Jun 02 07:31:10.872844 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:10.872802 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bg26p" event={"ID":"d835e1ce-7985-432d-809d-d71b36a13093","Type":"ContainerStarted","Data":"78cda6cbcfe1dc340c446a0524aaecbb6fadd7fa246f6e4b865ed22782ebfac0"} Jun 02 07:31:10.873929 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:10.873902 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-svfjd" event={"ID":"54c378b4-2d76-430f-b245-7cd764b8dfc1","Type":"ContainerStarted","Data":"8411e0598349d3940a875adb7a51d75d376e7b73926269c8f54287571c4b5823"} Jun 02 07:31:10.875856 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:10.875829 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2tpsl" event={"ID":"d8cace1c-1788-4d1d-8441-80c601fe9360","Type":"ContainerStarted","Data":"7ce69ee8dd26c6dc201ea150fabc289e2fa4899f29b8b261b6517ab346d24cc4"} Jun 02 07:31:10.892551 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:10.892284 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-2tpsl" podStartSLOduration=1.933159581 podStartE2EDuration="4.892270072s" podCreationTimestamp="2026-06-02 07:31:06 +0000 UTC" firstStartedPulling="2026-06-02 07:31:07.379294917 +0000 UTC m=+95.643276965" lastFinishedPulling="2026-06-02 07:31:10.338405397 +0000 UTC m=+98.602387456" observedRunningTime="2026-06-02 07:31:10.89164972 +0000 UTC m=+99.155631787" watchObservedRunningTime="2026-06-02 07:31:10.892270072 +0000 UTC m=+99.156252140" Jun 02 07:31:10.908251 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:10.908201 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5c4e369a-440b-4ec0-908d-8e3caf363863-console-config\") pod \"console-5755f749c7-dptlv\" (UID: \"5c4e369a-440b-4ec0-908d-8e3caf363863\") " pod="openshift-console/console-5755f749c7-dptlv" Jun 02 07:31:10.908425 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:10.908292 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c4e369a-440b-4ec0-908d-8e3caf363863-console-serving-cert\") pod \"console-5755f749c7-dptlv\" (UID: \"5c4e369a-440b-4ec0-908d-8e3caf363863\") " pod="openshift-console/console-5755f749c7-dptlv" Jun 02 07:31:10.908425 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:10.908335 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5c4e369a-440b-4ec0-908d-8e3caf363863-service-ca\") pod \"console-5755f749c7-dptlv\" (UID: \"5c4e369a-440b-4ec0-908d-8e3caf363863\") " pod="openshift-console/console-5755f749c7-dptlv" Jun 02 07:31:10.908425 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:10.908398 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5c4e369a-440b-4ec0-908d-8e3caf363863-console-oauth-config\") pod \"console-5755f749c7-dptlv\" (UID: \"5c4e369a-440b-4ec0-908d-8e3caf363863\") " pod="openshift-console/console-5755f749c7-dptlv" Jun 02 07:31:10.908706 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:10.908435 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5pg8\" (UniqueName: \"kubernetes.io/projected/5c4e369a-440b-4ec0-908d-8e3caf363863-kube-api-access-r5pg8\") pod \"console-5755f749c7-dptlv\" (UID: \"5c4e369a-440b-4ec0-908d-8e3caf363863\") " pod="openshift-console/console-5755f749c7-dptlv" Jun 02 07:31:10.908706 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:10.908463 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5c4e369a-440b-4ec0-908d-8e3caf363863-oauth-serving-cert\") pod \"console-5755f749c7-dptlv\" (UID: \"5c4e369a-440b-4ec0-908d-8e3caf363863\") " pod="openshift-console/console-5755f749c7-dptlv" Jun 02 07:31:11.009441 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:11.009402 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5c4e369a-440b-4ec0-908d-8e3caf363863-console-oauth-config\") pod \"console-5755f749c7-dptlv\" (UID: \"5c4e369a-440b-4ec0-908d-8e3caf363863\") " pod="openshift-console/console-5755f749c7-dptlv" Jun 02 07:31:11.009896 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:11.009460 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r5pg8\" (UniqueName: \"kubernetes.io/projected/5c4e369a-440b-4ec0-908d-8e3caf363863-kube-api-access-r5pg8\") pod \"console-5755f749c7-dptlv\" (UID: \"5c4e369a-440b-4ec0-908d-8e3caf363863\") " pod="openshift-console/console-5755f749c7-dptlv" Jun 02 07:31:11.009896 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:11.009490 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5c4e369a-440b-4ec0-908d-8e3caf363863-oauth-serving-cert\") pod \"console-5755f749c7-dptlv\" (UID: \"5c4e369a-440b-4ec0-908d-8e3caf363863\") " pod="openshift-console/console-5755f749c7-dptlv" Jun 02 07:31:11.009896 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:11.009510 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5c4e369a-440b-4ec0-908d-8e3caf363863-console-config\") pod \"console-5755f749c7-dptlv\" (UID: \"5c4e369a-440b-4ec0-908d-8e3caf363863\") " pod="openshift-console/console-5755f749c7-dptlv" Jun 02 07:31:11.009896 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:11.009549 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c4e369a-440b-4ec0-908d-8e3caf363863-console-serving-cert\") pod \"console-5755f749c7-dptlv\" (UID: \"5c4e369a-440b-4ec0-908d-8e3caf363863\") " pod="openshift-console/console-5755f749c7-dptlv" Jun 02 07:31:11.009896 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:11.009576 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5c4e369a-440b-4ec0-908d-8e3caf363863-service-ca\") pod \"console-5755f749c7-dptlv\" (UID: \"5c4e369a-440b-4ec0-908d-8e3caf363863\") " pod="openshift-console/console-5755f749c7-dptlv" Jun 02 07:31:11.010361 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:11.010301 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5c4e369a-440b-4ec0-908d-8e3caf363863-service-ca\") pod \"console-5755f749c7-dptlv\" (UID: \"5c4e369a-440b-4ec0-908d-8e3caf363863\") " pod="openshift-console/console-5755f749c7-dptlv" Jun 02 07:31:11.010828 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:11.010798 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5c4e369a-440b-4ec0-908d-8e3caf363863-oauth-serving-cert\") pod \"console-5755f749c7-dptlv\" (UID: \"5c4e369a-440b-4ec0-908d-8e3caf363863\") " pod="openshift-console/console-5755f749c7-dptlv" Jun 02 07:31:11.011108 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:11.011062 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5c4e369a-440b-4ec0-908d-8e3caf363863-console-config\") pod \"console-5755f749c7-dptlv\" (UID: \"5c4e369a-440b-4ec0-908d-8e3caf363863\") " pod="openshift-console/console-5755f749c7-dptlv" Jun 02 07:31:11.013706 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:11.013686 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5c4e369a-440b-4ec0-908d-8e3caf363863-console-oauth-config\") pod \"console-5755f749c7-dptlv\" (UID: \"5c4e369a-440b-4ec0-908d-8e3caf363863\") " pod="openshift-console/console-5755f749c7-dptlv" Jun 02 07:31:11.013852 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:11.013833 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c4e369a-440b-4ec0-908d-8e3caf363863-console-serving-cert\") pod \"console-5755f749c7-dptlv\" (UID: \"5c4e369a-440b-4ec0-908d-8e3caf363863\") " pod="openshift-console/console-5755f749c7-dptlv" Jun 02 07:31:11.019868 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:11.019833 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5pg8\" (UniqueName: \"kubernetes.io/projected/5c4e369a-440b-4ec0-908d-8e3caf363863-kube-api-access-r5pg8\") pod \"console-5755f749c7-dptlv\" (UID: \"5c4e369a-440b-4ec0-908d-8e3caf363863\") " pod="openshift-console/console-5755f749c7-dptlv" Jun 02 07:31:11.080894 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:11.080812 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5755f749c7-dptlv" Jun 02 07:31:11.234865 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:11.234830 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5755f749c7-dptlv"] Jun 02 07:31:11.238419 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:31:11.238386 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c4e369a_440b_4ec0_908d_8e3caf363863.slice/crio-56b9b3fb943876681b52a8135fe1046f9aa80484d70451b79965703af9da00cd WatchSource:0}: Error finding container 56b9b3fb943876681b52a8135fe1046f9aa80484d70451b79965703af9da00cd: Status 404 returned error can't find the container with id 56b9b3fb943876681b52a8135fe1046f9aa80484d70451b79965703af9da00cd Jun 02 07:31:11.880037 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:11.880000 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5755f749c7-dptlv" event={"ID":"5c4e369a-440b-4ec0-908d-8e3caf363863","Type":"ContainerStarted","Data":"56b9b3fb943876681b52a8135fe1046f9aa80484d70451b79965703af9da00cd"} Jun 02 07:31:12.889777 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:12.889735 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bg26p" event={"ID":"d835e1ce-7985-432d-809d-d71b36a13093","Type":"ContainerStarted","Data":"bedf1934f39a1cd890499ea8992c2ea392b7df6be7847946b006a73854bd8a6a"} Jun 02 07:31:12.891945 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:12.891906 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-svfjd" event={"ID":"54c378b4-2d76-430f-b245-7cd764b8dfc1","Type":"ContainerStarted","Data":"d451becfd7cdcdac64ad9ab7766b5c70c2651c7695a43490196b68cce41e5b3c"} Jun 02 07:31:12.891945 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:12.891941 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-svfjd" event={"ID":"54c378b4-2d76-430f-b245-7cd764b8dfc1","Type":"ContainerStarted","Data":"dae1db208c030326b07203a07f8d53539e45a0c72777bade696d6066db4ac6e1"} Jun 02 07:31:12.892125 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:12.892053 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-svfjd" Jun 02 07:31:12.905628 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:12.905590 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-bg26p" podStartSLOduration=65.057687381 podStartE2EDuration="1m6.905579117s" podCreationTimestamp="2026-06-02 07:30:06 +0000 UTC" firstStartedPulling="2026-06-02 07:31:10.481749572 +0000 UTC m=+98.745731615" lastFinishedPulling="2026-06-02 07:31:12.329641307 +0000 UTC m=+100.593623351" observedRunningTime="2026-06-02 07:31:12.904758869 +0000 UTC m=+101.168740935" watchObservedRunningTime="2026-06-02 07:31:12.905579117 +0000 UTC m=+101.169561218" Jun 02 07:31:12.920205 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:12.920152 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-svfjd" podStartSLOduration=65.062499605 podStartE2EDuration="1m6.92014073s" podCreationTimestamp="2026-06-02 07:30:06 +0000 UTC" firstStartedPulling="2026-06-02 07:31:10.468827857 +0000 UTC m=+98.732809900" lastFinishedPulling="2026-06-02 07:31:12.326468979 +0000 UTC m=+100.590451025" observedRunningTime="2026-06-02 07:31:12.919430433 +0000 UTC m=+101.183412500" watchObservedRunningTime="2026-06-02 07:31:12.92014073 +0000 UTC m=+101.184122800" Jun 02 07:31:13.793264 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:13.793232 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-wp2df" Jun 02 07:31:13.936522 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:13.936481 2580 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-ddnvf"] Jun 02 07:31:13.957822 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:13.957793 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-ddnvf" Jun 02 07:31:13.959908 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:13.959883 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-ddnvf"] Jun 02 07:31:13.960142 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:13.960126 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 02 07:31:13.960258 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:13.960154 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-9lt7h\"" Jun 02 07:31:14.139056 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:14.139016 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ea3d68ea-c7d0-4122-95f1-07cc49f2491f-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-ddnvf\" (UID: \"ea3d68ea-c7d0-4122-95f1-07cc49f2491f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-ddnvf" Jun 02 07:31:14.240094 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:14.240059 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ea3d68ea-c7d0-4122-95f1-07cc49f2491f-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-ddnvf\" (UID: \"ea3d68ea-c7d0-4122-95f1-07cc49f2491f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-ddnvf" Jun 02 07:31:14.242683 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:14.242650 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ea3d68ea-c7d0-4122-95f1-07cc49f2491f-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-ddnvf\" (UID: \"ea3d68ea-c7d0-4122-95f1-07cc49f2491f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-ddnvf" Jun 02 07:31:14.269720 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:14.269683 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-ddnvf" Jun 02 07:31:14.404543 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:14.404466 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-ddnvf"] Jun 02 07:31:14.407887 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:31:14.407859 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea3d68ea_c7d0_4122_95f1_07cc49f2491f.slice/crio-d3cead69e9def498f026146a4cf04f849dcb7545b3853d9e858796fcfb295bf7 WatchSource:0}: Error finding container d3cead69e9def498f026146a4cf04f849dcb7545b3853d9e858796fcfb295bf7: Status 404 returned error can't find the container with id d3cead69e9def498f026146a4cf04f849dcb7545b3853d9e858796fcfb295bf7 Jun 02 07:31:14.900400 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:14.900355 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-ddnvf" event={"ID":"ea3d68ea-c7d0-4122-95f1-07cc49f2491f","Type":"ContainerStarted","Data":"d3cead69e9def498f026146a4cf04f849dcb7545b3853d9e858796fcfb295bf7"} Jun 02 07:31:16.906873 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:16.906838 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5755f749c7-dptlv" event={"ID":"5c4e369a-440b-4ec0-908d-8e3caf363863","Type":"ContainerStarted","Data":"128139ac9e971895054c748800db49bea1b1b4b0bf12130e0bd5ce4aa888d9c3"} Jun 02 07:31:16.924865 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:16.924814 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5755f749c7-dptlv" podStartSLOduration=1.47670617 podStartE2EDuration="6.924800859s" podCreationTimestamp="2026-06-02 07:31:10 +0000 UTC" firstStartedPulling="2026-06-02 07:31:11.241664351 +0000 UTC m=+99.505646401" lastFinishedPulling="2026-06-02 07:31:16.689759047 +0000 UTC m=+104.953741090" observedRunningTime="2026-06-02 07:31:16.924406303 +0000 UTC m=+105.188388381" watchObservedRunningTime="2026-06-02 07:31:16.924800859 +0000 UTC m=+105.188782926" Jun 02 07:31:16.948354 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:16.948326 2580 patch_prober.go:28] interesting pod/image-registry-5986fdf9f-6j9sv container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 02 07:31:16.948456 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:16.948382 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5986fdf9f-6j9sv" podUID="b17d2e19-f3da-4433-9d16-476e815d5389" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 02 07:31:17.910532 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:17.910492 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-ddnvf" event={"ID":"ea3d68ea-c7d0-4122-95f1-07cc49f2491f","Type":"ContainerStarted","Data":"8532c05359585089fb549e1c932cf84508ac59b15ea73afa5b136b75f925a850"} Jun 02 07:31:17.925930 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:17.925883 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-ddnvf" podStartSLOduration=2.399158773 podStartE2EDuration="4.925870146s" podCreationTimestamp="2026-06-02 07:31:13 +0000 UTC" firstStartedPulling="2026-06-02 07:31:14.409842266 +0000 UTC m=+102.673824309" lastFinishedPulling="2026-06-02 07:31:16.936553635 +0000 UTC m=+105.200535682" observedRunningTime="2026-06-02 07:31:17.924394191 +0000 UTC m=+106.188376257" watchObservedRunningTime="2026-06-02 07:31:17.925870146 +0000 UTC m=+106.189852211" Jun 02 07:31:18.912907 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:18.912867 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-ddnvf" Jun 02 07:31:18.918401 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:18.918375 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-ddnvf" Jun 02 07:31:20.744664 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:20.744626 2580 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c645bd5c-66p5s"] Jun 02 07:31:20.746762 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:20.746743 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c645bd5c-66p5s" Jun 02 07:31:20.754308 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:20.754288 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 02 07:31:20.758034 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:20.758015 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c645bd5c-66p5s"] Jun 02 07:31:20.794098 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:20.794071 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20-oauth-serving-cert\") pod \"console-5c645bd5c-66p5s\" (UID: \"4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20\") " pod="openshift-console/console-5c645bd5c-66p5s" Jun 02 07:31:20.794275 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:20.794114 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20-console-oauth-config\") pod \"console-5c645bd5c-66p5s\" (UID: \"4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20\") " pod="openshift-console/console-5c645bd5c-66p5s" Jun 02 07:31:20.794275 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:20.794135 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20-service-ca\") pod \"console-5c645bd5c-66p5s\" (UID: \"4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20\") " pod="openshift-console/console-5c645bd5c-66p5s" Jun 02 07:31:20.794275 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:20.794176 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20-console-config\") pod \"console-5c645bd5c-66p5s\" (UID: \"4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20\") " pod="openshift-console/console-5c645bd5c-66p5s" Jun 02 07:31:20.794275 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:20.794209 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmk8x\" (UniqueName: \"kubernetes.io/projected/4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20-kube-api-access-tmk8x\") pod \"console-5c645bd5c-66p5s\" (UID: \"4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20\") " pod="openshift-console/console-5c645bd5c-66p5s" Jun 02 07:31:20.794275 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:20.794264 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20-trusted-ca-bundle\") pod \"console-5c645bd5c-66p5s\" (UID: \"4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20\") " pod="openshift-console/console-5c645bd5c-66p5s" Jun 02 07:31:20.794463 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:20.794284 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20-console-serving-cert\") pod \"console-5c645bd5c-66p5s\" (UID: \"4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20\") " pod="openshift-console/console-5c645bd5c-66p5s" Jun 02 07:31:20.894716 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:20.894682 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20-console-oauth-config\") pod \"console-5c645bd5c-66p5s\" (UID: \"4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20\") " pod="openshift-console/console-5c645bd5c-66p5s" Jun 02 07:31:20.894881 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:20.894725 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20-service-ca\") pod \"console-5c645bd5c-66p5s\" (UID: \"4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20\") " pod="openshift-console/console-5c645bd5c-66p5s" Jun 02 07:31:20.894881 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:20.894781 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20-console-config\") pod \"console-5c645bd5c-66p5s\" (UID: \"4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20\") " pod="openshift-console/console-5c645bd5c-66p5s" Jun 02 07:31:20.894881 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:20.894826 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tmk8x\" (UniqueName: \"kubernetes.io/projected/4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20-kube-api-access-tmk8x\") pod \"console-5c645bd5c-66p5s\" (UID: \"4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20\") " pod="openshift-console/console-5c645bd5c-66p5s" Jun 02 07:31:20.894881 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:20.894854 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20-trusted-ca-bundle\") pod \"console-5c645bd5c-66p5s\" (UID: \"4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20\") " pod="openshift-console/console-5c645bd5c-66p5s" Jun 02 07:31:20.894881 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:20.894875 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20-console-serving-cert\") pod \"console-5c645bd5c-66p5s\" (UID: \"4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20\") " pod="openshift-console/console-5c645bd5c-66p5s" Jun 02 07:31:20.895140 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:20.894920 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20-oauth-serving-cert\") pod \"console-5c645bd5c-66p5s\" (UID: \"4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20\") " pod="openshift-console/console-5c645bd5c-66p5s" Jun 02 07:31:20.895521 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:20.895491 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20-service-ca\") pod \"console-5c645bd5c-66p5s\" (UID: \"4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20\") " pod="openshift-console/console-5c645bd5c-66p5s" Jun 02 07:31:20.895639 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:20.895567 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20-console-config\") pod \"console-5c645bd5c-66p5s\" (UID: \"4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20\") " pod="openshift-console/console-5c645bd5c-66p5s" Jun 02 07:31:20.895704 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:20.895681 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20-oauth-serving-cert\") pod \"console-5c645bd5c-66p5s\" (UID: \"4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20\") " pod="openshift-console/console-5c645bd5c-66p5s" Jun 02 07:31:20.895760 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:20.895686 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20-trusted-ca-bundle\") pod \"console-5c645bd5c-66p5s\" (UID: \"4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20\") " pod="openshift-console/console-5c645bd5c-66p5s" Jun 02 07:31:20.897475 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:20.897457 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20-console-serving-cert\") pod \"console-5c645bd5c-66p5s\" (UID: \"4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20\") " pod="openshift-console/console-5c645bd5c-66p5s" Jun 02 07:31:20.897561 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:20.897507 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20-console-oauth-config\") pod \"console-5c645bd5c-66p5s\" (UID: \"4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20\") " pod="openshift-console/console-5c645bd5c-66p5s" Jun 02 07:31:20.903365 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:20.903331 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmk8x\" (UniqueName: \"kubernetes.io/projected/4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20-kube-api-access-tmk8x\") pod \"console-5c645bd5c-66p5s\" (UID: \"4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20\") " pod="openshift-console/console-5c645bd5c-66p5s" Jun 02 07:31:21.056162 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:21.056076 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c645bd5c-66p5s" Jun 02 07:31:21.082008 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:21.081977 2580 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5755f749c7-dptlv" Jun 02 07:31:21.082152 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:21.082026 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5755f749c7-dptlv" Jun 02 07:31:21.083515 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:21.083494 2580 patch_prober.go:28] interesting pod/console-5755f749c7-dptlv container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.15:8443/health\": dial tcp 10.133.0.15:8443: connect: connection refused" start-of-body= Jun 02 07:31:21.083639 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:21.083559 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5755f749c7-dptlv" podUID="5c4e369a-440b-4ec0-908d-8e3caf363863" containerName="console" probeResult="failure" output="Get \"https://10.133.0.15:8443/health\": dial tcp 10.133.0.15:8443: connect: connection refused" Jun 02 07:31:21.180258 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:21.180200 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c645bd5c-66p5s"] Jun 02 07:31:21.185519 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:31:21.185490 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bace172_fb3a_4c1d_a3e6_f27a1f2a2b20.slice/crio-6460667b579d100355773855799b75c8b542422b40499ec415be9e9e86a55730 WatchSource:0}: Error finding container 6460667b579d100355773855799b75c8b542422b40499ec415be9e9e86a55730: Status 404 returned error can't find the container with id 6460667b579d100355773855799b75c8b542422b40499ec415be9e9e86a55730 Jun 02 07:31:21.921775 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:21.921737 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c645bd5c-66p5s" event={"ID":"4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20","Type":"ContainerStarted","Data":"56ac99ed71b39d99e9ada54300cea9b33f5d896a1753fd9b1ceae1aec9ab63b5"} Jun 02 07:31:21.921775 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:21.921774 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c645bd5c-66p5s" event={"ID":"4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20","Type":"ContainerStarted","Data":"6460667b579d100355773855799b75c8b542422b40499ec415be9e9e86a55730"} Jun 02 07:31:21.942687 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:21.942612 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5c645bd5c-66p5s" podStartSLOduration=1.942596565 podStartE2EDuration="1.942596565s" podCreationTimestamp="2026-06-02 07:31:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 07:31:21.941862137 +0000 UTC m=+110.205844204" watchObservedRunningTime="2026-06-02 07:31:21.942596565 +0000 UTC m=+110.206578630" Jun 02 07:31:22.897359 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:22.897327 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-svfjd" Jun 02 07:31:26.948242 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:26.948187 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5986fdf9f-6j9sv" Jun 02 07:31:30.337318 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.337285 2580 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-479j2"] Jun 02 07:31:30.340254 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.340237 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-479j2" Jun 02 07:31:30.342519 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.342489 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 02 07:31:30.342650 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.342495 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 02 07:31:30.343315 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.343259 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 02 07:31:30.343315 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.343280 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 02 07:31:30.343315 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.343292 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-j68sg\"" Jun 02 07:31:30.343532 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.343259 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 02 07:31:30.353250 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.353201 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-479j2"] Jun 02 07:31:30.361190 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.361164 2580 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-m877v"] Jun 02 07:31:30.363629 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.363613 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-8469c486bb-m877v" Jun 02 07:31:30.366187 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.366170 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 02 07:31:30.366311 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.366171 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4996005a-a82f-4dad-bb03-6df779a722d3-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-479j2\" (UID: \"4996005a-a82f-4dad-bb03-6df779a722d3\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-479j2" Jun 02 07:31:30.366432 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.366336 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 02 07:31:30.366432 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.366344 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4996005a-a82f-4dad-bb03-6df779a722d3-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-479j2\" (UID: \"4996005a-a82f-4dad-bb03-6df779a722d3\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-479j2" Jun 02 07:31:30.366432 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.366179 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 02 07:31:30.366432 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.366202 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-svpjc\"" Jun 02 07:31:30.366614 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.366572 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4996005a-a82f-4dad-bb03-6df779a722d3-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-479j2\" (UID: \"4996005a-a82f-4dad-bb03-6df779a722d3\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-479j2" Jun 02 07:31:30.366667 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.366609 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blz4r\" (UniqueName: \"kubernetes.io/projected/4996005a-a82f-4dad-bb03-6df779a722d3-kube-api-access-blz4r\") pod \"openshift-state-metrics-85658796db-479j2\" (UID: \"4996005a-a82f-4dad-bb03-6df779a722d3\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-479j2" Jun 02 07:31:30.372549 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.372526 2580 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-clr5f"] Jun 02 07:31:30.377418 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.377397 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-m877v"] Jun 02 07:31:30.377661 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.377645 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-clr5f" Jun 02 07:31:30.381389 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.381364 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-rmc7b\"" Jun 02 07:31:30.381537 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.381386 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 02 07:31:30.381709 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.381423 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 02 07:31:30.382046 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.382029 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 02 07:31:30.467638 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.467600 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f2c623c7-0415-49df-9f4e-22e1748c99c2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-clr5f\" (UID: \"f2c623c7-0415-49df-9f4e-22e1748c99c2\") " pod="openshift-monitoring/node-exporter-clr5f" Jun 02 07:31:30.467846 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.467683 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f2c623c7-0415-49df-9f4e-22e1748c99c2-node-exporter-textfile\") pod \"node-exporter-clr5f\" (UID: \"f2c623c7-0415-49df-9f4e-22e1748c99c2\") " pod="openshift-monitoring/node-exporter-clr5f" Jun 02 07:31:30.467846 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.467715 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4996005a-a82f-4dad-bb03-6df779a722d3-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-479j2\" (UID: \"4996005a-a82f-4dad-bb03-6df779a722d3\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-479j2" Jun 02 07:31:30.467846 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.467747 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87f72\" (UniqueName: \"kubernetes.io/projected/039aaef0-1cf8-4e65-8968-f95625a46e77-kube-api-access-87f72\") pod \"kube-state-metrics-8469c486bb-m877v\" (UID: \"039aaef0-1cf8-4e65-8968-f95625a46e77\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-m877v" Jun 02 07:31:30.467846 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.467771 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f2c623c7-0415-49df-9f4e-22e1748c99c2-node-exporter-tls\") pod \"node-exporter-clr5f\" (UID: \"f2c623c7-0415-49df-9f4e-22e1748c99c2\") " pod="openshift-monitoring/node-exporter-clr5f" Jun 02 07:31:30.467846 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.467800 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/039aaef0-1cf8-4e65-8968-f95625a46e77-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-m877v\" (UID: \"039aaef0-1cf8-4e65-8968-f95625a46e77\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-m877v" Jun 02 07:31:30.467846 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.467835 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4996005a-a82f-4dad-bb03-6df779a722d3-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-479j2\" (UID: \"4996005a-a82f-4dad-bb03-6df779a722d3\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-479j2" Jun 02 07:31:30.468236 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.467866 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/039aaef0-1cf8-4e65-8968-f95625a46e77-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-m877v\" (UID: \"039aaef0-1cf8-4e65-8968-f95625a46e77\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-m877v" Jun 02 07:31:30.468236 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:31:30.467866 2580 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 02 07:31:30.468236 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.467924 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f2c623c7-0415-49df-9f4e-22e1748c99c2-sys\") pod \"node-exporter-clr5f\" (UID: \"f2c623c7-0415-49df-9f4e-22e1748c99c2\") " pod="openshift-monitoring/node-exporter-clr5f" Jun 02 07:31:30.468236 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:31:30.467947 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4996005a-a82f-4dad-bb03-6df779a722d3-openshift-state-metrics-tls podName:4996005a-a82f-4dad-bb03-6df779a722d3 nodeName:}" failed. No retries permitted until 2026-06-02 07:31:30.967925997 +0000 UTC m=+119.231908044 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/4996005a-a82f-4dad-bb03-6df779a722d3-openshift-state-metrics-tls") pod "openshift-state-metrics-85658796db-479j2" (UID: "4996005a-a82f-4dad-bb03-6df779a722d3") : secret "openshift-state-metrics-tls" not found Jun 02 07:31:30.468236 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.467996 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f2c623c7-0415-49df-9f4e-22e1748c99c2-node-exporter-wtmp\") pod \"node-exporter-clr5f\" (UID: \"f2c623c7-0415-49df-9f4e-22e1748c99c2\") " pod="openshift-monitoring/node-exporter-clr5f" Jun 02 07:31:30.468236 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.468021 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f2c623c7-0415-49df-9f4e-22e1748c99c2-metrics-client-ca\") pod \"node-exporter-clr5f\" (UID: \"f2c623c7-0415-49df-9f4e-22e1748c99c2\") " pod="openshift-monitoring/node-exporter-clr5f" Jun 02 07:31:30.468236 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.468049 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brbs9\" (UniqueName: \"kubernetes.io/projected/f2c623c7-0415-49df-9f4e-22e1748c99c2-kube-api-access-brbs9\") pod \"node-exporter-clr5f\" (UID: \"f2c623c7-0415-49df-9f4e-22e1748c99c2\") " pod="openshift-monitoring/node-exporter-clr5f" Jun 02 07:31:30.468236 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.468082 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4996005a-a82f-4dad-bb03-6df779a722d3-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-479j2\" (UID: \"4996005a-a82f-4dad-bb03-6df779a722d3\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-479j2" Jun 02 07:31:30.468236 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.468111 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f2c623c7-0415-49df-9f4e-22e1748c99c2-root\") pod \"node-exporter-clr5f\" (UID: \"f2c623c7-0415-49df-9f4e-22e1748c99c2\") " pod="openshift-monitoring/node-exporter-clr5f" Jun 02 07:31:30.468236 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.468140 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/039aaef0-1cf8-4e65-8968-f95625a46e77-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-m877v\" (UID: \"039aaef0-1cf8-4e65-8968-f95625a46e77\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-m877v" Jun 02 07:31:30.468236 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.468197 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-blz4r\" (UniqueName: \"kubernetes.io/projected/4996005a-a82f-4dad-bb03-6df779a722d3-kube-api-access-blz4r\") pod \"openshift-state-metrics-85658796db-479j2\" (UID: \"4996005a-a82f-4dad-bb03-6df779a722d3\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-479j2" Jun 02 07:31:30.468772 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.468267 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/039aaef0-1cf8-4e65-8968-f95625a46e77-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-m877v\" (UID: \"039aaef0-1cf8-4e65-8968-f95625a46e77\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-m877v" Jun 02 07:31:30.468772 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.468295 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/039aaef0-1cf8-4e65-8968-f95625a46e77-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-m877v\" (UID: \"039aaef0-1cf8-4e65-8968-f95625a46e77\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-m877v" Jun 02 07:31:30.468772 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.468325 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f2c623c7-0415-49df-9f4e-22e1748c99c2-node-exporter-accelerators-collector-config\") pod \"node-exporter-clr5f\" (UID: \"f2c623c7-0415-49df-9f4e-22e1748c99c2\") " pod="openshift-monitoring/node-exporter-clr5f" Jun 02 07:31:30.469153 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.469129 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4996005a-a82f-4dad-bb03-6df779a722d3-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-479j2\" (UID: \"4996005a-a82f-4dad-bb03-6df779a722d3\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-479j2" Jun 02 07:31:30.470675 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.470643 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4996005a-a82f-4dad-bb03-6df779a722d3-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-479j2\" (UID: \"4996005a-a82f-4dad-bb03-6df779a722d3\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-479j2" Jun 02 07:31:30.475879 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.475834 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-blz4r\" (UniqueName: \"kubernetes.io/projected/4996005a-a82f-4dad-bb03-6df779a722d3-kube-api-access-blz4r\") pod \"openshift-state-metrics-85658796db-479j2\" (UID: \"4996005a-a82f-4dad-bb03-6df779a722d3\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-479j2" Jun 02 07:31:30.568896 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.568858 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-87f72\" (UniqueName: \"kubernetes.io/projected/039aaef0-1cf8-4e65-8968-f95625a46e77-kube-api-access-87f72\") pod \"kube-state-metrics-8469c486bb-m877v\" (UID: \"039aaef0-1cf8-4e65-8968-f95625a46e77\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-m877v" Jun 02 07:31:30.568896 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.568901 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f2c623c7-0415-49df-9f4e-22e1748c99c2-node-exporter-tls\") pod \"node-exporter-clr5f\" (UID: \"f2c623c7-0415-49df-9f4e-22e1748c99c2\") " pod="openshift-monitoring/node-exporter-clr5f" Jun 02 07:31:30.569143 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.568931 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/039aaef0-1cf8-4e65-8968-f95625a46e77-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-m877v\" (UID: \"039aaef0-1cf8-4e65-8968-f95625a46e77\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-m877v" Jun 02 07:31:30.569143 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.568959 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/039aaef0-1cf8-4e65-8968-f95625a46e77-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-m877v\" (UID: \"039aaef0-1cf8-4e65-8968-f95625a46e77\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-m877v" Jun 02 07:31:30.569143 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.568996 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f2c623c7-0415-49df-9f4e-22e1748c99c2-sys\") pod \"node-exporter-clr5f\" (UID: \"f2c623c7-0415-49df-9f4e-22e1748c99c2\") " pod="openshift-monitoring/node-exporter-clr5f" Jun 02 07:31:30.569143 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.569014 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f2c623c7-0415-49df-9f4e-22e1748c99c2-node-exporter-wtmp\") pod \"node-exporter-clr5f\" (UID: \"f2c623c7-0415-49df-9f4e-22e1748c99c2\") " pod="openshift-monitoring/node-exporter-clr5f" Jun 02 07:31:30.569143 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.569030 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f2c623c7-0415-49df-9f4e-22e1748c99c2-metrics-client-ca\") pod \"node-exporter-clr5f\" (UID: \"f2c623c7-0415-49df-9f4e-22e1748c99c2\") " pod="openshift-monitoring/node-exporter-clr5f" Jun 02 07:31:30.569143 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.569048 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-brbs9\" (UniqueName: \"kubernetes.io/projected/f2c623c7-0415-49df-9f4e-22e1748c99c2-kube-api-access-brbs9\") pod \"node-exporter-clr5f\" (UID: \"f2c623c7-0415-49df-9f4e-22e1748c99c2\") " pod="openshift-monitoring/node-exporter-clr5f" Jun 02 07:31:30.569143 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.569071 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f2c623c7-0415-49df-9f4e-22e1748c99c2-root\") pod \"node-exporter-clr5f\" (UID: \"f2c623c7-0415-49df-9f4e-22e1748c99c2\") " pod="openshift-monitoring/node-exporter-clr5f" Jun 02 07:31:30.569143 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:31:30.569092 2580 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 02 07:31:30.569143 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.569101 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/039aaef0-1cf8-4e65-8968-f95625a46e77-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-m877v\" (UID: \"039aaef0-1cf8-4e65-8968-f95625a46e77\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-m877v" Jun 02 07:31:30.569599 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.569164 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/039aaef0-1cf8-4e65-8968-f95625a46e77-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-m877v\" (UID: \"039aaef0-1cf8-4e65-8968-f95625a46e77\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-m877v" Jun 02 07:31:30.569599 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.569191 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/039aaef0-1cf8-4e65-8968-f95625a46e77-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-m877v\" (UID: \"039aaef0-1cf8-4e65-8968-f95625a46e77\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-m877v" Jun 02 07:31:30.569599 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.569240 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f2c623c7-0415-49df-9f4e-22e1748c99c2-node-exporter-accelerators-collector-config\") pod \"node-exporter-clr5f\" (UID: \"f2c623c7-0415-49df-9f4e-22e1748c99c2\") " pod="openshift-monitoring/node-exporter-clr5f" Jun 02 07:31:30.569599 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:31:30.569269 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2c623c7-0415-49df-9f4e-22e1748c99c2-node-exporter-tls podName:f2c623c7-0415-49df-9f4e-22e1748c99c2 nodeName:}" failed. No retries permitted until 2026-06-02 07:31:31.069247142 +0000 UTC m=+119.333229195 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/f2c623c7-0415-49df-9f4e-22e1748c99c2-node-exporter-tls") pod "node-exporter-clr5f" (UID: "f2c623c7-0415-49df-9f4e-22e1748c99c2") : secret "node-exporter-tls" not found Jun 02 07:31:30.569599 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.569290 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f2c623c7-0415-49df-9f4e-22e1748c99c2-node-exporter-wtmp\") pod \"node-exporter-clr5f\" (UID: \"f2c623c7-0415-49df-9f4e-22e1748c99c2\") " pod="openshift-monitoring/node-exporter-clr5f" Jun 02 07:31:30.569599 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.569315 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f2c623c7-0415-49df-9f4e-22e1748c99c2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-clr5f\" (UID: \"f2c623c7-0415-49df-9f4e-22e1748c99c2\") " pod="openshift-monitoring/node-exporter-clr5f" Jun 02 07:31:30.569599 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.569414 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f2c623c7-0415-49df-9f4e-22e1748c99c2-node-exporter-textfile\") pod \"node-exporter-clr5f\" (UID: \"f2c623c7-0415-49df-9f4e-22e1748c99c2\") " pod="openshift-monitoring/node-exporter-clr5f" Jun 02 07:31:30.569599 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.569589 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f2c623c7-0415-49df-9f4e-22e1748c99c2-root\") pod \"node-exporter-clr5f\" (UID: \"f2c623c7-0415-49df-9f4e-22e1748c99c2\") " pod="openshift-monitoring/node-exporter-clr5f" Jun 02 07:31:30.569991 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.569879 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f2c623c7-0415-49df-9f4e-22e1748c99c2-node-exporter-accelerators-collector-config\") pod \"node-exporter-clr5f\" (UID: \"f2c623c7-0415-49df-9f4e-22e1748c99c2\") " pod="openshift-monitoring/node-exporter-clr5f" Jun 02 07:31:30.569991 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.569960 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/039aaef0-1cf8-4e65-8968-f95625a46e77-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-m877v\" (UID: \"039aaef0-1cf8-4e65-8968-f95625a46e77\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-m877v" Jun 02 07:31:30.570090 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.570069 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/039aaef0-1cf8-4e65-8968-f95625a46e77-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-m877v\" (UID: \"039aaef0-1cf8-4e65-8968-f95625a46e77\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-m877v" Jun 02 07:31:30.570143 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.570102 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f2c623c7-0415-49df-9f4e-22e1748c99c2-sys\") pod \"node-exporter-clr5f\" (UID: \"f2c623c7-0415-49df-9f4e-22e1748c99c2\") " pod="openshift-monitoring/node-exporter-clr5f" Jun 02 07:31:30.570516 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.570493 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/039aaef0-1cf8-4e65-8968-f95625a46e77-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-m877v\" (UID: \"039aaef0-1cf8-4e65-8968-f95625a46e77\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-m877v" Jun 02 07:31:30.570749 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.570713 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f2c623c7-0415-49df-9f4e-22e1748c99c2-node-exporter-textfile\") pod \"node-exporter-clr5f\" (UID: \"f2c623c7-0415-49df-9f4e-22e1748c99c2\") " pod="openshift-monitoring/node-exporter-clr5f" Jun 02 07:31:30.570936 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.570918 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f2c623c7-0415-49df-9f4e-22e1748c99c2-metrics-client-ca\") pod \"node-exporter-clr5f\" (UID: \"f2c623c7-0415-49df-9f4e-22e1748c99c2\") " pod="openshift-monitoring/node-exporter-clr5f" Jun 02 07:31:30.572565 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.572533 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f2c623c7-0415-49df-9f4e-22e1748c99c2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-clr5f\" (UID: \"f2c623c7-0415-49df-9f4e-22e1748c99c2\") " pod="openshift-monitoring/node-exporter-clr5f" Jun 02 07:31:30.576242 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.572955 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/039aaef0-1cf8-4e65-8968-f95625a46e77-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-m877v\" (UID: \"039aaef0-1cf8-4e65-8968-f95625a46e77\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-m877v" Jun 02 07:31:30.576242 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.573509 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/039aaef0-1cf8-4e65-8968-f95625a46e77-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-m877v\" (UID: \"039aaef0-1cf8-4e65-8968-f95625a46e77\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-m877v" Jun 02 07:31:30.581229 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.580986 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-brbs9\" (UniqueName: \"kubernetes.io/projected/f2c623c7-0415-49df-9f4e-22e1748c99c2-kube-api-access-brbs9\") pod \"node-exporter-clr5f\" (UID: \"f2c623c7-0415-49df-9f4e-22e1748c99c2\") " pod="openshift-monitoring/node-exporter-clr5f" Jun 02 07:31:30.585238 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.581984 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87f72\" (UniqueName: \"kubernetes.io/projected/039aaef0-1cf8-4e65-8968-f95625a46e77-kube-api-access-87f72\") pod \"kube-state-metrics-8469c486bb-m877v\" (UID: \"039aaef0-1cf8-4e65-8968-f95625a46e77\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-m877v" Jun 02 07:31:30.672641 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.672606 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-8469c486bb-m877v" Jun 02 07:31:30.814884 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.814845 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-m877v"] Jun 02 07:31:30.819166 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:31:30.819133 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod039aaef0_1cf8_4e65_8968_f95625a46e77.slice/crio-c870d4811dcea96f804e396a2d55ceb018278c8baa475e7d96ea52016a89a531 WatchSource:0}: Error finding container c870d4811dcea96f804e396a2d55ceb018278c8baa475e7d96ea52016a89a531: Status 404 returned error can't find the container with id c870d4811dcea96f804e396a2d55ceb018278c8baa475e7d96ea52016a89a531 Jun 02 07:31:30.947459 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.947366 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-m877v" event={"ID":"039aaef0-1cf8-4e65-8968-f95625a46e77","Type":"ContainerStarted","Data":"c870d4811dcea96f804e396a2d55ceb018278c8baa475e7d96ea52016a89a531"} Jun 02 07:31:30.974167 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:30.974140 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4996005a-a82f-4dad-bb03-6df779a722d3-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-479j2\" (UID: \"4996005a-a82f-4dad-bb03-6df779a722d3\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-479j2" Jun 02 07:31:30.974327 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:31:30.974309 2580 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 02 07:31:30.974404 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:31:30.974395 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4996005a-a82f-4dad-bb03-6df779a722d3-openshift-state-metrics-tls podName:4996005a-a82f-4dad-bb03-6df779a722d3 nodeName:}" failed. No retries permitted until 2026-06-02 07:31:31.974363183 +0000 UTC m=+120.238345230 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/4996005a-a82f-4dad-bb03-6df779a722d3-openshift-state-metrics-tls") pod "openshift-state-metrics-85658796db-479j2" (UID: "4996005a-a82f-4dad-bb03-6df779a722d3") : secret "openshift-state-metrics-tls" not found Jun 02 07:31:31.056423 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:31.056387 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c645bd5c-66p5s" Jun 02 07:31:31.056625 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:31.056556 2580 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c645bd5c-66p5s" Jun 02 07:31:31.061694 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:31.061672 2580 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5c645bd5c-66p5s" Jun 02 07:31:31.075068 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:31.075036 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f2c623c7-0415-49df-9f4e-22e1748c99c2-node-exporter-tls\") pod \"node-exporter-clr5f\" (UID: \"f2c623c7-0415-49df-9f4e-22e1748c99c2\") " pod="openshift-monitoring/node-exporter-clr5f" Jun 02 07:31:31.077573 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:31.077547 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f2c623c7-0415-49df-9f4e-22e1748c99c2-node-exporter-tls\") pod \"node-exporter-clr5f\" (UID: \"f2c623c7-0415-49df-9f4e-22e1748c99c2\") " pod="openshift-monitoring/node-exporter-clr5f" Jun 02 07:31:31.085443 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:31.085424 2580 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5755f749c7-dptlv" Jun 02 07:31:31.089544 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:31.089527 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5755f749c7-dptlv" Jun 02 07:31:31.291516 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:31.291431 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-clr5f" Jun 02 07:31:31.309549 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:31:31.309512 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2c623c7_0415_49df_9f4e_22e1748c99c2.slice/crio-2a1276257d62c38eb07dfc045bac270b33befe8ace1cc7181f2e0ef8ab4f8bfe WatchSource:0}: Error finding container 2a1276257d62c38eb07dfc045bac270b33befe8ace1cc7181f2e0ef8ab4f8bfe: Status 404 returned error can't find the container with id 2a1276257d62c38eb07dfc045bac270b33befe8ace1cc7181f2e0ef8ab4f8bfe Jun 02 07:31:31.414405 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:31.414373 2580 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 07:31:31.418013 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:31.417995 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 07:31:31.420412 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:31.420375 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 02 07:31:31.420519 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:31.420412 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 02 07:31:31.420689 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:31.420652 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 02 07:31:31.420848 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:31.420706 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 02 07:31:31.420848 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:31.420742 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 02 07:31:31.420848 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:31.420756 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 02 07:31:31.421099 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:31.420897 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 02 07:31:31.421099 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:31.420900 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-dthn9\"" Jun 02 07:31:31.421099 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:31.421010 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 02 07:31:31.421099 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:31.421033 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 02 07:31:31.431750 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:31.431730 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 07:31:31.478282 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:31.478256 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/11ab42f0-932b-41b6-9747-fd0369c0f50c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"11ab42f0-932b-41b6-9747-fd0369c0f50c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 07:31:31.478282 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:31.478289 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/11ab42f0-932b-41b6-9747-fd0369c0f50c-config-out\") pod \"alertmanager-main-0\" (UID: \"11ab42f0-932b-41b6-9747-fd0369c0f50c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 07:31:31.478483 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:31.478399 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/11ab42f0-932b-41b6-9747-fd0369c0f50c-config-volume\") pod \"alertmanager-main-0\" (UID: \"11ab42f0-932b-41b6-9747-fd0369c0f50c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 07:31:31.478483 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:31.478468 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xd2mw\" (UniqueName: \"kubernetes.io/projected/11ab42f0-932b-41b6-9747-fd0369c0f50c-kube-api-access-xd2mw\") pod \"alertmanager-main-0\" (UID: \"11ab42f0-932b-41b6-9747-fd0369c0f50c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 07:31:31.478602 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:31.478511 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/11ab42f0-932b-41b6-9747-fd0369c0f50c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"11ab42f0-932b-41b6-9747-fd0369c0f50c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 07:31:31.478602 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:31.478541 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/11ab42f0-932b-41b6-9747-fd0369c0f50c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"11ab42f0-932b-41b6-9747-fd0369c0f50c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 07:31:31.478602 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:31.478569 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/11ab42f0-932b-41b6-9747-fd0369c0f50c-web-config\") pod \"alertmanager-main-0\" (UID: \"11ab42f0-932b-41b6-9747-fd0369c0f50c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 07:31:31.478760 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:31.478620 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/11ab42f0-932b-41b6-9747-fd0369c0f50c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"11ab42f0-932b-41b6-9747-fd0369c0f50c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 07:31:31.478760 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:31.478652 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/11ab42f0-932b-41b6-9747-fd0369c0f50c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"11ab42f0-932b-41b6-9747-fd0369c0f50c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 07:31:31.478760 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:31.478679 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/11ab42f0-932b-41b6-9747-fd0369c0f50c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"11ab42f0-932b-41b6-9747-fd0369c0f50c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 07:31:31.478918 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:31.478752 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/11ab42f0-932b-41b6-9747-fd0369c0f50c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"11ab42f0-932b-41b6-9747-fd0369c0f50c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 07:31:31.478918 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:31.478784 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11ab42f0-932b-41b6-9747-fd0369c0f50c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"11ab42f0-932b-41b6-9747-fd0369c0f50c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 07:31:31.478918 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:31.478818 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11ab42f0-932b-41b6-9747-fd0369c0f50c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"11ab42f0-932b-41b6-9747-fd0369c0f50c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 07:31:31.579665 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:31.579576 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/11ab42f0-932b-41b6-9747-fd0369c0f50c-config-volume\") pod \"alertmanager-main-0\" (UID: \"11ab42f0-932b-41b6-9747-fd0369c0f50c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 07:31:31.579665 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:31.579657 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xd2mw\" (UniqueName: \"kubernetes.io/projected/11ab42f0-932b-41b6-9747-fd0369c0f50c-kube-api-access-xd2mw\") pod \"alertmanager-main-0\" (UID: \"11ab42f0-932b-41b6-9747-fd0369c0f50c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 07:31:31.579900 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:31.579689 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/11ab42f0-932b-41b6-9747-fd0369c0f50c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"11ab42f0-932b-41b6-9747-fd0369c0f50c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 07:31:31.579900 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:31.579716 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/11ab42f0-932b-41b6-9747-fd0369c0f50c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"11ab42f0-932b-41b6-9747-fd0369c0f50c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 07:31:31.579900 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:31.579741 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/11ab42f0-932b-41b6-9747-fd0369c0f50c-web-config\") pod \"alertmanager-main-0\" (UID: \"11ab42f0-932b-41b6-9747-fd0369c0f50c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 07:31:31.579900 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:31.579778 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/11ab42f0-932b-41b6-9747-fd0369c0f50c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"11ab42f0-932b-41b6-9747-fd0369c0f50c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 07:31:31.579900 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:31.579809 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/11ab42f0-932b-41b6-9747-fd0369c0f50c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"11ab42f0-932b-41b6-9747-fd0369c0f50c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 07:31:31.579900 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:31.579842 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/11ab42f0-932b-41b6-9747-fd0369c0f50c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"11ab42f0-932b-41b6-9747-fd0369c0f50c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 07:31:31.579900 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:31.579884 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/11ab42f0-932b-41b6-9747-fd0369c0f50c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"11ab42f0-932b-41b6-9747-fd0369c0f50c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 07:31:31.580170 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:31.579906 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11ab42f0-932b-41b6-9747-fd0369c0f50c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"11ab42f0-932b-41b6-9747-fd0369c0f50c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 07:31:31.580170 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:31.579936 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11ab42f0-932b-41b6-9747-fd0369c0f50c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"11ab42f0-932b-41b6-9747-fd0369c0f50c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 07:31:31.580170 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:31.579987 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/11ab42f0-932b-41b6-9747-fd0369c0f50c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"11ab42f0-932b-41b6-9747-fd0369c0f50c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 07:31:31.580170 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:31.580017 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/11ab42f0-932b-41b6-9747-fd0369c0f50c-config-out\") pod \"alertmanager-main-0\" (UID: \"11ab42f0-932b-41b6-9747-fd0369c0f50c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 07:31:31.580387 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:31.580292 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/11ab42f0-932b-41b6-9747-fd0369c0f50c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"11ab42f0-932b-41b6-9747-fd0369c0f50c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 07:31:31.580442 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:31:31.580406 2580 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 02 07:31:31.580549 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:31:31.580464 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11ab42f0-932b-41b6-9747-fd0369c0f50c-secret-alertmanager-main-tls podName:11ab42f0-932b-41b6-9747-fd0369c0f50c nodeName:}" failed. No retries permitted until 2026-06-02 07:31:32.080444837 +0000 UTC m=+120.344426893 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/11ab42f0-932b-41b6-9747-fd0369c0f50c-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "11ab42f0-932b-41b6-9747-fd0369c0f50c") : secret "alertmanager-main-tls" not found Jun 02 07:31:31.581310 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:31:31.580952 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/11ab42f0-932b-41b6-9747-fd0369c0f50c-alertmanager-trusted-ca-bundle podName:11ab42f0-932b-41b6-9747-fd0369c0f50c nodeName:}" failed. No retries permitted until 2026-06-02 07:31:32.080931284 +0000 UTC m=+120.344913352 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/11ab42f0-932b-41b6-9747-fd0369c0f50c-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "11ab42f0-932b-41b6-9747-fd0369c0f50c") : configmap references non-existent config key: ca-bundle.crt Jun 02 07:31:31.581617 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:31.581590 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11ab42f0-932b-41b6-9747-fd0369c0f50c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"11ab42f0-932b-41b6-9747-fd0369c0f50c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 07:31:31.583924 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:31.583869 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/11ab42f0-932b-41b6-9747-fd0369c0f50c-config-volume\") pod \"alertmanager-main-0\" (UID: \"11ab42f0-932b-41b6-9747-fd0369c0f50c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 07:31:31.584207 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:31.584184 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/11ab42f0-932b-41b6-9747-fd0369c0f50c-config-out\") pod \"alertmanager-main-0\" (UID: \"11ab42f0-932b-41b6-9747-fd0369c0f50c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 07:31:31.584328 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:31.584260 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/11ab42f0-932b-41b6-9747-fd0369c0f50c-web-config\") pod \"alertmanager-main-0\" (UID: \"11ab42f0-932b-41b6-9747-fd0369c0f50c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 07:31:31.584491 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:31.584459 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/11ab42f0-932b-41b6-9747-fd0369c0f50c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"11ab42f0-932b-41b6-9747-fd0369c0f50c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 07:31:31.584554 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:31.584499 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/11ab42f0-932b-41b6-9747-fd0369c0f50c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"11ab42f0-932b-41b6-9747-fd0369c0f50c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 07:31:31.585572 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:31.585539 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/11ab42f0-932b-41b6-9747-fd0369c0f50c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"11ab42f0-932b-41b6-9747-fd0369c0f50c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 07:31:31.585946 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:31.585925 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/11ab42f0-932b-41b6-9747-fd0369c0f50c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"11ab42f0-932b-41b6-9747-fd0369c0f50c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 07:31:31.586553 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:31.586530 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/11ab42f0-932b-41b6-9747-fd0369c0f50c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"11ab42f0-932b-41b6-9747-fd0369c0f50c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 07:31:31.588842 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:31.588822 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xd2mw\" (UniqueName: \"kubernetes.io/projected/11ab42f0-932b-41b6-9747-fd0369c0f50c-kube-api-access-xd2mw\") pod \"alertmanager-main-0\" (UID: \"11ab42f0-932b-41b6-9747-fd0369c0f50c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 07:31:31.952846 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:31.952812 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-clr5f" event={"ID":"f2c623c7-0415-49df-9f4e-22e1748c99c2","Type":"ContainerStarted","Data":"2a1276257d62c38eb07dfc045bac270b33befe8ace1cc7181f2e0ef8ab4f8bfe"} Jun 02 07:31:31.958420 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:31.958393 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5c645bd5c-66p5s" Jun 02 07:31:31.963962 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:31.963814 2580 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5986fdf9f-6j9sv" podUID="b17d2e19-f3da-4433-9d16-476e815d5389" containerName="registry" containerID="cri-o://8234b90abde8a16c395c6cbcc95b0040b57bf28eb8eb11d316e16f72f3ffe0cc" gracePeriod=30 Jun 02 07:31:31.983954 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:31.983926 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4996005a-a82f-4dad-bb03-6df779a722d3-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-479j2\" (UID: \"4996005a-a82f-4dad-bb03-6df779a722d3\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-479j2" Jun 02 07:31:31.987464 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:31.987440 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4996005a-a82f-4dad-bb03-6df779a722d3-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-479j2\" (UID: \"4996005a-a82f-4dad-bb03-6df779a722d3\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-479j2" Jun 02 07:31:32.004588 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:32.004567 2580 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5755f749c7-dptlv"] Jun 02 07:31:32.084888 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:32.084845 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/11ab42f0-932b-41b6-9747-fd0369c0f50c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"11ab42f0-932b-41b6-9747-fd0369c0f50c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 07:31:32.085070 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:32.084899 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11ab42f0-932b-41b6-9747-fd0369c0f50c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"11ab42f0-932b-41b6-9747-fd0369c0f50c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 07:31:32.085892 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:32.085839 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11ab42f0-932b-41b6-9747-fd0369c0f50c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"11ab42f0-932b-41b6-9747-fd0369c0f50c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 07:31:32.088057 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:32.088032 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/11ab42f0-932b-41b6-9747-fd0369c0f50c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"11ab42f0-932b-41b6-9747-fd0369c0f50c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 07:31:32.151970 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:32.151937 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-479j2" Jun 02 07:31:32.331541 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:32.331475 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-dthn9\"" Jun 02 07:31:32.340002 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:32.339979 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 07:31:32.680272 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:32.679780 2580 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5986fdf9f-6j9sv" Jun 02 07:31:32.711333 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:32.711286 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-479j2"] Jun 02 07:31:32.722744 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:31:32.722665 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4996005a_a82f_4dad_bb03_6df779a722d3.slice/crio-711044dffcefe9d298f5d9f016065085f2b6bc95f3675dc282d3f75b256881a2 WatchSource:0}: Error finding container 711044dffcefe9d298f5d9f016065085f2b6bc95f3675dc282d3f75b256881a2: Status 404 returned error can't find the container with id 711044dffcefe9d298f5d9f016065085f2b6bc95f3675dc282d3f75b256881a2 Jun 02 07:31:32.762664 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:32.762590 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 07:31:32.770909 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:31:32.770859 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11ab42f0_932b_41b6_9747_fd0369c0f50c.slice/crio-7607fcd2248a02cc3383ee503c0f82e0ae8ac97c4dd8105e30753ca1055b4966 WatchSource:0}: Error finding container 7607fcd2248a02cc3383ee503c0f82e0ae8ac97c4dd8105e30753ca1055b4966: Status 404 returned error can't find the container with id 7607fcd2248a02cc3383ee503c0f82e0ae8ac97c4dd8105e30753ca1055b4966 Jun 02 07:31:32.792770 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:32.792730 2580 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b17d2e19-f3da-4433-9d16-476e815d5389-ca-trust-extracted\") pod \"b17d2e19-f3da-4433-9d16-476e815d5389\" (UID: \"b17d2e19-f3da-4433-9d16-476e815d5389\") " Jun 02 07:31:32.792902 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:32.792794 2580 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b17d2e19-f3da-4433-9d16-476e815d5389-installation-pull-secrets\") pod \"b17d2e19-f3da-4433-9d16-476e815d5389\" (UID: \"b17d2e19-f3da-4433-9d16-476e815d5389\") " Jun 02 07:31:32.792902 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:32.792817 2580 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b17d2e19-f3da-4433-9d16-476e815d5389-registry-tls\") pod \"b17d2e19-f3da-4433-9d16-476e815d5389\" (UID: \"b17d2e19-f3da-4433-9d16-476e815d5389\") " Jun 02 07:31:32.792902 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:32.792863 2580 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b17d2e19-f3da-4433-9d16-476e815d5389-bound-sa-token\") pod \"b17d2e19-f3da-4433-9d16-476e815d5389\" (UID: \"b17d2e19-f3da-4433-9d16-476e815d5389\") " Jun 02 07:31:32.792902 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:32.792891 2580 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b17d2e19-f3da-4433-9d16-476e815d5389-registry-certificates\") pod \"b17d2e19-f3da-4433-9d16-476e815d5389\" (UID: \"b17d2e19-f3da-4433-9d16-476e815d5389\") " Jun 02 07:31:32.793106 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:32.792932 2580 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b17d2e19-f3da-4433-9d16-476e815d5389-image-registry-private-configuration\") pod \"b17d2e19-f3da-4433-9d16-476e815d5389\" (UID: \"b17d2e19-f3da-4433-9d16-476e815d5389\") " Jun 02 07:31:32.793106 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:32.792973 2580 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g2dbx\" (UniqueName: \"kubernetes.io/projected/b17d2e19-f3da-4433-9d16-476e815d5389-kube-api-access-g2dbx\") pod \"b17d2e19-f3da-4433-9d16-476e815d5389\" (UID: \"b17d2e19-f3da-4433-9d16-476e815d5389\") " Jun 02 07:31:32.793106 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:32.793002 2580 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b17d2e19-f3da-4433-9d16-476e815d5389-trusted-ca\") pod \"b17d2e19-f3da-4433-9d16-476e815d5389\" (UID: \"b17d2e19-f3da-4433-9d16-476e815d5389\") " Jun 02 07:31:32.793714 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:32.793661 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b17d2e19-f3da-4433-9d16-476e815d5389-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "b17d2e19-f3da-4433-9d16-476e815d5389" (UID: "b17d2e19-f3da-4433-9d16-476e815d5389"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 07:31:32.794325 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:32.794285 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b17d2e19-f3da-4433-9d16-476e815d5389-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "b17d2e19-f3da-4433-9d16-476e815d5389" (UID: "b17d2e19-f3da-4433-9d16-476e815d5389"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 07:31:32.796086 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:32.796037 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b17d2e19-f3da-4433-9d16-476e815d5389-kube-api-access-g2dbx" (OuterVolumeSpecName: "kube-api-access-g2dbx") pod "b17d2e19-f3da-4433-9d16-476e815d5389" (UID: "b17d2e19-f3da-4433-9d16-476e815d5389"). InnerVolumeSpecName "kube-api-access-g2dbx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 07:31:32.796086 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:32.796054 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b17d2e19-f3da-4433-9d16-476e815d5389-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "b17d2e19-f3da-4433-9d16-476e815d5389" (UID: "b17d2e19-f3da-4433-9d16-476e815d5389"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 07:31:32.796086 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:32.796035 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b17d2e19-f3da-4433-9d16-476e815d5389-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "b17d2e19-f3da-4433-9d16-476e815d5389" (UID: "b17d2e19-f3da-4433-9d16-476e815d5389"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 07:31:32.796352 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:32.796286 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b17d2e19-f3da-4433-9d16-476e815d5389-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "b17d2e19-f3da-4433-9d16-476e815d5389" (UID: "b17d2e19-f3da-4433-9d16-476e815d5389"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 07:31:32.796352 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:32.796324 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b17d2e19-f3da-4433-9d16-476e815d5389-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "b17d2e19-f3da-4433-9d16-476e815d5389" (UID: "b17d2e19-f3da-4433-9d16-476e815d5389"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 07:31:32.806139 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:32.806109 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b17d2e19-f3da-4433-9d16-476e815d5389-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "b17d2e19-f3da-4433-9d16-476e815d5389" (UID: "b17d2e19-f3da-4433-9d16-476e815d5389"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 07:31:32.893826 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:32.893702 2580 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b17d2e19-f3da-4433-9d16-476e815d5389-image-registry-private-configuration\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jun 02 07:31:32.893826 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:32.893732 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g2dbx\" (UniqueName: \"kubernetes.io/projected/b17d2e19-f3da-4433-9d16-476e815d5389-kube-api-access-g2dbx\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jun 02 07:31:32.893826 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:32.893744 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b17d2e19-f3da-4433-9d16-476e815d5389-trusted-ca\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jun 02 07:31:32.893826 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:32.893753 2580 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b17d2e19-f3da-4433-9d16-476e815d5389-ca-trust-extracted\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jun 02 07:31:32.893826 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:32.893762 2580 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b17d2e19-f3da-4433-9d16-476e815d5389-installation-pull-secrets\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jun 02 07:31:32.893826 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:32.893770 2580 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b17d2e19-f3da-4433-9d16-476e815d5389-registry-tls\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jun 02 07:31:32.893826 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:32.893778 2580 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b17d2e19-f3da-4433-9d16-476e815d5389-bound-sa-token\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jun 02 07:31:32.893826 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:32.893792 2580 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b17d2e19-f3da-4433-9d16-476e815d5389-registry-certificates\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jun 02 07:31:32.956504 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:32.956464 2580 generic.go:358] "Generic (PLEG): container finished" podID="f2c623c7-0415-49df-9f4e-22e1748c99c2" containerID="4f698c9efbf772a44250388493a61d3c23a34a82f7866c9f7a5412720cdc445b" exitCode=0 Jun 02 07:31:32.956703 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:32.956544 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-clr5f" event={"ID":"f2c623c7-0415-49df-9f4e-22e1748c99c2","Type":"ContainerDied","Data":"4f698c9efbf772a44250388493a61d3c23a34a82f7866c9f7a5412720cdc445b"} Jun 02 07:31:32.958445 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:32.958417 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-479j2" event={"ID":"4996005a-a82f-4dad-bb03-6df779a722d3","Type":"ContainerStarted","Data":"50b301c2434d7fc080f08498732462cb64f2d720e923d1548f54d4389fa56183"} Jun 02 07:31:32.958555 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:32.958452 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-479j2" event={"ID":"4996005a-a82f-4dad-bb03-6df779a722d3","Type":"ContainerStarted","Data":"d716154b1ee08a2fea0a79f59d38a2d2ce2486aa4e63172e91098e3b3722c032"} Jun 02 07:31:32.958555 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:32.958466 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-479j2" event={"ID":"4996005a-a82f-4dad-bb03-6df779a722d3","Type":"ContainerStarted","Data":"711044dffcefe9d298f5d9f016065085f2b6bc95f3675dc282d3f75b256881a2"} Jun 02 07:31:32.961297 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:32.961271 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-m877v" event={"ID":"039aaef0-1cf8-4e65-8968-f95625a46e77","Type":"ContainerStarted","Data":"935d813ccbe8b4e8be0a2fb5e02c2d4f82026091a17a4f009de617194a7eca86"} Jun 02 07:31:32.961380 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:32.961305 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-m877v" event={"ID":"039aaef0-1cf8-4e65-8968-f95625a46e77","Type":"ContainerStarted","Data":"3358e61626c1f2ad4349610d460cc390e77461f3e93b02f9115823bc7c6fba69"} Jun 02 07:31:32.961380 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:32.961322 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-m877v" event={"ID":"039aaef0-1cf8-4e65-8968-f95625a46e77","Type":"ContainerStarted","Data":"99a6522c5658631412555ff0aaa34db98eac7af2ec4fa07341704cc5eb12e413"} Jun 02 07:31:32.962833 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:32.962810 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"11ab42f0-932b-41b6-9747-fd0369c0f50c","Type":"ContainerStarted","Data":"7607fcd2248a02cc3383ee503c0f82e0ae8ac97c4dd8105e30753ca1055b4966"} Jun 02 07:31:32.963989 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:32.963968 2580 generic.go:358] "Generic (PLEG): container finished" podID="b17d2e19-f3da-4433-9d16-476e815d5389" containerID="8234b90abde8a16c395c6cbcc95b0040b57bf28eb8eb11d316e16f72f3ffe0cc" exitCode=0 Jun 02 07:31:32.964075 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:32.964029 2580 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5986fdf9f-6j9sv" Jun 02 07:31:32.964123 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:32.964030 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5986fdf9f-6j9sv" event={"ID":"b17d2e19-f3da-4433-9d16-476e815d5389","Type":"ContainerDied","Data":"8234b90abde8a16c395c6cbcc95b0040b57bf28eb8eb11d316e16f72f3ffe0cc"} Jun 02 07:31:32.964158 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:32.964121 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5986fdf9f-6j9sv" event={"ID":"b17d2e19-f3da-4433-9d16-476e815d5389","Type":"ContainerDied","Data":"795753fe496bdbfc53ba7534a1f9298ac448216ff78e80c8fbe583955e0561ff"} Jun 02 07:31:32.964158 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:32.964141 2580 scope.go:117] "RemoveContainer" containerID="8234b90abde8a16c395c6cbcc95b0040b57bf28eb8eb11d316e16f72f3ffe0cc" Jun 02 07:31:32.974468 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:32.972843 2580 scope.go:117] "RemoveContainer" containerID="8234b90abde8a16c395c6cbcc95b0040b57bf28eb8eb11d316e16f72f3ffe0cc" Jun 02 07:31:32.975289 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:31:32.974690 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8234b90abde8a16c395c6cbcc95b0040b57bf28eb8eb11d316e16f72f3ffe0cc\": container with ID starting with 8234b90abde8a16c395c6cbcc95b0040b57bf28eb8eb11d316e16f72f3ffe0cc not found: ID does not exist" containerID="8234b90abde8a16c395c6cbcc95b0040b57bf28eb8eb11d316e16f72f3ffe0cc" Jun 02 07:31:32.975289 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:32.974723 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8234b90abde8a16c395c6cbcc95b0040b57bf28eb8eb11d316e16f72f3ffe0cc"} err="failed to get container status \"8234b90abde8a16c395c6cbcc95b0040b57bf28eb8eb11d316e16f72f3ffe0cc\": rpc error: code = NotFound desc = could not find container \"8234b90abde8a16c395c6cbcc95b0040b57bf28eb8eb11d316e16f72f3ffe0cc\": container with ID starting with 8234b90abde8a16c395c6cbcc95b0040b57bf28eb8eb11d316e16f72f3ffe0cc not found: ID does not exist" Jun 02 07:31:32.992072 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:32.992033 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-8469c486bb-m877v" podStartSLOduration=1.2673876210000001 podStartE2EDuration="2.992021183s" podCreationTimestamp="2026-06-02 07:31:30 +0000 UTC" firstStartedPulling="2026-06-02 07:31:30.821195514 +0000 UTC m=+119.085177562" lastFinishedPulling="2026-06-02 07:31:32.54582908 +0000 UTC m=+120.809811124" observedRunningTime="2026-06-02 07:31:32.99093264 +0000 UTC m=+121.254914708" watchObservedRunningTime="2026-06-02 07:31:32.992021183 +0000 UTC m=+121.256003612" Jun 02 07:31:33.009402 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:33.009372 2580 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5986fdf9f-6j9sv"] Jun 02 07:31:33.014766 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:33.014743 2580 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5986fdf9f-6j9sv"] Jun 02 07:31:33.457433 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:33.457398 2580 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5976d4747-w2ph2"] Jun 02 07:31:33.457734 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:33.457722 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b17d2e19-f3da-4433-9d16-476e815d5389" containerName="registry" Jun 02 07:31:33.457778 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:33.457738 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b17d2e19-f3da-4433-9d16-476e815d5389" containerName="registry" Jun 02 07:31:33.457812 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:33.457792 2580 memory_manager.go:356] "RemoveStaleState removing state" podUID="b17d2e19-f3da-4433-9d16-476e815d5389" containerName="registry" Jun 02 07:31:33.460024 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:33.459996 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5976d4747-w2ph2" Jun 02 07:31:33.462432 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:33.462407 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 02 07:31:33.462432 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:33.462417 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 02 07:31:33.462707 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:33.462685 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-qbj7b\"" Jun 02 07:31:33.462824 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:33.462724 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-dchg7htfl54n5\"" Jun 02 07:31:33.462885 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:33.462865 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 02 07:31:33.463007 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:33.462978 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 02 07:31:33.463121 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:33.463015 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 02 07:31:33.474328 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:33.474306 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5976d4747-w2ph2"] Jun 02 07:31:33.499976 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:33.499946 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbdvw\" (UniqueName: \"kubernetes.io/projected/25f32ea0-bc07-4b1f-8750-9568eac758ff-kube-api-access-qbdvw\") pod \"thanos-querier-5976d4747-w2ph2\" (UID: \"25f32ea0-bc07-4b1f-8750-9568eac758ff\") " pod="openshift-monitoring/thanos-querier-5976d4747-w2ph2" Jun 02 07:31:33.500088 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:33.499990 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/25f32ea0-bc07-4b1f-8750-9568eac758ff-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5976d4747-w2ph2\" (UID: \"25f32ea0-bc07-4b1f-8750-9568eac758ff\") " pod="openshift-monitoring/thanos-querier-5976d4747-w2ph2" Jun 02 07:31:33.500135 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:33.500079 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/25f32ea0-bc07-4b1f-8750-9568eac758ff-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5976d4747-w2ph2\" (UID: \"25f32ea0-bc07-4b1f-8750-9568eac758ff\") " pod="openshift-monitoring/thanos-querier-5976d4747-w2ph2" Jun 02 07:31:33.500135 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:33.500126 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/25f32ea0-bc07-4b1f-8750-9568eac758ff-secret-thanos-querier-tls\") pod \"thanos-querier-5976d4747-w2ph2\" (UID: \"25f32ea0-bc07-4b1f-8750-9568eac758ff\") " pod="openshift-monitoring/thanos-querier-5976d4747-w2ph2" Jun 02 07:31:33.500193 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:33.500174 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/25f32ea0-bc07-4b1f-8750-9568eac758ff-metrics-client-ca\") pod \"thanos-querier-5976d4747-w2ph2\" (UID: \"25f32ea0-bc07-4b1f-8750-9568eac758ff\") " pod="openshift-monitoring/thanos-querier-5976d4747-w2ph2" Jun 02 07:31:33.500256 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:33.500238 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/25f32ea0-bc07-4b1f-8750-9568eac758ff-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5976d4747-w2ph2\" (UID: \"25f32ea0-bc07-4b1f-8750-9568eac758ff\") " pod="openshift-monitoring/thanos-querier-5976d4747-w2ph2" Jun 02 07:31:33.500314 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:33.500279 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/25f32ea0-bc07-4b1f-8750-9568eac758ff-secret-grpc-tls\") pod \"thanos-querier-5976d4747-w2ph2\" (UID: \"25f32ea0-bc07-4b1f-8750-9568eac758ff\") " pod="openshift-monitoring/thanos-querier-5976d4747-w2ph2" Jun 02 07:31:33.500352 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:33.500333 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/25f32ea0-bc07-4b1f-8750-9568eac758ff-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5976d4747-w2ph2\" (UID: \"25f32ea0-bc07-4b1f-8750-9568eac758ff\") " pod="openshift-monitoring/thanos-querier-5976d4747-w2ph2" Jun 02 07:31:33.601539 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:33.601497 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/25f32ea0-bc07-4b1f-8750-9568eac758ff-metrics-client-ca\") pod \"thanos-querier-5976d4747-w2ph2\" (UID: \"25f32ea0-bc07-4b1f-8750-9568eac758ff\") " pod="openshift-monitoring/thanos-querier-5976d4747-w2ph2" Jun 02 07:31:33.601689 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:33.601614 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/25f32ea0-bc07-4b1f-8750-9568eac758ff-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5976d4747-w2ph2\" (UID: \"25f32ea0-bc07-4b1f-8750-9568eac758ff\") " pod="openshift-monitoring/thanos-querier-5976d4747-w2ph2" Jun 02 07:31:33.601689 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:33.601656 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/25f32ea0-bc07-4b1f-8750-9568eac758ff-secret-grpc-tls\") pod \"thanos-querier-5976d4747-w2ph2\" (UID: \"25f32ea0-bc07-4b1f-8750-9568eac758ff\") " pod="openshift-monitoring/thanos-querier-5976d4747-w2ph2" Jun 02 07:31:33.601689 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:33.601681 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/25f32ea0-bc07-4b1f-8750-9568eac758ff-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5976d4747-w2ph2\" (UID: \"25f32ea0-bc07-4b1f-8750-9568eac758ff\") " pod="openshift-monitoring/thanos-querier-5976d4747-w2ph2" Jun 02 07:31:33.601856 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:33.601730 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qbdvw\" (UniqueName: \"kubernetes.io/projected/25f32ea0-bc07-4b1f-8750-9568eac758ff-kube-api-access-qbdvw\") pod \"thanos-querier-5976d4747-w2ph2\" (UID: \"25f32ea0-bc07-4b1f-8750-9568eac758ff\") " pod="openshift-monitoring/thanos-querier-5976d4747-w2ph2" Jun 02 07:31:33.601856 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:33.601760 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/25f32ea0-bc07-4b1f-8750-9568eac758ff-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5976d4747-w2ph2\" (UID: \"25f32ea0-bc07-4b1f-8750-9568eac758ff\") " pod="openshift-monitoring/thanos-querier-5976d4747-w2ph2" Jun 02 07:31:33.601856 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:33.601817 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/25f32ea0-bc07-4b1f-8750-9568eac758ff-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5976d4747-w2ph2\" (UID: \"25f32ea0-bc07-4b1f-8750-9568eac758ff\") " pod="openshift-monitoring/thanos-querier-5976d4747-w2ph2" Jun 02 07:31:33.601856 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:33.601845 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/25f32ea0-bc07-4b1f-8750-9568eac758ff-secret-thanos-querier-tls\") pod \"thanos-querier-5976d4747-w2ph2\" (UID: \"25f32ea0-bc07-4b1f-8750-9568eac758ff\") " pod="openshift-monitoring/thanos-querier-5976d4747-w2ph2" Jun 02 07:31:33.602338 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:33.602310 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/25f32ea0-bc07-4b1f-8750-9568eac758ff-metrics-client-ca\") pod \"thanos-querier-5976d4747-w2ph2\" (UID: \"25f32ea0-bc07-4b1f-8750-9568eac758ff\") " pod="openshift-monitoring/thanos-querier-5976d4747-w2ph2" Jun 02 07:31:33.604570 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:33.604538 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/25f32ea0-bc07-4b1f-8750-9568eac758ff-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5976d4747-w2ph2\" (UID: \"25f32ea0-bc07-4b1f-8750-9568eac758ff\") " pod="openshift-monitoring/thanos-querier-5976d4747-w2ph2" Jun 02 07:31:33.604999 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:33.604976 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/25f32ea0-bc07-4b1f-8750-9568eac758ff-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5976d4747-w2ph2\" (UID: \"25f32ea0-bc07-4b1f-8750-9568eac758ff\") " pod="openshift-monitoring/thanos-querier-5976d4747-w2ph2" Jun 02 07:31:33.605071 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:33.605036 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/25f32ea0-bc07-4b1f-8750-9568eac758ff-secret-thanos-querier-tls\") pod \"thanos-querier-5976d4747-w2ph2\" (UID: \"25f32ea0-bc07-4b1f-8750-9568eac758ff\") " pod="openshift-monitoring/thanos-querier-5976d4747-w2ph2" Jun 02 07:31:33.605145 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:33.605121 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/25f32ea0-bc07-4b1f-8750-9568eac758ff-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5976d4747-w2ph2\" (UID: \"25f32ea0-bc07-4b1f-8750-9568eac758ff\") " pod="openshift-monitoring/thanos-querier-5976d4747-w2ph2" Jun 02 07:31:33.605201 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:33.605141 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/25f32ea0-bc07-4b1f-8750-9568eac758ff-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5976d4747-w2ph2\" (UID: \"25f32ea0-bc07-4b1f-8750-9568eac758ff\") " pod="openshift-monitoring/thanos-querier-5976d4747-w2ph2" Jun 02 07:31:33.605515 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:33.605497 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/25f32ea0-bc07-4b1f-8750-9568eac758ff-secret-grpc-tls\") pod \"thanos-querier-5976d4747-w2ph2\" (UID: \"25f32ea0-bc07-4b1f-8750-9568eac758ff\") " pod="openshift-monitoring/thanos-querier-5976d4747-w2ph2" Jun 02 07:31:33.615129 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:33.615104 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbdvw\" (UniqueName: \"kubernetes.io/projected/25f32ea0-bc07-4b1f-8750-9568eac758ff-kube-api-access-qbdvw\") pod \"thanos-querier-5976d4747-w2ph2\" (UID: \"25f32ea0-bc07-4b1f-8750-9568eac758ff\") " pod="openshift-monitoring/thanos-querier-5976d4747-w2ph2" Jun 02 07:31:33.771391 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:33.771310 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5976d4747-w2ph2" Jun 02 07:31:33.967932 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:33.967888 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5976d4747-w2ph2"] Jun 02 07:31:33.973057 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:33.973023 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-clr5f" event={"ID":"f2c623c7-0415-49df-9f4e-22e1748c99c2","Type":"ContainerStarted","Data":"aac0f3640e78097da9fbbdfae2030a95aee1e36fea539da56327bfecad37189b"} Jun 02 07:31:33.973192 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:33.973066 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-clr5f" event={"ID":"f2c623c7-0415-49df-9f4e-22e1748c99c2","Type":"ContainerStarted","Data":"2f498387e3bb55283d7e516aa08fb64a9167346771fd1cb1619df144a5984e88"} Jun 02 07:31:34.140284 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:31:34.140247 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25f32ea0_bc07_4b1f_8750_9568eac758ff.slice/crio-4cfe8de0baad715d63178c6a7e6b14a0d6b1d2ee2df4254f25162c89b10060b5 WatchSource:0}: Error finding container 4cfe8de0baad715d63178c6a7e6b14a0d6b1d2ee2df4254f25162c89b10060b5: Status 404 returned error can't find the container with id 4cfe8de0baad715d63178c6a7e6b14a0d6b1d2ee2df4254f25162c89b10060b5 Jun 02 07:31:34.378597 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:34.378573 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b17d2e19-f3da-4433-9d16-476e815d5389" path="/var/lib/kubelet/pods/b17d2e19-f3da-4433-9d16-476e815d5389/volumes" Jun 02 07:31:34.646773 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:34.646667 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-clr5f" podStartSLOduration=3.41088439 podStartE2EDuration="4.646652395s" podCreationTimestamp="2026-06-02 07:31:30 +0000 UTC" firstStartedPulling="2026-06-02 07:31:31.312023363 +0000 UTC m=+119.576005420" lastFinishedPulling="2026-06-02 07:31:32.547791367 +0000 UTC m=+120.811773425" observedRunningTime="2026-06-02 07:31:33.991633949 +0000 UTC m=+122.255616017" watchObservedRunningTime="2026-06-02 07:31:34.646652395 +0000 UTC m=+122.910634462" Jun 02 07:31:34.647111 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:34.647094 2580 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6788db7769-ktbv4"] Jun 02 07:31:34.649820 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:34.649798 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6788db7769-ktbv4" Jun 02 07:31:34.652340 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:34.652208 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-5ig2ljpu4dst7\"" Jun 02 07:31:34.652340 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:34.652252 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 02 07:31:34.652340 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:34.652278 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 02 07:31:34.652340 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:34.652328 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 02 07:31:34.652639 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:34.652622 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-xttxr\"" Jun 02 07:31:34.652734 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:34.652675 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 02 07:31:34.660727 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:34.660700 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6788db7769-ktbv4"] Jun 02 07:31:34.720598 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:34.720532 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfncx\" (UniqueName: \"kubernetes.io/projected/2130ac45-091c-4264-85d9-79b7e8e155d4-kube-api-access-pfncx\") pod \"metrics-server-6788db7769-ktbv4\" (UID: \"2130ac45-091c-4264-85d9-79b7e8e155d4\") " pod="openshift-monitoring/metrics-server-6788db7769-ktbv4" Jun 02 07:31:34.720773 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:34.720619 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2130ac45-091c-4264-85d9-79b7e8e155d4-secret-metrics-server-tls\") pod \"metrics-server-6788db7769-ktbv4\" (UID: \"2130ac45-091c-4264-85d9-79b7e8e155d4\") " pod="openshift-monitoring/metrics-server-6788db7769-ktbv4" Jun 02 07:31:34.720773 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:34.720650 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2130ac45-091c-4264-85d9-79b7e8e155d4-metrics-server-audit-profiles\") pod \"metrics-server-6788db7769-ktbv4\" (UID: \"2130ac45-091c-4264-85d9-79b7e8e155d4\") " pod="openshift-monitoring/metrics-server-6788db7769-ktbv4" Jun 02 07:31:34.720773 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:34.720750 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2130ac45-091c-4264-85d9-79b7e8e155d4-secret-metrics-server-client-certs\") pod \"metrics-server-6788db7769-ktbv4\" (UID: \"2130ac45-091c-4264-85d9-79b7e8e155d4\") " pod="openshift-monitoring/metrics-server-6788db7769-ktbv4" Jun 02 07:31:34.720943 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:34.720803 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2130ac45-091c-4264-85d9-79b7e8e155d4-client-ca-bundle\") pod \"metrics-server-6788db7769-ktbv4\" (UID: \"2130ac45-091c-4264-85d9-79b7e8e155d4\") " pod="openshift-monitoring/metrics-server-6788db7769-ktbv4" Jun 02 07:31:34.720943 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:34.720832 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2130ac45-091c-4264-85d9-79b7e8e155d4-audit-log\") pod \"metrics-server-6788db7769-ktbv4\" (UID: \"2130ac45-091c-4264-85d9-79b7e8e155d4\") " pod="openshift-monitoring/metrics-server-6788db7769-ktbv4" Jun 02 07:31:34.720943 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:34.720897 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2130ac45-091c-4264-85d9-79b7e8e155d4-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6788db7769-ktbv4\" (UID: \"2130ac45-091c-4264-85d9-79b7e8e155d4\") " pod="openshift-monitoring/metrics-server-6788db7769-ktbv4" Jun 02 07:31:34.822061 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:34.822027 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2130ac45-091c-4264-85d9-79b7e8e155d4-metrics-server-audit-profiles\") pod \"metrics-server-6788db7769-ktbv4\" (UID: \"2130ac45-091c-4264-85d9-79b7e8e155d4\") " pod="openshift-monitoring/metrics-server-6788db7769-ktbv4" Jun 02 07:31:34.822562 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:34.822111 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2130ac45-091c-4264-85d9-79b7e8e155d4-secret-metrics-server-client-certs\") pod \"metrics-server-6788db7769-ktbv4\" (UID: \"2130ac45-091c-4264-85d9-79b7e8e155d4\") " pod="openshift-monitoring/metrics-server-6788db7769-ktbv4" Jun 02 07:31:34.822562 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:34.822151 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2130ac45-091c-4264-85d9-79b7e8e155d4-client-ca-bundle\") pod \"metrics-server-6788db7769-ktbv4\" (UID: \"2130ac45-091c-4264-85d9-79b7e8e155d4\") " pod="openshift-monitoring/metrics-server-6788db7769-ktbv4" Jun 02 07:31:34.822562 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:34.822177 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2130ac45-091c-4264-85d9-79b7e8e155d4-audit-log\") pod \"metrics-server-6788db7769-ktbv4\" (UID: \"2130ac45-091c-4264-85d9-79b7e8e155d4\") " pod="openshift-monitoring/metrics-server-6788db7769-ktbv4" Jun 02 07:31:34.822562 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:34.822257 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2130ac45-091c-4264-85d9-79b7e8e155d4-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6788db7769-ktbv4\" (UID: \"2130ac45-091c-4264-85d9-79b7e8e155d4\") " pod="openshift-monitoring/metrics-server-6788db7769-ktbv4" Jun 02 07:31:34.822562 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:34.822310 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pfncx\" (UniqueName: \"kubernetes.io/projected/2130ac45-091c-4264-85d9-79b7e8e155d4-kube-api-access-pfncx\") pod \"metrics-server-6788db7769-ktbv4\" (UID: \"2130ac45-091c-4264-85d9-79b7e8e155d4\") " pod="openshift-monitoring/metrics-server-6788db7769-ktbv4" Jun 02 07:31:34.822562 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:34.822358 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2130ac45-091c-4264-85d9-79b7e8e155d4-secret-metrics-server-tls\") pod \"metrics-server-6788db7769-ktbv4\" (UID: \"2130ac45-091c-4264-85d9-79b7e8e155d4\") " pod="openshift-monitoring/metrics-server-6788db7769-ktbv4" Jun 02 07:31:34.823056 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:34.823031 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2130ac45-091c-4264-85d9-79b7e8e155d4-audit-log\") pod \"metrics-server-6788db7769-ktbv4\" (UID: \"2130ac45-091c-4264-85d9-79b7e8e155d4\") " pod="openshift-monitoring/metrics-server-6788db7769-ktbv4" Jun 02 07:31:34.823342 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:34.823321 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2130ac45-091c-4264-85d9-79b7e8e155d4-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6788db7769-ktbv4\" (UID: \"2130ac45-091c-4264-85d9-79b7e8e155d4\") " pod="openshift-monitoring/metrics-server-6788db7769-ktbv4" Jun 02 07:31:34.827030 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:34.823537 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2130ac45-091c-4264-85d9-79b7e8e155d4-metrics-server-audit-profiles\") pod \"metrics-server-6788db7769-ktbv4\" (UID: \"2130ac45-091c-4264-85d9-79b7e8e155d4\") " pod="openshift-monitoring/metrics-server-6788db7769-ktbv4" Jun 02 07:31:34.827030 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:34.826089 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2130ac45-091c-4264-85d9-79b7e8e155d4-client-ca-bundle\") pod \"metrics-server-6788db7769-ktbv4\" (UID: \"2130ac45-091c-4264-85d9-79b7e8e155d4\") " pod="openshift-monitoring/metrics-server-6788db7769-ktbv4" Jun 02 07:31:34.827030 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:34.826148 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2130ac45-091c-4264-85d9-79b7e8e155d4-secret-metrics-server-client-certs\") pod \"metrics-server-6788db7769-ktbv4\" (UID: \"2130ac45-091c-4264-85d9-79b7e8e155d4\") " pod="openshift-monitoring/metrics-server-6788db7769-ktbv4" Jun 02 07:31:34.830454 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:34.830430 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2130ac45-091c-4264-85d9-79b7e8e155d4-secret-metrics-server-tls\") pod \"metrics-server-6788db7769-ktbv4\" (UID: \"2130ac45-091c-4264-85d9-79b7e8e155d4\") " pod="openshift-monitoring/metrics-server-6788db7769-ktbv4" Jun 02 07:31:34.831778 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:34.831755 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfncx\" (UniqueName: \"kubernetes.io/projected/2130ac45-091c-4264-85d9-79b7e8e155d4-kube-api-access-pfncx\") pod \"metrics-server-6788db7769-ktbv4\" (UID: \"2130ac45-091c-4264-85d9-79b7e8e155d4\") " pod="openshift-monitoring/metrics-server-6788db7769-ktbv4" Jun 02 07:31:34.962741 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:34.962644 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6788db7769-ktbv4" Jun 02 07:31:34.979578 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:34.979446 2580 generic.go:358] "Generic (PLEG): container finished" podID="11ab42f0-932b-41b6-9747-fd0369c0f50c" containerID="c1266b61972132bada40b3a5b2e576f94baa2b563dd463cf2238b72418c68394" exitCode=0 Jun 02 07:31:34.979578 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:34.979539 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"11ab42f0-932b-41b6-9747-fd0369c0f50c","Type":"ContainerDied","Data":"c1266b61972132bada40b3a5b2e576f94baa2b563dd463cf2238b72418c68394"} Jun 02 07:31:34.980859 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:34.980827 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5976d4747-w2ph2" event={"ID":"25f32ea0-bc07-4b1f-8750-9568eac758ff","Type":"ContainerStarted","Data":"4cfe8de0baad715d63178c6a7e6b14a0d6b1d2ee2df4254f25162c89b10060b5"} Jun 02 07:31:34.983805 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:34.983763 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-479j2" event={"ID":"4996005a-a82f-4dad-bb03-6df779a722d3","Type":"ContainerStarted","Data":"4705f2054066b875945671ee6a26f629a531554f8e32147235f329e43b48be82"} Jun 02 07:31:35.019539 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:35.018268 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-85658796db-479j2" podStartSLOduration=3.565099994 podStartE2EDuration="5.018251624s" podCreationTimestamp="2026-06-02 07:31:30 +0000 UTC" firstStartedPulling="2026-06-02 07:31:32.921810398 +0000 UTC m=+121.185792442" lastFinishedPulling="2026-06-02 07:31:34.374962008 +0000 UTC m=+122.638944072" observedRunningTime="2026-06-02 07:31:35.016279891 +0000 UTC m=+123.280261960" watchObservedRunningTime="2026-06-02 07:31:35.018251624 +0000 UTC m=+123.282233668" Jun 02 07:31:35.112758 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:35.112722 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6788db7769-ktbv4"] Jun 02 07:31:35.117230 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:31:35.117187 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2130ac45_091c_4264_85d9_79b7e8e155d4.slice/crio-15017e66e642dec17bd62bbd855f937a146ab82779de819aac2b0b5de7e4dea1 WatchSource:0}: Error finding container 15017e66e642dec17bd62bbd855f937a146ab82779de819aac2b0b5de7e4dea1: Status 404 returned error can't find the container with id 15017e66e642dec17bd62bbd855f937a146ab82779de819aac2b0b5de7e4dea1 Jun 02 07:31:35.137162 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:35.137126 2580 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-4qz2p"] Jun 02 07:31:35.140813 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:35.140787 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-4qz2p" Jun 02 07:31:35.143501 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:35.143479 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-cr6n5\"" Jun 02 07:31:35.143652 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:35.143501 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 02 07:31:35.147698 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:35.147667 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-4qz2p"] Jun 02 07:31:35.226958 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:35.226872 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/22d5228c-3c0d-410e-867c-eb891d7e3895-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-4qz2p\" (UID: \"22d5228c-3c0d-410e-867c-eb891d7e3895\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-4qz2p" Jun 02 07:31:35.327828 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:35.327793 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/22d5228c-3c0d-410e-867c-eb891d7e3895-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-4qz2p\" (UID: \"22d5228c-3c0d-410e-867c-eb891d7e3895\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-4qz2p" Jun 02 07:31:35.330371 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:35.330351 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/22d5228c-3c0d-410e-867c-eb891d7e3895-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-4qz2p\" (UID: \"22d5228c-3c0d-410e-867c-eb891d7e3895\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-4qz2p" Jun 02 07:31:35.453862 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:35.453820 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-4qz2p" Jun 02 07:31:35.548576 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:35.548493 2580 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-686f5dd774-tfhhp"] Jun 02 07:31:35.552391 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:35.552362 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-686f5dd774-tfhhp" Jun 02 07:31:35.555445 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:35.555272 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 02 07:31:35.556512 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:35.555716 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 02 07:31:35.556512 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:35.555900 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-rkgbl\"" Jun 02 07:31:35.556512 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:35.556043 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 02 07:31:35.556512 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:35.556181 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 02 07:31:35.556512 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:35.556365 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 02 07:31:35.560873 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:35.560853 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 02 07:31:35.567270 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:35.567208 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-686f5dd774-tfhhp"] Jun 02 07:31:35.606697 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:35.606673 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-4qz2p"] Jun 02 07:31:35.609639 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:31:35.609608 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22d5228c_3c0d_410e_867c_eb891d7e3895.slice/crio-a3385e6b6c7b7989eac1bbded6fc3a87cbf86db1ceb6d357ac67cc159031f336 WatchSource:0}: Error finding container a3385e6b6c7b7989eac1bbded6fc3a87cbf86db1ceb6d357ac67cc159031f336: Status 404 returned error can't find the container with id a3385e6b6c7b7989eac1bbded6fc3a87cbf86db1ceb6d357ac67cc159031f336 Jun 02 07:31:35.630947 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:35.630917 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc2d67b7-f757-4530-a6f1-a10d422413b3-serving-certs-ca-bundle\") pod \"telemeter-client-686f5dd774-tfhhp\" (UID: \"bc2d67b7-f757-4530-a6f1-a10d422413b3\") " pod="openshift-monitoring/telemeter-client-686f5dd774-tfhhp" Jun 02 07:31:35.631092 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:35.631054 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc2d67b7-f757-4530-a6f1-a10d422413b3-metrics-client-ca\") pod \"telemeter-client-686f5dd774-tfhhp\" (UID: \"bc2d67b7-f757-4530-a6f1-a10d422413b3\") " pod="openshift-monitoring/telemeter-client-686f5dd774-tfhhp" Jun 02 07:31:35.631156 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:35.631092 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/bc2d67b7-f757-4530-a6f1-a10d422413b3-secret-telemeter-client\") pod \"telemeter-client-686f5dd774-tfhhp\" (UID: \"bc2d67b7-f757-4530-a6f1-a10d422413b3\") " pod="openshift-monitoring/telemeter-client-686f5dd774-tfhhp" Jun 02 07:31:35.631156 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:35.631121 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc2d67b7-f757-4530-a6f1-a10d422413b3-telemeter-trusted-ca-bundle\") pod \"telemeter-client-686f5dd774-tfhhp\" (UID: \"bc2d67b7-f757-4530-a6f1-a10d422413b3\") " pod="openshift-monitoring/telemeter-client-686f5dd774-tfhhp" Jun 02 07:31:35.631321 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:35.631203 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/bc2d67b7-f757-4530-a6f1-a10d422413b3-federate-client-tls\") pod \"telemeter-client-686f5dd774-tfhhp\" (UID: \"bc2d67b7-f757-4530-a6f1-a10d422413b3\") " pod="openshift-monitoring/telemeter-client-686f5dd774-tfhhp" Jun 02 07:31:35.631321 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:35.631252 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bc2d67b7-f757-4530-a6f1-a10d422413b3-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-686f5dd774-tfhhp\" (UID: \"bc2d67b7-f757-4530-a6f1-a10d422413b3\") " pod="openshift-monitoring/telemeter-client-686f5dd774-tfhhp" Jun 02 07:31:35.631321 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:35.631284 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/bc2d67b7-f757-4530-a6f1-a10d422413b3-telemeter-client-tls\") pod \"telemeter-client-686f5dd774-tfhhp\" (UID: \"bc2d67b7-f757-4530-a6f1-a10d422413b3\") " pod="openshift-monitoring/telemeter-client-686f5dd774-tfhhp" Jun 02 07:31:35.631321 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:35.631308 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bt5z\" (UniqueName: \"kubernetes.io/projected/bc2d67b7-f757-4530-a6f1-a10d422413b3-kube-api-access-4bt5z\") pod \"telemeter-client-686f5dd774-tfhhp\" (UID: \"bc2d67b7-f757-4530-a6f1-a10d422413b3\") " pod="openshift-monitoring/telemeter-client-686f5dd774-tfhhp" Jun 02 07:31:35.736460 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:35.733791 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/bc2d67b7-f757-4530-a6f1-a10d422413b3-federate-client-tls\") pod \"telemeter-client-686f5dd774-tfhhp\" (UID: \"bc2d67b7-f757-4530-a6f1-a10d422413b3\") " pod="openshift-monitoring/telemeter-client-686f5dd774-tfhhp" Jun 02 07:31:35.736460 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:35.733844 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bc2d67b7-f757-4530-a6f1-a10d422413b3-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-686f5dd774-tfhhp\" (UID: \"bc2d67b7-f757-4530-a6f1-a10d422413b3\") " pod="openshift-monitoring/telemeter-client-686f5dd774-tfhhp" Jun 02 07:31:35.736460 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:35.733877 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/bc2d67b7-f757-4530-a6f1-a10d422413b3-telemeter-client-tls\") pod \"telemeter-client-686f5dd774-tfhhp\" (UID: \"bc2d67b7-f757-4530-a6f1-a10d422413b3\") " pod="openshift-monitoring/telemeter-client-686f5dd774-tfhhp" Jun 02 07:31:35.736460 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:35.733902 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4bt5z\" (UniqueName: \"kubernetes.io/projected/bc2d67b7-f757-4530-a6f1-a10d422413b3-kube-api-access-4bt5z\") pod \"telemeter-client-686f5dd774-tfhhp\" (UID: \"bc2d67b7-f757-4530-a6f1-a10d422413b3\") " pod="openshift-monitoring/telemeter-client-686f5dd774-tfhhp" Jun 02 07:31:35.736460 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:35.733973 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc2d67b7-f757-4530-a6f1-a10d422413b3-serving-certs-ca-bundle\") pod \"telemeter-client-686f5dd774-tfhhp\" (UID: \"bc2d67b7-f757-4530-a6f1-a10d422413b3\") " pod="openshift-monitoring/telemeter-client-686f5dd774-tfhhp" Jun 02 07:31:35.736460 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:35.734060 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc2d67b7-f757-4530-a6f1-a10d422413b3-metrics-client-ca\") pod \"telemeter-client-686f5dd774-tfhhp\" (UID: \"bc2d67b7-f757-4530-a6f1-a10d422413b3\") " pod="openshift-monitoring/telemeter-client-686f5dd774-tfhhp" Jun 02 07:31:35.736460 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:35.734089 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/bc2d67b7-f757-4530-a6f1-a10d422413b3-secret-telemeter-client\") pod \"telemeter-client-686f5dd774-tfhhp\" (UID: \"bc2d67b7-f757-4530-a6f1-a10d422413b3\") " pod="openshift-monitoring/telemeter-client-686f5dd774-tfhhp" Jun 02 07:31:35.736460 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:35.734117 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc2d67b7-f757-4530-a6f1-a10d422413b3-telemeter-trusted-ca-bundle\") pod \"telemeter-client-686f5dd774-tfhhp\" (UID: \"bc2d67b7-f757-4530-a6f1-a10d422413b3\") " pod="openshift-monitoring/telemeter-client-686f5dd774-tfhhp" Jun 02 07:31:35.736460 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:35.735122 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc2d67b7-f757-4530-a6f1-a10d422413b3-telemeter-trusted-ca-bundle\") pod \"telemeter-client-686f5dd774-tfhhp\" (UID: \"bc2d67b7-f757-4530-a6f1-a10d422413b3\") " pod="openshift-monitoring/telemeter-client-686f5dd774-tfhhp" Jun 02 07:31:35.738006 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:35.737930 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc2d67b7-f757-4530-a6f1-a10d422413b3-metrics-client-ca\") pod \"telemeter-client-686f5dd774-tfhhp\" (UID: \"bc2d67b7-f757-4530-a6f1-a10d422413b3\") " pod="openshift-monitoring/telemeter-client-686f5dd774-tfhhp" Jun 02 07:31:35.738705 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:35.738681 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc2d67b7-f757-4530-a6f1-a10d422413b3-serving-certs-ca-bundle\") pod \"telemeter-client-686f5dd774-tfhhp\" (UID: \"bc2d67b7-f757-4530-a6f1-a10d422413b3\") " pod="openshift-monitoring/telemeter-client-686f5dd774-tfhhp" Jun 02 07:31:35.741584 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:35.741079 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/bc2d67b7-f757-4530-a6f1-a10d422413b3-telemeter-client-tls\") pod \"telemeter-client-686f5dd774-tfhhp\" (UID: \"bc2d67b7-f757-4530-a6f1-a10d422413b3\") " pod="openshift-monitoring/telemeter-client-686f5dd774-tfhhp" Jun 02 07:31:35.744475 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:35.744346 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bc2d67b7-f757-4530-a6f1-a10d422413b3-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-686f5dd774-tfhhp\" (UID: \"bc2d67b7-f757-4530-a6f1-a10d422413b3\") " pod="openshift-monitoring/telemeter-client-686f5dd774-tfhhp" Jun 02 07:31:35.744475 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:35.744431 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bt5z\" (UniqueName: \"kubernetes.io/projected/bc2d67b7-f757-4530-a6f1-a10d422413b3-kube-api-access-4bt5z\") pod \"telemeter-client-686f5dd774-tfhhp\" (UID: \"bc2d67b7-f757-4530-a6f1-a10d422413b3\") " pod="openshift-monitoring/telemeter-client-686f5dd774-tfhhp" Jun 02 07:31:35.746896 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:35.746870 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/bc2d67b7-f757-4530-a6f1-a10d422413b3-federate-client-tls\") pod \"telemeter-client-686f5dd774-tfhhp\" (UID: \"bc2d67b7-f757-4530-a6f1-a10d422413b3\") " pod="openshift-monitoring/telemeter-client-686f5dd774-tfhhp" Jun 02 07:31:35.748620 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:35.748586 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/bc2d67b7-f757-4530-a6f1-a10d422413b3-secret-telemeter-client\") pod \"telemeter-client-686f5dd774-tfhhp\" (UID: \"bc2d67b7-f757-4530-a6f1-a10d422413b3\") " pod="openshift-monitoring/telemeter-client-686f5dd774-tfhhp" Jun 02 07:31:35.867567 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:35.867071 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-686f5dd774-tfhhp" Jun 02 07:31:35.989721 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:35.989675 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-4qz2p" event={"ID":"22d5228c-3c0d-410e-867c-eb891d7e3895","Type":"ContainerStarted","Data":"a3385e6b6c7b7989eac1bbded6fc3a87cbf86db1ceb6d357ac67cc159031f336"} Jun 02 07:31:35.991360 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:35.991323 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6788db7769-ktbv4" event={"ID":"2130ac45-091c-4264-85d9-79b7e8e155d4","Type":"ContainerStarted","Data":"15017e66e642dec17bd62bbd855f937a146ab82779de819aac2b0b5de7e4dea1"} Jun 02 07:31:36.574335 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:36.574289 2580 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 07:31:36.578861 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:36.578836 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 07:31:36.581985 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:36.581960 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 02 07:31:36.582119 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:36.582103 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-e0grleedb44go\"" Jun 02 07:31:36.582243 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:36.582189 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 02 07:31:36.582367 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:36.582243 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 02 07:31:36.582367 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:36.582317 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 02 07:31:36.582367 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:36.582325 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-9cdj9\"" Jun 02 07:31:36.582367 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:36.582331 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 02 07:31:36.582808 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:36.582779 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 02 07:31:36.582909 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:36.582849 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 02 07:31:36.582909 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:36.582895 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 02 07:31:36.583124 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:36.583104 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 02 07:31:36.583124 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:36.583115 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 02 07:31:36.583325 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:36.583157 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 02 07:31:36.585687 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:36.585666 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 02 07:31:36.588573 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:36.588552 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 07:31:36.643603 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:36.643566 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 07:31:36.643603 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:36.643609 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 07:31:36.643858 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:36.643649 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 07:31:36.643858 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:36.643676 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 07:31:36.643858 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:36.643704 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d-config-out\") pod \"prometheus-k8s-0\" (UID: \"38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 07:31:36.643858 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:36.643790 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 07:31:36.643858 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:36.643831 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 07:31:36.644117 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:36.643866 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 07:31:36.644117 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:36.643905 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 07:31:36.644117 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:36.643938 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 07:31:36.644117 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:36.643970 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d-web-config\") pod \"prometheus-k8s-0\" (UID: \"38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 07:31:36.644117 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:36.644024 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 07:31:36.644117 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:36.644040 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 07:31:36.644117 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:36.644056 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d-config\") pod \"prometheus-k8s-0\" (UID: \"38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 07:31:36.644480 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:36.644127 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 07:31:36.644480 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:36.644165 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 07:31:36.644480 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:36.644203 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 07:31:36.644480 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:36.644276 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfrdz\" (UniqueName: \"kubernetes.io/projected/38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d-kube-api-access-lfrdz\") pod \"prometheus-k8s-0\" (UID: \"38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 07:31:36.745319 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:36.745284 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 07:31:36.745319 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:36.745323 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 07:31:36.745544 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:36.745356 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 07:31:36.745544 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:36.745381 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 07:31:36.745544 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:36.745407 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d-config-out\") pod \"prometheus-k8s-0\" (UID: \"38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 07:31:36.745698 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:36.745647 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 07:31:36.745698 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:36.745690 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 07:31:36.745803 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:36.745717 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 07:31:36.745803 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:36.745760 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 07:31:36.745803 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:36.745796 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 07:31:36.745956 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:36.745807 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 07:31:36.745956 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:36.745835 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d-web-config\") pod \"prometheus-k8s-0\" (UID: \"38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 07:31:36.745956 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:36.745886 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 07:31:36.745956 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:36.745911 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 07:31:36.745956 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:36.745938 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d-config\") pod \"prometheus-k8s-0\" (UID: \"38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 07:31:36.746389 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:36.745987 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 07:31:36.746389 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:36.746020 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 07:31:36.746389 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:36.746055 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 07:31:36.746389 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:36.746079 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 07:31:36.746389 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:36.746083 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lfrdz\" (UniqueName: \"kubernetes.io/projected/38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d-kube-api-access-lfrdz\") pod \"prometheus-k8s-0\" (UID: \"38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 07:31:36.748253 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:36.747376 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 07:31:36.748796 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:36.748707 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 07:31:36.749343 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:36.749111 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d-config-out\") pod \"prometheus-k8s-0\" (UID: \"38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 07:31:36.749343 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:36.749207 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 07:31:36.749506 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:36.749463 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 07:31:36.750114 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:36.749688 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 07:31:36.750114 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:36.750068 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 07:31:36.750358 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:36.750275 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 07:31:36.750775 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:36.750729 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d-config\") pod \"prometheus-k8s-0\" (UID: \"38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 07:31:36.750862 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:36.750803 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 07:31:36.751335 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:36.751312 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 07:31:36.752259 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:36.752188 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 07:31:36.752466 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:36.752434 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 07:31:36.752883 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:36.752863 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d-web-config\") pod \"prometheus-k8s-0\" (UID: \"38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 07:31:36.753072 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:36.753054 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 07:31:36.755186 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:36.755164 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfrdz\" (UniqueName: \"kubernetes.io/projected/38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d-kube-api-access-lfrdz\") pod \"prometheus-k8s-0\" (UID: \"38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 07:31:36.892172 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:36.892128 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 07:31:37.161392 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:37.161251 2580 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-77d564d864-lh62v"] Jun 02 07:31:37.163653 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:37.163633 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77d564d864-lh62v" Jun 02 07:31:37.174614 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:37.174589 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77d564d864-lh62v"] Jun 02 07:31:37.254169 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:37.251755 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b8935b49-9282-4ab1-8a32-f6436453a7d1-console-oauth-config\") pod \"console-77d564d864-lh62v\" (UID: \"b8935b49-9282-4ab1-8a32-f6436453a7d1\") " pod="openshift-console/console-77d564d864-lh62v" Jun 02 07:31:37.254169 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:37.251797 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b8935b49-9282-4ab1-8a32-f6436453a7d1-console-config\") pod \"console-77d564d864-lh62v\" (UID: \"b8935b49-9282-4ab1-8a32-f6436453a7d1\") " pod="openshift-console/console-77d564d864-lh62v" Jun 02 07:31:37.254169 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:37.251849 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmflx\" (UniqueName: \"kubernetes.io/projected/b8935b49-9282-4ab1-8a32-f6436453a7d1-kube-api-access-wmflx\") pod \"console-77d564d864-lh62v\" (UID: \"b8935b49-9282-4ab1-8a32-f6436453a7d1\") " pod="openshift-console/console-77d564d864-lh62v" Jun 02 07:31:37.254169 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:37.251892 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b8935b49-9282-4ab1-8a32-f6436453a7d1-oauth-serving-cert\") pod \"console-77d564d864-lh62v\" (UID: \"b8935b49-9282-4ab1-8a32-f6436453a7d1\") " pod="openshift-console/console-77d564d864-lh62v" Jun 02 07:31:37.254169 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:37.251922 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b8935b49-9282-4ab1-8a32-f6436453a7d1-console-serving-cert\") pod \"console-77d564d864-lh62v\" (UID: \"b8935b49-9282-4ab1-8a32-f6436453a7d1\") " pod="openshift-console/console-77d564d864-lh62v" Jun 02 07:31:37.254169 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:37.251957 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b8935b49-9282-4ab1-8a32-f6436453a7d1-service-ca\") pod \"console-77d564d864-lh62v\" (UID: \"b8935b49-9282-4ab1-8a32-f6436453a7d1\") " pod="openshift-console/console-77d564d864-lh62v" Jun 02 07:31:37.254169 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:37.252067 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b8935b49-9282-4ab1-8a32-f6436453a7d1-trusted-ca-bundle\") pod \"console-77d564d864-lh62v\" (UID: \"b8935b49-9282-4ab1-8a32-f6436453a7d1\") " pod="openshift-console/console-77d564d864-lh62v" Jun 02 07:31:37.353552 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:37.353075 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b8935b49-9282-4ab1-8a32-f6436453a7d1-console-oauth-config\") pod \"console-77d564d864-lh62v\" (UID: \"b8935b49-9282-4ab1-8a32-f6436453a7d1\") " pod="openshift-console/console-77d564d864-lh62v" Jun 02 07:31:37.353552 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:37.353117 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b8935b49-9282-4ab1-8a32-f6436453a7d1-console-config\") pod \"console-77d564d864-lh62v\" (UID: \"b8935b49-9282-4ab1-8a32-f6436453a7d1\") " pod="openshift-console/console-77d564d864-lh62v" Jun 02 07:31:37.353552 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:37.353163 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wmflx\" (UniqueName: \"kubernetes.io/projected/b8935b49-9282-4ab1-8a32-f6436453a7d1-kube-api-access-wmflx\") pod \"console-77d564d864-lh62v\" (UID: \"b8935b49-9282-4ab1-8a32-f6436453a7d1\") " pod="openshift-console/console-77d564d864-lh62v" Jun 02 07:31:37.353552 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:37.353245 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b8935b49-9282-4ab1-8a32-f6436453a7d1-oauth-serving-cert\") pod \"console-77d564d864-lh62v\" (UID: \"b8935b49-9282-4ab1-8a32-f6436453a7d1\") " pod="openshift-console/console-77d564d864-lh62v" Jun 02 07:31:37.353552 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:37.353277 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b8935b49-9282-4ab1-8a32-f6436453a7d1-console-serving-cert\") pod \"console-77d564d864-lh62v\" (UID: \"b8935b49-9282-4ab1-8a32-f6436453a7d1\") " pod="openshift-console/console-77d564d864-lh62v" Jun 02 07:31:37.353552 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:37.353310 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b8935b49-9282-4ab1-8a32-f6436453a7d1-service-ca\") pod \"console-77d564d864-lh62v\" (UID: \"b8935b49-9282-4ab1-8a32-f6436453a7d1\") " pod="openshift-console/console-77d564d864-lh62v" Jun 02 07:31:37.353552 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:37.353387 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b8935b49-9282-4ab1-8a32-f6436453a7d1-trusted-ca-bundle\") pod \"console-77d564d864-lh62v\" (UID: \"b8935b49-9282-4ab1-8a32-f6436453a7d1\") " pod="openshift-console/console-77d564d864-lh62v" Jun 02 07:31:37.354772 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:37.354410 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b8935b49-9282-4ab1-8a32-f6436453a7d1-trusted-ca-bundle\") pod \"console-77d564d864-lh62v\" (UID: \"b8935b49-9282-4ab1-8a32-f6436453a7d1\") " pod="openshift-console/console-77d564d864-lh62v" Jun 02 07:31:37.355254 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:37.354933 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b8935b49-9282-4ab1-8a32-f6436453a7d1-service-ca\") pod \"console-77d564d864-lh62v\" (UID: \"b8935b49-9282-4ab1-8a32-f6436453a7d1\") " pod="openshift-console/console-77d564d864-lh62v" Jun 02 07:31:37.355540 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:37.355497 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b8935b49-9282-4ab1-8a32-f6436453a7d1-oauth-serving-cert\") pod \"console-77d564d864-lh62v\" (UID: \"b8935b49-9282-4ab1-8a32-f6436453a7d1\") " pod="openshift-console/console-77d564d864-lh62v" Jun 02 07:31:37.355540 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:37.355497 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b8935b49-9282-4ab1-8a32-f6436453a7d1-console-config\") pod \"console-77d564d864-lh62v\" (UID: \"b8935b49-9282-4ab1-8a32-f6436453a7d1\") " pod="openshift-console/console-77d564d864-lh62v" Jun 02 07:31:37.358371 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:37.358327 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b8935b49-9282-4ab1-8a32-f6436453a7d1-console-serving-cert\") pod \"console-77d564d864-lh62v\" (UID: \"b8935b49-9282-4ab1-8a32-f6436453a7d1\") " pod="openshift-console/console-77d564d864-lh62v" Jun 02 07:31:37.362751 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:37.362711 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b8935b49-9282-4ab1-8a32-f6436453a7d1-console-oauth-config\") pod \"console-77d564d864-lh62v\" (UID: \"b8935b49-9282-4ab1-8a32-f6436453a7d1\") " pod="openshift-console/console-77d564d864-lh62v" Jun 02 07:31:37.367292 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:37.367206 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmflx\" (UniqueName: \"kubernetes.io/projected/b8935b49-9282-4ab1-8a32-f6436453a7d1-kube-api-access-wmflx\") pod \"console-77d564d864-lh62v\" (UID: \"b8935b49-9282-4ab1-8a32-f6436453a7d1\") " pod="openshift-console/console-77d564d864-lh62v" Jun 02 07:31:37.374458 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:37.373997 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-686f5dd774-tfhhp"] Jun 02 07:31:37.384108 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:31:37.384082 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc2d67b7_f757_4530_a6f1_a10d422413b3.slice/crio-fa3aad470dcf6eb89691f8b1cd7919e76c2606bed9e0666e00894facb65cf95f WatchSource:0}: Error finding container fa3aad470dcf6eb89691f8b1cd7919e76c2606bed9e0666e00894facb65cf95f: Status 404 returned error can't find the container with id fa3aad470dcf6eb89691f8b1cd7919e76c2606bed9e0666e00894facb65cf95f Jun 02 07:31:37.406916 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:37.406886 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 07:31:37.410266 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:31:37.410204 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38a7228b_fe66_4d55_bf6a_7e4dcffdcc6d.slice/crio-d25f4a37537a6682618d41ac9d149df0fe19900d102c81e32ce41c0498149843 WatchSource:0}: Error finding container d25f4a37537a6682618d41ac9d149df0fe19900d102c81e32ce41c0498149843: Status 404 returned error can't find the container with id d25f4a37537a6682618d41ac9d149df0fe19900d102c81e32ce41c0498149843 Jun 02 07:31:37.473760 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:37.473711 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77d564d864-lh62v" Jun 02 07:31:37.624270 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:37.624055 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77d564d864-lh62v"] Jun 02 07:31:37.629538 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:31:37.629310 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8935b49_9282_4ab1_8a32_f6436453a7d1.slice/crio-d8e6a30424f53c2093d0df8debb3a97f477b5319cbf9b653566984a3e5ca39bd WatchSource:0}: Error finding container d8e6a30424f53c2093d0df8debb3a97f477b5319cbf9b653566984a3e5ca39bd: Status 404 returned error can't find the container with id d8e6a30424f53c2093d0df8debb3a97f477b5319cbf9b653566984a3e5ca39bd Jun 02 07:31:38.006021 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:38.005927 2580 generic.go:358] "Generic (PLEG): container finished" podID="38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d" containerID="5eb16f49a6c8580184681d5503a3c4916788e593084275d961775c3a8f870990" exitCode=0 Jun 02 07:31:38.006481 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:38.006299 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d","Type":"ContainerDied","Data":"5eb16f49a6c8580184681d5503a3c4916788e593084275d961775c3a8f870990"} Jun 02 07:31:38.006481 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:38.006340 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d","Type":"ContainerStarted","Data":"d25f4a37537a6682618d41ac9d149df0fe19900d102c81e32ce41c0498149843"} Jun 02 07:31:38.007804 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:38.007772 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6788db7769-ktbv4" event={"ID":"2130ac45-091c-4264-85d9-79b7e8e155d4","Type":"ContainerStarted","Data":"129556ffe8045fdaea32376bed5644d0e1f0201d62f10518d19eba84381b1323"} Jun 02 07:31:38.011318 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:38.011296 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"11ab42f0-932b-41b6-9747-fd0369c0f50c","Type":"ContainerStarted","Data":"93e2b50291229c7f486df290909f1936779baa7774c0a9e55abb3c40d66b11bf"} Jun 02 07:31:38.011418 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:38.011321 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"11ab42f0-932b-41b6-9747-fd0369c0f50c","Type":"ContainerStarted","Data":"30b6eea2a6aaa854cf495b31d645d8d48fd70e45647dd945daac0fa7ed848f69"} Jun 02 07:31:38.011418 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:38.011337 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"11ab42f0-932b-41b6-9747-fd0369c0f50c","Type":"ContainerStarted","Data":"f87afdfaa2a9dafa1ece7e568d869714d1e1e232d573ccd5085dc219556ace8d"} Jun 02 07:31:38.011418 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:38.011351 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"11ab42f0-932b-41b6-9747-fd0369c0f50c","Type":"ContainerStarted","Data":"a135bce96a5c9401e7952a9072b67bb2d8d7b420b25a6bc02ff6191f5cd56454"} Jun 02 07:31:38.011418 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:38.011366 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"11ab42f0-932b-41b6-9747-fd0369c0f50c","Type":"ContainerStarted","Data":"ce0a7201f7bdfd842470738d12c43d00c34b5d0733327f71cb8c9e3d535b667b"} Jun 02 07:31:38.013488 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:38.013461 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5976d4747-w2ph2" event={"ID":"25f32ea0-bc07-4b1f-8750-9568eac758ff","Type":"ContainerStarted","Data":"56be43e53d631fadfc3682be6cf0ba73eba3070e876d88c7dbcc11dc95cf9319"} Jun 02 07:31:38.013579 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:38.013495 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5976d4747-w2ph2" event={"ID":"25f32ea0-bc07-4b1f-8750-9568eac758ff","Type":"ContainerStarted","Data":"7998d06ca5544b52cdd31b1b013e6de7cab246b98e10f8f1fbee619eebcd136b"} Jun 02 07:31:38.013579 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:38.013513 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5976d4747-w2ph2" event={"ID":"25f32ea0-bc07-4b1f-8750-9568eac758ff","Type":"ContainerStarted","Data":"6126819f689bc7baf3566145599246a0a30d9c8084f4b7039d41d2bb241aed41"} Jun 02 07:31:38.014652 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:38.014629 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-686f5dd774-tfhhp" event={"ID":"bc2d67b7-f757-4530-a6f1-a10d422413b3","Type":"ContainerStarted","Data":"fa3aad470dcf6eb89691f8b1cd7919e76c2606bed9e0666e00894facb65cf95f"} Jun 02 07:31:38.016124 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:38.016094 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77d564d864-lh62v" event={"ID":"b8935b49-9282-4ab1-8a32-f6436453a7d1","Type":"ContainerStarted","Data":"7cc4363656b9a8a734916f358034250cb8036f22f26ba2b4df84ac32875d51ad"} Jun 02 07:31:38.016243 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:38.016131 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77d564d864-lh62v" event={"ID":"b8935b49-9282-4ab1-8a32-f6436453a7d1","Type":"ContainerStarted","Data":"d8e6a30424f53c2093d0df8debb3a97f477b5319cbf9b653566984a3e5ca39bd"} Jun 02 07:31:38.045132 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:38.045080 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-77d564d864-lh62v" podStartSLOduration=1.04506613 podStartE2EDuration="1.04506613s" podCreationTimestamp="2026-06-02 07:31:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 07:31:38.043938221 +0000 UTC m=+126.307920292" watchObservedRunningTime="2026-06-02 07:31:38.04506613 +0000 UTC m=+126.309048195" Jun 02 07:31:39.023127 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:39.023047 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"11ab42f0-932b-41b6-9747-fd0369c0f50c","Type":"ContainerStarted","Data":"ae843e9cb92b264af3bbd5fa38c1d9cfefe3f4254fa1d0f12f4248a6a5371189"} Jun 02 07:31:39.025728 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:39.025698 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5976d4747-w2ph2" event={"ID":"25f32ea0-bc07-4b1f-8750-9568eac758ff","Type":"ContainerStarted","Data":"73721084e9bb9f3990928f55e3c2b004ff2c1ceaddb759192aad5dea53339afd"} Jun 02 07:31:39.025855 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:39.025735 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5976d4747-w2ph2" event={"ID":"25f32ea0-bc07-4b1f-8750-9568eac758ff","Type":"ContainerStarted","Data":"0df4c9d5e8cb95f6c44093eea639976626601d07cb955b7992cdc4df24838a24"} Jun 02 07:31:39.025855 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:39.025750 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5976d4747-w2ph2" event={"ID":"25f32ea0-bc07-4b1f-8750-9568eac758ff","Type":"ContainerStarted","Data":"10f0ea80b2d2d4f76256a819aff5a718e9c38708bfb7ae6bd1a2d14e2d048cd6"} Jun 02 07:31:39.025970 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:39.025857 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5976d4747-w2ph2" Jun 02 07:31:39.027022 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:39.026996 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-4qz2p" event={"ID":"22d5228c-3c0d-410e-867c-eb891d7e3895","Type":"ContainerStarted","Data":"0d74e930993349f717a33933513235e6933702f0afe87084a8ca70dd4f127024"} Jun 02 07:31:39.027524 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:39.027458 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-4qz2p" Jun 02 07:31:39.033148 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:39.033131 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-4qz2p" Jun 02 07:31:39.049629 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:39.049579 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6788db7769-ktbv4" podStartSLOduration=2.985186714 podStartE2EDuration="5.049567497s" podCreationTimestamp="2026-06-02 07:31:34 +0000 UTC" firstStartedPulling="2026-06-02 07:31:35.119680524 +0000 UTC m=+123.383662572" lastFinishedPulling="2026-06-02 07:31:37.184061301 +0000 UTC m=+125.448043355" observedRunningTime="2026-06-02 07:31:38.061468861 +0000 UTC m=+126.325450928" watchObservedRunningTime="2026-06-02 07:31:39.049567497 +0000 UTC m=+127.313549540" Jun 02 07:31:39.050128 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:39.050097 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.092105822 podStartE2EDuration="8.050089618s" podCreationTimestamp="2026-06-02 07:31:31 +0000 UTC" firstStartedPulling="2026-06-02 07:31:32.773358478 +0000 UTC m=+121.037340529" lastFinishedPulling="2026-06-02 07:31:38.731342266 +0000 UTC m=+126.995324325" observedRunningTime="2026-06-02 07:31:39.048406006 +0000 UTC m=+127.312388072" watchObservedRunningTime="2026-06-02 07:31:39.050089618 +0000 UTC m=+127.314071684" Jun 02 07:31:39.070090 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:39.070041 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5976d4747-w2ph2" podStartSLOduration=1.4828071600000001 podStartE2EDuration="6.070028903s" podCreationTimestamp="2026-06-02 07:31:33 +0000 UTC" firstStartedPulling="2026-06-02 07:31:34.142306387 +0000 UTC m=+122.406288434" lastFinishedPulling="2026-06-02 07:31:38.729528117 +0000 UTC m=+126.993510177" observedRunningTime="2026-06-02 07:31:39.069359587 +0000 UTC m=+127.333341667" watchObservedRunningTime="2026-06-02 07:31:39.070028903 +0000 UTC m=+127.334010969" Jun 02 07:31:39.084002 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:39.083962 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-4qz2p" podStartSLOduration=1.544873459 podStartE2EDuration="4.083949815s" podCreationTimestamp="2026-06-02 07:31:35 +0000 UTC" firstStartedPulling="2026-06-02 07:31:35.612291528 +0000 UTC m=+123.876273572" lastFinishedPulling="2026-06-02 07:31:38.151367878 +0000 UTC m=+126.415349928" observedRunningTime="2026-06-02 07:31:39.082421146 +0000 UTC m=+127.346403212" watchObservedRunningTime="2026-06-02 07:31:39.083949815 +0000 UTC m=+127.347931923" Jun 02 07:31:42.041459 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:42.041418 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d","Type":"ContainerStarted","Data":"b281f95875505edb7b133b56a40f7c972a33cbae36ad339513b693a8e3dd531f"} Jun 02 07:31:42.041459 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:42.041463 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d","Type":"ContainerStarted","Data":"73193ab50ba853ed61d1d07b82d2133e5074b7626851fe78ed763bb3f02800bf"} Jun 02 07:31:42.041966 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:42.041476 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d","Type":"ContainerStarted","Data":"85c5ef7cf86bd4f955a9f9a15959db6276098a9aad2e55c0ed6bd5da8fd66fa0"} Jun 02 07:31:42.041966 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:42.041487 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d","Type":"ContainerStarted","Data":"0ff677a41a4acaf24bb479aca29c2b09725ec6c290b5ca41b70b86a6297fc4c2"} Jun 02 07:31:42.041966 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:42.041497 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d","Type":"ContainerStarted","Data":"f24d9b56e8e8f15aefa3cb8c404064ccd7acc970f5abc90c844180fb924775fb"} Jun 02 07:31:42.041966 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:42.041507 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d","Type":"ContainerStarted","Data":"867b8b61ffb8dc70bdf540904d86b219badc24cedfda528d99299cc39687ec69"} Jun 02 07:31:42.043278 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:42.043249 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-686f5dd774-tfhhp" event={"ID":"bc2d67b7-f757-4530-a6f1-a10d422413b3","Type":"ContainerStarted","Data":"f48194da57b1b0a7a910a7e38acf8ab39de38305a1010b18daf84b13b187b029"} Jun 02 07:31:42.043377 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:42.043285 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-686f5dd774-tfhhp" event={"ID":"bc2d67b7-f757-4530-a6f1-a10d422413b3","Type":"ContainerStarted","Data":"bdef29a0f756fcb0f671e283342ac7482316a7c4e8053c6021cb0dbc5e195146"} Jun 02 07:31:42.043377 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:42.043299 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-686f5dd774-tfhhp" event={"ID":"bc2d67b7-f757-4530-a6f1-a10d422413b3","Type":"ContainerStarted","Data":"23d8969d59e3cd7c6d5a1a17a2bd01167598c0dc9a06b11aacac4dcf81624f1c"} Jun 02 07:31:42.070506 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:42.070445 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.807472076 podStartE2EDuration="6.070427454s" podCreationTimestamp="2026-06-02 07:31:36 +0000 UTC" firstStartedPulling="2026-06-02 07:31:38.00758046 +0000 UTC m=+126.271562521" lastFinishedPulling="2026-06-02 07:31:41.27053585 +0000 UTC m=+129.534517899" observedRunningTime="2026-06-02 07:31:42.067846587 +0000 UTC m=+130.331828653" watchObservedRunningTime="2026-06-02 07:31:42.070427454 +0000 UTC m=+130.334409526" Jun 02 07:31:42.088776 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:42.088728 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-686f5dd774-tfhhp" podStartSLOduration=3.209788418 podStartE2EDuration="7.088715637s" podCreationTimestamp="2026-06-02 07:31:35 +0000 UTC" firstStartedPulling="2026-06-02 07:31:37.387082784 +0000 UTC m=+125.651064846" lastFinishedPulling="2026-06-02 07:31:41.266010014 +0000 UTC m=+129.529992065" observedRunningTime="2026-06-02 07:31:42.086175693 +0000 UTC m=+130.350157772" watchObservedRunningTime="2026-06-02 07:31:42.088715637 +0000 UTC m=+130.352697704" Jun 02 07:31:42.104045 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:42.103994 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56bb33da-8c46-4433-8b45-f6fe098c4d25-metrics-certs\") pod \"network-metrics-daemon-rgk46\" (UID: \"56bb33da-8c46-4433-8b45-f6fe098c4d25\") " pod="openshift-multus/network-metrics-daemon-rgk46" Jun 02 07:31:42.106627 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:42.106604 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56bb33da-8c46-4433-8b45-f6fe098c4d25-metrics-certs\") pod \"network-metrics-daemon-rgk46\" (UID: \"56bb33da-8c46-4433-8b45-f6fe098c4d25\") " pod="openshift-multus/network-metrics-daemon-rgk46" Jun 02 07:31:42.189132 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:42.189099 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zbw2q\"" Jun 02 07:31:42.197853 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:42.197834 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rgk46" Jun 02 07:31:42.322626 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:42.322548 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rgk46"] Jun 02 07:31:42.325901 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:31:42.325861 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56bb33da_8c46_4433_8b45_f6fe098c4d25.slice/crio-698fd213f9c59bb259249982c140fc82bc9a24d63a0f6c004690ba66211d7d18 WatchSource:0}: Error finding container 698fd213f9c59bb259249982c140fc82bc9a24d63a0f6c004690ba66211d7d18: Status 404 returned error can't find the container with id 698fd213f9c59bb259249982c140fc82bc9a24d63a0f6c004690ba66211d7d18 Jun 02 07:31:42.616955 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:42.616813 2580 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77d564d864-lh62v"] Jun 02 07:31:42.646340 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:42.646314 2580 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d488ffffb-f9hj5"] Jun 02 07:31:42.651041 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:42.651020 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d488ffffb-f9hj5" Jun 02 07:31:42.666557 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:42.666522 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d488ffffb-f9hj5"] Jun 02 07:31:42.707967 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:42.707933 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11c4d0ee-53ef-44e0-ad26-844c1ec0042b-console-config\") pod \"console-6d488ffffb-f9hj5\" (UID: \"11c4d0ee-53ef-44e0-ad26-844c1ec0042b\") " pod="openshift-console/console-6d488ffffb-f9hj5" Jun 02 07:31:42.708109 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:42.707975 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11c4d0ee-53ef-44e0-ad26-844c1ec0042b-trusted-ca-bundle\") pod \"console-6d488ffffb-f9hj5\" (UID: \"11c4d0ee-53ef-44e0-ad26-844c1ec0042b\") " pod="openshift-console/console-6d488ffffb-f9hj5" Jun 02 07:31:42.708109 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:42.707995 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11c4d0ee-53ef-44e0-ad26-844c1ec0042b-service-ca\") pod \"console-6d488ffffb-f9hj5\" (UID: \"11c4d0ee-53ef-44e0-ad26-844c1ec0042b\") " pod="openshift-console/console-6d488ffffb-f9hj5" Jun 02 07:31:42.708109 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:42.708023 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11c4d0ee-53ef-44e0-ad26-844c1ec0042b-console-oauth-config\") pod \"console-6d488ffffb-f9hj5\" (UID: \"11c4d0ee-53ef-44e0-ad26-844c1ec0042b\") " pod="openshift-console/console-6d488ffffb-f9hj5" Jun 02 07:31:42.708204 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:42.708123 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pq4tz\" (UniqueName: \"kubernetes.io/projected/11c4d0ee-53ef-44e0-ad26-844c1ec0042b-kube-api-access-pq4tz\") pod \"console-6d488ffffb-f9hj5\" (UID: \"11c4d0ee-53ef-44e0-ad26-844c1ec0042b\") " pod="openshift-console/console-6d488ffffb-f9hj5" Jun 02 07:31:42.708204 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:42.708174 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11c4d0ee-53ef-44e0-ad26-844c1ec0042b-console-serving-cert\") pod \"console-6d488ffffb-f9hj5\" (UID: \"11c4d0ee-53ef-44e0-ad26-844c1ec0042b\") " pod="openshift-console/console-6d488ffffb-f9hj5" Jun 02 07:31:42.708295 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:42.708267 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11c4d0ee-53ef-44e0-ad26-844c1ec0042b-oauth-serving-cert\") pod \"console-6d488ffffb-f9hj5\" (UID: \"11c4d0ee-53ef-44e0-ad26-844c1ec0042b\") " pod="openshift-console/console-6d488ffffb-f9hj5" Jun 02 07:31:42.808944 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:42.808911 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11c4d0ee-53ef-44e0-ad26-844c1ec0042b-trusted-ca-bundle\") pod \"console-6d488ffffb-f9hj5\" (UID: \"11c4d0ee-53ef-44e0-ad26-844c1ec0042b\") " pod="openshift-console/console-6d488ffffb-f9hj5" Jun 02 07:31:42.808944 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:42.808951 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11c4d0ee-53ef-44e0-ad26-844c1ec0042b-service-ca\") pod \"console-6d488ffffb-f9hj5\" (UID: \"11c4d0ee-53ef-44e0-ad26-844c1ec0042b\") " pod="openshift-console/console-6d488ffffb-f9hj5" Jun 02 07:31:42.809184 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:42.808995 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11c4d0ee-53ef-44e0-ad26-844c1ec0042b-console-oauth-config\") pod \"console-6d488ffffb-f9hj5\" (UID: \"11c4d0ee-53ef-44e0-ad26-844c1ec0042b\") " pod="openshift-console/console-6d488ffffb-f9hj5" Jun 02 07:31:42.809184 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:42.809060 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pq4tz\" (UniqueName: \"kubernetes.io/projected/11c4d0ee-53ef-44e0-ad26-844c1ec0042b-kube-api-access-pq4tz\") pod \"console-6d488ffffb-f9hj5\" (UID: \"11c4d0ee-53ef-44e0-ad26-844c1ec0042b\") " pod="openshift-console/console-6d488ffffb-f9hj5" Jun 02 07:31:42.809184 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:42.809116 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11c4d0ee-53ef-44e0-ad26-844c1ec0042b-console-serving-cert\") pod \"console-6d488ffffb-f9hj5\" (UID: \"11c4d0ee-53ef-44e0-ad26-844c1ec0042b\") " pod="openshift-console/console-6d488ffffb-f9hj5" Jun 02 07:31:42.809184 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:42.809169 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11c4d0ee-53ef-44e0-ad26-844c1ec0042b-oauth-serving-cert\") pod \"console-6d488ffffb-f9hj5\" (UID: \"11c4d0ee-53ef-44e0-ad26-844c1ec0042b\") " pod="openshift-console/console-6d488ffffb-f9hj5" Jun 02 07:31:42.809416 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:42.809201 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11c4d0ee-53ef-44e0-ad26-844c1ec0042b-console-config\") pod \"console-6d488ffffb-f9hj5\" (UID: \"11c4d0ee-53ef-44e0-ad26-844c1ec0042b\") " pod="openshift-console/console-6d488ffffb-f9hj5" Jun 02 07:31:42.809807 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:42.809776 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11c4d0ee-53ef-44e0-ad26-844c1ec0042b-service-ca\") pod \"console-6d488ffffb-f9hj5\" (UID: \"11c4d0ee-53ef-44e0-ad26-844c1ec0042b\") " pod="openshift-console/console-6d488ffffb-f9hj5" Jun 02 07:31:42.809924 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:42.809863 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11c4d0ee-53ef-44e0-ad26-844c1ec0042b-console-config\") pod \"console-6d488ffffb-f9hj5\" (UID: \"11c4d0ee-53ef-44e0-ad26-844c1ec0042b\") " pod="openshift-console/console-6d488ffffb-f9hj5" Jun 02 07:31:42.809924 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:42.809881 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11c4d0ee-53ef-44e0-ad26-844c1ec0042b-trusted-ca-bundle\") pod \"console-6d488ffffb-f9hj5\" (UID: \"11c4d0ee-53ef-44e0-ad26-844c1ec0042b\") " pod="openshift-console/console-6d488ffffb-f9hj5" Jun 02 07:31:42.810596 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:42.810569 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11c4d0ee-53ef-44e0-ad26-844c1ec0042b-oauth-serving-cert\") pod \"console-6d488ffffb-f9hj5\" (UID: \"11c4d0ee-53ef-44e0-ad26-844c1ec0042b\") " pod="openshift-console/console-6d488ffffb-f9hj5" Jun 02 07:31:42.812319 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:42.812293 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11c4d0ee-53ef-44e0-ad26-844c1ec0042b-console-serving-cert\") pod \"console-6d488ffffb-f9hj5\" (UID: \"11c4d0ee-53ef-44e0-ad26-844c1ec0042b\") " pod="openshift-console/console-6d488ffffb-f9hj5" Jun 02 07:31:42.812428 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:42.812388 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11c4d0ee-53ef-44e0-ad26-844c1ec0042b-console-oauth-config\") pod \"console-6d488ffffb-f9hj5\" (UID: \"11c4d0ee-53ef-44e0-ad26-844c1ec0042b\") " pod="openshift-console/console-6d488ffffb-f9hj5" Jun 02 07:31:42.823589 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:42.823568 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pq4tz\" (UniqueName: \"kubernetes.io/projected/11c4d0ee-53ef-44e0-ad26-844c1ec0042b-kube-api-access-pq4tz\") pod \"console-6d488ffffb-f9hj5\" (UID: \"11c4d0ee-53ef-44e0-ad26-844c1ec0042b\") " pod="openshift-console/console-6d488ffffb-f9hj5" Jun 02 07:31:42.968077 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:42.968025 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d488ffffb-f9hj5" Jun 02 07:31:43.047915 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:43.047882 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rgk46" event={"ID":"56bb33da-8c46-4433-8b45-f6fe098c4d25","Type":"ContainerStarted","Data":"698fd213f9c59bb259249982c140fc82bc9a24d63a0f6c004690ba66211d7d18"} Jun 02 07:31:43.125666 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:43.125633 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d488ffffb-f9hj5"] Jun 02 07:31:43.359654 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:31:43.359582 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11c4d0ee_53ef_44e0_ad26_844c1ec0042b.slice/crio-c58dd27208443f94a2bf6d4c84b708770d35627e8106414c8ed39550eba6e3ae WatchSource:0}: Error finding container c58dd27208443f94a2bf6d4c84b708770d35627e8106414c8ed39550eba6e3ae: Status 404 returned error can't find the container with id c58dd27208443f94a2bf6d4c84b708770d35627e8106414c8ed39550eba6e3ae Jun 02 07:31:44.053073 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:44.053038 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d488ffffb-f9hj5" event={"ID":"11c4d0ee-53ef-44e0-ad26-844c1ec0042b","Type":"ContainerStarted","Data":"06835e735ddc120831cf3ee5163ec52a0874b5d82b3413e7855184f993f6c380"} Jun 02 07:31:44.053073 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:44.053074 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d488ffffb-f9hj5" event={"ID":"11c4d0ee-53ef-44e0-ad26-844c1ec0042b","Type":"ContainerStarted","Data":"c58dd27208443f94a2bf6d4c84b708770d35627e8106414c8ed39550eba6e3ae"} Jun 02 07:31:44.054685 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:44.054658 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rgk46" event={"ID":"56bb33da-8c46-4433-8b45-f6fe098c4d25","Type":"ContainerStarted","Data":"16ad54fbe1b09f2fbefae82db18043a838f3c1739ee37f9ee183cc9af05e4171"} Jun 02 07:31:44.054792 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:44.054691 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rgk46" event={"ID":"56bb33da-8c46-4433-8b45-f6fe098c4d25","Type":"ContainerStarted","Data":"9c9a4af73a89e9f4cce6f6bb357c7e1be59cd634a646f1a5722fe14fc3f9e98d"} Jun 02 07:31:44.077711 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:44.077664 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6d488ffffb-f9hj5" podStartSLOduration=2.077650766 podStartE2EDuration="2.077650766s" podCreationTimestamp="2026-06-02 07:31:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 07:31:44.073654518 +0000 UTC m=+132.337636583" watchObservedRunningTime="2026-06-02 07:31:44.077650766 +0000 UTC m=+132.341632882" Jun 02 07:31:44.098324 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:44.098277 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-rgk46" podStartSLOduration=130.828905293 podStartE2EDuration="2m12.098264315s" podCreationTimestamp="2026-06-02 07:29:32 +0000 UTC" firstStartedPulling="2026-06-02 07:31:42.328023874 +0000 UTC m=+130.592005917" lastFinishedPulling="2026-06-02 07:31:43.59738289 +0000 UTC m=+131.861364939" observedRunningTime="2026-06-02 07:31:44.096175232 +0000 UTC m=+132.360157307" watchObservedRunningTime="2026-06-02 07:31:44.098264315 +0000 UTC m=+132.362246381" Jun 02 07:31:45.037074 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:45.037046 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5976d4747-w2ph2" Jun 02 07:31:46.892723 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:46.892677 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 07:31:47.474186 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:47.474152 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-77d564d864-lh62v" Jun 02 07:31:52.969047 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:52.969003 2580 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d488ffffb-f9hj5" Jun 02 07:31:52.969047 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:52.969054 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d488ffffb-f9hj5" Jun 02 07:31:52.973697 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:52.973674 2580 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d488ffffb-f9hj5" Jun 02 07:31:53.088746 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:53.088706 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d488ffffb-f9hj5" Jun 02 07:31:53.141542 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:53.141505 2580 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c645bd5c-66p5s"] Jun 02 07:31:54.963244 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:54.963201 2580 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6788db7769-ktbv4" Jun 02 07:31:54.963619 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:54.963257 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6788db7769-ktbv4" Jun 02 07:31:57.988258 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:57.988189 2580 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-5755f749c7-dptlv" podUID="5c4e369a-440b-4ec0-908d-8e3caf363863" containerName="console" containerID="cri-o://128139ac9e971895054c748800db49bea1b1b4b0bf12130e0bd5ce4aa888d9c3" gracePeriod=15 Jun 02 07:31:58.102544 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:58.102512 2580 generic.go:358] "Generic (PLEG): container finished" podID="8a4e587e-c21b-4884-ba83-60768b7b2bc0" containerID="4712f4f83424d355008a1251b96b33e72dc0121e9683976ec2ff9e2227a41a30" exitCode=0 Jun 02 07:31:58.102681 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:58.102584 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-cdswh" event={"ID":"8a4e587e-c21b-4884-ba83-60768b7b2bc0","Type":"ContainerDied","Data":"4712f4f83424d355008a1251b96b33e72dc0121e9683976ec2ff9e2227a41a30"} Jun 02 07:31:58.102953 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:58.102937 2580 scope.go:117] "RemoveContainer" containerID="4712f4f83424d355008a1251b96b33e72dc0121e9683976ec2ff9e2227a41a30" Jun 02 07:31:58.257514 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:58.257488 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5755f749c7-dptlv_5c4e369a-440b-4ec0-908d-8e3caf363863/console/0.log" Jun 02 07:31:58.257631 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:58.257553 2580 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5755f749c7-dptlv" Jun 02 07:31:58.363579 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:58.363533 2580 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r5pg8\" (UniqueName: \"kubernetes.io/projected/5c4e369a-440b-4ec0-908d-8e3caf363863-kube-api-access-r5pg8\") pod \"5c4e369a-440b-4ec0-908d-8e3caf363863\" (UID: \"5c4e369a-440b-4ec0-908d-8e3caf363863\") " Jun 02 07:31:58.363767 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:58.363602 2580 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5c4e369a-440b-4ec0-908d-8e3caf363863-console-config\") pod \"5c4e369a-440b-4ec0-908d-8e3caf363863\" (UID: \"5c4e369a-440b-4ec0-908d-8e3caf363863\") " Jun 02 07:31:58.363767 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:58.363651 2580 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5c4e369a-440b-4ec0-908d-8e3caf363863-service-ca\") pod \"5c4e369a-440b-4ec0-908d-8e3caf363863\" (UID: \"5c4e369a-440b-4ec0-908d-8e3caf363863\") " Jun 02 07:31:58.363767 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:58.363684 2580 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5c4e369a-440b-4ec0-908d-8e3caf363863-console-oauth-config\") pod \"5c4e369a-440b-4ec0-908d-8e3caf363863\" (UID: \"5c4e369a-440b-4ec0-908d-8e3caf363863\") " Jun 02 07:31:58.363767 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:58.363709 2580 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c4e369a-440b-4ec0-908d-8e3caf363863-console-serving-cert\") pod \"5c4e369a-440b-4ec0-908d-8e3caf363863\" (UID: \"5c4e369a-440b-4ec0-908d-8e3caf363863\") " Jun 02 07:31:58.363976 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:58.363777 2580 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5c4e369a-440b-4ec0-908d-8e3caf363863-oauth-serving-cert\") pod \"5c4e369a-440b-4ec0-908d-8e3caf363863\" (UID: \"5c4e369a-440b-4ec0-908d-8e3caf363863\") " Jun 02 07:31:58.364056 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:58.364020 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c4e369a-440b-4ec0-908d-8e3caf363863-console-config" (OuterVolumeSpecName: "console-config") pod "5c4e369a-440b-4ec0-908d-8e3caf363863" (UID: "5c4e369a-440b-4ec0-908d-8e3caf363863"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 07:31:58.364229 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:58.364180 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c4e369a-440b-4ec0-908d-8e3caf363863-service-ca" (OuterVolumeSpecName: "service-ca") pod "5c4e369a-440b-4ec0-908d-8e3caf363863" (UID: "5c4e369a-440b-4ec0-908d-8e3caf363863"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 07:31:58.364523 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:58.364207 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5c4e369a-440b-4ec0-908d-8e3caf363863-console-config\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jun 02 07:31:58.364523 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:58.364261 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c4e369a-440b-4ec0-908d-8e3caf363863-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5c4e369a-440b-4ec0-908d-8e3caf363863" (UID: "5c4e369a-440b-4ec0-908d-8e3caf363863"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 07:31:58.366075 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:58.366045 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c4e369a-440b-4ec0-908d-8e3caf363863-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5c4e369a-440b-4ec0-908d-8e3caf363863" (UID: "5c4e369a-440b-4ec0-908d-8e3caf363863"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 07:31:58.366174 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:58.366074 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c4e369a-440b-4ec0-908d-8e3caf363863-kube-api-access-r5pg8" (OuterVolumeSpecName: "kube-api-access-r5pg8") pod "5c4e369a-440b-4ec0-908d-8e3caf363863" (UID: "5c4e369a-440b-4ec0-908d-8e3caf363863"). InnerVolumeSpecName "kube-api-access-r5pg8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 07:31:58.366174 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:58.366078 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c4e369a-440b-4ec0-908d-8e3caf363863-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5c4e369a-440b-4ec0-908d-8e3caf363863" (UID: "5c4e369a-440b-4ec0-908d-8e3caf363863"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 07:31:58.464915 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:58.464876 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r5pg8\" (UniqueName: \"kubernetes.io/projected/5c4e369a-440b-4ec0-908d-8e3caf363863-kube-api-access-r5pg8\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jun 02 07:31:58.464915 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:58.464910 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5c4e369a-440b-4ec0-908d-8e3caf363863-service-ca\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jun 02 07:31:58.465111 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:58.464925 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5c4e369a-440b-4ec0-908d-8e3caf363863-console-oauth-config\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jun 02 07:31:58.465111 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:58.464938 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c4e369a-440b-4ec0-908d-8e3caf363863-console-serving-cert\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jun 02 07:31:58.465111 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:58.464953 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5c4e369a-440b-4ec0-908d-8e3caf363863-oauth-serving-cert\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jun 02 07:31:59.107557 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:59.107523 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-cdswh" event={"ID":"8a4e587e-c21b-4884-ba83-60768b7b2bc0","Type":"ContainerStarted","Data":"480b886d3a647d8579bdb8ff2372e02f64f24759f96850a765984265b0edbc2c"} Jun 02 07:31:59.111096 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:59.111076 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5755f749c7-dptlv_5c4e369a-440b-4ec0-908d-8e3caf363863/console/0.log" Jun 02 07:31:59.111259 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:59.111111 2580 generic.go:358] "Generic (PLEG): container finished" podID="5c4e369a-440b-4ec0-908d-8e3caf363863" containerID="128139ac9e971895054c748800db49bea1b1b4b0bf12130e0bd5ce4aa888d9c3" exitCode=2 Jun 02 07:31:59.111259 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:59.111164 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5755f749c7-dptlv" event={"ID":"5c4e369a-440b-4ec0-908d-8e3caf363863","Type":"ContainerDied","Data":"128139ac9e971895054c748800db49bea1b1b4b0bf12130e0bd5ce4aa888d9c3"} Jun 02 07:31:59.111259 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:59.111182 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5755f749c7-dptlv" event={"ID":"5c4e369a-440b-4ec0-908d-8e3caf363863","Type":"ContainerDied","Data":"56b9b3fb943876681b52a8135fe1046f9aa80484d70451b79965703af9da00cd"} Jun 02 07:31:59.111259 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:59.111186 2580 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5755f749c7-dptlv" Jun 02 07:31:59.111259 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:59.111198 2580 scope.go:117] "RemoveContainer" containerID="128139ac9e971895054c748800db49bea1b1b4b0bf12130e0bd5ce4aa888d9c3" Jun 02 07:31:59.119978 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:59.119956 2580 scope.go:117] "RemoveContainer" containerID="128139ac9e971895054c748800db49bea1b1b4b0bf12130e0bd5ce4aa888d9c3" Jun 02 07:31:59.120257 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:31:59.120234 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"128139ac9e971895054c748800db49bea1b1b4b0bf12130e0bd5ce4aa888d9c3\": container with ID starting with 128139ac9e971895054c748800db49bea1b1b4b0bf12130e0bd5ce4aa888d9c3 not found: ID does not exist" containerID="128139ac9e971895054c748800db49bea1b1b4b0bf12130e0bd5ce4aa888d9c3" Jun 02 07:31:59.120313 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:59.120266 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"128139ac9e971895054c748800db49bea1b1b4b0bf12130e0bd5ce4aa888d9c3"} err="failed to get container status \"128139ac9e971895054c748800db49bea1b1b4b0bf12130e0bd5ce4aa888d9c3\": rpc error: code = NotFound desc = could not find container \"128139ac9e971895054c748800db49bea1b1b4b0bf12130e0bd5ce4aa888d9c3\": container with ID starting with 128139ac9e971895054c748800db49bea1b1b4b0bf12130e0bd5ce4aa888d9c3 not found: ID does not exist" Jun 02 07:31:59.137162 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:59.137133 2580 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5755f749c7-dptlv"] Jun 02 07:31:59.142335 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:31:59.142302 2580 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5755f749c7-dptlv"] Jun 02 07:32:00.379340 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:00.379298 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c4e369a-440b-4ec0-908d-8e3caf363863" path="/var/lib/kubelet/pods/5c4e369a-440b-4ec0-908d-8e3caf363863/volumes" Jun 02 07:32:07.638969 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:07.638911 2580 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-77d564d864-lh62v" podUID="b8935b49-9282-4ab1-8a32-f6436453a7d1" containerName="console" containerID="cri-o://7cc4363656b9a8a734916f358034250cb8036f22f26ba2b4df84ac32875d51ad" gracePeriod=15 Jun 02 07:32:07.908416 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:07.908395 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-77d564d864-lh62v_b8935b49-9282-4ab1-8a32-f6436453a7d1/console/0.log" Jun 02 07:32:07.908511 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:07.908454 2580 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77d564d864-lh62v" Jun 02 07:32:07.944821 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:07.944786 2580 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b8935b49-9282-4ab1-8a32-f6436453a7d1-console-oauth-config\") pod \"b8935b49-9282-4ab1-8a32-f6436453a7d1\" (UID: \"b8935b49-9282-4ab1-8a32-f6436453a7d1\") " Jun 02 07:32:07.944821 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:07.944827 2580 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wmflx\" (UniqueName: \"kubernetes.io/projected/b8935b49-9282-4ab1-8a32-f6436453a7d1-kube-api-access-wmflx\") pod \"b8935b49-9282-4ab1-8a32-f6436453a7d1\" (UID: \"b8935b49-9282-4ab1-8a32-f6436453a7d1\") " Jun 02 07:32:07.945099 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:07.944844 2580 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b8935b49-9282-4ab1-8a32-f6436453a7d1-console-serving-cert\") pod \"b8935b49-9282-4ab1-8a32-f6436453a7d1\" (UID: \"b8935b49-9282-4ab1-8a32-f6436453a7d1\") " Jun 02 07:32:07.945099 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:07.944870 2580 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b8935b49-9282-4ab1-8a32-f6436453a7d1-trusted-ca-bundle\") pod \"b8935b49-9282-4ab1-8a32-f6436453a7d1\" (UID: \"b8935b49-9282-4ab1-8a32-f6436453a7d1\") " Jun 02 07:32:07.945099 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:07.944918 2580 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b8935b49-9282-4ab1-8a32-f6436453a7d1-service-ca\") pod \"b8935b49-9282-4ab1-8a32-f6436453a7d1\" (UID: \"b8935b49-9282-4ab1-8a32-f6436453a7d1\") " Jun 02 07:32:07.945099 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:07.944940 2580 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b8935b49-9282-4ab1-8a32-f6436453a7d1-oauth-serving-cert\") pod \"b8935b49-9282-4ab1-8a32-f6436453a7d1\" (UID: \"b8935b49-9282-4ab1-8a32-f6436453a7d1\") " Jun 02 07:32:07.945099 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:07.944985 2580 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b8935b49-9282-4ab1-8a32-f6436453a7d1-console-config\") pod \"b8935b49-9282-4ab1-8a32-f6436453a7d1\" (UID: \"b8935b49-9282-4ab1-8a32-f6436453a7d1\") " Jun 02 07:32:07.945465 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:07.945431 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8935b49-9282-4ab1-8a32-f6436453a7d1-service-ca" (OuterVolumeSpecName: "service-ca") pod "b8935b49-9282-4ab1-8a32-f6436453a7d1" (UID: "b8935b49-9282-4ab1-8a32-f6436453a7d1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 07:32:07.945689 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:07.945453 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8935b49-9282-4ab1-8a32-f6436453a7d1-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b8935b49-9282-4ab1-8a32-f6436453a7d1" (UID: "b8935b49-9282-4ab1-8a32-f6436453a7d1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 07:32:07.945689 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:07.945605 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8935b49-9282-4ab1-8a32-f6436453a7d1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b8935b49-9282-4ab1-8a32-f6436453a7d1" (UID: "b8935b49-9282-4ab1-8a32-f6436453a7d1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 07:32:07.945847 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:07.945823 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8935b49-9282-4ab1-8a32-f6436453a7d1-console-config" (OuterVolumeSpecName: "console-config") pod "b8935b49-9282-4ab1-8a32-f6436453a7d1" (UID: "b8935b49-9282-4ab1-8a32-f6436453a7d1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 07:32:07.947184 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:07.947163 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8935b49-9282-4ab1-8a32-f6436453a7d1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b8935b49-9282-4ab1-8a32-f6436453a7d1" (UID: "b8935b49-9282-4ab1-8a32-f6436453a7d1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 07:32:07.947309 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:07.947247 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8935b49-9282-4ab1-8a32-f6436453a7d1-kube-api-access-wmflx" (OuterVolumeSpecName: "kube-api-access-wmflx") pod "b8935b49-9282-4ab1-8a32-f6436453a7d1" (UID: "b8935b49-9282-4ab1-8a32-f6436453a7d1"). InnerVolumeSpecName "kube-api-access-wmflx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 07:32:07.947504 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:07.947487 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8935b49-9282-4ab1-8a32-f6436453a7d1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b8935b49-9282-4ab1-8a32-f6436453a7d1" (UID: "b8935b49-9282-4ab1-8a32-f6436453a7d1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 07:32:08.046148 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:08.046109 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wmflx\" (UniqueName: \"kubernetes.io/projected/b8935b49-9282-4ab1-8a32-f6436453a7d1-kube-api-access-wmflx\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jun 02 07:32:08.046148 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:08.046145 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b8935b49-9282-4ab1-8a32-f6436453a7d1-console-serving-cert\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jun 02 07:32:08.046148 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:08.046155 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b8935b49-9282-4ab1-8a32-f6436453a7d1-trusted-ca-bundle\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jun 02 07:32:08.046390 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:08.046164 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b8935b49-9282-4ab1-8a32-f6436453a7d1-service-ca\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jun 02 07:32:08.046390 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:08.046173 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b8935b49-9282-4ab1-8a32-f6436453a7d1-oauth-serving-cert\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jun 02 07:32:08.046390 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:08.046183 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b8935b49-9282-4ab1-8a32-f6436453a7d1-console-config\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jun 02 07:32:08.046390 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:08.046191 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b8935b49-9282-4ab1-8a32-f6436453a7d1-console-oauth-config\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jun 02 07:32:08.143237 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:08.143141 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-77d564d864-lh62v_b8935b49-9282-4ab1-8a32-f6436453a7d1/console/0.log" Jun 02 07:32:08.143237 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:08.143184 2580 generic.go:358] "Generic (PLEG): container finished" podID="b8935b49-9282-4ab1-8a32-f6436453a7d1" containerID="7cc4363656b9a8a734916f358034250cb8036f22f26ba2b4df84ac32875d51ad" exitCode=2 Jun 02 07:32:08.143431 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:08.143289 2580 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77d564d864-lh62v" Jun 02 07:32:08.143431 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:08.143285 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77d564d864-lh62v" event={"ID":"b8935b49-9282-4ab1-8a32-f6436453a7d1","Type":"ContainerDied","Data":"7cc4363656b9a8a734916f358034250cb8036f22f26ba2b4df84ac32875d51ad"} Jun 02 07:32:08.143431 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:08.143391 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77d564d864-lh62v" event={"ID":"b8935b49-9282-4ab1-8a32-f6436453a7d1","Type":"ContainerDied","Data":"d8e6a30424f53c2093d0df8debb3a97f477b5319cbf9b653566984a3e5ca39bd"} Jun 02 07:32:08.143431 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:08.143406 2580 scope.go:117] "RemoveContainer" containerID="7cc4363656b9a8a734916f358034250cb8036f22f26ba2b4df84ac32875d51ad" Jun 02 07:32:08.152380 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:08.152359 2580 scope.go:117] "RemoveContainer" containerID="7cc4363656b9a8a734916f358034250cb8036f22f26ba2b4df84ac32875d51ad" Jun 02 07:32:08.152648 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:32:08.152629 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7cc4363656b9a8a734916f358034250cb8036f22f26ba2b4df84ac32875d51ad\": container with ID starting with 7cc4363656b9a8a734916f358034250cb8036f22f26ba2b4df84ac32875d51ad not found: ID does not exist" containerID="7cc4363656b9a8a734916f358034250cb8036f22f26ba2b4df84ac32875d51ad" Jun 02 07:32:08.152709 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:08.152661 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cc4363656b9a8a734916f358034250cb8036f22f26ba2b4df84ac32875d51ad"} err="failed to get container status \"7cc4363656b9a8a734916f358034250cb8036f22f26ba2b4df84ac32875d51ad\": rpc error: code = NotFound desc = could not find container \"7cc4363656b9a8a734916f358034250cb8036f22f26ba2b4df84ac32875d51ad\": container with ID starting with 7cc4363656b9a8a734916f358034250cb8036f22f26ba2b4df84ac32875d51ad not found: ID does not exist" Jun 02 07:32:08.163979 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:08.163952 2580 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77d564d864-lh62v"] Jun 02 07:32:08.168096 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:08.168072 2580 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-77d564d864-lh62v"] Jun 02 07:32:08.379072 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:08.379042 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8935b49-9282-4ab1-8a32-f6436453a7d1" path="/var/lib/kubelet/pods/b8935b49-9282-4ab1-8a32-f6436453a7d1/volumes" Jun 02 07:32:14.969231 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:14.969183 2580 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6788db7769-ktbv4" Jun 02 07:32:14.972980 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:14.972956 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6788db7769-ktbv4" Jun 02 07:32:18.168068 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:18.168006 2580 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-5c645bd5c-66p5s" podUID="4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20" containerName="console" containerID="cri-o://56ac99ed71b39d99e9ada54300cea9b33f5d896a1753fd9b1ceae1aec9ab63b5" gracePeriod=15 Jun 02 07:32:18.420136 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:18.420084 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5c645bd5c-66p5s_4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20/console/0.log" Jun 02 07:32:18.420246 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:18.420148 2580 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c645bd5c-66p5s" Jun 02 07:32:18.541010 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:18.540974 2580 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20-service-ca\") pod \"4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20\" (UID: \"4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20\") " Jun 02 07:32:18.541185 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:18.541026 2580 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tmk8x\" (UniqueName: \"kubernetes.io/projected/4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20-kube-api-access-tmk8x\") pod \"4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20\" (UID: \"4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20\") " Jun 02 07:32:18.541185 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:18.541055 2580 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20-console-config\") pod \"4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20\" (UID: \"4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20\") " Jun 02 07:32:18.541185 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:18.541074 2580 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20-oauth-serving-cert\") pod \"4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20\" (UID: \"4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20\") " Jun 02 07:32:18.541376 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:18.541196 2580 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20-trusted-ca-bundle\") pod \"4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20\" (UID: \"4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20\") " Jun 02 07:32:18.541376 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:18.541313 2580 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20-console-serving-cert\") pod \"4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20\" (UID: \"4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20\") " Jun 02 07:32:18.541376 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:18.541348 2580 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20-console-oauth-config\") pod \"4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20\" (UID: \"4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20\") " Jun 02 07:32:18.541519 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:18.541490 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20-console-config" (OuterVolumeSpecName: "console-config") pod "4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20" (UID: "4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 07:32:18.541579 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:18.541544 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20" (UID: "4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 07:32:18.541579 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:18.541423 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20-service-ca" (OuterVolumeSpecName: "service-ca") pod "4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20" (UID: "4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 07:32:18.541680 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:18.541642 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20" (UID: "4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 07:32:18.541737 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:18.541701 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20-console-config\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jun 02 07:32:18.541737 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:18.541722 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20-oauth-serving-cert\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jun 02 07:32:18.541807 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:18.541737 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20-service-ca\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jun 02 07:32:18.543410 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:18.543380 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20" (UID: "4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 07:32:18.543505 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:18.543486 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20-kube-api-access-tmk8x" (OuterVolumeSpecName: "kube-api-access-tmk8x") pod "4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20" (UID: "4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20"). InnerVolumeSpecName "kube-api-access-tmk8x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 07:32:18.543547 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:18.543491 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20" (UID: "4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 07:32:18.643161 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:18.643111 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tmk8x\" (UniqueName: \"kubernetes.io/projected/4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20-kube-api-access-tmk8x\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jun 02 07:32:18.643161 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:18.643159 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20-trusted-ca-bundle\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jun 02 07:32:18.643161 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:18.643169 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20-console-serving-cert\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jun 02 07:32:18.643161 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:18.643177 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20-console-oauth-config\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jun 02 07:32:19.185725 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:19.185653 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5c645bd5c-66p5s_4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20/console/0.log" Jun 02 07:32:19.185725 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:19.185691 2580 generic.go:358] "Generic (PLEG): container finished" podID="4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20" containerID="56ac99ed71b39d99e9ada54300cea9b33f5d896a1753fd9b1ceae1aec9ab63b5" exitCode=2 Jun 02 07:32:19.186162 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:19.185757 2580 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c645bd5c-66p5s" Jun 02 07:32:19.186162 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:19.185786 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c645bd5c-66p5s" event={"ID":"4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20","Type":"ContainerDied","Data":"56ac99ed71b39d99e9ada54300cea9b33f5d896a1753fd9b1ceae1aec9ab63b5"} Jun 02 07:32:19.186162 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:19.185825 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c645bd5c-66p5s" event={"ID":"4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20","Type":"ContainerDied","Data":"6460667b579d100355773855799b75c8b542422b40499ec415be9e9e86a55730"} Jun 02 07:32:19.186162 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:19.185840 2580 scope.go:117] "RemoveContainer" containerID="56ac99ed71b39d99e9ada54300cea9b33f5d896a1753fd9b1ceae1aec9ab63b5" Jun 02 07:32:19.194362 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:19.194342 2580 scope.go:117] "RemoveContainer" containerID="56ac99ed71b39d99e9ada54300cea9b33f5d896a1753fd9b1ceae1aec9ab63b5" Jun 02 07:32:19.194620 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:32:19.194600 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56ac99ed71b39d99e9ada54300cea9b33f5d896a1753fd9b1ceae1aec9ab63b5\": container with ID starting with 56ac99ed71b39d99e9ada54300cea9b33f5d896a1753fd9b1ceae1aec9ab63b5 not found: ID does not exist" containerID="56ac99ed71b39d99e9ada54300cea9b33f5d896a1753fd9b1ceae1aec9ab63b5" Jun 02 07:32:19.194664 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:19.194629 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56ac99ed71b39d99e9ada54300cea9b33f5d896a1753fd9b1ceae1aec9ab63b5"} err="failed to get container status \"56ac99ed71b39d99e9ada54300cea9b33f5d896a1753fd9b1ceae1aec9ab63b5\": rpc error: code = NotFound desc = could not find container \"56ac99ed71b39d99e9ada54300cea9b33f5d896a1753fd9b1ceae1aec9ab63b5\": container with ID starting with 56ac99ed71b39d99e9ada54300cea9b33f5d896a1753fd9b1ceae1aec9ab63b5 not found: ID does not exist" Jun 02 07:32:19.206900 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:19.206873 2580 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c645bd5c-66p5s"] Jun 02 07:32:19.208397 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:19.208369 2580 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5c645bd5c-66p5s"] Jun 02 07:32:20.378851 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:20.378818 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20" path="/var/lib/kubelet/pods/4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20/volumes" Jun 02 07:32:36.892904 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:36.892852 2580 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 07:32:36.913127 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:36.913101 2580 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 07:32:37.262552 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:37.262481 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 07:32:53.964495 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:53.964458 2580 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-785856955d-k6qw5"] Jun 02 07:32:53.965032 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:53.964974 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8935b49-9282-4ab1-8a32-f6436453a7d1" containerName="console" Jun 02 07:32:53.965032 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:53.964993 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8935b49-9282-4ab1-8a32-f6436453a7d1" containerName="console" Jun 02 07:32:53.965032 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:53.965010 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c4e369a-440b-4ec0-908d-8e3caf363863" containerName="console" Jun 02 07:32:53.965032 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:53.965020 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c4e369a-440b-4ec0-908d-8e3caf363863" containerName="console" Jun 02 07:32:53.965032 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:53.965028 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20" containerName="console" Jun 02 07:32:53.965255 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:53.965036 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20" containerName="console" Jun 02 07:32:53.965255 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:53.965133 2580 memory_manager.go:356] "RemoveStaleState removing state" podUID="4bace172-fb3a-4c1d-a3e6-f27a1f2a2b20" containerName="console" Jun 02 07:32:53.965255 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:53.965143 2580 memory_manager.go:356] "RemoveStaleState removing state" podUID="5c4e369a-440b-4ec0-908d-8e3caf363863" containerName="console" Jun 02 07:32:53.965255 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:53.965151 2580 memory_manager.go:356] "RemoveStaleState removing state" podUID="b8935b49-9282-4ab1-8a32-f6436453a7d1" containerName="console" Jun 02 07:32:53.967509 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:53.967486 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-785856955d-k6qw5" Jun 02 07:32:53.976722 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:53.976694 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-785856955d-k6qw5"] Jun 02 07:32:54.079037 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:54.079004 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdtsp\" (UniqueName: \"kubernetes.io/projected/cfd55de5-05df-4d8d-a93e-53a57663086b-kube-api-access-vdtsp\") pod \"console-785856955d-k6qw5\" (UID: \"cfd55de5-05df-4d8d-a93e-53a57663086b\") " pod="openshift-console/console-785856955d-k6qw5" Jun 02 07:32:54.079037 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:54.079054 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cfd55de5-05df-4d8d-a93e-53a57663086b-console-serving-cert\") pod \"console-785856955d-k6qw5\" (UID: \"cfd55de5-05df-4d8d-a93e-53a57663086b\") " pod="openshift-console/console-785856955d-k6qw5" Jun 02 07:32:54.079334 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:54.079092 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cfd55de5-05df-4d8d-a93e-53a57663086b-service-ca\") pod \"console-785856955d-k6qw5\" (UID: \"cfd55de5-05df-4d8d-a93e-53a57663086b\") " pod="openshift-console/console-785856955d-k6qw5" Jun 02 07:32:54.079334 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:54.079110 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfd55de5-05df-4d8d-a93e-53a57663086b-trusted-ca-bundle\") pod \"console-785856955d-k6qw5\" (UID: \"cfd55de5-05df-4d8d-a93e-53a57663086b\") " pod="openshift-console/console-785856955d-k6qw5" Jun 02 07:32:54.079334 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:54.079178 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cfd55de5-05df-4d8d-a93e-53a57663086b-console-config\") pod \"console-785856955d-k6qw5\" (UID: \"cfd55de5-05df-4d8d-a93e-53a57663086b\") " pod="openshift-console/console-785856955d-k6qw5" Jun 02 07:32:54.079334 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:54.079263 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cfd55de5-05df-4d8d-a93e-53a57663086b-oauth-serving-cert\") pod \"console-785856955d-k6qw5\" (UID: \"cfd55de5-05df-4d8d-a93e-53a57663086b\") " pod="openshift-console/console-785856955d-k6qw5" Jun 02 07:32:54.079334 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:54.079304 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cfd55de5-05df-4d8d-a93e-53a57663086b-console-oauth-config\") pod \"console-785856955d-k6qw5\" (UID: \"cfd55de5-05df-4d8d-a93e-53a57663086b\") " pod="openshift-console/console-785856955d-k6qw5" Jun 02 07:32:54.180525 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:54.180484 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cfd55de5-05df-4d8d-a93e-53a57663086b-service-ca\") pod \"console-785856955d-k6qw5\" (UID: \"cfd55de5-05df-4d8d-a93e-53a57663086b\") " pod="openshift-console/console-785856955d-k6qw5" Jun 02 07:32:54.180525 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:54.180526 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfd55de5-05df-4d8d-a93e-53a57663086b-trusted-ca-bundle\") pod \"console-785856955d-k6qw5\" (UID: \"cfd55de5-05df-4d8d-a93e-53a57663086b\") " pod="openshift-console/console-785856955d-k6qw5" Jun 02 07:32:54.180788 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:54.180545 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cfd55de5-05df-4d8d-a93e-53a57663086b-console-config\") pod \"console-785856955d-k6qw5\" (UID: \"cfd55de5-05df-4d8d-a93e-53a57663086b\") " pod="openshift-console/console-785856955d-k6qw5" Jun 02 07:32:54.180788 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:54.180574 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cfd55de5-05df-4d8d-a93e-53a57663086b-oauth-serving-cert\") pod \"console-785856955d-k6qw5\" (UID: \"cfd55de5-05df-4d8d-a93e-53a57663086b\") " pod="openshift-console/console-785856955d-k6qw5" Jun 02 07:32:54.180788 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:54.180599 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cfd55de5-05df-4d8d-a93e-53a57663086b-console-oauth-config\") pod \"console-785856955d-k6qw5\" (UID: \"cfd55de5-05df-4d8d-a93e-53a57663086b\") " pod="openshift-console/console-785856955d-k6qw5" Jun 02 07:32:54.180788 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:54.180655 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vdtsp\" (UniqueName: \"kubernetes.io/projected/cfd55de5-05df-4d8d-a93e-53a57663086b-kube-api-access-vdtsp\") pod \"console-785856955d-k6qw5\" (UID: \"cfd55de5-05df-4d8d-a93e-53a57663086b\") " pod="openshift-console/console-785856955d-k6qw5" Jun 02 07:32:54.180788 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:54.180703 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cfd55de5-05df-4d8d-a93e-53a57663086b-console-serving-cert\") pod \"console-785856955d-k6qw5\" (UID: \"cfd55de5-05df-4d8d-a93e-53a57663086b\") " pod="openshift-console/console-785856955d-k6qw5" Jun 02 07:32:54.181385 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:54.181356 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cfd55de5-05df-4d8d-a93e-53a57663086b-service-ca\") pod \"console-785856955d-k6qw5\" (UID: \"cfd55de5-05df-4d8d-a93e-53a57663086b\") " pod="openshift-console/console-785856955d-k6qw5" Jun 02 07:32:54.181523 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:54.181394 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cfd55de5-05df-4d8d-a93e-53a57663086b-console-config\") pod \"console-785856955d-k6qw5\" (UID: \"cfd55de5-05df-4d8d-a93e-53a57663086b\") " pod="openshift-console/console-785856955d-k6qw5" Jun 02 07:32:54.181523 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:54.181440 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cfd55de5-05df-4d8d-a93e-53a57663086b-oauth-serving-cert\") pod \"console-785856955d-k6qw5\" (UID: \"cfd55de5-05df-4d8d-a93e-53a57663086b\") " pod="openshift-console/console-785856955d-k6qw5" Jun 02 07:32:54.181523 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:54.181488 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfd55de5-05df-4d8d-a93e-53a57663086b-trusted-ca-bundle\") pod \"console-785856955d-k6qw5\" (UID: \"cfd55de5-05df-4d8d-a93e-53a57663086b\") " pod="openshift-console/console-785856955d-k6qw5" Jun 02 07:32:54.183297 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:54.183270 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cfd55de5-05df-4d8d-a93e-53a57663086b-console-oauth-config\") pod \"console-785856955d-k6qw5\" (UID: \"cfd55de5-05df-4d8d-a93e-53a57663086b\") " pod="openshift-console/console-785856955d-k6qw5" Jun 02 07:32:54.183398 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:54.183353 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cfd55de5-05df-4d8d-a93e-53a57663086b-console-serving-cert\") pod \"console-785856955d-k6qw5\" (UID: \"cfd55de5-05df-4d8d-a93e-53a57663086b\") " pod="openshift-console/console-785856955d-k6qw5" Jun 02 07:32:54.188405 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:54.188384 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdtsp\" (UniqueName: \"kubernetes.io/projected/cfd55de5-05df-4d8d-a93e-53a57663086b-kube-api-access-vdtsp\") pod \"console-785856955d-k6qw5\" (UID: \"cfd55de5-05df-4d8d-a93e-53a57663086b\") " pod="openshift-console/console-785856955d-k6qw5" Jun 02 07:32:54.278285 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:54.278172 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-785856955d-k6qw5" Jun 02 07:32:54.410562 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:54.410535 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-785856955d-k6qw5"] Jun 02 07:32:54.412596 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:32:54.412569 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfd55de5_05df_4d8d_a93e_53a57663086b.slice/crio-1488d7b5c162280989b93b9b57a2ff5a2a8b9fd8fe2e5b4445d460a562c32588 WatchSource:0}: Error finding container 1488d7b5c162280989b93b9b57a2ff5a2a8b9fd8fe2e5b4445d460a562c32588: Status 404 returned error can't find the container with id 1488d7b5c162280989b93b9b57a2ff5a2a8b9fd8fe2e5b4445d460a562c32588 Jun 02 07:32:55.300387 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:55.300348 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-785856955d-k6qw5" event={"ID":"cfd55de5-05df-4d8d-a93e-53a57663086b","Type":"ContainerStarted","Data":"53dc661be8d337e6d015f23314154436d51eaaed1fe161f2648944ce6cc04105"} Jun 02 07:32:55.300387 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:55.300388 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-785856955d-k6qw5" event={"ID":"cfd55de5-05df-4d8d-a93e-53a57663086b","Type":"ContainerStarted","Data":"1488d7b5c162280989b93b9b57a2ff5a2a8b9fd8fe2e5b4445d460a562c32588"} Jun 02 07:32:55.316508 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:32:55.316459 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-785856955d-k6qw5" podStartSLOduration=2.316442491 podStartE2EDuration="2.316442491s" podCreationTimestamp="2026-06-02 07:32:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 07:32:55.31534107 +0000 UTC m=+203.579323136" watchObservedRunningTime="2026-06-02 07:32:55.316442491 +0000 UTC m=+203.580424558" Jun 02 07:33:04.278720 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:33:04.278673 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-785856955d-k6qw5" Jun 02 07:33:04.279204 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:33:04.278993 2580 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-785856955d-k6qw5" Jun 02 07:33:04.283364 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:33:04.283345 2580 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-785856955d-k6qw5" Jun 02 07:33:04.333529 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:33:04.333502 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-785856955d-k6qw5" Jun 02 07:33:04.411031 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:33:04.410988 2580 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d488ffffb-f9hj5"] Jun 02 07:33:29.431937 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:33:29.431876 2580 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-6d488ffffb-f9hj5" podUID="11c4d0ee-53ef-44e0-ad26-844c1ec0042b" containerName="console" containerID="cri-o://06835e735ddc120831cf3ee5163ec52a0874b5d82b3413e7855184f993f6c380" gracePeriod=15 Jun 02 07:33:29.682289 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:33:29.682229 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6d488ffffb-f9hj5_11c4d0ee-53ef-44e0-ad26-844c1ec0042b/console/0.log" Jun 02 07:33:29.682289 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:33:29.682289 2580 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d488ffffb-f9hj5" Jun 02 07:33:29.708937 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:33:29.708907 2580 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11c4d0ee-53ef-44e0-ad26-844c1ec0042b-service-ca\") pod \"11c4d0ee-53ef-44e0-ad26-844c1ec0042b\" (UID: \"11c4d0ee-53ef-44e0-ad26-844c1ec0042b\") " Jun 02 07:33:29.709079 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:33:29.709030 2580 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11c4d0ee-53ef-44e0-ad26-844c1ec0042b-trusted-ca-bundle\") pod \"11c4d0ee-53ef-44e0-ad26-844c1ec0042b\" (UID: \"11c4d0ee-53ef-44e0-ad26-844c1ec0042b\") " Jun 02 07:33:29.709079 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:33:29.709061 2580 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pq4tz\" (UniqueName: \"kubernetes.io/projected/11c4d0ee-53ef-44e0-ad26-844c1ec0042b-kube-api-access-pq4tz\") pod \"11c4d0ee-53ef-44e0-ad26-844c1ec0042b\" (UID: \"11c4d0ee-53ef-44e0-ad26-844c1ec0042b\") " Jun 02 07:33:29.709249 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:33:29.709096 2580 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11c4d0ee-53ef-44e0-ad26-844c1ec0042b-console-config\") pod \"11c4d0ee-53ef-44e0-ad26-844c1ec0042b\" (UID: \"11c4d0ee-53ef-44e0-ad26-844c1ec0042b\") " Jun 02 07:33:29.709249 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:33:29.709135 2580 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11c4d0ee-53ef-44e0-ad26-844c1ec0042b-oauth-serving-cert\") pod \"11c4d0ee-53ef-44e0-ad26-844c1ec0042b\" (UID: \"11c4d0ee-53ef-44e0-ad26-844c1ec0042b\") " Jun 02 07:33:29.709249 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:33:29.709160 2580 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11c4d0ee-53ef-44e0-ad26-844c1ec0042b-console-serving-cert\") pod \"11c4d0ee-53ef-44e0-ad26-844c1ec0042b\" (UID: \"11c4d0ee-53ef-44e0-ad26-844c1ec0042b\") " Jun 02 07:33:29.709249 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:33:29.709188 2580 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11c4d0ee-53ef-44e0-ad26-844c1ec0042b-console-oauth-config\") pod \"11c4d0ee-53ef-44e0-ad26-844c1ec0042b\" (UID: \"11c4d0ee-53ef-44e0-ad26-844c1ec0042b\") " Jun 02 07:33:29.709466 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:33:29.709389 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11c4d0ee-53ef-44e0-ad26-844c1ec0042b-service-ca" (OuterVolumeSpecName: "service-ca") pod "11c4d0ee-53ef-44e0-ad26-844c1ec0042b" (UID: "11c4d0ee-53ef-44e0-ad26-844c1ec0042b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 07:33:29.709536 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:33:29.709516 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11c4d0ee-53ef-44e0-ad26-844c1ec0042b-service-ca\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jun 02 07:33:29.709593 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:33:29.709532 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11c4d0ee-53ef-44e0-ad26-844c1ec0042b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "11c4d0ee-53ef-44e0-ad26-844c1ec0042b" (UID: "11c4d0ee-53ef-44e0-ad26-844c1ec0042b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 07:33:29.709689 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:33:29.709636 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11c4d0ee-53ef-44e0-ad26-844c1ec0042b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "11c4d0ee-53ef-44e0-ad26-844c1ec0042b" (UID: "11c4d0ee-53ef-44e0-ad26-844c1ec0042b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 07:33:29.709816 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:33:29.709788 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11c4d0ee-53ef-44e0-ad26-844c1ec0042b-console-config" (OuterVolumeSpecName: "console-config") pod "11c4d0ee-53ef-44e0-ad26-844c1ec0042b" (UID: "11c4d0ee-53ef-44e0-ad26-844c1ec0042b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 07:33:29.711864 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:33:29.711841 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11c4d0ee-53ef-44e0-ad26-844c1ec0042b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "11c4d0ee-53ef-44e0-ad26-844c1ec0042b" (UID: "11c4d0ee-53ef-44e0-ad26-844c1ec0042b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 07:33:29.711961 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:33:29.711866 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11c4d0ee-53ef-44e0-ad26-844c1ec0042b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "11c4d0ee-53ef-44e0-ad26-844c1ec0042b" (UID: "11c4d0ee-53ef-44e0-ad26-844c1ec0042b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 07:33:29.711961 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:33:29.711907 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11c4d0ee-53ef-44e0-ad26-844c1ec0042b-kube-api-access-pq4tz" (OuterVolumeSpecName: "kube-api-access-pq4tz") pod "11c4d0ee-53ef-44e0-ad26-844c1ec0042b" (UID: "11c4d0ee-53ef-44e0-ad26-844c1ec0042b"). InnerVolumeSpecName "kube-api-access-pq4tz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 07:33:29.809916 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:33:29.809884 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11c4d0ee-53ef-44e0-ad26-844c1ec0042b-trusted-ca-bundle\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jun 02 07:33:29.809916 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:33:29.809913 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pq4tz\" (UniqueName: \"kubernetes.io/projected/11c4d0ee-53ef-44e0-ad26-844c1ec0042b-kube-api-access-pq4tz\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jun 02 07:33:29.809916 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:33:29.809926 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11c4d0ee-53ef-44e0-ad26-844c1ec0042b-console-config\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jun 02 07:33:29.810151 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:33:29.809938 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11c4d0ee-53ef-44e0-ad26-844c1ec0042b-oauth-serving-cert\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jun 02 07:33:29.810151 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:33:29.809952 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11c4d0ee-53ef-44e0-ad26-844c1ec0042b-console-serving-cert\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jun 02 07:33:29.810151 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:33:29.809964 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11c4d0ee-53ef-44e0-ad26-844c1ec0042b-console-oauth-config\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jun 02 07:33:30.408548 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:33:30.408523 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6d488ffffb-f9hj5_11c4d0ee-53ef-44e0-ad26-844c1ec0042b/console/0.log" Jun 02 07:33:30.408704 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:33:30.408564 2580 generic.go:358] "Generic (PLEG): container finished" podID="11c4d0ee-53ef-44e0-ad26-844c1ec0042b" containerID="06835e735ddc120831cf3ee5163ec52a0874b5d82b3413e7855184f993f6c380" exitCode=2 Jun 02 07:33:30.408704 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:33:30.408628 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d488ffffb-f9hj5" event={"ID":"11c4d0ee-53ef-44e0-ad26-844c1ec0042b","Type":"ContainerDied","Data":"06835e735ddc120831cf3ee5163ec52a0874b5d82b3413e7855184f993f6c380"} Jun 02 07:33:30.408704 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:33:30.408654 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d488ffffb-f9hj5" event={"ID":"11c4d0ee-53ef-44e0-ad26-844c1ec0042b","Type":"ContainerDied","Data":"c58dd27208443f94a2bf6d4c84b708770d35627e8106414c8ed39550eba6e3ae"} Jun 02 07:33:30.408704 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:33:30.408669 2580 scope.go:117] "RemoveContainer" containerID="06835e735ddc120831cf3ee5163ec52a0874b5d82b3413e7855184f993f6c380" Jun 02 07:33:30.408895 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:33:30.408633 2580 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d488ffffb-f9hj5" Jun 02 07:33:30.416961 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:33:30.416938 2580 scope.go:117] "RemoveContainer" containerID="06835e735ddc120831cf3ee5163ec52a0874b5d82b3413e7855184f993f6c380" Jun 02 07:33:30.417246 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:33:30.417193 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06835e735ddc120831cf3ee5163ec52a0874b5d82b3413e7855184f993f6c380\": container with ID starting with 06835e735ddc120831cf3ee5163ec52a0874b5d82b3413e7855184f993f6c380 not found: ID does not exist" containerID="06835e735ddc120831cf3ee5163ec52a0874b5d82b3413e7855184f993f6c380" Jun 02 07:33:30.417246 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:33:30.417235 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06835e735ddc120831cf3ee5163ec52a0874b5d82b3413e7855184f993f6c380"} err="failed to get container status \"06835e735ddc120831cf3ee5163ec52a0874b5d82b3413e7855184f993f6c380\": rpc error: code = NotFound desc = could not find container \"06835e735ddc120831cf3ee5163ec52a0874b5d82b3413e7855184f993f6c380\": container with ID starting with 06835e735ddc120831cf3ee5163ec52a0874b5d82b3413e7855184f993f6c380 not found: ID does not exist" Jun 02 07:33:30.425142 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:33:30.425116 2580 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d488ffffb-f9hj5"] Jun 02 07:33:30.429107 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:33:30.429086 2580 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6d488ffffb-f9hj5"] Jun 02 07:33:32.379448 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:33:32.379417 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11c4d0ee-53ef-44e0-ad26-844c1ec0042b" path="/var/lib/kubelet/pods/11c4d0ee-53ef-44e0-ad26-844c1ec0042b/volumes" Jun 02 07:34:32.264717 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:34:32.264690 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-lngdw_18c75b48-f630-4be5-9c30-58062558248d/console-operator/1.log" Jun 02 07:34:32.265294 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:34:32.265227 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-lngdw_18c75b48-f630-4be5-9c30-58062558248d/console-operator/1.log" Jun 02 07:34:32.268968 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:34:32.268943 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tjvw4_f3415efe-20d6-430a-8501-c8c2d2709d7e/ovn-acl-logging/0.log" Jun 02 07:34:32.269591 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:34:32.269574 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tjvw4_f3415efe-20d6-430a-8501-c8c2d2709d7e/ovn-acl-logging/0.log" Jun 02 07:34:32.274517 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:34:32.274501 2580 kubelet.go:1628] "Image garbage collection succeeded" Jun 02 07:35:19.195158 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:35:19.195064 2580 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-operator-747c5859c7-clrvh"] Jun 02 07:35:19.195673 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:35:19.195590 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11c4d0ee-53ef-44e0-ad26-844c1ec0042b" containerName="console" Jun 02 07:35:19.195673 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:35:19.195610 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="11c4d0ee-53ef-44e0-ad26-844c1ec0042b" containerName="console" Jun 02 07:35:19.195785 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:35:19.195738 2580 memory_manager.go:356] "RemoveStaleState removing state" podUID="11c4d0ee-53ef-44e0-ad26-844c1ec0042b" containerName="console" Jun 02 07:35:19.197914 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:35:19.197895 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-747c5859c7-clrvh" Jun 02 07:35:19.200270 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:35:19.200246 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\"" Jun 02 07:35:19.200377 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:35:19.200286 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-operator-dockercfg-xc5bd\"" Jun 02 07:35:19.201173 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:35:19.201155 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\"" Jun 02 07:35:19.207151 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:35:19.207126 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-747c5859c7-clrvh"] Jun 02 07:35:19.295930 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:35:19.295895 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzrsc\" (UniqueName: \"kubernetes.io/projected/ac90059e-3f63-4e48-a0ff-d5b00ab4f408-kube-api-access-kzrsc\") pod \"jobset-operator-747c5859c7-clrvh\" (UID: \"ac90059e-3f63-4e48-a0ff-d5b00ab4f408\") " pod="openshift-jobset-operator/jobset-operator-747c5859c7-clrvh" Jun 02 07:35:19.296145 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:35:19.295944 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ac90059e-3f63-4e48-a0ff-d5b00ab4f408-tmp\") pod \"jobset-operator-747c5859c7-clrvh\" (UID: \"ac90059e-3f63-4e48-a0ff-d5b00ab4f408\") " pod="openshift-jobset-operator/jobset-operator-747c5859c7-clrvh" Jun 02 07:35:19.397012 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:35:19.396979 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kzrsc\" (UniqueName: \"kubernetes.io/projected/ac90059e-3f63-4e48-a0ff-d5b00ab4f408-kube-api-access-kzrsc\") pod \"jobset-operator-747c5859c7-clrvh\" (UID: \"ac90059e-3f63-4e48-a0ff-d5b00ab4f408\") " pod="openshift-jobset-operator/jobset-operator-747c5859c7-clrvh" Jun 02 07:35:19.397161 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:35:19.397026 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ac90059e-3f63-4e48-a0ff-d5b00ab4f408-tmp\") pod \"jobset-operator-747c5859c7-clrvh\" (UID: \"ac90059e-3f63-4e48-a0ff-d5b00ab4f408\") " pod="openshift-jobset-operator/jobset-operator-747c5859c7-clrvh" Jun 02 07:35:19.397427 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:35:19.397411 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ac90059e-3f63-4e48-a0ff-d5b00ab4f408-tmp\") pod \"jobset-operator-747c5859c7-clrvh\" (UID: \"ac90059e-3f63-4e48-a0ff-d5b00ab4f408\") " pod="openshift-jobset-operator/jobset-operator-747c5859c7-clrvh" Jun 02 07:35:19.405055 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:35:19.405031 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzrsc\" (UniqueName: \"kubernetes.io/projected/ac90059e-3f63-4e48-a0ff-d5b00ab4f408-kube-api-access-kzrsc\") pod \"jobset-operator-747c5859c7-clrvh\" (UID: \"ac90059e-3f63-4e48-a0ff-d5b00ab4f408\") " pod="openshift-jobset-operator/jobset-operator-747c5859c7-clrvh" Jun 02 07:35:19.515290 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:35:19.515174 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-747c5859c7-clrvh" Jun 02 07:35:19.645875 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:35:19.645851 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-747c5859c7-clrvh"] Jun 02 07:35:19.648391 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:35:19.648346 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podac90059e_3f63_4e48_a0ff_d5b00ab4f408.slice/crio-9e3a56348f634ee7cef25ec0050fee368eb348067559327ac6be86018aea55c0 WatchSource:0}: Error finding container 9e3a56348f634ee7cef25ec0050fee368eb348067559327ac6be86018aea55c0: Status 404 returned error can't find the container with id 9e3a56348f634ee7cef25ec0050fee368eb348067559327ac6be86018aea55c0 Jun 02 07:35:19.650462 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:35:19.650442 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 07:35:19.751393 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:35:19.751355 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-747c5859c7-clrvh" event={"ID":"ac90059e-3f63-4e48-a0ff-d5b00ab4f408","Type":"ContainerStarted","Data":"9e3a56348f634ee7cef25ec0050fee368eb348067559327ac6be86018aea55c0"} Jun 02 07:35:23.769030 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:35:23.768987 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-747c5859c7-clrvh" event={"ID":"ac90059e-3f63-4e48-a0ff-d5b00ab4f408","Type":"ContainerStarted","Data":"9c453f21b947d0ec8af628f7117705f85cb31d74aa6720138b6da133623560d6"} Jun 02 07:35:23.785200 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:35:23.785150 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-operator-747c5859c7-clrvh" podStartSLOduration=1.6031701680000001 podStartE2EDuration="4.785133781s" podCreationTimestamp="2026-06-02 07:35:19 +0000 UTC" firstStartedPulling="2026-06-02 07:35:19.650623534 +0000 UTC m=+347.914605584" lastFinishedPulling="2026-06-02 07:35:22.832587154 +0000 UTC m=+351.096569197" observedRunningTime="2026-06-02 07:35:23.783293066 +0000 UTC m=+352.047275129" watchObservedRunningTime="2026-06-02 07:35:23.785133781 +0000 UTC m=+352.049115840" Jun 02 07:36:49.258265 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:36:49.258143 2580 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6688ff6d8b-mflgq"] Jun 02 07:36:49.261753 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:36:49.261727 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6688ff6d8b-mflgq" Jun 02 07:36:49.272565 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:36:49.272538 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6688ff6d8b-mflgq"] Jun 02 07:36:49.390187 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:36:49.390155 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b41bd176-1136-40ba-a156-eacde079c8a1-trusted-ca-bundle\") pod \"console-6688ff6d8b-mflgq\" (UID: \"b41bd176-1136-40ba-a156-eacde079c8a1\") " pod="openshift-console/console-6688ff6d8b-mflgq" Jun 02 07:36:49.390376 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:36:49.390205 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b41bd176-1136-40ba-a156-eacde079c8a1-console-serving-cert\") pod \"console-6688ff6d8b-mflgq\" (UID: \"b41bd176-1136-40ba-a156-eacde079c8a1\") " pod="openshift-console/console-6688ff6d8b-mflgq" Jun 02 07:36:49.390376 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:36:49.390244 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b41bd176-1136-40ba-a156-eacde079c8a1-service-ca\") pod \"console-6688ff6d8b-mflgq\" (UID: \"b41bd176-1136-40ba-a156-eacde079c8a1\") " pod="openshift-console/console-6688ff6d8b-mflgq" Jun 02 07:36:49.390376 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:36:49.390263 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ft6p8\" (UniqueName: \"kubernetes.io/projected/b41bd176-1136-40ba-a156-eacde079c8a1-kube-api-access-ft6p8\") pod \"console-6688ff6d8b-mflgq\" (UID: \"b41bd176-1136-40ba-a156-eacde079c8a1\") " pod="openshift-console/console-6688ff6d8b-mflgq" Jun 02 07:36:49.390376 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:36:49.390311 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b41bd176-1136-40ba-a156-eacde079c8a1-console-config\") pod \"console-6688ff6d8b-mflgq\" (UID: \"b41bd176-1136-40ba-a156-eacde079c8a1\") " pod="openshift-console/console-6688ff6d8b-mflgq" Jun 02 07:36:49.390545 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:36:49.390441 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b41bd176-1136-40ba-a156-eacde079c8a1-oauth-serving-cert\") pod \"console-6688ff6d8b-mflgq\" (UID: \"b41bd176-1136-40ba-a156-eacde079c8a1\") " pod="openshift-console/console-6688ff6d8b-mflgq" Jun 02 07:36:49.390545 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:36:49.390473 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b41bd176-1136-40ba-a156-eacde079c8a1-console-oauth-config\") pod \"console-6688ff6d8b-mflgq\" (UID: \"b41bd176-1136-40ba-a156-eacde079c8a1\") " pod="openshift-console/console-6688ff6d8b-mflgq" Jun 02 07:36:49.491624 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:36:49.491589 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b41bd176-1136-40ba-a156-eacde079c8a1-oauth-serving-cert\") pod \"console-6688ff6d8b-mflgq\" (UID: \"b41bd176-1136-40ba-a156-eacde079c8a1\") " pod="openshift-console/console-6688ff6d8b-mflgq" Jun 02 07:36:49.491624 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:36:49.491627 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b41bd176-1136-40ba-a156-eacde079c8a1-console-oauth-config\") pod \"console-6688ff6d8b-mflgq\" (UID: \"b41bd176-1136-40ba-a156-eacde079c8a1\") " pod="openshift-console/console-6688ff6d8b-mflgq" Jun 02 07:36:49.491854 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:36:49.491651 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b41bd176-1136-40ba-a156-eacde079c8a1-trusted-ca-bundle\") pod \"console-6688ff6d8b-mflgq\" (UID: \"b41bd176-1136-40ba-a156-eacde079c8a1\") " pod="openshift-console/console-6688ff6d8b-mflgq" Jun 02 07:36:49.491854 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:36:49.491696 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b41bd176-1136-40ba-a156-eacde079c8a1-console-serving-cert\") pod \"console-6688ff6d8b-mflgq\" (UID: \"b41bd176-1136-40ba-a156-eacde079c8a1\") " pod="openshift-console/console-6688ff6d8b-mflgq" Jun 02 07:36:49.491854 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:36:49.491715 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b41bd176-1136-40ba-a156-eacde079c8a1-service-ca\") pod \"console-6688ff6d8b-mflgq\" (UID: \"b41bd176-1136-40ba-a156-eacde079c8a1\") " pod="openshift-console/console-6688ff6d8b-mflgq" Jun 02 07:36:49.491854 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:36:49.491732 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ft6p8\" (UniqueName: \"kubernetes.io/projected/b41bd176-1136-40ba-a156-eacde079c8a1-kube-api-access-ft6p8\") pod \"console-6688ff6d8b-mflgq\" (UID: \"b41bd176-1136-40ba-a156-eacde079c8a1\") " pod="openshift-console/console-6688ff6d8b-mflgq" Jun 02 07:36:49.491854 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:36:49.491760 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b41bd176-1136-40ba-a156-eacde079c8a1-console-config\") pod \"console-6688ff6d8b-mflgq\" (UID: \"b41bd176-1136-40ba-a156-eacde079c8a1\") " pod="openshift-console/console-6688ff6d8b-mflgq" Jun 02 07:36:49.492475 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:36:49.492431 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b41bd176-1136-40ba-a156-eacde079c8a1-oauth-serving-cert\") pod \"console-6688ff6d8b-mflgq\" (UID: \"b41bd176-1136-40ba-a156-eacde079c8a1\") " pod="openshift-console/console-6688ff6d8b-mflgq" Jun 02 07:36:49.492631 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:36:49.492586 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b41bd176-1136-40ba-a156-eacde079c8a1-console-config\") pod \"console-6688ff6d8b-mflgq\" (UID: \"b41bd176-1136-40ba-a156-eacde079c8a1\") " pod="openshift-console/console-6688ff6d8b-mflgq" Jun 02 07:36:49.492709 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:36:49.492684 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b41bd176-1136-40ba-a156-eacde079c8a1-service-ca\") pod \"console-6688ff6d8b-mflgq\" (UID: \"b41bd176-1136-40ba-a156-eacde079c8a1\") " pod="openshift-console/console-6688ff6d8b-mflgq" Jun 02 07:36:49.492767 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:36:49.492745 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b41bd176-1136-40ba-a156-eacde079c8a1-trusted-ca-bundle\") pod \"console-6688ff6d8b-mflgq\" (UID: \"b41bd176-1136-40ba-a156-eacde079c8a1\") " pod="openshift-console/console-6688ff6d8b-mflgq" Jun 02 07:36:49.494412 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:36:49.494383 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b41bd176-1136-40ba-a156-eacde079c8a1-console-serving-cert\") pod \"console-6688ff6d8b-mflgq\" (UID: \"b41bd176-1136-40ba-a156-eacde079c8a1\") " pod="openshift-console/console-6688ff6d8b-mflgq" Jun 02 07:36:49.494412 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:36:49.494390 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b41bd176-1136-40ba-a156-eacde079c8a1-console-oauth-config\") pod \"console-6688ff6d8b-mflgq\" (UID: \"b41bd176-1136-40ba-a156-eacde079c8a1\") " pod="openshift-console/console-6688ff6d8b-mflgq" Jun 02 07:36:49.499856 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:36:49.499832 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ft6p8\" (UniqueName: \"kubernetes.io/projected/b41bd176-1136-40ba-a156-eacde079c8a1-kube-api-access-ft6p8\") pod \"console-6688ff6d8b-mflgq\" (UID: \"b41bd176-1136-40ba-a156-eacde079c8a1\") " pod="openshift-console/console-6688ff6d8b-mflgq" Jun 02 07:36:49.573304 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:36:49.573171 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6688ff6d8b-mflgq" Jun 02 07:36:49.711936 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:36:49.711909 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6688ff6d8b-mflgq"] Jun 02 07:36:49.714557 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:36:49.714528 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb41bd176_1136_40ba_a156_eacde079c8a1.slice/crio-9eff4b6ca260fd42b7dc0ace935dcda575f9d750a8fe7e96fea340834ec616bc WatchSource:0}: Error finding container 9eff4b6ca260fd42b7dc0ace935dcda575f9d750a8fe7e96fea340834ec616bc: Status 404 returned error can't find the container with id 9eff4b6ca260fd42b7dc0ace935dcda575f9d750a8fe7e96fea340834ec616bc Jun 02 07:36:50.069152 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:36:50.069115 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6688ff6d8b-mflgq" event={"ID":"b41bd176-1136-40ba-a156-eacde079c8a1","Type":"ContainerStarted","Data":"5146465e4676079f0150026120ee9d68f00b16436065fc330683ff99b500757a"} Jun 02 07:36:50.069152 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:36:50.069152 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6688ff6d8b-mflgq" event={"ID":"b41bd176-1136-40ba-a156-eacde079c8a1","Type":"ContainerStarted","Data":"9eff4b6ca260fd42b7dc0ace935dcda575f9d750a8fe7e96fea340834ec616bc"} Jun 02 07:36:50.087238 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:36:50.087154 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6688ff6d8b-mflgq" podStartSLOduration=1.087136556 podStartE2EDuration="1.087136556s" podCreationTimestamp="2026-06-02 07:36:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 07:36:50.086665319 +0000 UTC m=+438.350647386" watchObservedRunningTime="2026-06-02 07:36:50.087136556 +0000 UTC m=+438.351118623" Jun 02 07:36:59.574226 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:36:59.574185 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6688ff6d8b-mflgq" Jun 02 07:36:59.574711 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:36:59.574256 2580 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6688ff6d8b-mflgq" Jun 02 07:36:59.578882 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:36:59.578857 2580 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6688ff6d8b-mflgq" Jun 02 07:37:00.112812 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:37:00.112783 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6688ff6d8b-mflgq" Jun 02 07:37:00.157198 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:37:00.157163 2580 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-785856955d-k6qw5"] Jun 02 07:37:25.180407 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:37:25.180347 2580 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-785856955d-k6qw5" podUID="cfd55de5-05df-4d8d-a93e-53a57663086b" containerName="console" containerID="cri-o://53dc661be8d337e6d015f23314154436d51eaaed1fe161f2648944ce6cc04105" gracePeriod=15 Jun 02 07:37:25.435384 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:37:25.435314 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-785856955d-k6qw5_cfd55de5-05df-4d8d-a93e-53a57663086b/console/0.log" Jun 02 07:37:25.435384 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:37:25.435377 2580 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-785856955d-k6qw5" Jun 02 07:37:25.522059 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:37:25.522021 2580 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cfd55de5-05df-4d8d-a93e-53a57663086b-oauth-serving-cert\") pod \"cfd55de5-05df-4d8d-a93e-53a57663086b\" (UID: \"cfd55de5-05df-4d8d-a93e-53a57663086b\") " Jun 02 07:37:25.522247 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:37:25.522084 2580 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vdtsp\" (UniqueName: \"kubernetes.io/projected/cfd55de5-05df-4d8d-a93e-53a57663086b-kube-api-access-vdtsp\") pod \"cfd55de5-05df-4d8d-a93e-53a57663086b\" (UID: \"cfd55de5-05df-4d8d-a93e-53a57663086b\") " Jun 02 07:37:25.522247 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:37:25.522134 2580 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfd55de5-05df-4d8d-a93e-53a57663086b-trusted-ca-bundle\") pod \"cfd55de5-05df-4d8d-a93e-53a57663086b\" (UID: \"cfd55de5-05df-4d8d-a93e-53a57663086b\") " Jun 02 07:37:25.522247 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:37:25.522163 2580 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cfd55de5-05df-4d8d-a93e-53a57663086b-console-config\") pod \"cfd55de5-05df-4d8d-a93e-53a57663086b\" (UID: \"cfd55de5-05df-4d8d-a93e-53a57663086b\") " Jun 02 07:37:25.522247 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:37:25.522209 2580 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cfd55de5-05df-4d8d-a93e-53a57663086b-console-serving-cert\") pod \"cfd55de5-05df-4d8d-a93e-53a57663086b\" (UID: \"cfd55de5-05df-4d8d-a93e-53a57663086b\") " Jun 02 07:37:25.522439 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:37:25.522278 2580 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cfd55de5-05df-4d8d-a93e-53a57663086b-service-ca\") pod \"cfd55de5-05df-4d8d-a93e-53a57663086b\" (UID: \"cfd55de5-05df-4d8d-a93e-53a57663086b\") " Jun 02 07:37:25.522439 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:37:25.522311 2580 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cfd55de5-05df-4d8d-a93e-53a57663086b-console-oauth-config\") pod \"cfd55de5-05df-4d8d-a93e-53a57663086b\" (UID: \"cfd55de5-05df-4d8d-a93e-53a57663086b\") " Jun 02 07:37:25.522543 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:37:25.522433 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cfd55de5-05df-4d8d-a93e-53a57663086b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cfd55de5-05df-4d8d-a93e-53a57663086b" (UID: "cfd55de5-05df-4d8d-a93e-53a57663086b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 07:37:25.522605 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:37:25.522552 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cfd55de5-05df-4d8d-a93e-53a57663086b-console-config" (OuterVolumeSpecName: "console-config") pod "cfd55de5-05df-4d8d-a93e-53a57663086b" (UID: "cfd55de5-05df-4d8d-a93e-53a57663086b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 07:37:25.522605 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:37:25.522573 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cfd55de5-05df-4d8d-a93e-53a57663086b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "cfd55de5-05df-4d8d-a93e-53a57663086b" (UID: "cfd55de5-05df-4d8d-a93e-53a57663086b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 07:37:25.522708 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:37:25.522626 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cfd55de5-05df-4d8d-a93e-53a57663086b-oauth-serving-cert\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jun 02 07:37:25.522708 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:37:25.522645 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cfd55de5-05df-4d8d-a93e-53a57663086b-console-config\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jun 02 07:37:25.522826 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:37:25.522804 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cfd55de5-05df-4d8d-a93e-53a57663086b-service-ca" (OuterVolumeSpecName: "service-ca") pod "cfd55de5-05df-4d8d-a93e-53a57663086b" (UID: "cfd55de5-05df-4d8d-a93e-53a57663086b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 07:37:25.524460 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:37:25.524436 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cfd55de5-05df-4d8d-a93e-53a57663086b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cfd55de5-05df-4d8d-a93e-53a57663086b" (UID: "cfd55de5-05df-4d8d-a93e-53a57663086b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 07:37:25.524564 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:37:25.524478 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cfd55de5-05df-4d8d-a93e-53a57663086b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cfd55de5-05df-4d8d-a93e-53a57663086b" (UID: "cfd55de5-05df-4d8d-a93e-53a57663086b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 07:37:25.524603 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:37:25.524568 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfd55de5-05df-4d8d-a93e-53a57663086b-kube-api-access-vdtsp" (OuterVolumeSpecName: "kube-api-access-vdtsp") pod "cfd55de5-05df-4d8d-a93e-53a57663086b" (UID: "cfd55de5-05df-4d8d-a93e-53a57663086b"). InnerVolumeSpecName "kube-api-access-vdtsp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 07:37:25.624039 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:37:25.624001 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cfd55de5-05df-4d8d-a93e-53a57663086b-console-serving-cert\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jun 02 07:37:25.624039 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:37:25.624035 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cfd55de5-05df-4d8d-a93e-53a57663086b-service-ca\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jun 02 07:37:25.624039 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:37:25.624049 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cfd55de5-05df-4d8d-a93e-53a57663086b-console-oauth-config\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jun 02 07:37:25.624284 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:37:25.624059 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vdtsp\" (UniqueName: \"kubernetes.io/projected/cfd55de5-05df-4d8d-a93e-53a57663086b-kube-api-access-vdtsp\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jun 02 07:37:25.624284 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:37:25.624069 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfd55de5-05df-4d8d-a93e-53a57663086b-trusted-ca-bundle\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jun 02 07:37:26.200169 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:37:26.200141 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-785856955d-k6qw5_cfd55de5-05df-4d8d-a93e-53a57663086b/console/0.log" Jun 02 07:37:26.200696 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:37:26.200180 2580 generic.go:358] "Generic (PLEG): container finished" podID="cfd55de5-05df-4d8d-a93e-53a57663086b" containerID="53dc661be8d337e6d015f23314154436d51eaaed1fe161f2648944ce6cc04105" exitCode=2 Jun 02 07:37:26.200696 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:37:26.200252 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-785856955d-k6qw5" event={"ID":"cfd55de5-05df-4d8d-a93e-53a57663086b","Type":"ContainerDied","Data":"53dc661be8d337e6d015f23314154436d51eaaed1fe161f2648944ce6cc04105"} Jun 02 07:37:26.200696 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:37:26.200273 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-785856955d-k6qw5" event={"ID":"cfd55de5-05df-4d8d-a93e-53a57663086b","Type":"ContainerDied","Data":"1488d7b5c162280989b93b9b57a2ff5a2a8b9fd8fe2e5b4445d460a562c32588"} Jun 02 07:37:26.200696 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:37:26.200288 2580 scope.go:117] "RemoveContainer" containerID="53dc661be8d337e6d015f23314154436d51eaaed1fe161f2648944ce6cc04105" Jun 02 07:37:26.200696 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:37:26.200286 2580 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-785856955d-k6qw5" Jun 02 07:37:26.209276 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:37:26.209257 2580 scope.go:117] "RemoveContainer" containerID="53dc661be8d337e6d015f23314154436d51eaaed1fe161f2648944ce6cc04105" Jun 02 07:37:26.209531 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:37:26.209514 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53dc661be8d337e6d015f23314154436d51eaaed1fe161f2648944ce6cc04105\": container with ID starting with 53dc661be8d337e6d015f23314154436d51eaaed1fe161f2648944ce6cc04105 not found: ID does not exist" containerID="53dc661be8d337e6d015f23314154436d51eaaed1fe161f2648944ce6cc04105" Jun 02 07:37:26.209576 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:37:26.209541 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53dc661be8d337e6d015f23314154436d51eaaed1fe161f2648944ce6cc04105"} err="failed to get container status \"53dc661be8d337e6d015f23314154436d51eaaed1fe161f2648944ce6cc04105\": rpc error: code = NotFound desc = could not find container \"53dc661be8d337e6d015f23314154436d51eaaed1fe161f2648944ce6cc04105\": container with ID starting with 53dc661be8d337e6d015f23314154436d51eaaed1fe161f2648944ce6cc04105 not found: ID does not exist" Jun 02 07:37:26.220791 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:37:26.220764 2580 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-785856955d-k6qw5"] Jun 02 07:37:26.229403 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:37:26.225672 2580 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-785856955d-k6qw5"] Jun 02 07:37:26.379364 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:37:26.379331 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cfd55de5-05df-4d8d-a93e-53a57663086b" path="/var/lib/kubelet/pods/cfd55de5-05df-4d8d-a93e-53a57663086b/volumes" Jun 02 07:37:38.020477 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:37:38.020441 2580 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-d49kd/test-trainjob-mrzp4-node-0-0-tdb69"] Jun 02 07:37:38.021051 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:37:38.021032 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfd55de5-05df-4d8d-a93e-53a57663086b" containerName="console" Jun 02 07:37:38.021051 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:37:38.021053 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfd55de5-05df-4d8d-a93e-53a57663086b" containerName="console" Jun 02 07:37:38.021191 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:37:38.021146 2580 memory_manager.go:356] "RemoveStaleState removing state" podUID="cfd55de5-05df-4d8d-a93e-53a57663086b" containerName="console" Jun 02 07:37:38.026065 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:37:38.026042 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-d49kd/test-trainjob-mrzp4-node-0-0-tdb69" Jun 02 07:37:38.028303 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:37:38.028278 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-d49kd\"/\"openshift-service-ca.crt\"" Jun 02 07:37:38.028415 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:37:38.028285 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-d49kd\"/\"kube-root-ca.crt\"" Jun 02 07:37:38.028993 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:37:38.028978 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-d49kd\"/\"default-dockercfg-glkqh\"" Jun 02 07:37:38.031381 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:37:38.031361 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-d49kd/test-trainjob-mrzp4-node-0-0-tdb69"] Jun 02 07:37:38.139086 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:37:38.139051 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tht2r\" (UniqueName: \"kubernetes.io/projected/7c2fc6bb-c731-401a-8845-5cc01fc45dbb-kube-api-access-tht2r\") pod \"test-trainjob-mrzp4-node-0-0-tdb69\" (UID: \"7c2fc6bb-c731-401a-8845-5cc01fc45dbb\") " pod="test-ns-d49kd/test-trainjob-mrzp4-node-0-0-tdb69" Jun 02 07:37:38.240590 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:37:38.240544 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tht2r\" (UniqueName: \"kubernetes.io/projected/7c2fc6bb-c731-401a-8845-5cc01fc45dbb-kube-api-access-tht2r\") pod \"test-trainjob-mrzp4-node-0-0-tdb69\" (UID: \"7c2fc6bb-c731-401a-8845-5cc01fc45dbb\") " pod="test-ns-d49kd/test-trainjob-mrzp4-node-0-0-tdb69" Jun 02 07:37:38.248987 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:37:38.248961 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tht2r\" (UniqueName: \"kubernetes.io/projected/7c2fc6bb-c731-401a-8845-5cc01fc45dbb-kube-api-access-tht2r\") pod \"test-trainjob-mrzp4-node-0-0-tdb69\" (UID: \"7c2fc6bb-c731-401a-8845-5cc01fc45dbb\") " pod="test-ns-d49kd/test-trainjob-mrzp4-node-0-0-tdb69" Jun 02 07:37:38.336516 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:37:38.336421 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-d49kd/test-trainjob-mrzp4-node-0-0-tdb69" Jun 02 07:37:38.466292 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:37:38.466259 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-d49kd/test-trainjob-mrzp4-node-0-0-tdb69"] Jun 02 07:37:38.468034 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:37:38.468008 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7c2fc6bb_c731_401a_8845_5cc01fc45dbb.slice/crio-af1323d7aa962cfe2254e21b020f129d7e9b873ad78543d21cd2f5c691379ddf WatchSource:0}: Error finding container af1323d7aa962cfe2254e21b020f129d7e9b873ad78543d21cd2f5c691379ddf: Status 404 returned error can't find the container with id af1323d7aa962cfe2254e21b020f129d7e9b873ad78543d21cd2f5c691379ddf Jun 02 07:37:39.262231 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:37:39.262093 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-d49kd/test-trainjob-mrzp4-node-0-0-tdb69" event={"ID":"7c2fc6bb-c731-401a-8845-5cc01fc45dbb","Type":"ContainerStarted","Data":"af1323d7aa962cfe2254e21b020f129d7e9b873ad78543d21cd2f5c691379ddf"} Jun 02 07:38:58.574476 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:38:58.574435 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-d49kd/test-trainjob-mrzp4-node-0-0-tdb69" event={"ID":"7c2fc6bb-c731-401a-8845-5cc01fc45dbb","Type":"ContainerStarted","Data":"90b0fb050a020917c91594ddcb3579cee4e3749eaa3d1c793b7835ff94040a64"} Jun 02 07:38:58.591834 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:38:58.591780 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-d49kd/test-trainjob-mrzp4-node-0-0-tdb69" podStartSLOduration=2.334821582 podStartE2EDuration="1m21.59176628s" podCreationTimestamp="2026-06-02 07:37:37 +0000 UTC" firstStartedPulling="2026-06-02 07:37:38.469853961 +0000 UTC m=+486.733836005" lastFinishedPulling="2026-06-02 07:38:57.726798658 +0000 UTC m=+565.990780703" observedRunningTime="2026-06-02 07:38:58.588717542 +0000 UTC m=+566.852699607" watchObservedRunningTime="2026-06-02 07:38:58.59176628 +0000 UTC m=+566.855748423" Jun 02 07:38:58.883030 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:38:58.883002 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-d49kd_test-trainjob-mrzp4-node-0-0-tdb69_7c2fc6bb-c731-401a-8845-5cc01fc45dbb/node/0.log" Jun 02 07:39:00.582919 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:39:00.582883 2580 generic.go:358] "Generic (PLEG): container finished" podID="7c2fc6bb-c731-401a-8845-5cc01fc45dbb" containerID="90b0fb050a020917c91594ddcb3579cee4e3749eaa3d1c793b7835ff94040a64" exitCode=0 Jun 02 07:39:00.583387 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:39:00.582944 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-d49kd/test-trainjob-mrzp4-node-0-0-tdb69" event={"ID":"7c2fc6bb-c731-401a-8845-5cc01fc45dbb","Type":"ContainerDied","Data":"90b0fb050a020917c91594ddcb3579cee4e3749eaa3d1c793b7835ff94040a64"} Jun 02 07:39:01.707750 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:39:01.707728 2580 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-d49kd/test-trainjob-mrzp4-node-0-0-tdb69" Jun 02 07:39:01.832534 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:39:01.832501 2580 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tht2r\" (UniqueName: \"kubernetes.io/projected/7c2fc6bb-c731-401a-8845-5cc01fc45dbb-kube-api-access-tht2r\") pod \"7c2fc6bb-c731-401a-8845-5cc01fc45dbb\" (UID: \"7c2fc6bb-c731-401a-8845-5cc01fc45dbb\") " Jun 02 07:39:01.834789 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:39:01.834759 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c2fc6bb-c731-401a-8845-5cc01fc45dbb-kube-api-access-tht2r" (OuterVolumeSpecName: "kube-api-access-tht2r") pod "7c2fc6bb-c731-401a-8845-5cc01fc45dbb" (UID: "7c2fc6bb-c731-401a-8845-5cc01fc45dbb"). InnerVolumeSpecName "kube-api-access-tht2r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 07:39:01.883148 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:39:01.883119 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-d49kd_test-trainjob-mrzp4-node-0-0-tdb69_7c2fc6bb-c731-401a-8845-5cc01fc45dbb/node/0.log" Jun 02 07:39:01.933613 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:39:01.933575 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tht2r\" (UniqueName: \"kubernetes.io/projected/7c2fc6bb-c731-401a-8845-5cc01fc45dbb-kube-api-access-tht2r\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jun 02 07:39:02.590788 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:39:02.590760 2580 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-d49kd/test-trainjob-mrzp4-node-0-0-tdb69" Jun 02 07:39:02.590950 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:39:02.590751 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-d49kd/test-trainjob-mrzp4-node-0-0-tdb69" event={"ID":"7c2fc6bb-c731-401a-8845-5cc01fc45dbb","Type":"ContainerDied","Data":"af1323d7aa962cfe2254e21b020f129d7e9b873ad78543d21cd2f5c691379ddf"} Jun 02 07:39:02.590950 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:39:02.590841 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="af1323d7aa962cfe2254e21b020f129d7e9b873ad78543d21cd2f5c691379ddf" Jun 02 07:39:03.287556 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:39:03.287519 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-d49kd_test-trainjob-mrzp4-node-0-0-tdb69_7c2fc6bb-c731-401a-8845-5cc01fc45dbb/node/0.log" Jun 02 07:39:04.463851 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:39:04.463819 2580 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xjf4w/must-gather-qlrjj"] Jun 02 07:39:04.464229 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:39:04.464148 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c2fc6bb-c731-401a-8845-5cc01fc45dbb" containerName="node" Jun 02 07:39:04.464229 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:39:04.464158 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c2fc6bb-c731-401a-8845-5cc01fc45dbb" containerName="node" Jun 02 07:39:04.464307 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:39:04.464248 2580 memory_manager.go:356] "RemoveStaleState removing state" podUID="7c2fc6bb-c731-401a-8845-5cc01fc45dbb" containerName="node" Jun 02 07:39:04.479618 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:39:04.479587 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xjf4w/must-gather-qlrjj"] Jun 02 07:39:04.479777 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:39:04.479695 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xjf4w/must-gather-qlrjj" Jun 02 07:39:04.482017 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:39:04.481988 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xjf4w\"/\"openshift-service-ca.crt\"" Jun 02 07:39:04.482017 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:39:04.482018 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-xjf4w\"/\"default-dockercfg-gj87t\"" Jun 02 07:39:04.482850 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:39:04.482830 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xjf4w\"/\"kube-root-ca.crt\"" Jun 02 07:39:04.561550 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:39:04.561519 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/268471a5-bc08-40f6-af18-4132933d7eab-must-gather-output\") pod \"must-gather-qlrjj\" (UID: \"268471a5-bc08-40f6-af18-4132933d7eab\") " pod="openshift-must-gather-xjf4w/must-gather-qlrjj" Jun 02 07:39:04.561550 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:39:04.561563 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzn48\" (UniqueName: \"kubernetes.io/projected/268471a5-bc08-40f6-af18-4132933d7eab-kube-api-access-fzn48\") pod \"must-gather-qlrjj\" (UID: \"268471a5-bc08-40f6-af18-4132933d7eab\") " pod="openshift-must-gather-xjf4w/must-gather-qlrjj" Jun 02 07:39:04.662015 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:39:04.661971 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/268471a5-bc08-40f6-af18-4132933d7eab-must-gather-output\") pod \"must-gather-qlrjj\" (UID: \"268471a5-bc08-40f6-af18-4132933d7eab\") " pod="openshift-must-gather-xjf4w/must-gather-qlrjj" Jun 02 07:39:04.662186 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:39:04.662029 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fzn48\" (UniqueName: \"kubernetes.io/projected/268471a5-bc08-40f6-af18-4132933d7eab-kube-api-access-fzn48\") pod \"must-gather-qlrjj\" (UID: \"268471a5-bc08-40f6-af18-4132933d7eab\") " pod="openshift-must-gather-xjf4w/must-gather-qlrjj" Jun 02 07:39:04.662334 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:39:04.662312 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/268471a5-bc08-40f6-af18-4132933d7eab-must-gather-output\") pod \"must-gather-qlrjj\" (UID: \"268471a5-bc08-40f6-af18-4132933d7eab\") " pod="openshift-must-gather-xjf4w/must-gather-qlrjj" Jun 02 07:39:04.669635 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:39:04.669608 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzn48\" (UniqueName: \"kubernetes.io/projected/268471a5-bc08-40f6-af18-4132933d7eab-kube-api-access-fzn48\") pod \"must-gather-qlrjj\" (UID: \"268471a5-bc08-40f6-af18-4132933d7eab\") " pod="openshift-must-gather-xjf4w/must-gather-qlrjj" Jun 02 07:39:04.790109 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:39:04.790000 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xjf4w/must-gather-qlrjj" Jun 02 07:39:04.916124 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:39:04.916096 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xjf4w/must-gather-qlrjj"] Jun 02 07:39:04.918701 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:39:04.918673 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod268471a5_bc08_40f6_af18_4132933d7eab.slice/crio-c2597b8afdbad9fb6a0195b46b31dbc277a2d0f13415570130cc5be089e53dc7 WatchSource:0}: Error finding container c2597b8afdbad9fb6a0195b46b31dbc277a2d0f13415570130cc5be089e53dc7: Status 404 returned error can't find the container with id c2597b8afdbad9fb6a0195b46b31dbc277a2d0f13415570130cc5be089e53dc7 Jun 02 07:39:05.602616 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:39:05.602563 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xjf4w/must-gather-qlrjj" event={"ID":"268471a5-bc08-40f6-af18-4132933d7eab","Type":"ContainerStarted","Data":"c2597b8afdbad9fb6a0195b46b31dbc277a2d0f13415570130cc5be089e53dc7"} Jun 02 07:39:08.318489 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:39:08.318449 2580 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-d49kd/test-trainjob-mrzp4-node-0-0-tdb69"] Jun 02 07:39:08.321982 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:39:08.321941 2580 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-d49kd/test-trainjob-mrzp4-node-0-0-tdb69"] Jun 02 07:39:08.382728 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:39:08.382692 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c2fc6bb-c731-401a-8845-5cc01fc45dbb" path="/var/lib/kubelet/pods/7c2fc6bb-c731-401a-8845-5cc01fc45dbb/volumes" Jun 02 07:39:12.661000 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:39:12.660961 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xjf4w/must-gather-qlrjj" event={"ID":"268471a5-bc08-40f6-af18-4132933d7eab","Type":"ContainerStarted","Data":"153b5f56b2452de94d94b1c24ccccca850ab3f8eb567171b2fee8138cb23bbb4"} Jun 02 07:39:12.661498 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:39:12.661009 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xjf4w/must-gather-qlrjj" event={"ID":"268471a5-bc08-40f6-af18-4132933d7eab","Type":"ContainerStarted","Data":"dfa68d52e5a3a0b56a16a30cb9e17fb8365658b8aa672c68ea426254d3cbdfec"} Jun 02 07:39:12.675471 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:39:12.675423 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-xjf4w/must-gather-qlrjj" podStartSLOduration=2.117257142 podStartE2EDuration="8.675409809s" podCreationTimestamp="2026-06-02 07:39:04 +0000 UTC" firstStartedPulling="2026-06-02 07:39:04.920473885 +0000 UTC m=+573.184455944" lastFinishedPulling="2026-06-02 07:39:11.478626567 +0000 UTC m=+579.742608611" observedRunningTime="2026-06-02 07:39:12.674361216 +0000 UTC m=+580.938343282" watchObservedRunningTime="2026-06-02 07:39:12.675409809 +0000 UTC m=+580.939391904" Jun 02 07:39:32.296950 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:39:32.296917 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-lngdw_18c75b48-f630-4be5-9c30-58062558248d/console-operator/1.log" Jun 02 07:39:32.297746 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:39:32.297720 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-lngdw_18c75b48-f630-4be5-9c30-58062558248d/console-operator/1.log" Jun 02 07:39:32.302956 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:39:32.302932 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tjvw4_f3415efe-20d6-430a-8501-c8c2d2709d7e/ovn-acl-logging/0.log" Jun 02 07:39:32.304951 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:39:32.304804 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tjvw4_f3415efe-20d6-430a-8501-c8c2d2709d7e/ovn-acl-logging/0.log" Jun 02 07:39:58.836260 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:39:58.836148 2580 generic.go:358] "Generic (PLEG): container finished" podID="268471a5-bc08-40f6-af18-4132933d7eab" containerID="dfa68d52e5a3a0b56a16a30cb9e17fb8365658b8aa672c68ea426254d3cbdfec" exitCode=0 Jun 02 07:39:58.836260 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:39:58.836239 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xjf4w/must-gather-qlrjj" event={"ID":"268471a5-bc08-40f6-af18-4132933d7eab","Type":"ContainerDied","Data":"dfa68d52e5a3a0b56a16a30cb9e17fb8365658b8aa672c68ea426254d3cbdfec"} Jun 02 07:39:58.836686 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:39:58.836617 2580 scope.go:117] "RemoveContainer" containerID="dfa68d52e5a3a0b56a16a30cb9e17fb8365658b8aa672c68ea426254d3cbdfec" Jun 02 07:39:59.580755 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:39:59.580728 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-xjf4w_must-gather-qlrjj_268471a5-bc08-40f6-af18-4132933d7eab/gather/0.log" Jun 02 07:40:02.689743 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:02.689716 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-jh96t_f3cc7d61-5de3-4982-9b2e-5dec00a1659d/global-pull-secret-syncer/0.log" Jun 02 07:40:02.838891 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:02.838855 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-m8rd6_eee91b43-4311-42b2-aa7b-e1ad62724d7d/konnectivity-agent/0.log" Jun 02 07:40:02.881072 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:02.881041 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-245.ec2.internal_80331574f62266c7e335acd657e0cebc/haproxy/0.log" Jun 02 07:40:04.959179 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:04.959145 2580 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-xjf4w/must-gather-qlrjj"] Jun 02 07:40:04.959604 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:04.959371 2580 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-must-gather-xjf4w/must-gather-qlrjj" podUID="268471a5-bc08-40f6-af18-4132933d7eab" containerName="copy" containerID="cri-o://153b5f56b2452de94d94b1c24ccccca850ab3f8eb567171b2fee8138cb23bbb4" gracePeriod=2 Jun 02 07:40:04.966903 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:04.966843 2580 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-xjf4w/must-gather-qlrjj"] Jun 02 07:40:05.194972 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:05.194946 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-xjf4w_must-gather-qlrjj_268471a5-bc08-40f6-af18-4132933d7eab/copy/0.log" Jun 02 07:40:05.195347 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:05.195332 2580 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xjf4w/must-gather-qlrjj" Jun 02 07:40:05.197309 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:05.197281 2580 status_manager.go:895] "Failed to get status for pod" podUID="268471a5-bc08-40f6-af18-4132933d7eab" pod="openshift-must-gather-xjf4w/must-gather-qlrjj" err="pods \"must-gather-qlrjj\" is forbidden: User \"system:node:ip-10-0-136-245.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-xjf4w\": no relationship found between node 'ip-10-0-136-245.ec2.internal' and this object" Jun 02 07:40:05.254978 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:05.254885 2580 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/268471a5-bc08-40f6-af18-4132933d7eab-must-gather-output\") pod \"268471a5-bc08-40f6-af18-4132933d7eab\" (UID: \"268471a5-bc08-40f6-af18-4132933d7eab\") " Jun 02 07:40:05.254978 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:05.254923 2580 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fzn48\" (UniqueName: \"kubernetes.io/projected/268471a5-bc08-40f6-af18-4132933d7eab-kube-api-access-fzn48\") pod \"268471a5-bc08-40f6-af18-4132933d7eab\" (UID: \"268471a5-bc08-40f6-af18-4132933d7eab\") " Jun 02 07:40:05.257120 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:05.257093 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/268471a5-bc08-40f6-af18-4132933d7eab-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "268471a5-bc08-40f6-af18-4132933d7eab" (UID: "268471a5-bc08-40f6-af18-4132933d7eab"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 07:40:05.257390 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:05.257369 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/268471a5-bc08-40f6-af18-4132933d7eab-kube-api-access-fzn48" (OuterVolumeSpecName: "kube-api-access-fzn48") pod "268471a5-bc08-40f6-af18-4132933d7eab" (UID: "268471a5-bc08-40f6-af18-4132933d7eab"). InnerVolumeSpecName "kube-api-access-fzn48". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 07:40:05.356182 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:05.356151 2580 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/268471a5-bc08-40f6-af18-4132933d7eab-must-gather-output\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jun 02 07:40:05.356182 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:05.356177 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fzn48\" (UniqueName: \"kubernetes.io/projected/268471a5-bc08-40f6-af18-4132933d7eab-kube-api-access-fzn48\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jun 02 07:40:05.860501 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:05.860470 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-xjf4w_must-gather-qlrjj_268471a5-bc08-40f6-af18-4132933d7eab/copy/0.log" Jun 02 07:40:05.860815 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:05.860791 2580 generic.go:358] "Generic (PLEG): container finished" podID="268471a5-bc08-40f6-af18-4132933d7eab" containerID="153b5f56b2452de94d94b1c24ccccca850ab3f8eb567171b2fee8138cb23bbb4" exitCode=143 Jun 02 07:40:05.860933 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:05.860861 2580 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xjf4w/must-gather-qlrjj" Jun 02 07:40:05.860933 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:05.860892 2580 scope.go:117] "RemoveContainer" containerID="153b5f56b2452de94d94b1c24ccccca850ab3f8eb567171b2fee8138cb23bbb4" Jun 02 07:40:05.863247 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:05.863199 2580 status_manager.go:895] "Failed to get status for pod" podUID="268471a5-bc08-40f6-af18-4132933d7eab" pod="openshift-must-gather-xjf4w/must-gather-qlrjj" err="pods \"must-gather-qlrjj\" is forbidden: User \"system:node:ip-10-0-136-245.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-xjf4w\": no relationship found between node 'ip-10-0-136-245.ec2.internal' and this object" Jun 02 07:40:05.869175 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:05.869160 2580 scope.go:117] "RemoveContainer" containerID="dfa68d52e5a3a0b56a16a30cb9e17fb8365658b8aa672c68ea426254d3cbdfec" Jun 02 07:40:05.870771 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:05.870746 2580 status_manager.go:895] "Failed to get status for pod" podUID="268471a5-bc08-40f6-af18-4132933d7eab" pod="openshift-must-gather-xjf4w/must-gather-qlrjj" err="pods \"must-gather-qlrjj\" is forbidden: User \"system:node:ip-10-0-136-245.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-xjf4w\": no relationship found between node 'ip-10-0-136-245.ec2.internal' and this object" Jun 02 07:40:05.881094 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:05.881072 2580 scope.go:117] "RemoveContainer" containerID="153b5f56b2452de94d94b1c24ccccca850ab3f8eb567171b2fee8138cb23bbb4" Jun 02 07:40:05.881404 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:40:05.881386 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"153b5f56b2452de94d94b1c24ccccca850ab3f8eb567171b2fee8138cb23bbb4\": container with ID starting with 153b5f56b2452de94d94b1c24ccccca850ab3f8eb567171b2fee8138cb23bbb4 not found: ID does not exist" containerID="153b5f56b2452de94d94b1c24ccccca850ab3f8eb567171b2fee8138cb23bbb4" Jun 02 07:40:05.881470 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:05.881412 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"153b5f56b2452de94d94b1c24ccccca850ab3f8eb567171b2fee8138cb23bbb4"} err="failed to get container status \"153b5f56b2452de94d94b1c24ccccca850ab3f8eb567171b2fee8138cb23bbb4\": rpc error: code = NotFound desc = could not find container \"153b5f56b2452de94d94b1c24ccccca850ab3f8eb567171b2fee8138cb23bbb4\": container with ID starting with 153b5f56b2452de94d94b1c24ccccca850ab3f8eb567171b2fee8138cb23bbb4 not found: ID does not exist" Jun 02 07:40:05.881470 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:05.881432 2580 scope.go:117] "RemoveContainer" containerID="dfa68d52e5a3a0b56a16a30cb9e17fb8365658b8aa672c68ea426254d3cbdfec" Jun 02 07:40:05.881680 ip-10-0-136-245 kubenswrapper[2580]: E0602 07:40:05.881650 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dfa68d52e5a3a0b56a16a30cb9e17fb8365658b8aa672c68ea426254d3cbdfec\": container with ID starting with dfa68d52e5a3a0b56a16a30cb9e17fb8365658b8aa672c68ea426254d3cbdfec not found: ID does not exist" containerID="dfa68d52e5a3a0b56a16a30cb9e17fb8365658b8aa672c68ea426254d3cbdfec" Jun 02 07:40:05.881737 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:05.881683 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfa68d52e5a3a0b56a16a30cb9e17fb8365658b8aa672c68ea426254d3cbdfec"} err="failed to get container status \"dfa68d52e5a3a0b56a16a30cb9e17fb8365658b8aa672c68ea426254d3cbdfec\": rpc error: code = NotFound desc = could not find container \"dfa68d52e5a3a0b56a16a30cb9e17fb8365658b8aa672c68ea426254d3cbdfec\": container with ID starting with dfa68d52e5a3a0b56a16a30cb9e17fb8365658b8aa672c68ea426254d3cbdfec not found: ID does not exist" Jun 02 07:40:06.077576 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:06.077548 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_11ab42f0-932b-41b6-9747-fd0369c0f50c/alertmanager/0.log" Jun 02 07:40:06.101883 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:06.101860 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_11ab42f0-932b-41b6-9747-fd0369c0f50c/config-reloader/0.log" Jun 02 07:40:06.123508 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:06.123488 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_11ab42f0-932b-41b6-9747-fd0369c0f50c/kube-rbac-proxy-web/0.log" Jun 02 07:40:06.142707 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:06.142668 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_11ab42f0-932b-41b6-9747-fd0369c0f50c/kube-rbac-proxy/0.log" Jun 02 07:40:06.168907 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:06.168882 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_11ab42f0-932b-41b6-9747-fd0369c0f50c/kube-rbac-proxy-metric/0.log" Jun 02 07:40:06.190272 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:06.190239 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_11ab42f0-932b-41b6-9747-fd0369c0f50c/prom-label-proxy/0.log" Jun 02 07:40:06.215844 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:06.215820 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_11ab42f0-932b-41b6-9747-fd0369c0f50c/init-config-reloader/0.log" Jun 02 07:40:06.279208 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:06.279166 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-m877v_039aaef0-1cf8-4e65-8968-f95625a46e77/kube-state-metrics/0.log" Jun 02 07:40:06.297755 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:06.297724 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-m877v_039aaef0-1cf8-4e65-8968-f95625a46e77/kube-rbac-proxy-main/0.log" Jun 02 07:40:06.320871 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:06.320835 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-m877v_039aaef0-1cf8-4e65-8968-f95625a46e77/kube-rbac-proxy-self/0.log" Jun 02 07:40:06.350306 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:06.350283 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6788db7769-ktbv4_2130ac45-091c-4264-85d9-79b7e8e155d4/metrics-server/0.log" Jun 02 07:40:06.376681 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:06.376614 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5768fcc9dd-4qz2p_22d5228c-3c0d-410e-867c-eb891d7e3895/monitoring-plugin/0.log" Jun 02 07:40:06.379688 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:06.379664 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="268471a5-bc08-40f6-af18-4132933d7eab" path="/var/lib/kubelet/pods/268471a5-bc08-40f6-af18-4132933d7eab/volumes" Jun 02 07:40:06.478208 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:06.478180 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-clr5f_f2c623c7-0415-49df-9f4e-22e1748c99c2/node-exporter/0.log" Jun 02 07:40:06.502832 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:06.502803 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-clr5f_f2c623c7-0415-49df-9f4e-22e1748c99c2/kube-rbac-proxy/0.log" Jun 02 07:40:06.525135 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:06.525109 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-clr5f_f2c623c7-0415-49df-9f4e-22e1748c99c2/init-textfile/0.log" Jun 02 07:40:06.627769 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:06.627692 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-479j2_4996005a-a82f-4dad-bb03-6df779a722d3/kube-rbac-proxy-main/0.log" Jun 02 07:40:06.650121 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:06.650072 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-479j2_4996005a-a82f-4dad-bb03-6df779a722d3/kube-rbac-proxy-self/0.log" Jun 02 07:40:06.672965 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:06.672938 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-479j2_4996005a-a82f-4dad-bb03-6df779a722d3/openshift-state-metrics/0.log" Jun 02 07:40:06.713398 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:06.713369 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d/prometheus/0.log" Jun 02 07:40:06.733476 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:06.733450 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d/config-reloader/0.log" Jun 02 07:40:06.755894 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:06.755868 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d/thanos-sidecar/0.log" Jun 02 07:40:06.777990 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:06.777968 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d/kube-rbac-proxy-web/0.log" Jun 02 07:40:06.801329 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:06.801306 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d/kube-rbac-proxy/0.log" Jun 02 07:40:06.822497 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:06.822477 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d/kube-rbac-proxy-thanos/0.log" Jun 02 07:40:06.851337 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:06.851316 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_38a7228b-fe66-4d55-bf6a-7e4dcffdcc6d/init-config-reloader/0.log" Jun 02 07:40:06.937072 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:06.937002 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-59b7f8756b-ddnvf_ea3d68ea-c7d0-4122-95f1-07cc49f2491f/prometheus-operator-admission-webhook/0.log" Jun 02 07:40:06.968583 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:06.968559 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-686f5dd774-tfhhp_bc2d67b7-f757-4530-a6f1-a10d422413b3/telemeter-client/0.log" Jun 02 07:40:06.991941 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:06.991914 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-686f5dd774-tfhhp_bc2d67b7-f757-4530-a6f1-a10d422413b3/reload/0.log" Jun 02 07:40:07.010810 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:07.010784 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-686f5dd774-tfhhp_bc2d67b7-f757-4530-a6f1-a10d422413b3/kube-rbac-proxy/0.log" Jun 02 07:40:07.049240 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:07.049198 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5976d4747-w2ph2_25f32ea0-bc07-4b1f-8750-9568eac758ff/thanos-query/0.log" Jun 02 07:40:07.082874 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:07.082850 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5976d4747-w2ph2_25f32ea0-bc07-4b1f-8750-9568eac758ff/kube-rbac-proxy-web/0.log" Jun 02 07:40:07.114052 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:07.114028 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5976d4747-w2ph2_25f32ea0-bc07-4b1f-8750-9568eac758ff/kube-rbac-proxy/0.log" Jun 02 07:40:07.149620 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:07.149596 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5976d4747-w2ph2_25f32ea0-bc07-4b1f-8750-9568eac758ff/prom-label-proxy/0.log" Jun 02 07:40:07.175629 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:07.175596 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5976d4747-w2ph2_25f32ea0-bc07-4b1f-8750-9568eac758ff/kube-rbac-proxy-rules/0.log" Jun 02 07:40:07.205746 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:07.205675 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5976d4747-w2ph2_25f32ea0-bc07-4b1f-8750-9568eac758ff/kube-rbac-proxy-metrics/0.log" Jun 02 07:40:08.214730 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:08.214699 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-76c9bb5fdf-shg9w_5b038526-eebb-4b2b-996d-48949bb3a852/networking-console-plugin/0.log" Jun 02 07:40:08.590310 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:08.590236 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-lngdw_18c75b48-f630-4be5-9c30-58062558248d/console-operator/1.log" Jun 02 07:40:08.594579 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:08.594555 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-lngdw_18c75b48-f630-4be5-9c30-58062558248d/console-operator/2.log" Jun 02 07:40:08.936140 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:08.936113 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6688ff6d8b-mflgq_b41bd176-1136-40ba-a156-eacde079c8a1/console/0.log" Jun 02 07:40:09.223109 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:09.223029 2580 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mp8dw/perf-node-gather-daemonset-v6rb9"] Jun 02 07:40:09.223512 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:09.223397 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="268471a5-bc08-40f6-af18-4132933d7eab" containerName="gather" Jun 02 07:40:09.223512 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:09.223408 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="268471a5-bc08-40f6-af18-4132933d7eab" containerName="gather" Jun 02 07:40:09.223512 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:09.223419 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="268471a5-bc08-40f6-af18-4132933d7eab" containerName="copy" Jun 02 07:40:09.223512 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:09.223426 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="268471a5-bc08-40f6-af18-4132933d7eab" containerName="copy" Jun 02 07:40:09.223512 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:09.223489 2580 memory_manager.go:356] "RemoveStaleState removing state" podUID="268471a5-bc08-40f6-af18-4132933d7eab" containerName="gather" Jun 02 07:40:09.223512 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:09.223498 2580 memory_manager.go:356] "RemoveStaleState removing state" podUID="268471a5-bc08-40f6-af18-4132933d7eab" containerName="copy" Jun 02 07:40:09.227050 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:09.227030 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mp8dw/perf-node-gather-daemonset-v6rb9" Jun 02 07:40:09.229413 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:09.229394 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mp8dw\"/\"openshift-service-ca.crt\"" Jun 02 07:40:09.230136 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:09.230121 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mp8dw\"/\"default-dockercfg-m8ffp\"" Jun 02 07:40:09.230202 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:09.230161 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mp8dw\"/\"kube-root-ca.crt\"" Jun 02 07:40:09.233892 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:09.233573 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mp8dw/perf-node-gather-daemonset-v6rb9"] Jun 02 07:40:09.294288 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:09.294254 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a30a3ed9-66a3-4711-94c8-2887ae84e4aa-proc\") pod \"perf-node-gather-daemonset-v6rb9\" (UID: \"a30a3ed9-66a3-4711-94c8-2887ae84e4aa\") " pod="openshift-must-gather-mp8dw/perf-node-gather-daemonset-v6rb9" Jun 02 07:40:09.294456 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:09.294318 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nj684\" (UniqueName: \"kubernetes.io/projected/a30a3ed9-66a3-4711-94c8-2887ae84e4aa-kube-api-access-nj684\") pod \"perf-node-gather-daemonset-v6rb9\" (UID: \"a30a3ed9-66a3-4711-94c8-2887ae84e4aa\") " pod="openshift-must-gather-mp8dw/perf-node-gather-daemonset-v6rb9" Jun 02 07:40:09.294456 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:09.294348 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a30a3ed9-66a3-4711-94c8-2887ae84e4aa-sys\") pod \"perf-node-gather-daemonset-v6rb9\" (UID: \"a30a3ed9-66a3-4711-94c8-2887ae84e4aa\") " pod="openshift-must-gather-mp8dw/perf-node-gather-daemonset-v6rb9" Jun 02 07:40:09.294456 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:09.294422 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a30a3ed9-66a3-4711-94c8-2887ae84e4aa-lib-modules\") pod \"perf-node-gather-daemonset-v6rb9\" (UID: \"a30a3ed9-66a3-4711-94c8-2887ae84e4aa\") " pod="openshift-must-gather-mp8dw/perf-node-gather-daemonset-v6rb9" Jun 02 07:40:09.294456 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:09.294452 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a30a3ed9-66a3-4711-94c8-2887ae84e4aa-podres\") pod \"perf-node-gather-daemonset-v6rb9\" (UID: \"a30a3ed9-66a3-4711-94c8-2887ae84e4aa\") " pod="openshift-must-gather-mp8dw/perf-node-gather-daemonset-v6rb9" Jun 02 07:40:09.395350 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:09.395318 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a30a3ed9-66a3-4711-94c8-2887ae84e4aa-lib-modules\") pod \"perf-node-gather-daemonset-v6rb9\" (UID: \"a30a3ed9-66a3-4711-94c8-2887ae84e4aa\") " pod="openshift-must-gather-mp8dw/perf-node-gather-daemonset-v6rb9" Jun 02 07:40:09.395529 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:09.395356 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a30a3ed9-66a3-4711-94c8-2887ae84e4aa-podres\") pod \"perf-node-gather-daemonset-v6rb9\" (UID: \"a30a3ed9-66a3-4711-94c8-2887ae84e4aa\") " pod="openshift-must-gather-mp8dw/perf-node-gather-daemonset-v6rb9" Jun 02 07:40:09.395529 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:09.395399 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a30a3ed9-66a3-4711-94c8-2887ae84e4aa-proc\") pod \"perf-node-gather-daemonset-v6rb9\" (UID: \"a30a3ed9-66a3-4711-94c8-2887ae84e4aa\") " pod="openshift-must-gather-mp8dw/perf-node-gather-daemonset-v6rb9" Jun 02 07:40:09.395529 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:09.395441 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nj684\" (UniqueName: \"kubernetes.io/projected/a30a3ed9-66a3-4711-94c8-2887ae84e4aa-kube-api-access-nj684\") pod \"perf-node-gather-daemonset-v6rb9\" (UID: \"a30a3ed9-66a3-4711-94c8-2887ae84e4aa\") " pod="openshift-must-gather-mp8dw/perf-node-gather-daemonset-v6rb9" Jun 02 07:40:09.395529 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:09.395475 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a30a3ed9-66a3-4711-94c8-2887ae84e4aa-sys\") pod \"perf-node-gather-daemonset-v6rb9\" (UID: \"a30a3ed9-66a3-4711-94c8-2887ae84e4aa\") " pod="openshift-must-gather-mp8dw/perf-node-gather-daemonset-v6rb9" Jun 02 07:40:09.395529 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:09.395485 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a30a3ed9-66a3-4711-94c8-2887ae84e4aa-lib-modules\") pod \"perf-node-gather-daemonset-v6rb9\" (UID: \"a30a3ed9-66a3-4711-94c8-2887ae84e4aa\") " pod="openshift-must-gather-mp8dw/perf-node-gather-daemonset-v6rb9" Jun 02 07:40:09.395713 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:09.395532 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a30a3ed9-66a3-4711-94c8-2887ae84e4aa-proc\") pod \"perf-node-gather-daemonset-v6rb9\" (UID: \"a30a3ed9-66a3-4711-94c8-2887ae84e4aa\") " pod="openshift-must-gather-mp8dw/perf-node-gather-daemonset-v6rb9" Jun 02 07:40:09.395713 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:09.395548 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a30a3ed9-66a3-4711-94c8-2887ae84e4aa-podres\") pod \"perf-node-gather-daemonset-v6rb9\" (UID: \"a30a3ed9-66a3-4711-94c8-2887ae84e4aa\") " pod="openshift-must-gather-mp8dw/perf-node-gather-daemonset-v6rb9" Jun 02 07:40:09.395713 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:09.395618 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a30a3ed9-66a3-4711-94c8-2887ae84e4aa-sys\") pod \"perf-node-gather-daemonset-v6rb9\" (UID: \"a30a3ed9-66a3-4711-94c8-2887ae84e4aa\") " pod="openshift-must-gather-mp8dw/perf-node-gather-daemonset-v6rb9" Jun 02 07:40:09.402887 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:09.402861 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nj684\" (UniqueName: \"kubernetes.io/projected/a30a3ed9-66a3-4711-94c8-2887ae84e4aa-kube-api-access-nj684\") pod \"perf-node-gather-daemonset-v6rb9\" (UID: \"a30a3ed9-66a3-4711-94c8-2887ae84e4aa\") " pod="openshift-must-gather-mp8dw/perf-node-gather-daemonset-v6rb9" Jun 02 07:40:09.428126 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:09.428092 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-7598fd5bd-fh28g_8991f6ba-2f47-4e62-a524-a6181441c3b6/volume-data-source-validator/0.log" Jun 02 07:40:09.537449 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:09.537348 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mp8dw/perf-node-gather-daemonset-v6rb9" Jun 02 07:40:09.670861 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:09.670825 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mp8dw/perf-node-gather-daemonset-v6rb9"] Jun 02 07:40:09.674441 ip-10-0-136-245 kubenswrapper[2580]: W0602 07:40:09.674405 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda30a3ed9_66a3_4711_94c8_2887ae84e4aa.slice/crio-8198e2282c59080099731e8073735e2f1d13aefcd39d28fc37dbc6a9daa4963c WatchSource:0}: Error finding container 8198e2282c59080099731e8073735e2f1d13aefcd39d28fc37dbc6a9daa4963c: Status 404 returned error can't find the container with id 8198e2282c59080099731e8073735e2f1d13aefcd39d28fc37dbc6a9daa4963c Jun 02 07:40:09.876117 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:09.876083 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mp8dw/perf-node-gather-daemonset-v6rb9" event={"ID":"a30a3ed9-66a3-4711-94c8-2887ae84e4aa","Type":"ContainerStarted","Data":"eb82e807da78f7bad7b0b35d130cf0de4a07c15c273f5d8639e08663ed99d9c1"} Jun 02 07:40:09.876117 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:09.876116 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mp8dw/perf-node-gather-daemonset-v6rb9" event={"ID":"a30a3ed9-66a3-4711-94c8-2887ae84e4aa","Type":"ContainerStarted","Data":"8198e2282c59080099731e8073735e2f1d13aefcd39d28fc37dbc6a9daa4963c"} Jun 02 07:40:09.876353 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:09.876201 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mp8dw/perf-node-gather-daemonset-v6rb9" Jun 02 07:40:09.892319 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:09.892268 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-mp8dw/perf-node-gather-daemonset-v6rb9" podStartSLOduration=0.892251623 podStartE2EDuration="892.251623ms" podCreationTimestamp="2026-06-02 07:40:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 07:40:09.89040429 +0000 UTC m=+638.154386347" watchObservedRunningTime="2026-06-02 07:40:09.892251623 +0000 UTC m=+638.156233689" Jun 02 07:40:10.167788 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:10.167715 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-svfjd_54c378b4-2d76-430f-b245-7cd764b8dfc1/dns/0.log" Jun 02 07:40:10.189415 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:10.189390 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-svfjd_54c378b4-2d76-430f-b245-7cd764b8dfc1/kube-rbac-proxy/0.log" Jun 02 07:40:10.214530 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:10.214498 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2krhv_a731c005-ed09-4135-9776-d885682e8200/dns-node-resolver/0.log" Jun 02 07:40:10.667688 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:10.667657 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9bbts_8479fba7-d0c6-4c26-82cd-44cff52ef948/node-ca/0.log" Jun 02 07:40:11.683987 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:11.683956 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bg26p_d835e1ce-7985-432d-809d-d71b36a13093/serve-healthcheck-canary/0.log" Jun 02 07:40:12.075023 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:12.074934 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2tpsl_d8cace1c-1788-4d1d-8441-80c601fe9360/kube-rbac-proxy/0.log" Jun 02 07:40:12.096443 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:12.096417 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2tpsl_d8cace1c-1788-4d1d-8441-80c601fe9360/exporter/0.log" Jun 02 07:40:12.115415 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:12.115392 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2tpsl_d8cace1c-1788-4d1d-8441-80c601fe9360/extractor/0.log" Jun 02 07:40:13.813430 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:13.813399 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-operator-747c5859c7-clrvh_ac90059e-3f63-4e48-a0ff-d5b00ab4f408/jobset-operator/0.log" Jun 02 07:40:15.891194 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:15.891168 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mp8dw/perf-node-gather-daemonset-v6rb9" Jun 02 07:40:17.971256 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:17.971208 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8nv4p_a28eec73-4627-4d20-925e-23fb8e998a96/kube-multus-additional-cni-plugins/0.log" Jun 02 07:40:17.993532 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:17.993506 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8nv4p_a28eec73-4627-4d20-925e-23fb8e998a96/egress-router-binary-copy/0.log" Jun 02 07:40:18.018408 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:18.018391 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8nv4p_a28eec73-4627-4d20-925e-23fb8e998a96/cni-plugins/0.log" Jun 02 07:40:18.041705 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:18.041670 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8nv4p_a28eec73-4627-4d20-925e-23fb8e998a96/bond-cni-plugin/0.log" Jun 02 07:40:18.066982 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:18.066962 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8nv4p_a28eec73-4627-4d20-925e-23fb8e998a96/routeoverride-cni/0.log" Jun 02 07:40:18.088184 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:18.088165 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8nv4p_a28eec73-4627-4d20-925e-23fb8e998a96/whereabouts-cni-bincopy/0.log" Jun 02 07:40:18.110305 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:18.110278 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8nv4p_a28eec73-4627-4d20-925e-23fb8e998a96/whereabouts-cni/0.log" Jun 02 07:40:18.475579 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:18.475554 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-kf8mm_065f3e32-54af-4094-bdd9-2aa60ae8cb83/kube-multus/0.log" Jun 02 07:40:18.542729 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:18.542696 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rgk46_56bb33da-8c46-4433-8b45-f6fe098c4d25/network-metrics-daemon/0.log" Jun 02 07:40:18.567370 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:18.567340 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rgk46_56bb33da-8c46-4433-8b45-f6fe098c4d25/kube-rbac-proxy/0.log" Jun 02 07:40:19.904371 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:19.904345 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tjvw4_f3415efe-20d6-430a-8501-c8c2d2709d7e/ovn-controller/0.log" Jun 02 07:40:19.963501 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:19.963464 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tjvw4_f3415efe-20d6-430a-8501-c8c2d2709d7e/ovn-acl-logging/0.log" Jun 02 07:40:19.966487 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:19.966465 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tjvw4_f3415efe-20d6-430a-8501-c8c2d2709d7e/ovn-acl-logging/1.log" Jun 02 07:40:19.984635 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:19.984614 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tjvw4_f3415efe-20d6-430a-8501-c8c2d2709d7e/kube-rbac-proxy-node/0.log" Jun 02 07:40:20.006025 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:20.005997 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tjvw4_f3415efe-20d6-430a-8501-c8c2d2709d7e/kube-rbac-proxy-ovn-metrics/0.log" Jun 02 07:40:20.027309 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:20.027283 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tjvw4_f3415efe-20d6-430a-8501-c8c2d2709d7e/northd/0.log" Jun 02 07:40:20.050182 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:20.050159 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tjvw4_f3415efe-20d6-430a-8501-c8c2d2709d7e/nbdb/0.log" Jun 02 07:40:20.079097 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:20.079030 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tjvw4_f3415efe-20d6-430a-8501-c8c2d2709d7e/sbdb/0.log" Jun 02 07:40:20.176083 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:20.176048 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tjvw4_f3415efe-20d6-430a-8501-c8c2d2709d7e/ovnkube-controller/0.log" Jun 02 07:40:21.185139 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:21.185109 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-wp2df_f60cac34-93f5-4439-b197-17a7283b4599/network-check-target-container/0.log" Jun 02 07:40:22.099105 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:22.099078 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-nng4s_63f72893-abb3-493b-a512-9e9bd17b76a4/iptables-alerter/0.log" Jun 02 07:40:22.682135 ip-10-0-136-245 kubenswrapper[2580]: I0602 07:40:22.682102 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-67gkk_32c32725-d170-41c3-82f8-78900f6220c2/tuned/0.log"