Jun 09 13:23:45.274205 ip-10-0-135-125 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 09 13:23:45.274216 ip-10-0-135-125 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 09 13:23:45.274223 ip-10-0-135-125 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 09 13:23:45.274380 ip-10-0-135-125 systemd[1]: Failed to start Kubernetes Kubelet. Jun 09 13:23:55.526875 ip-10-0-135-125 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 09 13:23:55.526894 ip-10-0-135-125 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot d3b24ec8216e4604a79aa4dd1b35afd7 -- Jun 09 13:26:25.171478 ip-10-0-135-125 systemd[1]: Starting Kubernetes Kubelet... Jun 09 13:26:25.615614 ip-10-0-135-125 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 13:26:25.615614 ip-10-0-135-125 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 09 13:26:25.615614 ip-10-0-135-125 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 13:26:25.615614 ip-10-0-135-125 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 09 13:26:25.615614 ip-10-0-135-125 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 13:26:25.617839 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.617749 2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 09 13:26:25.624980 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.624957 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 13:26:25.624980 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.624978 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 13:26:25.624980 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.624983 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 13:26:25.624980 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.624987 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 13:26:25.625260 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.624991 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 13:26:25.625260 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.624996 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 13:26:25.625260 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625002 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 13:26:25.625260 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625008 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 13:26:25.625260 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625013 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 13:26:25.625260 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625017 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 13:26:25.625260 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625021 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 13:26:25.625260 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625025 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 13:26:25.625260 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625030 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 13:26:25.625260 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625034 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 13:26:25.625260 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625038 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 13:26:25.625260 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625042 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 13:26:25.625260 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625045 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 13:26:25.625260 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625049 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 13:26:25.625260 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625053 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 13:26:25.625260 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625057 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 13:26:25.625260 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625062 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 13:26:25.625260 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625066 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 13:26:25.625260 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625069 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 13:26:25.625260 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625073 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 13:26:25.626071 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625077 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 13:26:25.626071 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625081 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 13:26:25.626071 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625085 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 13:26:25.626071 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625089 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 13:26:25.626071 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625093 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 13:26:25.626071 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625096 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 13:26:25.626071 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625100 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 13:26:25.626071 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625104 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 13:26:25.626071 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625108 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 13:26:25.626071 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625112 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 13:26:25.626071 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625116 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 13:26:25.626071 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625120 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 13:26:25.626071 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625124 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 13:26:25.626071 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625131 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 13:26:25.626071 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625136 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 13:26:25.626071 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625140 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 13:26:25.626071 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625144 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 13:26:25.626071 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625149 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 13:26:25.626071 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625153 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 13:26:25.626071 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625158 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 13:26:25.626932 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625162 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 13:26:25.626932 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625166 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 13:26:25.626932 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625171 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 13:26:25.626932 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625176 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 13:26:25.626932 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625196 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 13:26:25.626932 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625201 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 13:26:25.626932 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625205 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 13:26:25.626932 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625209 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 13:26:25.626932 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625215 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 13:26:25.626932 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625220 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 13:26:25.626932 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625224 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 13:26:25.626932 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625228 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 13:26:25.626932 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625232 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 13:26:25.626932 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625237 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 13:26:25.626932 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625241 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 13:26:25.626932 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625248 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 13:26:25.626932 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625254 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 13:26:25.626932 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625258 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 13:26:25.626932 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625263 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 13:26:25.626932 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625268 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 13:26:25.627771 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625273 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 13:26:25.627771 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625277 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 13:26:25.627771 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625281 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 13:26:25.627771 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625285 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 13:26:25.627771 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625289 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 13:26:25.627771 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625295 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 13:26:25.627771 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625302 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 13:26:25.627771 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625308 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 13:26:25.627771 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625312 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 13:26:25.627771 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625317 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 13:26:25.627771 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625321 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 13:26:25.627771 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625325 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 13:26:25.627771 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625330 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 13:26:25.627771 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625334 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 13:26:25.627771 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625339 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 13:26:25.627771 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625344 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 13:26:25.627771 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625348 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 13:26:25.627771 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625352 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 13:26:25.627771 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625357 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 13:26:25.628584 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625361 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 13:26:25.628584 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625366 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 13:26:25.628584 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625370 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 13:26:25.628584 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625374 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 13:26:25.628584 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625378 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 13:26:25.628584 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625383 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 13:26:25.628584 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625387 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 13:26:25.628584 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625391 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 13:26:25.628584 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625395 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 13:26:25.628584 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625400 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 13:26:25.628584 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625404 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 09 13:26:25.628584 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625408 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 13:26:25.628584 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625413 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 13:26:25.628584 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625417 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 13:26:25.628584 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625422 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 13:26:25.628584 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.625426 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 13:26:25.628584 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.626642 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 13:26:25.628584 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.626652 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 13:26:25.628584 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.626657 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 13:26:25.628584 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.626661 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 13:26:25.629111 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.626666 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 13:26:25.629111 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.626671 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 13:26:25.629111 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.626675 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 13:26:25.629111 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.626679 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 13:26:25.629111 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.626684 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 13:26:25.629111 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.626688 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 13:26:25.629111 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.626693 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 13:26:25.629111 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.626697 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 13:26:25.629111 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.626711 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 13:26:25.629111 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.626716 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 13:26:25.629111 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.626721 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 13:26:25.629111 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.626726 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 13:26:25.629111 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.626730 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 13:26:25.629111 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.626735 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 13:26:25.629111 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.626739 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 13:26:25.629111 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.626743 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 13:26:25.629111 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.626747 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 13:26:25.629111 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.626752 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 13:26:25.629111 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.626756 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 13:26:25.629111 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.626760 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 13:26:25.629624 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.626764 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 13:26:25.629624 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.626768 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 13:26:25.629624 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.626772 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 13:26:25.629624 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.626777 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 13:26:25.629624 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.626781 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 13:26:25.629624 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.626786 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 13:26:25.629624 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.626790 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 13:26:25.629624 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.626794 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 13:26:25.629624 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.626798 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 13:26:25.629624 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.626802 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 13:26:25.629624 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.626806 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 13:26:25.629624 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.626811 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 13:26:25.629624 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.626817 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 13:26:25.629624 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.626821 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 13:26:25.629624 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.626825 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 13:26:25.629624 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.626829 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 13:26:25.629624 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.626834 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 13:26:25.629624 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.626838 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 13:26:25.629624 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.626845 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 13:26:25.630210 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.626851 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 13:26:25.630210 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.626857 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 13:26:25.630210 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.626872 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 13:26:25.630210 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.626877 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 13:26:25.630210 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.626882 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 13:26:25.630210 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.626888 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 13:26:25.630210 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.626893 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 13:26:25.630210 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.626900 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 13:26:25.630210 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.626905 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 13:26:25.630210 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.626910 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 13:26:25.630210 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.626914 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 13:26:25.630210 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.626918 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 13:26:25.630210 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.626923 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 13:26:25.630210 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.626927 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 13:26:25.630210 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.626931 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 13:26:25.630210 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.626935 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 13:26:25.630210 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.626938 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 13:26:25.630210 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.626950 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 13:26:25.630210 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.626955 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 13:26:25.630681 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.626959 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 13:26:25.630681 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.626964 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 13:26:25.630681 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.626968 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 13:26:25.630681 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.626974 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 13:26:25.630681 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.626978 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 13:26:25.630681 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.626982 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 13:26:25.630681 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.626987 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 13:26:25.630681 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.626992 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 13:26:25.630681 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.626996 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 13:26:25.630681 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.627000 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 13:26:25.630681 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.627004 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 13:26:25.630681 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.627009 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 13:26:25.630681 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.627013 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 13:26:25.630681 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.627018 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 13:26:25.630681 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.627022 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 13:26:25.630681 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.627026 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 13:26:25.630681 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.627040 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 13:26:25.630681 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.627044 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 13:26:25.630681 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.627049 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 13:26:25.630681 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.627053 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 13:26:25.631170 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.627057 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 13:26:25.631170 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.627062 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 13:26:25.631170 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.627066 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 13:26:25.631170 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.627070 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 13:26:25.631170 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.627074 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 13:26:25.631170 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.627078 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 13:26:25.631170 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.627082 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 13:26:25.631170 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.627087 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 13:26:25.631170 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.627092 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 13:26:25.631170 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.627096 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 13:26:25.631170 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.627102 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 13:26:25.631170 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.627106 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 13:26:25.631170 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.627111 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 13:26:25.631170 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.627115 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 13:26:25.631170 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.627119 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 13:26:25.631170 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.627123 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 13:26:25.631170 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.627127 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 09 13:26:25.631170 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.627775 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 13:26:25.631170 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.627783 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 13:26:25.631170 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.627788 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 13:26:25.631704 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.627793 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 13:26:25.631704 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.627797 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 13:26:25.631704 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.627801 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 13:26:25.631704 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.627805 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 13:26:25.631704 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.627812 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 13:26:25.631704 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.627819 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 13:26:25.631704 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.627824 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 13:26:25.631704 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.627829 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 13:26:25.631704 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.627842 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 13:26:25.631704 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.627846 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 09 13:26:25.631704 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.627851 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 13:26:25.631704 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.627855 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 13:26:25.631704 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.627860 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 13:26:25.631704 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.627864 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 13:26:25.631704 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.627869 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 13:26:25.631704 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.627873 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 13:26:25.631704 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.627877 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 13:26:25.631704 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.627882 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 13:26:25.631704 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.627886 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 13:26:25.631704 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.627890 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 13:26:25.632251 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.627895 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 13:26:25.632251 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.627899 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 13:26:25.632251 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.627906 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 13:26:25.632251 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.627910 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 13:26:25.632251 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.627915 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 13:26:25.632251 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.627919 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 13:26:25.632251 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.627923 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 13:26:25.632251 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.627928 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 13:26:25.632251 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.627932 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 13:26:25.632251 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.627936 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 13:26:25.632251 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.627941 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 13:26:25.632251 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.627945 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 13:26:25.632251 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.627950 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 13:26:25.632251 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.627955 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 13:26:25.632251 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.627960 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 13:26:25.632251 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.627964 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 13:26:25.632251 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.627968 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 13:26:25.632251 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.627972 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 13:26:25.632251 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.627977 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 13:26:25.632750 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.627981 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 13:26:25.632750 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.627985 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 13:26:25.632750 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.627991 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 13:26:25.632750 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.627996 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 13:26:25.632750 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.628000 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 13:26:25.632750 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.628004 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 13:26:25.632750 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.628008 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 13:26:25.632750 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.628013 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 13:26:25.632750 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.628017 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 13:26:25.632750 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.628021 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 13:26:25.632750 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.628026 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 13:26:25.632750 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.628030 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 13:26:25.632750 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.628034 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 13:26:25.632750 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.628038 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 13:26:25.632750 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.628043 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 13:26:25.632750 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.628049 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 13:26:25.632750 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.628053 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 13:26:25.632750 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.628058 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 13:26:25.632750 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.628062 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 13:26:25.632750 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.628066 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 13:26:25.633267 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.628070 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 13:26:25.633267 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.628075 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 13:26:25.633267 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.628081 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 13:26:25.633267 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.628086 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 13:26:25.633267 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.628090 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 13:26:25.633267 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.628094 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 13:26:25.633267 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.628104 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 13:26:25.633267 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.628109 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 13:26:25.633267 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.628115 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 13:26:25.633267 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.628119 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 13:26:25.633267 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.628123 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 13:26:25.633267 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.628128 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 13:26:25.633267 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.628132 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 13:26:25.633267 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.628137 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 13:26:25.633267 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.628142 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 13:26:25.633267 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.628147 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 13:26:25.633267 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.628152 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 13:26:25.633267 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.628156 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 13:26:25.633267 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.628160 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 13:26:25.633809 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.628165 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 13:26:25.633809 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.628169 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 13:26:25.633809 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.628173 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 13:26:25.633809 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.628177 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 13:26:25.633809 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.628200 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 13:26:25.633809 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.628205 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 13:26:25.633809 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.628209 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 13:26:25.633809 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.628213 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 13:26:25.633809 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.628219 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 13:26:25.633809 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.628223 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 13:26:25.633809 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.628227 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 13:26:25.633809 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.628231 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 13:26:25.633809 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.628235 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 13:26:25.633809 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.628240 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 13:26:25.633809 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.628244 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 13:26:25.633809 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.628250 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 13:26:25.633809 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.628254 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 13:26:25.633809 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.628259 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 13:26:25.633809 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628363 2577 flags.go:64] FLAG: --address="0.0.0.0" Jun 09 13:26:25.633809 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628375 2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 09 13:26:25.633809 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628385 2577 flags.go:64] FLAG: --anonymous-auth="true" Jun 09 13:26:25.634371 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628392 2577 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 09 13:26:25.634371 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628398 2577 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 09 13:26:25.634371 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628403 2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 09 13:26:25.634371 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628411 2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 09 13:26:25.634371 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628418 2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 09 13:26:25.634371 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628424 2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 09 13:26:25.634371 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628429 2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 09 13:26:25.634371 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628434 2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 09 13:26:25.634371 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628444 2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 09 13:26:25.634371 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628450 2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 09 13:26:25.634371 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628456 2577 flags.go:64] FLAG: --cgroup-root="" Jun 09 13:26:25.634371 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628462 2577 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 09 13:26:25.634371 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628466 2577 flags.go:64] FLAG: --client-ca-file="" Jun 09 13:26:25.634371 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628471 2577 flags.go:64] FLAG: --cloud-provider="external" Jun 09 13:26:25.634371 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628476 2577 flags.go:64] FLAG: --cluster-dns="[]" Jun 09 13:26:25.634371 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628482 2577 flags.go:64] FLAG: --cluster-domain="" Jun 09 13:26:25.634371 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628487 2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 09 13:26:25.634371 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628492 2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 09 13:26:25.634371 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628498 2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 09 13:26:25.634371 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628505 2577 flags.go:64] FLAG: --container-log-max-files="5" Jun 09 13:26:25.634371 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628512 2577 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 09 13:26:25.634371 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628517 2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 09 13:26:25.634371 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628522 2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 09 13:26:25.634932 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628528 2577 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 09 13:26:25.634932 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628556 2577 flags.go:64] FLAG: --contention-profiling="false" Jun 09 13:26:25.634932 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628574 2577 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 09 13:26:25.634932 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628578 2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 09 13:26:25.634932 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628583 2577 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 09 13:26:25.634932 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628588 2577 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 09 13:26:25.634932 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628594 2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 09 13:26:25.634932 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628598 2577 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 09 13:26:25.634932 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628601 2577 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 09 13:26:25.634932 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628604 2577 flags.go:64] FLAG: --enable-load-reader="false" Jun 09 13:26:25.634932 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628608 2577 flags.go:64] FLAG: --enable-server="true" Jun 09 13:26:25.634932 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628611 2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 09 13:26:25.634932 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628618 2577 flags.go:64] FLAG: --event-burst="100" Jun 09 13:26:25.634932 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628622 2577 flags.go:64] FLAG: --event-qps="50" Jun 09 13:26:25.634932 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628626 2577 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 09 13:26:25.634932 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628629 2577 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 09 13:26:25.634932 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628632 2577 flags.go:64] FLAG: --eviction-hard="" Jun 09 13:26:25.634932 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628637 2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 09 13:26:25.634932 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628640 2577 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 09 13:26:25.634932 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628643 2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 09 13:26:25.634932 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628647 2577 flags.go:64] FLAG: --eviction-soft="" Jun 09 13:26:25.634932 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628650 2577 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 09 13:26:25.634932 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628653 2577 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 09 13:26:25.634932 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628656 2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 09 13:26:25.634932 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628659 2577 flags.go:64] FLAG: --experimental-mounter-path="" Jun 09 13:26:25.635572 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628662 2577 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 09 13:26:25.635572 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628665 2577 flags.go:64] FLAG: --fail-swap-on="true" Jun 09 13:26:25.635572 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628669 2577 flags.go:64] FLAG: --feature-gates="" Jun 09 13:26:25.635572 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628673 2577 flags.go:64] FLAG: --file-check-frequency="20s" Jun 09 13:26:25.635572 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628677 2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 09 13:26:25.635572 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628680 2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 09 13:26:25.635572 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628684 2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 09 13:26:25.635572 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628687 2577 flags.go:64] FLAG: --healthz-port="10248" Jun 09 13:26:25.635572 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628690 2577 flags.go:64] FLAG: --help="false" Jun 09 13:26:25.635572 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628699 2577 flags.go:64] FLAG: --hostname-override="ip-10-0-135-125.ec2.internal" Jun 09 13:26:25.635572 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628703 2577 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 09 13:26:25.635572 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628707 2577 flags.go:64] FLAG: --http-check-frequency="20s" Jun 09 13:26:25.635572 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628710 2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 09 13:26:25.635572 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628713 2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 09 13:26:25.635572 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628718 2577 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 09 13:26:25.635572 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628721 2577 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 09 13:26:25.635572 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628724 2577 flags.go:64] FLAG: --image-service-endpoint="" Jun 09 13:26:25.635572 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628727 2577 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 09 13:26:25.635572 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628730 2577 flags.go:64] FLAG: --kube-api-burst="100" Jun 09 13:26:25.635572 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628733 2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 09 13:26:25.635572 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628736 2577 flags.go:64] FLAG: --kube-api-qps="50" Jun 09 13:26:25.635572 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628740 2577 flags.go:64] FLAG: --kube-reserved="" Jun 09 13:26:25.635572 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628743 2577 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 09 13:26:25.635572 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628745 2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 09 13:26:25.636176 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628749 2577 flags.go:64] FLAG: --kubelet-cgroups="" Jun 09 13:26:25.636176 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628752 2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 09 13:26:25.636176 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628755 2577 flags.go:64] FLAG: --lock-file="" Jun 09 13:26:25.636176 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628758 2577 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 09 13:26:25.636176 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628761 2577 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 09 13:26:25.636176 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628764 2577 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 09 13:26:25.636176 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628770 2577 flags.go:64] FLAG: --log-json-split-stream="false" Jun 09 13:26:25.636176 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628773 2577 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 09 13:26:25.636176 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628776 2577 flags.go:64] FLAG: --log-text-split-stream="false" Jun 09 13:26:25.636176 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628779 2577 flags.go:64] FLAG: --logging-format="text" Jun 09 13:26:25.636176 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628782 2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 09 13:26:25.636176 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628785 2577 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 09 13:26:25.636176 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628788 2577 flags.go:64] FLAG: --manifest-url="" Jun 09 13:26:25.636176 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628791 2577 flags.go:64] FLAG: --manifest-url-header="" Jun 09 13:26:25.636176 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628796 2577 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 09 13:26:25.636176 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628799 2577 flags.go:64] FLAG: --max-open-files="1000000" Jun 09 13:26:25.636176 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628803 2577 flags.go:64] FLAG: --max-pods="110" Jun 09 13:26:25.636176 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628808 2577 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 09 13:26:25.636176 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628812 2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 09 13:26:25.636176 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628815 2577 flags.go:64] FLAG: --memory-manager-policy="None" Jun 09 13:26:25.636176 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628818 2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 09 13:26:25.636176 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628821 2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 09 13:26:25.636176 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628824 2577 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 09 13:26:25.636176 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628828 2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 09 13:26:25.636176 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628836 2577 flags.go:64] FLAG: --node-status-max-images="50" Jun 09 13:26:25.636872 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628840 2577 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 09 13:26:25.636872 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628843 2577 flags.go:64] FLAG: --oom-score-adj="-999" Jun 09 13:26:25.636872 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628846 2577 flags.go:64] FLAG: --pod-cidr="" Jun 09 13:26:25.636872 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628849 2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 09 13:26:25.636872 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628854 2577 flags.go:64] FLAG: --pod-manifest-path="" Jun 09 13:26:25.636872 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628857 2577 flags.go:64] FLAG: --pod-max-pids="-1" Jun 09 13:26:25.636872 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628860 2577 flags.go:64] FLAG: --pods-per-core="0" Jun 09 13:26:25.636872 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628863 2577 flags.go:64] FLAG: --port="10250" Jun 09 13:26:25.636872 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628866 2577 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 09 13:26:25.636872 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628869 2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-072da9a088aeb4697" Jun 09 13:26:25.636872 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628872 2577 flags.go:64] FLAG: --qos-reserved="" Jun 09 13:26:25.636872 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628875 2577 flags.go:64] FLAG: --read-only-port="10255" Jun 09 13:26:25.636872 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628878 2577 flags.go:64] FLAG: --register-node="true" Jun 09 13:26:25.636872 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628881 2577 flags.go:64] FLAG: --register-with-taints="" Jun 09 13:26:25.636872 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628885 2577 flags.go:64] FLAG: --registry-burst="10" Jun 09 13:26:25.636872 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628888 2577 flags.go:64] FLAG: --registry-qps="5" Jun 09 13:26:25.636872 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628891 2577 flags.go:64] FLAG: --reserved-cpus="" Jun 09 13:26:25.636872 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628894 2577 flags.go:64] FLAG: --reserved-memory="" Jun 09 13:26:25.636872 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628898 2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 09 13:26:25.636872 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628901 2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 09 13:26:25.636872 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628904 2577 flags.go:64] FLAG: --rotate-certificates="false" Jun 09 13:26:25.636872 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628907 2577 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 09 13:26:25.636872 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628910 2577 flags.go:64] FLAG: --runonce="false" Jun 09 13:26:25.636872 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628913 2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 09 13:26:25.636872 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628917 2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 09 13:26:25.637867 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628921 2577 flags.go:64] FLAG: --seccomp-default="false" Jun 09 13:26:25.637867 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628925 2577 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 09 13:26:25.637867 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628928 2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 09 13:26:25.637867 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628931 2577 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 09 13:26:25.637867 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628934 2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 09 13:26:25.637867 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628937 2577 flags.go:64] FLAG: --storage-driver-password="root" Jun 09 13:26:25.637867 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628940 2577 flags.go:64] FLAG: --storage-driver-secure="false" Jun 09 13:26:25.637867 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628943 2577 flags.go:64] FLAG: --storage-driver-table="stats" Jun 09 13:26:25.637867 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628946 2577 flags.go:64] FLAG: --storage-driver-user="root" Jun 09 13:26:25.637867 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628949 2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 09 13:26:25.637867 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628952 2577 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 09 13:26:25.637867 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628955 2577 flags.go:64] FLAG: --system-cgroups="" Jun 09 13:26:25.637867 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628958 2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 09 13:26:25.637867 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628963 2577 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 09 13:26:25.637867 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628967 2577 flags.go:64] FLAG: --tls-cert-file="" Jun 09 13:26:25.637867 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628970 2577 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 09 13:26:25.637867 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628974 2577 flags.go:64] FLAG: --tls-min-version="" Jun 09 13:26:25.637867 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628977 2577 flags.go:64] FLAG: --tls-private-key-file="" Jun 09 13:26:25.637867 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628980 2577 flags.go:64] FLAG: --topology-manager-policy="none" Jun 09 13:26:25.637867 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628983 2577 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 09 13:26:25.637867 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628986 2577 flags.go:64] FLAG: --topology-manager-scope="container" Jun 09 13:26:25.637867 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628989 2577 flags.go:64] FLAG: --v="2" Jun 09 13:26:25.637867 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628993 2577 flags.go:64] FLAG: --version="false" Jun 09 13:26:25.637867 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.628997 2577 flags.go:64] FLAG: --vmodule="" Jun 09 13:26:25.637867 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.629001 2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 09 13:26:25.638585 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.629005 2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 09 13:26:25.638585 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629133 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 13:26:25.638585 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629137 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 13:26:25.638585 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629140 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 13:26:25.638585 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629144 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 13:26:25.638585 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629147 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 13:26:25.638585 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629151 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 13:26:25.638585 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629154 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 13:26:25.638585 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629157 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 13:26:25.638585 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629160 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 13:26:25.638585 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629164 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 13:26:25.638585 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629168 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 13:26:25.638585 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629171 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 13:26:25.638585 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629174 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 13:26:25.638585 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629177 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 13:26:25.638585 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629198 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 13:26:25.638585 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629201 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 13:26:25.638585 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629204 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 13:26:25.638585 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629207 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 13:26:25.639044 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629210 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 13:26:25.639044 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629213 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 13:26:25.639044 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629216 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 13:26:25.639044 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629219 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 13:26:25.639044 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629222 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 13:26:25.639044 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629224 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 13:26:25.639044 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629227 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 13:26:25.639044 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629230 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 13:26:25.639044 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629236 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 13:26:25.639044 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629239 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 13:26:25.639044 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629242 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 13:26:25.639044 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629246 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 13:26:25.639044 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629249 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 13:26:25.639044 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629253 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 13:26:25.639044 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629256 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 13:26:25.639044 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629259 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 13:26:25.639044 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629261 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 13:26:25.639044 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629264 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 13:26:25.639044 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629267 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 13:26:25.639044 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629272 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 13:26:25.639552 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629275 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 13:26:25.639552 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629277 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 13:26:25.639552 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629280 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 13:26:25.639552 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629284 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 13:26:25.639552 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629287 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 13:26:25.639552 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629290 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 13:26:25.639552 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629292 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 13:26:25.639552 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629295 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 13:26:25.639552 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629298 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 13:26:25.639552 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629300 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 13:26:25.639552 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629303 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 13:26:25.639552 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629305 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 13:26:25.639552 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629308 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 13:26:25.639552 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629310 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 13:26:25.639552 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629313 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 13:26:25.639552 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629316 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 13:26:25.639552 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629319 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 13:26:25.639552 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629321 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 13:26:25.639552 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629324 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 13:26:25.640019 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629327 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 13:26:25.640019 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629332 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 13:26:25.640019 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629335 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 13:26:25.640019 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629338 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 13:26:25.640019 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629340 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 13:26:25.640019 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629343 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 13:26:25.640019 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629345 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 13:26:25.640019 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629348 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 13:26:25.640019 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629351 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 13:26:25.640019 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629354 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 13:26:25.640019 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629356 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 13:26:25.640019 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629359 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 13:26:25.640019 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629365 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 13:26:25.640019 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629368 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 13:26:25.640019 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629371 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 13:26:25.640019 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629374 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 13:26:25.640019 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629377 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 13:26:25.640019 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629380 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 13:26:25.640019 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629383 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 13:26:25.640019 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629386 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 13:26:25.640530 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629389 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 13:26:25.640530 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629391 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 13:26:25.640530 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629394 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 13:26:25.640530 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629396 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 13:26:25.640530 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629399 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 13:26:25.640530 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629401 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 13:26:25.640530 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629404 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 13:26:25.640530 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629407 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 13:26:25.640530 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629409 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 13:26:25.640530 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629412 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 13:26:25.640530 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629414 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 09 13:26:25.640530 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629417 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 13:26:25.640530 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629419 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 13:26:25.640530 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629423 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 13:26:25.640530 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629426 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 13:26:25.640530 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629429 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 13:26:25.640530 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629431 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 13:26:25.640530 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629434 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 13:26:25.640530 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629436 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 13:26:25.640530 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629439 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 13:26:25.641016 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629442 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 13:26:25.641016 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.629445 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 13:26:25.641016 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.630155 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 13:26:25.641016 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.638458 2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 09 13:26:25.641016 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.638475 2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 09 13:26:25.641016 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.639384 2577 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 09 13:26:25.641016 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.639392 2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 09 13:26:25.641016 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639451 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 13:26:25.641016 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639456 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 13:26:25.641016 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639460 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 13:26:25.641016 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639463 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 13:26:25.641016 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639468 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 13:26:25.641016 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639472 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 13:26:25.641016 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639475 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 13:26:25.641456 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639478 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 13:26:25.641456 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639481 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 13:26:25.641456 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639484 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 13:26:25.641456 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639487 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 13:26:25.641456 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639490 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 09 13:26:25.641456 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639492 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 13:26:25.641456 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639495 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 13:26:25.641456 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639498 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 13:26:25.641456 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639500 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 13:26:25.641456 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639503 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 13:26:25.641456 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639505 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 13:26:25.641456 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639508 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 13:26:25.641456 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639511 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 13:26:25.641456 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639514 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 13:26:25.641456 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639517 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 13:26:25.641456 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639519 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 13:26:25.641456 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639522 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 13:26:25.641456 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639525 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 13:26:25.641456 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639527 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 13:26:25.641456 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639530 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 13:26:25.641936 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639533 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 13:26:25.641936 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639535 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 13:26:25.641936 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639539 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 13:26:25.641936 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639542 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 13:26:25.641936 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639545 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 13:26:25.641936 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639548 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 13:26:25.641936 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639551 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 13:26:25.641936 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639554 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 13:26:25.641936 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639556 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 13:26:25.641936 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639559 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 13:26:25.641936 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639562 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 13:26:25.641936 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639564 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 13:26:25.641936 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639567 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 13:26:25.641936 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639570 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 13:26:25.641936 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639573 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 13:26:25.641936 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639575 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 13:26:25.641936 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639595 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 13:26:25.641936 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639599 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 13:26:25.641936 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639602 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 13:26:25.641936 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639605 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 13:26:25.642469 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639608 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 13:26:25.642469 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639611 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 13:26:25.642469 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639615 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 13:26:25.642469 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639617 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 13:26:25.642469 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639621 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 13:26:25.642469 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639623 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 13:26:25.642469 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639626 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 13:26:25.642469 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639629 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 13:26:25.642469 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639632 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 13:26:25.642469 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639634 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 13:26:25.642469 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639637 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 13:26:25.642469 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639640 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 13:26:25.642469 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639643 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 13:26:25.642469 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639645 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 13:26:25.642469 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639648 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 13:26:25.642469 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639651 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 13:26:25.642469 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639653 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 13:26:25.642469 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639656 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 13:26:25.642469 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639658 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 13:26:25.642469 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639661 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 13:26:25.643024 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639663 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 13:26:25.643024 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639667 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 13:26:25.643024 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639671 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 13:26:25.643024 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639674 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 13:26:25.643024 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639677 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 13:26:25.643024 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639681 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 13:26:25.643024 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639683 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 13:26:25.643024 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639686 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 13:26:25.643024 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639689 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 13:26:25.643024 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639691 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 13:26:25.643024 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639694 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 13:26:25.643024 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639696 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 13:26:25.643024 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639700 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 13:26:25.643024 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639704 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 13:26:25.643024 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639707 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 13:26:25.643024 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639711 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 13:26:25.643024 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639714 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 13:26:25.643024 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639717 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 13:26:25.643024 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639720 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 13:26:25.643516 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639722 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 13:26:25.643516 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639726 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 13:26:25.643516 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639729 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 13:26:25.643516 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639731 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 13:26:25.643516 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639734 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 13:26:25.643516 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639737 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 13:26:25.643516 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639739 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 13:26:25.643516 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639742 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 13:26:25.643516 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639744 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 13:26:25.643516 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639747 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 13:26:25.643516 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639750 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 13:26:25.643516 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639752 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 13:26:25.643516 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639755 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 13:26:25.643516 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.639760 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 13:26:25.643516 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639869 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 13:26:25.643888 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639874 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 13:26:25.643888 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639877 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 13:26:25.643888 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639880 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 13:26:25.643888 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639882 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 13:26:25.643888 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639885 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 13:26:25.643888 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639888 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 13:26:25.643888 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639891 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 13:26:25.643888 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639898 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 13:26:25.643888 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639902 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 13:26:25.643888 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639904 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 13:26:25.643888 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639907 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 13:26:25.643888 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639911 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 13:26:25.643888 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639914 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 13:26:25.643888 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639916 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 13:26:25.643888 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639919 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 13:26:25.643888 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639922 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 13:26:25.643888 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639924 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 13:26:25.643888 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639927 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 13:26:25.643888 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639929 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 13:26:25.643888 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639932 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 13:26:25.644583 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639934 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 13:26:25.644583 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639937 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 13:26:25.644583 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639939 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 13:26:25.644583 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639942 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 13:26:25.644583 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639945 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 13:26:25.644583 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639948 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 13:26:25.644583 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639951 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 13:26:25.644583 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639953 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 13:26:25.644583 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639956 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 13:26:25.644583 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639959 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 13:26:25.644583 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639961 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 13:26:25.644583 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639964 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 13:26:25.644583 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639967 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 13:26:25.644583 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639969 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 13:26:25.644583 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639972 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 13:26:25.644583 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639974 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 13:26:25.644583 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639977 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 13:26:25.644583 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639980 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 13:26:25.644583 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639982 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 13:26:25.645047 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639985 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 13:26:25.645047 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639987 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 13:26:25.645047 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639990 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 13:26:25.645047 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639992 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 13:26:25.645047 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639995 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 13:26:25.645047 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.639998 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 13:26:25.645047 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.640001 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 13:26:25.645047 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.640004 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 13:26:25.645047 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.640006 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 13:26:25.645047 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.640008 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 13:26:25.645047 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.640011 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 09 13:26:25.645047 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.640013 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 13:26:25.645047 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.640016 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 13:26:25.645047 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.640019 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 13:26:25.645047 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.640021 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 13:26:25.645047 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.640024 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 13:26:25.645047 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.640026 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 13:26:25.645047 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.640029 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 13:26:25.645047 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.640034 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 13:26:25.645047 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.640037 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 13:26:25.645550 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.640039 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 13:26:25.645550 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.640042 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 13:26:25.645550 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.640044 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 13:26:25.645550 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.640047 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 13:26:25.645550 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.640049 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 13:26:25.645550 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.640052 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 13:26:25.645550 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.640054 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 13:26:25.645550 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.640057 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 13:26:25.645550 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.640059 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 13:26:25.645550 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.640062 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 13:26:25.645550 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.640064 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 13:26:25.645550 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.640067 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 13:26:25.645550 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.640069 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 13:26:25.645550 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.640072 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 13:26:25.645550 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.640076 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 13:26:25.645550 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.640079 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 13:26:25.645550 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.640082 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 13:26:25.645550 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.640085 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 13:26:25.645550 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.640088 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 13:26:25.646011 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.640091 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 13:26:25.646011 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.640094 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 13:26:25.646011 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.640096 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 13:26:25.646011 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.640098 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 13:26:25.646011 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.640101 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 13:26:25.646011 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.640104 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 13:26:25.646011 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.640107 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 13:26:25.646011 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.640109 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 13:26:25.646011 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.640112 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 13:26:25.646011 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.640114 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 13:26:25.646011 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.640117 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 13:26:25.646011 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.640122 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 13:26:25.646011 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.640125 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 13:26:25.646011 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.640128 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 13:26:25.646011 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.640130 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 13:26:25.646011 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.640133 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 13:26:25.646011 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.640135 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 13:26:25.646011 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.640138 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 13:26:25.646011 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.640140 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 13:26:25.646513 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:25.640143 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 13:26:25.646513 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.640148 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 13:26:25.646513 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.640270 2577 server.go:962] "Client rotation is on, will bootstrap in background" Jun 09 13:26:25.646513 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.642766 2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 09 13:26:25.646513 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.644513 2577 server.go:1019] "Starting client certificate rotation" Jun 09 13:26:25.646513 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.644615 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 13:26:25.646513 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.644648 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 13:26:25.648230 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.648204 2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 13:26:25.649435 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.649415 2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 13:26:25.663483 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.663456 2577 log.go:25] "Validated CRI v1 runtime API" Jun 09 13:26:25.666888 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.666874 2577 log.go:25] "Validated CRI v1 image API" Jun 09 13:26:25.667687 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.667669 2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 09 13:26:25.672765 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.672731 2577 fs.go:135] Filesystem UUIDs: map[03f331cc-fbbe-4585-b68e-e5728726f8f8:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 828673c3-57fb-4e77-9942-06a81156685e:/dev/nvme0n1p4] Jun 09 13:26:25.672834 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.672764 2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 09 13:26:25.674955 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.674939 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 13:26:25.679156 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.679034 2577 manager.go:216] Machine: {Timestamp:2026-06-09 13:26:25.677612092 +0000 UTC m=+0.377887043 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099753 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec23544b7fe8cee31eacd3959876cff7 SystemUUID:ec23544b-7fe8-cee3-1eac-d3959876cff7 BootID:d3b24ec8-216e-4604-a79a-a4dd1b35afd7 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:3e:54:66:6b:79 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:3e:54:66:6b:79 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a2:e6:01:0e:8c:53 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 09 13:26:25.679156 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.679148 2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 09 13:26:25.679282 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.679274 2577 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 09 13:26:25.681214 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.681178 2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 09 13:26:25.681344 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.681216 2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-125.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 09 13:26:25.682091 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.682082 2577 topology_manager.go:138] "Creating topology manager with none policy" Jun 09 13:26:25.682126 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.682094 2577 container_manager_linux.go:309] "Creating device plugin manager" Jun 09 13:26:25.682126 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.682102 2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 13:26:25.682983 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.682974 2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 13:26:25.684229 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.684220 2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 09 13:26:25.688748 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.688737 2577 state_mem.go:36] "Initialized new in-memory state store" Jun 09 13:26:25.688866 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.688857 2577 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 09 13:26:25.689137 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.689119 2577 kubelet.go:486] "Attempting to sync node with API server" Jun 09 13:26:25.689205 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.689146 2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 09 13:26:25.689205 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.689169 2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 09 13:26:25.689205 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.689201 2577 kubelet.go:398] "Adding apiserver pod source" Jun 09 13:26:25.689330 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.689215 2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 09 13:26:25.689704 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.689686 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 13:26:25.689750 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.689719 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 13:26:25.693324 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.693303 2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 09 13:26:25.695033 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.695017 2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 09 13:26:25.695109 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.695047 2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 09 13:26:25.697315 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.697300 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 09 13:26:25.697362 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.697328 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 09 13:26:25.697362 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.697335 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 09 13:26:25.697362 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.697341 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 09 13:26:25.697362 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.697350 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 09 13:26:25.697362 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.697356 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 09 13:26:25.697497 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.697365 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 09 13:26:25.697497 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.697371 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 09 13:26:25.697497 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.697379 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 09 13:26:25.697497 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.697385 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 09 13:26:25.697497 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.697396 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 09 13:26:25.697497 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.697402 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 09 13:26:25.698279 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.698269 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 09 13:26:25.698279 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.698278 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 09 13:26:25.701511 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.701498 2577 server.go:1268] "Started kubelet" Jun 09 13:26:25.701627 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.701577 2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 09 13:26:25.701820 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.701586 2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 09 13:26:25.701965 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.701943 2577 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 09 13:26:25.702494 ip-10-0-135-125 systemd[1]: Started Kubernetes Kubelet. Jun 09 13:26:25.703111 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.702978 2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-125.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 09 13:26:25.703111 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:25.702983 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 09 13:26:25.703210 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:25.703134 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-125.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 09 13:26:25.704127 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.704113 2577 server.go:310] "Adding debug handlers to kubelet server" Jun 09 13:26:25.704226 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.704209 2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 09 13:26:25.709134 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:25.709114 2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 09 13:26:25.709230 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:25.708108 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-125.ec2.internal.18b76c99da975f44 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-125.ec2.internal,UID:ip-10-0-135-125.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-125.ec2.internal,},FirstTimestamp:2026-06-09 13:26:25.70147002 +0000 UTC m=+0.401744950,LastTimestamp:2026-06-09 13:26:25.70147002 +0000 UTC m=+0.401744950,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-125.ec2.internal,}" Jun 09 13:26:25.711063 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.711049 2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 09 13:26:25.711121 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.711062 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 09 13:26:25.711168 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:25.711140 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-125.ec2.internal\" not found" Jun 09 13:26:25.711963 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.711796 2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 09 13:26:25.711963 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.711799 2577 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 09 13:26:25.711963 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.711976 2577 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 09 13:26:25.712139 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.711911 2577 factory.go:55] Registering systemd factory Jun 09 13:26:25.712139 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.711995 2577 factory.go:223] Registration of the systemd container factory successfully Jun 09 13:26:25.712139 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.712070 2577 reconstruct.go:97] "Volume reconstruction finished" Jun 09 13:26:25.712139 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.712079 2577 reconciler.go:29] "Reconciler: start to sync state" Jun 09 13:26:25.712307 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.712291 2577 factory.go:153] Registering CRI-O factory Jun 09 13:26:25.712353 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.712313 2577 factory.go:223] Registration of the crio container factory successfully Jun 09 13:26:25.712416 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.712404 2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 09 13:26:25.712454 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.712434 2577 factory.go:103] Registering Raw factory Jun 09 13:26:25.712454 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.712452 2577 manager.go:1196] Started watching for new ooms in manager Jun 09 13:26:25.712859 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.712843 2577 manager.go:349] Starting recovery of all containers Jun 09 13:26:25.715230 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:25.715204 2577 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-125.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 09 13:26:25.715363 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:25.715340 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 09 13:26:25.724329 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.724310 2577 manager.go:354] Recovery completed Jun 09 13:26:25.728489 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.728473 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 13:26:25.730455 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.730434 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-125.ec2.internal" event="NodeHasSufficientMemory" Jun 09 13:26:25.730544 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.730472 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-125.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 13:26:25.730544 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.730488 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-125.ec2.internal" event="NodeHasSufficientPID" Jun 09 13:26:25.730974 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.730960 2577 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 09 13:26:25.730974 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.730975 2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 09 13:26:25.731101 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.730965 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 13:26:25.731101 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.730993 2577 state_mem.go:36] "Initialized new in-memory state store" Jun 09 13:26:25.731718 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.731703 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-125.ec2.internal" event="NodeHasSufficientMemory" Jun 09 13:26:25.731777 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.731729 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-125.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 13:26:25.731777 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.731738 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-125.ec2.internal" event="NodeHasSufficientPID" Jun 09 13:26:25.733023 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:25.732938 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-125.ec2.internal.18b76c99dc51a810 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-125.ec2.internal,UID:ip-10-0-135-125.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-125.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-125.ec2.internal,},FirstTimestamp:2026-06-09 13:26:25.730455568 +0000 UTC m=+0.430730500,LastTimestamp:2026-06-09 13:26:25.730455568 +0000 UTC m=+0.430730500,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-125.ec2.internal,}" Jun 09 13:26:25.733365 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.733351 2577 policy_none.go:49] "None policy: Start" Jun 09 13:26:25.733422 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.733370 2577 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 09 13:26:25.733422 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.733384 2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 09 13:26:25.735094 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.735081 2577 policy_none.go:47] "Start" Jun 09 13:26:25.742386 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.742367 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6cphm" Jun 09 13:26:25.744077 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:25.744009 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-125.ec2.internal.18b76c99dc520574 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-125.ec2.internal,UID:ip-10-0-135-125.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-135-125.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-135-125.ec2.internal,},FirstTimestamp:2026-06-09 13:26:25.730479476 +0000 UTC m=+0.430754407,LastTimestamp:2026-06-09 13:26:25.730479476 +0000 UTC m=+0.430754407,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-125.ec2.internal,}" Jun 09 13:26:25.750613 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.750594 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6cphm" Jun 09 13:26:25.752008 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:25.751937 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-125.ec2.internal.18b76c99dc523464 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-125.ec2.internal,UID:ip-10-0-135-125.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-135-125.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-135-125.ec2.internal,},FirstTimestamp:2026-06-09 13:26:25.730491492 +0000 UTC m=+0.430766423,LastTimestamp:2026-06-09 13:26:25.730491492 +0000 UTC m=+0.430766423,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-125.ec2.internal,}" Jun 09 13:26:25.793724 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.769510 2577 manager.go:337] "Starting Device Plugin manager" Jun 09 13:26:25.793724 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:25.769540 2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 09 13:26:25.793724 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.769550 2577 server.go:87] "Starting device plugin registration server" Jun 09 13:26:25.793724 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.769823 2577 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 09 13:26:25.793724 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.769836 2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 09 13:26:25.793724 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.770026 2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 09 13:26:25.793724 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.770153 2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 09 13:26:25.793724 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.770166 2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 09 13:26:25.793724 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:25.770603 2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 09 13:26:25.793724 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:25.770660 2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-125.ec2.internal\" not found" Jun 09 13:26:25.793724 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.782166 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 09 13:26:25.793724 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.783361 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 09 13:26:25.793724 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.783395 2577 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 09 13:26:25.793724 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.783428 2577 kubelet.go:2448] "Starting kubelet main sync loop" Jun 09 13:26:25.793724 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:25.783465 2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 09 13:26:25.793724 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.785832 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 13:26:25.870256 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.870217 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 13:26:25.871252 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.871214 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-125.ec2.internal" event="NodeHasSufficientMemory" Jun 09 13:26:25.871252 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.871262 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-125.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 13:26:25.871403 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.871275 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-125.ec2.internal" event="NodeHasSufficientPID" Jun 09 13:26:25.871403 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.871303 2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-125.ec2.internal" Jun 09 13:26:25.881930 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.881912 2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-125.ec2.internal" Jun 09 13:26:25.881984 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:25.881935 2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-125.ec2.internal\": node \"ip-10-0-135-125.ec2.internal\" not found" Jun 09 13:26:25.883987 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.883970 2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-125.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-125.ec2.internal"] Jun 09 13:26:25.884034 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.884026 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 13:26:25.884871 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.884856 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-125.ec2.internal" event="NodeHasSufficientMemory" Jun 09 13:26:25.884942 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.884892 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-125.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 13:26:25.884942 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.884903 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-125.ec2.internal" event="NodeHasSufficientPID" Jun 09 13:26:25.887547 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.887533 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 13:26:25.887657 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.887643 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-125.ec2.internal" Jun 09 13:26:25.887699 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.887693 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 13:26:25.888272 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.888257 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-125.ec2.internal" event="NodeHasSufficientMemory" Jun 09 13:26:25.888347 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.888287 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-125.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 13:26:25.888347 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.888302 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-125.ec2.internal" event="NodeHasSufficientPID" Jun 09 13:26:25.888347 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.888301 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-125.ec2.internal" event="NodeHasSufficientMemory" Jun 09 13:26:25.888347 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.888338 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-125.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 13:26:25.888470 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.888384 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-125.ec2.internal" event="NodeHasSufficientPID" Jun 09 13:26:25.890632 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.890615 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-125.ec2.internal" Jun 09 13:26:25.890731 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.890640 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 13:26:25.891309 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.891291 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-125.ec2.internal" event="NodeHasSufficientMemory" Jun 09 13:26:25.891413 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.891322 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-125.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 13:26:25.891413 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.891337 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-125.ec2.internal" event="NodeHasSufficientPID" Jun 09 13:26:25.913456 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.913428 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/63d271a837858141719cb90b8e166f85-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-125.ec2.internal\" (UID: \"63d271a837858141719cb90b8e166f85\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-125.ec2.internal" Jun 09 13:26:25.913558 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.913459 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/63d271a837858141719cb90b8e166f85-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-125.ec2.internal\" (UID: \"63d271a837858141719cb90b8e166f85\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-125.ec2.internal" Jun 09 13:26:25.913558 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:25.913479 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/27417b22d6fa8d5909b4f4f539649658-config\") pod \"kube-apiserver-proxy-ip-10-0-135-125.ec2.internal\" (UID: \"27417b22d6fa8d5909b4f4f539649658\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-125.ec2.internal" Jun 09 13:26:25.915096 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:25.915077 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-125.ec2.internal\" not found" Jun 09 13:26:25.915911 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:25.915892 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-125.ec2.internal\" not found" node="ip-10-0-135-125.ec2.internal" Jun 09 13:26:25.920352 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:25.920334 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-125.ec2.internal\" not found" node="ip-10-0-135-125.ec2.internal" Jun 09 13:26:26.013658 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:26.013579 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/63d271a837858141719cb90b8e166f85-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-125.ec2.internal\" (UID: \"63d271a837858141719cb90b8e166f85\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-125.ec2.internal" Jun 09 13:26:26.013658 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:26.013609 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/63d271a837858141719cb90b8e166f85-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-125.ec2.internal\" (UID: \"63d271a837858141719cb90b8e166f85\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-125.ec2.internal" Jun 09 13:26:26.013658 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:26.013628 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/27417b22d6fa8d5909b4f4f539649658-config\") pod \"kube-apiserver-proxy-ip-10-0-135-125.ec2.internal\" (UID: \"27417b22d6fa8d5909b4f4f539649658\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-125.ec2.internal" Jun 09 13:26:26.013867 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:26.013655 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/27417b22d6fa8d5909b4f4f539649658-config\") pod \"kube-apiserver-proxy-ip-10-0-135-125.ec2.internal\" (UID: \"27417b22d6fa8d5909b4f4f539649658\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-125.ec2.internal" Jun 09 13:26:26.013867 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:26.013677 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/63d271a837858141719cb90b8e166f85-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-125.ec2.internal\" (UID: \"63d271a837858141719cb90b8e166f85\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-125.ec2.internal" Jun 09 13:26:26.013867 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:26.013698 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/63d271a837858141719cb90b8e166f85-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-125.ec2.internal\" (UID: \"63d271a837858141719cb90b8e166f85\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-125.ec2.internal" Jun 09 13:26:26.015685 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:26.015670 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-125.ec2.internal\" not found" Jun 09 13:26:26.115793 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:26.115748 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-125.ec2.internal\" not found" Jun 09 13:26:26.216572 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:26.216544 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-125.ec2.internal\" not found" Jun 09 13:26:26.222712 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:26.222691 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-125.ec2.internal" Jun 09 13:26:26.227610 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:26.227402 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-125.ec2.internal" Jun 09 13:26:26.317376 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:26.317287 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-125.ec2.internal\" not found" Jun 09 13:26:26.417858 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:26.417822 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-125.ec2.internal\" not found" Jun 09 13:26:26.518399 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:26.518350 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-125.ec2.internal\" not found" Jun 09 13:26:26.619119 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:26.619041 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-125.ec2.internal\" not found" Jun 09 13:26:26.643240 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:26.643210 2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 09 13:26:26.643378 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:26.643359 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 13:26:26.719199 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:26.719158 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-125.ec2.internal\" not found" Jun 09 13:26:26.754706 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:26.754664 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-08 13:21:25 +0000 UTC" deadline="2028-01-03 12:38:52.141942355 +0000 UTC" Jun 09 13:26:26.754706 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:26.754698 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13751h12m25.38724747s" Jun 09 13:26:26.801056 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:26.801031 2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 13:26:26.812102 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:26.812077 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-125.ec2.internal" Jun 09 13:26:26.814591 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:26.814564 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63d271a837858141719cb90b8e166f85.slice/crio-894a757d84a3c5f5193e16101962f4402597f8407adcacdf740e1baf4969d1cf WatchSource:0}: Error finding container 894a757d84a3c5f5193e16101962f4402597f8407adcacdf740e1baf4969d1cf: Status 404 returned error can't find the container with id 894a757d84a3c5f5193e16101962f4402597f8407adcacdf740e1baf4969d1cf Jun 09 13:26:26.814939 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:26.814924 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27417b22d6fa8d5909b4f4f539649658.slice/crio-ab72fcb5750db93b4b1f9b6d61f317a0fa5eab324f92fd6c1e912ad70a2b0008 WatchSource:0}: Error finding container ab72fcb5750db93b4b1f9b6d61f317a0fa5eab324f92fd6c1e912ad70a2b0008: Status 404 returned error can't find the container with id ab72fcb5750db93b4b1f9b6d61f317a0fa5eab324f92fd6c1e912ad70a2b0008 Jun 09 13:26:26.821074 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:26.821059 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 13:26:26.828260 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:26.828240 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 13:26:26.830387 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:26.830372 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-125.ec2.internal" Jun 09 13:26:26.839829 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:26.839803 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 13:26:27.014420 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.014351 2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 13:26:27.241911 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.241882 2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 13:26:27.691006 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.690964 2577 apiserver.go:52] "Watching apiserver" Jun 09 13:26:27.698537 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.698506 2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 09 13:26:27.698918 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.698888 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-bqwlr","openshift-multus/multus-mz5b5","openshift-network-diagnostics/network-check-target-kdbl8","kube-system/global-pull-secret-syncer-9wk4n","kube-system/konnectivity-agent-h65nk","kube-system/kube-apiserver-proxy-ip-10-0-135-125.ec2.internal","openshift-cluster-node-tuning-operator/tuned-5xhqv","openshift-multus/network-metrics-daemon-s8xkw","openshift-network-operator/iptables-alerter-dhvgh","openshift-ovn-kubernetes/ovnkube-node-rcxgh","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lzrgp","openshift-dns/node-resolver-hsvg8","openshift-image-registry/node-ca-gb54t","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-125.ec2.internal"] Jun 09 13:26:27.701565 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.701548 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s8xkw" Jun 09 13:26:27.701668 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:27.701617 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s8xkw" podUID="5ee23738-5173-4f32-83d2-4f47140592b3" Jun 09 13:26:27.703494 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.703473 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mz5b5" Jun 09 13:26:27.705648 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.705585 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lzrgp" Jun 09 13:26:27.705998 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.705969 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 09 13:26:27.706220 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.706178 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 09 13:26:27.706301 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.706261 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 09 13:26:27.706301 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.706282 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 09 13:26:27.706404 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.706303 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-qwlnf\"" Jun 09 13:26:27.707612 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.707592 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 09 13:26:27.707842 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.707823 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" Jun 09 13:26:27.708403 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.708384 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 09 13:26:27.708509 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.708441 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 09 13:26:27.708509 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.708459 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-w9j7q\"" Jun 09 13:26:27.710403 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.710387 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-h65nk" Jun 09 13:26:27.710876 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.710856 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 09 13:26:27.710977 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.710861 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 09 13:26:27.710977 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.710907 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 09 13:26:27.711129 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.711113 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 09 13:26:27.711215 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.711178 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 09 13:26:27.711275 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.711210 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-46rps\"" Jun 09 13:26:27.711327 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.711302 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 09 13:26:27.711770 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.711751 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 09 13:26:27.713283 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.712662 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 09 13:26:27.713283 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.712796 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 09 13:26:27.713283 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.712890 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9wk4n" Jun 09 13:26:27.713283 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:27.712953 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9wk4n" podUID="679c37d9-6d86-41eb-aac4-073d70f2c285" Jun 09 13:26:27.713283 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.713021 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6kd96\"" Jun 09 13:26:27.714830 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.714812 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5xhqv" Jun 09 13:26:27.717087 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.716976 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 09 13:26:27.717087 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.717037 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dhvgh" Jun 09 13:26:27.717087 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.717044 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 09 13:26:27.717295 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.717206 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-p25gz\"" Jun 09 13:26:27.719057 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.719037 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 09 13:26:27.719501 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.719410 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bqwlr" Jun 09 13:26:27.719579 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.719540 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 09 13:26:27.719748 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.719723 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 09 13:26:27.719925 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.719877 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-n7d92\"" Jun 09 13:26:27.721340 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.721322 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 09 13:26:27.721684 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.721664 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 09 13:26:27.721780 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.721740 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-t6pvr\"" Jun 09 13:26:27.722420 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.722391 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kdbl8" Jun 09 13:26:27.722505 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:27.722457 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kdbl8" podUID="a9ecc5cb-87e0-4daa-9cc4-156dd0952402" Jun 09 13:26:27.723311 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.722715 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ee23738-5173-4f32-83d2-4f47140592b3-metrics-certs\") pod \"network-metrics-daemon-s8xkw\" (UID: \"5ee23738-5173-4f32-83d2-4f47140592b3\") " pod="openshift-multus/network-metrics-daemon-s8xkw" Jun 09 13:26:27.723311 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.723040 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/67cfbf1f-7a58-467e-a353-69e78abfa48f-cnibin\") pod \"multus-mz5b5\" (UID: \"67cfbf1f-7a58-467e-a353-69e78abfa48f\") " pod="openshift-multus/multus-mz5b5" Jun 09 13:26:27.723311 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.723079 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/67cfbf1f-7a58-467e-a353-69e78abfa48f-host-var-lib-cni-multus\") pod \"multus-mz5b5\" (UID: \"67cfbf1f-7a58-467e-a353-69e78abfa48f\") " pod="openshift-multus/multus-mz5b5" Jun 09 13:26:27.723311 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.723137 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/67cfbf1f-7a58-467e-a353-69e78abfa48f-hostroot\") pod \"multus-mz5b5\" (UID: \"67cfbf1f-7a58-467e-a353-69e78abfa48f\") " pod="openshift-multus/multus-mz5b5" Jun 09 13:26:27.723311 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.723170 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pj7g6\" (UniqueName: \"kubernetes.io/projected/2fd91b92-5941-41cd-bdaa-4c43cfb8d1b2-kube-api-access-pj7g6\") pod \"aws-ebs-csi-driver-node-lzrgp\" (UID: \"2fd91b92-5941-41cd-bdaa-4c43cfb8d1b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lzrgp" Jun 09 13:26:27.723311 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.723218 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5f5c65b0-3ab1-40fe-bf7d-c08c3548d520-systemd-units\") pod \"ovnkube-node-rcxgh\" (UID: \"5f5c65b0-3ab1-40fe-bf7d-c08c3548d520\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" Jun 09 13:26:27.723311 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.723241 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f5c65b0-3ab1-40fe-bf7d-c08c3548d520-var-lib-openvswitch\") pod \"ovnkube-node-rcxgh\" (UID: \"5f5c65b0-3ab1-40fe-bf7d-c08c3548d520\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" Jun 09 13:26:27.723311 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.723271 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f5c65b0-3ab1-40fe-bf7d-c08c3548d520-etc-openvswitch\") pod \"ovnkube-node-rcxgh\" (UID: \"5f5c65b0-3ab1-40fe-bf7d-c08c3548d520\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" Jun 09 13:26:27.723699 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.723319 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2fd91b92-5941-41cd-bdaa-4c43cfb8d1b2-registration-dir\") pod \"aws-ebs-csi-driver-node-lzrgp\" (UID: \"2fd91b92-5941-41cd-bdaa-4c43cfb8d1b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lzrgp" Jun 09 13:26:27.723699 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.723354 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/67cfbf1f-7a58-467e-a353-69e78abfa48f-system-cni-dir\") pod \"multus-mz5b5\" (UID: \"67cfbf1f-7a58-467e-a353-69e78abfa48f\") " pod="openshift-multus/multus-mz5b5" Jun 09 13:26:27.723699 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.723378 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/67cfbf1f-7a58-467e-a353-69e78abfa48f-os-release\") pod \"multus-mz5b5\" (UID: \"67cfbf1f-7a58-467e-a353-69e78abfa48f\") " pod="openshift-multus/multus-mz5b5" Jun 09 13:26:27.723699 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.723426 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/67cfbf1f-7a58-467e-a353-69e78abfa48f-multus-socket-dir-parent\") pod \"multus-mz5b5\" (UID: \"67cfbf1f-7a58-467e-a353-69e78abfa48f\") " pod="openshift-multus/multus-mz5b5" Jun 09 13:26:27.723699 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.723458 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67cfbf1f-7a58-467e-a353-69e78abfa48f-etc-kubernetes\") pod \"multus-mz5b5\" (UID: \"67cfbf1f-7a58-467e-a353-69e78abfa48f\") " pod="openshift-multus/multus-mz5b5" Jun 09 13:26:27.723699 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.723488 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2fd91b92-5941-41cd-bdaa-4c43cfb8d1b2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lzrgp\" (UID: \"2fd91b92-5941-41cd-bdaa-4c43cfb8d1b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lzrgp" Jun 09 13:26:27.723699 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.723513 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f5c65b0-3ab1-40fe-bf7d-c08c3548d520-host-run-ovn-kubernetes\") pod \"ovnkube-node-rcxgh\" (UID: \"5f5c65b0-3ab1-40fe-bf7d-c08c3548d520\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" Jun 09 13:26:27.723699 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.723544 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/67cfbf1f-7a58-467e-a353-69e78abfa48f-host-run-k8s-cni-cncf-io\") pod \"multus-mz5b5\" (UID: \"67cfbf1f-7a58-467e-a353-69e78abfa48f\") " pod="openshift-multus/multus-mz5b5" Jun 09 13:26:27.723699 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.723575 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czjzm\" (UniqueName: \"kubernetes.io/projected/67cfbf1f-7a58-467e-a353-69e78abfa48f-kube-api-access-czjzm\") pod \"multus-mz5b5\" (UID: \"67cfbf1f-7a58-467e-a353-69e78abfa48f\") " pod="openshift-multus/multus-mz5b5" Jun 09 13:26:27.723699 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.723640 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2fd91b92-5941-41cd-bdaa-4c43cfb8d1b2-etc-selinux\") pod \"aws-ebs-csi-driver-node-lzrgp\" (UID: \"2fd91b92-5941-41cd-bdaa-4c43cfb8d1b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lzrgp" Jun 09 13:26:27.724121 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.723784 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f5c65b0-3ab1-40fe-bf7d-c08c3548d520-host-kubelet\") pod \"ovnkube-node-rcxgh\" (UID: \"5f5c65b0-3ab1-40fe-bf7d-c08c3548d520\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" Jun 09 13:26:27.724121 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.723817 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f5c65b0-3ab1-40fe-bf7d-c08c3548d520-host-run-netns\") pod \"ovnkube-node-rcxgh\" (UID: \"5f5c65b0-3ab1-40fe-bf7d-c08c3548d520\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" Jun 09 13:26:27.724121 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.723846 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f5c65b0-3ab1-40fe-bf7d-c08c3548d520-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rcxgh\" (UID: \"5f5c65b0-3ab1-40fe-bf7d-c08c3548d520\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" Jun 09 13:26:27.724121 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.723878 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5f5c65b0-3ab1-40fe-bf7d-c08c3548d520-ovnkube-config\") pod \"ovnkube-node-rcxgh\" (UID: \"5f5c65b0-3ab1-40fe-bf7d-c08c3548d520\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" Jun 09 13:26:27.724121 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.723903 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h274x\" (UniqueName: \"kubernetes.io/projected/5ee23738-5173-4f32-83d2-4f47140592b3-kube-api-access-h274x\") pod \"network-metrics-daemon-s8xkw\" (UID: \"5ee23738-5173-4f32-83d2-4f47140592b3\") " pod="openshift-multus/network-metrics-daemon-s8xkw" Jun 09 13:26:27.724121 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.724059 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/67cfbf1f-7a58-467e-a353-69e78abfa48f-multus-cni-dir\") pod \"multus-mz5b5\" (UID: \"67cfbf1f-7a58-467e-a353-69e78abfa48f\") " pod="openshift-multus/multus-mz5b5" Jun 09 13:26:27.724121 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.724088 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/67cfbf1f-7a58-467e-a353-69e78abfa48f-host-var-lib-cni-bin\") pod \"multus-mz5b5\" (UID: \"67cfbf1f-7a58-467e-a353-69e78abfa48f\") " pod="openshift-multus/multus-mz5b5" Jun 09 13:26:27.724121 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.724117 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f5c65b0-3ab1-40fe-bf7d-c08c3548d520-run-openvswitch\") pod \"ovnkube-node-rcxgh\" (UID: \"5f5c65b0-3ab1-40fe-bf7d-c08c3548d520\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" Jun 09 13:26:27.724560 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.724147 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5f5c65b0-3ab1-40fe-bf7d-c08c3548d520-node-log\") pod \"ovnkube-node-rcxgh\" (UID: \"5f5c65b0-3ab1-40fe-bf7d-c08c3548d520\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" Jun 09 13:26:27.724560 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.724174 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5f5c65b0-3ab1-40fe-bf7d-c08c3548d520-ovn-node-metrics-cert\") pod \"ovnkube-node-rcxgh\" (UID: \"5f5c65b0-3ab1-40fe-bf7d-c08c3548d520\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" Jun 09 13:26:27.724560 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.724225 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a65851db-7a9b-4f6f-a791-203591fb7e17-konnectivity-ca\") pod \"konnectivity-agent-h65nk\" (UID: \"a65851db-7a9b-4f6f-a791-203591fb7e17\") " pod="kube-system/konnectivity-agent-h65nk" Jun 09 13:26:27.724560 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.724253 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/67cfbf1f-7a58-467e-a353-69e78abfa48f-cni-binary-copy\") pod \"multus-mz5b5\" (UID: \"67cfbf1f-7a58-467e-a353-69e78abfa48f\") " pod="openshift-multus/multus-mz5b5" Jun 09 13:26:27.724560 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.724300 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5f5c65b0-3ab1-40fe-bf7d-c08c3548d520-run-systemd\") pod \"ovnkube-node-rcxgh\" (UID: \"5f5c65b0-3ab1-40fe-bf7d-c08c3548d520\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" Jun 09 13:26:27.724560 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.724465 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xlv8\" (UniqueName: \"kubernetes.io/projected/5f5c65b0-3ab1-40fe-bf7d-c08c3548d520-kube-api-access-4xlv8\") pod \"ovnkube-node-rcxgh\" (UID: \"5f5c65b0-3ab1-40fe-bf7d-c08c3548d520\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" Jun 09 13:26:27.724560 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.724501 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/679c37d9-6d86-41eb-aac4-073d70f2c285-kubelet-config\") pod \"global-pull-secret-syncer-9wk4n\" (UID: \"679c37d9-6d86-41eb-aac4-073d70f2c285\") " pod="kube-system/global-pull-secret-syncer-9wk4n" Jun 09 13:26:27.724560 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.724534 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/679c37d9-6d86-41eb-aac4-073d70f2c285-original-pull-secret\") pod \"global-pull-secret-syncer-9wk4n\" (UID: \"679c37d9-6d86-41eb-aac4-073d70f2c285\") " pod="kube-system/global-pull-secret-syncer-9wk4n" Jun 09 13:26:27.724912 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.724564 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2fd91b92-5941-41cd-bdaa-4c43cfb8d1b2-sys-fs\") pod \"aws-ebs-csi-driver-node-lzrgp\" (UID: \"2fd91b92-5941-41cd-bdaa-4c43cfb8d1b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lzrgp" Jun 09 13:26:27.724912 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.724673 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/67cfbf1f-7a58-467e-a353-69e78abfa48f-multus-daemon-config\") pod \"multus-mz5b5\" (UID: \"67cfbf1f-7a58-467e-a353-69e78abfa48f\") " pod="openshift-multus/multus-mz5b5" Jun 09 13:26:27.724912 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.724753 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5f5c65b0-3ab1-40fe-bf7d-c08c3548d520-host-slash\") pod \"ovnkube-node-rcxgh\" (UID: \"5f5c65b0-3ab1-40fe-bf7d-c08c3548d520\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" Jun 09 13:26:27.724912 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.724822 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5f5c65b0-3ab1-40fe-bf7d-c08c3548d520-host-cni-netd\") pod \"ovnkube-node-rcxgh\" (UID: \"5f5c65b0-3ab1-40fe-bf7d-c08c3548d520\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" Jun 09 13:26:27.724912 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.724853 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5f5c65b0-3ab1-40fe-bf7d-c08c3548d520-env-overrides\") pod \"ovnkube-node-rcxgh\" (UID: \"5f5c65b0-3ab1-40fe-bf7d-c08c3548d520\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" Jun 09 13:26:27.724912 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.724908 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5f5c65b0-3ab1-40fe-bf7d-c08c3548d520-ovnkube-script-lib\") pod \"ovnkube-node-rcxgh\" (UID: \"5f5c65b0-3ab1-40fe-bf7d-c08c3548d520\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" Jun 09 13:26:27.725251 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.724938 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/67cfbf1f-7a58-467e-a353-69e78abfa48f-host-run-netns\") pod \"multus-mz5b5\" (UID: \"67cfbf1f-7a58-467e-a353-69e78abfa48f\") " pod="openshift-multus/multus-mz5b5" Jun 09 13:26:27.725251 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.725001 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/67cfbf1f-7a58-467e-a353-69e78abfa48f-multus-conf-dir\") pod \"multus-mz5b5\" (UID: \"67cfbf1f-7a58-467e-a353-69e78abfa48f\") " pod="openshift-multus/multus-mz5b5" Jun 09 13:26:27.725251 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.725069 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/67cfbf1f-7a58-467e-a353-69e78abfa48f-host-run-multus-certs\") pod \"multus-mz5b5\" (UID: \"67cfbf1f-7a58-467e-a353-69e78abfa48f\") " pod="openshift-multus/multus-mz5b5" Jun 09 13:26:27.725251 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.725098 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2fd91b92-5941-41cd-bdaa-4c43cfb8d1b2-socket-dir\") pod \"aws-ebs-csi-driver-node-lzrgp\" (UID: \"2fd91b92-5941-41cd-bdaa-4c43cfb8d1b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lzrgp" Jun 09 13:26:27.725251 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.725138 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2fd91b92-5941-41cd-bdaa-4c43cfb8d1b2-device-dir\") pod \"aws-ebs-csi-driver-node-lzrgp\" (UID: \"2fd91b92-5941-41cd-bdaa-4c43cfb8d1b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lzrgp" Jun 09 13:26:27.725251 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.725162 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5f5c65b0-3ab1-40fe-bf7d-c08c3548d520-run-ovn\") pod \"ovnkube-node-rcxgh\" (UID: \"5f5c65b0-3ab1-40fe-bf7d-c08c3548d520\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" Jun 09 13:26:27.725251 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.725201 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f5c65b0-3ab1-40fe-bf7d-c08c3548d520-host-cni-bin\") pod \"ovnkube-node-rcxgh\" (UID: \"5f5c65b0-3ab1-40fe-bf7d-c08c3548d520\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" Jun 09 13:26:27.725251 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.725228 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/679c37d9-6d86-41eb-aac4-073d70f2c285-dbus\") pod \"global-pull-secret-syncer-9wk4n\" (UID: \"679c37d9-6d86-41eb-aac4-073d70f2c285\") " pod="kube-system/global-pull-secret-syncer-9wk4n" Jun 09 13:26:27.725590 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.725255 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/67cfbf1f-7a58-467e-a353-69e78abfa48f-host-var-lib-kubelet\") pod \"multus-mz5b5\" (UID: \"67cfbf1f-7a58-467e-a353-69e78abfa48f\") " pod="openshift-multus/multus-mz5b5" Jun 09 13:26:27.725590 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.725293 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5f5c65b0-3ab1-40fe-bf7d-c08c3548d520-log-socket\") pod \"ovnkube-node-rcxgh\" (UID: \"5f5c65b0-3ab1-40fe-bf7d-c08c3548d520\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" Jun 09 13:26:27.725590 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.725344 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a65851db-7a9b-4f6f-a791-203591fb7e17-agent-certs\") pod \"konnectivity-agent-h65nk\" (UID: \"a65851db-7a9b-4f6f-a791-203591fb7e17\") " pod="kube-system/konnectivity-agent-h65nk" Jun 09 13:26:27.726375 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.726350 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 13:26:27.726723 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.726705 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hsvg8" Jun 09 13:26:27.728867 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.728846 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 09 13:26:27.728992 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.728972 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-x7dvq\"" Jun 09 13:26:27.729301 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.729282 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 09 13:26:27.729794 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.729778 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gb54t" Jun 09 13:26:27.731984 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.731968 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 09 13:26:27.732323 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.732207 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 09 13:26:27.732448 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.732378 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 09 13:26:27.732581 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.732560 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-thntc\"" Jun 09 13:26:27.751065 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.751041 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-tvs7m" Jun 09 13:26:27.756384 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.756344 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-tvs7m" Jun 09 13:26:27.788650 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.788603 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-125.ec2.internal" event={"ID":"63d271a837858141719cb90b8e166f85","Type":"ContainerStarted","Data":"894a757d84a3c5f5193e16101962f4402597f8407adcacdf740e1baf4969d1cf"} Jun 09 13:26:27.789908 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.789875 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-125.ec2.internal" event={"ID":"27417b22d6fa8d5909b4f4f539649658","Type":"ContainerStarted","Data":"ab72fcb5750db93b4b1f9b6d61f317a0fa5eab324f92fd6c1e912ad70a2b0008"} Jun 09 13:26:27.813125 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.813095 2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 09 13:26:27.825803 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.825777 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/67cfbf1f-7a58-467e-a353-69e78abfa48f-host-var-lib-kubelet\") pod \"multus-mz5b5\" (UID: \"67cfbf1f-7a58-467e-a353-69e78abfa48f\") " pod="openshift-multus/multus-mz5b5" Jun 09 13:26:27.825803 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.825807 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5f5c65b0-3ab1-40fe-bf7d-c08c3548d520-log-socket\") pod \"ovnkube-node-rcxgh\" (UID: \"5f5c65b0-3ab1-40fe-bf7d-c08c3548d520\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" Jun 09 13:26:27.826026 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.825832 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/675b5408-f1a4-4e3a-a7ce-688beba79cb9-tmp\") pod \"tuned-5xhqv\" (UID: \"675b5408-f1a4-4e3a-a7ce-688beba79cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-5xhqv" Jun 09 13:26:27.826026 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.825856 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wvdt\" (UniqueName: \"kubernetes.io/projected/a9ecc5cb-87e0-4daa-9cc4-156dd0952402-kube-api-access-8wvdt\") pod \"network-check-target-kdbl8\" (UID: \"a9ecc5cb-87e0-4daa-9cc4-156dd0952402\") " pod="openshift-network-diagnostics/network-check-target-kdbl8" Jun 09 13:26:27.826026 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.825885 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/67cfbf1f-7a58-467e-a353-69e78abfa48f-host-var-lib-kubelet\") pod \"multus-mz5b5\" (UID: \"67cfbf1f-7a58-467e-a353-69e78abfa48f\") " pod="openshift-multus/multus-mz5b5" Jun 09 13:26:27.826026 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.825906 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5f5c65b0-3ab1-40fe-bf7d-c08c3548d520-log-socket\") pod \"ovnkube-node-rcxgh\" (UID: \"5f5c65b0-3ab1-40fe-bf7d-c08c3548d520\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" Jun 09 13:26:27.826026 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.825913 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltx5d\" (UniqueName: \"kubernetes.io/projected/a0547d16-4dde-4b06-97d4-091c54fd4534-kube-api-access-ltx5d\") pod \"node-resolver-hsvg8\" (UID: \"a0547d16-4dde-4b06-97d4-091c54fd4534\") " pod="openshift-dns/node-resolver-hsvg8" Jun 09 13:26:27.826026 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.825956 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ee23738-5173-4f32-83d2-4f47140592b3-metrics-certs\") pod \"network-metrics-daemon-s8xkw\" (UID: \"5ee23738-5173-4f32-83d2-4f47140592b3\") " pod="openshift-multus/network-metrics-daemon-s8xkw" Jun 09 13:26:27.826026 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.825993 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/67cfbf1f-7a58-467e-a353-69e78abfa48f-cnibin\") pod \"multus-mz5b5\" (UID: \"67cfbf1f-7a58-467e-a353-69e78abfa48f\") " pod="openshift-multus/multus-mz5b5" Jun 09 13:26:27.826026 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.826016 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/67cfbf1f-7a58-467e-a353-69e78abfa48f-hostroot\") pod \"multus-mz5b5\" (UID: \"67cfbf1f-7a58-467e-a353-69e78abfa48f\") " pod="openshift-multus/multus-mz5b5" Jun 09 13:26:27.826464 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.826039 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5f5c65b0-3ab1-40fe-bf7d-c08c3548d520-systemd-units\") pod \"ovnkube-node-rcxgh\" (UID: \"5f5c65b0-3ab1-40fe-bf7d-c08c3548d520\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" Jun 09 13:26:27.826464 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.826070 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f5c65b0-3ab1-40fe-bf7d-c08c3548d520-var-lib-openvswitch\") pod \"ovnkube-node-rcxgh\" (UID: \"5f5c65b0-3ab1-40fe-bf7d-c08c3548d520\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" Jun 09 13:26:27.826464 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.826094 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/675b5408-f1a4-4e3a-a7ce-688beba79cb9-etc-kubernetes\") pod \"tuned-5xhqv\" (UID: \"675b5408-f1a4-4e3a-a7ce-688beba79cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-5xhqv" Jun 09 13:26:27.826464 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:27.826114 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 13:26:27.826464 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:27.826175 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ee23738-5173-4f32-83d2-4f47140592b3-metrics-certs podName:5ee23738-5173-4f32-83d2-4f47140592b3 nodeName:}" failed. No retries permitted until 2026-06-09 13:26:28.326153802 +0000 UTC m=+3.026428734 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5ee23738-5173-4f32-83d2-4f47140592b3-metrics-certs") pod "network-metrics-daemon-s8xkw" (UID: "5ee23738-5173-4f32-83d2-4f47140592b3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 13:26:27.826464 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.826176 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/67cfbf1f-7a58-467e-a353-69e78abfa48f-cnibin\") pod \"multus-mz5b5\" (UID: \"67cfbf1f-7a58-467e-a353-69e78abfa48f\") " pod="openshift-multus/multus-mz5b5" Jun 09 13:26:27.826464 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.826245 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/67cfbf1f-7a58-467e-a353-69e78abfa48f-hostroot\") pod \"multus-mz5b5\" (UID: \"67cfbf1f-7a58-467e-a353-69e78abfa48f\") " pod="openshift-multus/multus-mz5b5" Jun 09 13:26:27.826464 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.826289 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5f5c65b0-3ab1-40fe-bf7d-c08c3548d520-systemd-units\") pod \"ovnkube-node-rcxgh\" (UID: \"5f5c65b0-3ab1-40fe-bf7d-c08c3548d520\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" Jun 09 13:26:27.826464 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.826323 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f5c65b0-3ab1-40fe-bf7d-c08c3548d520-var-lib-openvswitch\") pod \"ovnkube-node-rcxgh\" (UID: \"5f5c65b0-3ab1-40fe-bf7d-c08c3548d520\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" Jun 09 13:26:27.826464 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.826116 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/675b5408-f1a4-4e3a-a7ce-688beba79cb9-host\") pod \"tuned-5xhqv\" (UID: \"675b5408-f1a4-4e3a-a7ce-688beba79cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-5xhqv" Jun 09 13:26:27.826464 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.826395 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tr7bn\" (UniqueName: \"kubernetes.io/projected/eab169a4-f873-4234-a2bd-3e592f05ca0c-kube-api-access-tr7bn\") pod \"iptables-alerter-dhvgh\" (UID: \"eab169a4-f873-4234-a2bd-3e592f05ca0c\") " pod="openshift-network-operator/iptables-alerter-dhvgh" Jun 09 13:26:27.826464 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.826424 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5f5c65b0-3ab1-40fe-bf7d-c08c3548d520-ovnkube-config\") pod \"ovnkube-node-rcxgh\" (UID: \"5f5c65b0-3ab1-40fe-bf7d-c08c3548d520\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" Jun 09 13:26:27.826464 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.826441 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/675b5408-f1a4-4e3a-a7ce-688beba79cb9-etc-sysconfig\") pod \"tuned-5xhqv\" (UID: \"675b5408-f1a4-4e3a-a7ce-688beba79cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-5xhqv" Jun 09 13:26:27.826464 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.826464 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/67cfbf1f-7a58-467e-a353-69e78abfa48f-system-cni-dir\") pod \"multus-mz5b5\" (UID: \"67cfbf1f-7a58-467e-a353-69e78abfa48f\") " pod="openshift-multus/multus-mz5b5" Jun 09 13:26:27.827557 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.826486 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67cfbf1f-7a58-467e-a353-69e78abfa48f-etc-kubernetes\") pod \"multus-mz5b5\" (UID: \"67cfbf1f-7a58-467e-a353-69e78abfa48f\") " pod="openshift-multus/multus-mz5b5" Jun 09 13:26:27.827557 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.826511 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/67cfbf1f-7a58-467e-a353-69e78abfa48f-host-run-k8s-cni-cncf-io\") pod \"multus-mz5b5\" (UID: \"67cfbf1f-7a58-467e-a353-69e78abfa48f\") " pod="openshift-multus/multus-mz5b5" Jun 09 13:26:27.827557 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.826535 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2fd91b92-5941-41cd-bdaa-4c43cfb8d1b2-etc-selinux\") pod \"aws-ebs-csi-driver-node-lzrgp\" (UID: \"2fd91b92-5941-41cd-bdaa-4c43cfb8d1b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lzrgp" Jun 09 13:26:27.827557 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.826556 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f5c65b0-3ab1-40fe-bf7d-c08c3548d520-host-kubelet\") pod \"ovnkube-node-rcxgh\" (UID: \"5f5c65b0-3ab1-40fe-bf7d-c08c3548d520\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" Jun 09 13:26:27.827557 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.826575 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/67cfbf1f-7a58-467e-a353-69e78abfa48f-system-cni-dir\") pod \"multus-mz5b5\" (UID: \"67cfbf1f-7a58-467e-a353-69e78abfa48f\") " pod="openshift-multus/multus-mz5b5" Jun 09 13:26:27.827557 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.826593 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f5c65b0-3ab1-40fe-bf7d-c08c3548d520-host-run-netns\") pod \"ovnkube-node-rcxgh\" (UID: \"5f5c65b0-3ab1-40fe-bf7d-c08c3548d520\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" Jun 09 13:26:27.827557 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.826614 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/675b5408-f1a4-4e3a-a7ce-688beba79cb9-run\") pod \"tuned-5xhqv\" (UID: \"675b5408-f1a4-4e3a-a7ce-688beba79cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-5xhqv" Jun 09 13:26:27.827557 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.826637 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/675b5408-f1a4-4e3a-a7ce-688beba79cb9-lib-modules\") pod \"tuned-5xhqv\" (UID: \"675b5408-f1a4-4e3a-a7ce-688beba79cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-5xhqv" Jun 09 13:26:27.827557 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.826636 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/67cfbf1f-7a58-467e-a353-69e78abfa48f-host-run-k8s-cni-cncf-io\") pod \"multus-mz5b5\" (UID: \"67cfbf1f-7a58-467e-a353-69e78abfa48f\") " pod="openshift-multus/multus-mz5b5" Jun 09 13:26:27.827557 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.826677 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67cfbf1f-7a58-467e-a353-69e78abfa48f-etc-kubernetes\") pod \"multus-mz5b5\" (UID: \"67cfbf1f-7a58-467e-a353-69e78abfa48f\") " pod="openshift-multus/multus-mz5b5" Jun 09 13:26:27.827557 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.826712 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/67cfbf1f-7a58-467e-a353-69e78abfa48f-host-var-lib-cni-bin\") pod \"multus-mz5b5\" (UID: \"67cfbf1f-7a58-467e-a353-69e78abfa48f\") " pod="openshift-multus/multus-mz5b5" Jun 09 13:26:27.827557 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.826723 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2fd91b92-5941-41cd-bdaa-4c43cfb8d1b2-etc-selinux\") pod \"aws-ebs-csi-driver-node-lzrgp\" (UID: \"2fd91b92-5941-41cd-bdaa-4c43cfb8d1b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lzrgp" Jun 09 13:26:27.827557 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.826743 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5924b051-0215-4fc3-b719-1368c5d88226-cni-binary-copy\") pod \"multus-additional-cni-plugins-bqwlr\" (UID: \"5924b051-0215-4fc3-b719-1368c5d88226\") " pod="openshift-multus/multus-additional-cni-plugins-bqwlr" Jun 09 13:26:27.827557 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.826763 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f5c65b0-3ab1-40fe-bf7d-c08c3548d520-host-kubelet\") pod \"ovnkube-node-rcxgh\" (UID: \"5f5c65b0-3ab1-40fe-bf7d-c08c3548d520\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" Jun 09 13:26:27.827557 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.826773 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/679c37d9-6d86-41eb-aac4-073d70f2c285-kubelet-config\") pod \"global-pull-secret-syncer-9wk4n\" (UID: \"679c37d9-6d86-41eb-aac4-073d70f2c285\") " pod="kube-system/global-pull-secret-syncer-9wk4n" Jun 09 13:26:27.827557 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.826795 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f5c65b0-3ab1-40fe-bf7d-c08c3548d520-host-run-netns\") pod \"ovnkube-node-rcxgh\" (UID: \"5f5c65b0-3ab1-40fe-bf7d-c08c3548d520\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" Jun 09 13:26:27.827557 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.826798 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6tsm\" (UniqueName: \"kubernetes.io/projected/675b5408-f1a4-4e3a-a7ce-688beba79cb9-kube-api-access-f6tsm\") pod \"tuned-5xhqv\" (UID: \"675b5408-f1a4-4e3a-a7ce-688beba79cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-5xhqv" Jun 09 13:26:27.828332 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.826822 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2fd91b92-5941-41cd-bdaa-4c43cfb8d1b2-sys-fs\") pod \"aws-ebs-csi-driver-node-lzrgp\" (UID: \"2fd91b92-5941-41cd-bdaa-4c43cfb8d1b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lzrgp" Jun 09 13:26:27.828332 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.826852 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9x96k\" (UniqueName: \"kubernetes.io/projected/1ab8fa81-0942-447f-9c26-6f448848c07d-kube-api-access-9x96k\") pod \"node-ca-gb54t\" (UID: \"1ab8fa81-0942-447f-9c26-6f448848c07d\") " pod="openshift-image-registry/node-ca-gb54t" Jun 09 13:26:27.828332 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.826871 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/67cfbf1f-7a58-467e-a353-69e78abfa48f-multus-conf-dir\") pod \"multus-mz5b5\" (UID: \"67cfbf1f-7a58-467e-a353-69e78abfa48f\") " pod="openshift-multus/multus-mz5b5" Jun 09 13:26:27.828332 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.826884 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/67cfbf1f-7a58-467e-a353-69e78abfa48f-host-var-lib-cni-bin\") pod \"multus-mz5b5\" (UID: \"67cfbf1f-7a58-467e-a353-69e78abfa48f\") " pod="openshift-multus/multus-mz5b5" Jun 09 13:26:27.828332 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.826933 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/67cfbf1f-7a58-467e-a353-69e78abfa48f-multus-conf-dir\") pod \"multus-mz5b5\" (UID: \"67cfbf1f-7a58-467e-a353-69e78abfa48f\") " pod="openshift-multus/multus-mz5b5" Jun 09 13:26:27.828332 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.826944 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/679c37d9-6d86-41eb-aac4-073d70f2c285-kubelet-config\") pod \"global-pull-secret-syncer-9wk4n\" (UID: \"679c37d9-6d86-41eb-aac4-073d70f2c285\") " pod="kube-system/global-pull-secret-syncer-9wk4n" Jun 09 13:26:27.828332 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.826898 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2fd91b92-5941-41cd-bdaa-4c43cfb8d1b2-device-dir\") pod \"aws-ebs-csi-driver-node-lzrgp\" (UID: \"2fd91b92-5941-41cd-bdaa-4c43cfb8d1b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lzrgp" Jun 09 13:26:27.828332 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.826981 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2fd91b92-5941-41cd-bdaa-4c43cfb8d1b2-sys-fs\") pod \"aws-ebs-csi-driver-node-lzrgp\" (UID: \"2fd91b92-5941-41cd-bdaa-4c43cfb8d1b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lzrgp" Jun 09 13:26:27.828332 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.826995 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f5c65b0-3ab1-40fe-bf7d-c08c3548d520-host-cni-bin\") pod \"ovnkube-node-rcxgh\" (UID: \"5f5c65b0-3ab1-40fe-bf7d-c08c3548d520\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" Jun 09 13:26:27.828332 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.827019 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/675b5408-f1a4-4e3a-a7ce-688beba79cb9-var-lib-kubelet\") pod \"tuned-5xhqv\" (UID: \"675b5408-f1a4-4e3a-a7ce-688beba79cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-5xhqv" Jun 09 13:26:27.828332 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.827030 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2fd91b92-5941-41cd-bdaa-4c43cfb8d1b2-device-dir\") pod \"aws-ebs-csi-driver-node-lzrgp\" (UID: \"2fd91b92-5941-41cd-bdaa-4c43cfb8d1b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lzrgp" Jun 09 13:26:27.828332 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.827043 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5924b051-0215-4fc3-b719-1368c5d88226-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bqwlr\" (UID: \"5924b051-0215-4fc3-b719-1368c5d88226\") " pod="openshift-multus/multus-additional-cni-plugins-bqwlr" Jun 09 13:26:27.828332 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.827047 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5f5c65b0-3ab1-40fe-bf7d-c08c3548d520-ovnkube-config\") pod \"ovnkube-node-rcxgh\" (UID: \"5f5c65b0-3ab1-40fe-bf7d-c08c3548d520\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" Jun 09 13:26:27.828332 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.827071 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a65851db-7a9b-4f6f-a791-203591fb7e17-agent-certs\") pod \"konnectivity-agent-h65nk\" (UID: \"a65851db-7a9b-4f6f-a791-203591fb7e17\") " pod="kube-system/konnectivity-agent-h65nk" Jun 09 13:26:27.828332 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.827098 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/675b5408-f1a4-4e3a-a7ce-688beba79cb9-etc-systemd\") pod \"tuned-5xhqv\" (UID: \"675b5408-f1a4-4e3a-a7ce-688beba79cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-5xhqv" Jun 09 13:26:27.828332 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.827073 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f5c65b0-3ab1-40fe-bf7d-c08c3548d520-host-cni-bin\") pod \"ovnkube-node-rcxgh\" (UID: \"5f5c65b0-3ab1-40fe-bf7d-c08c3548d520\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" Jun 09 13:26:27.828332 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.827132 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/675b5408-f1a4-4e3a-a7ce-688beba79cb9-sys\") pod \"tuned-5xhqv\" (UID: \"675b5408-f1a4-4e3a-a7ce-688beba79cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-5xhqv" Jun 09 13:26:27.829118 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.827160 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/67cfbf1f-7a58-467e-a353-69e78abfa48f-host-var-lib-cni-multus\") pod \"multus-mz5b5\" (UID: \"67cfbf1f-7a58-467e-a353-69e78abfa48f\") " pod="openshift-multus/multus-mz5b5" Jun 09 13:26:27.829118 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.827200 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pj7g6\" (UniqueName: \"kubernetes.io/projected/2fd91b92-5941-41cd-bdaa-4c43cfb8d1b2-kube-api-access-pj7g6\") pod \"aws-ebs-csi-driver-node-lzrgp\" (UID: \"2fd91b92-5941-41cd-bdaa-4c43cfb8d1b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lzrgp" Jun 09 13:26:27.829118 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.827227 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f5c65b0-3ab1-40fe-bf7d-c08c3548d520-etc-openvswitch\") pod \"ovnkube-node-rcxgh\" (UID: \"5f5c65b0-3ab1-40fe-bf7d-c08c3548d520\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" Jun 09 13:26:27.829118 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.827250 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f5c65b0-3ab1-40fe-bf7d-c08c3548d520-host-run-ovn-kubernetes\") pod \"ovnkube-node-rcxgh\" (UID: \"5f5c65b0-3ab1-40fe-bf7d-c08c3548d520\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" Jun 09 13:26:27.829118 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.827264 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/67cfbf1f-7a58-467e-a353-69e78abfa48f-host-var-lib-cni-multus\") pod \"multus-mz5b5\" (UID: \"67cfbf1f-7a58-467e-a353-69e78abfa48f\") " pod="openshift-multus/multus-mz5b5" Jun 09 13:26:27.829118 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.827279 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5924b051-0215-4fc3-b719-1368c5d88226-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bqwlr\" (UID: \"5924b051-0215-4fc3-b719-1368c5d88226\") " pod="openshift-multus/multus-additional-cni-plugins-bqwlr" Jun 09 13:26:27.829118 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.827304 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xlv8\" (UniqueName: \"kubernetes.io/projected/5f5c65b0-3ab1-40fe-bf7d-c08c3548d520-kube-api-access-4xlv8\") pod \"ovnkube-node-rcxgh\" (UID: \"5f5c65b0-3ab1-40fe-bf7d-c08c3548d520\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" Jun 09 13:26:27.829118 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.827308 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f5c65b0-3ab1-40fe-bf7d-c08c3548d520-etc-openvswitch\") pod \"ovnkube-node-rcxgh\" (UID: \"5f5c65b0-3ab1-40fe-bf7d-c08c3548d520\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" Jun 09 13:26:27.829118 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.827327 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/679c37d9-6d86-41eb-aac4-073d70f2c285-original-pull-secret\") pod \"global-pull-secret-syncer-9wk4n\" (UID: \"679c37d9-6d86-41eb-aac4-073d70f2c285\") " pod="kube-system/global-pull-secret-syncer-9wk4n" Jun 09 13:26:27.829118 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.827354 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2fd91b92-5941-41cd-bdaa-4c43cfb8d1b2-registration-dir\") pod \"aws-ebs-csi-driver-node-lzrgp\" (UID: \"2fd91b92-5941-41cd-bdaa-4c43cfb8d1b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lzrgp" Jun 09 13:26:27.829118 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.827378 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/67cfbf1f-7a58-467e-a353-69e78abfa48f-os-release\") pod \"multus-mz5b5\" (UID: \"67cfbf1f-7a58-467e-a353-69e78abfa48f\") " pod="openshift-multus/multus-mz5b5" Jun 09 13:26:27.829118 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.827405 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/67cfbf1f-7a58-467e-a353-69e78abfa48f-multus-socket-dir-parent\") pod \"multus-mz5b5\" (UID: \"67cfbf1f-7a58-467e-a353-69e78abfa48f\") " pod="openshift-multus/multus-mz5b5" Jun 09 13:26:27.829118 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.827428 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2fd91b92-5941-41cd-bdaa-4c43cfb8d1b2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lzrgp\" (UID: \"2fd91b92-5941-41cd-bdaa-4c43cfb8d1b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lzrgp" Jun 09 13:26:27.829118 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.827453 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5924b051-0215-4fc3-b719-1368c5d88226-system-cni-dir\") pod \"multus-additional-cni-plugins-bqwlr\" (UID: \"5924b051-0215-4fc3-b719-1368c5d88226\") " pod="openshift-multus/multus-additional-cni-plugins-bqwlr" Jun 09 13:26:27.829118 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.827460 2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 09 13:26:27.829118 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.827530 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f5c65b0-3ab1-40fe-bf7d-c08c3548d520-host-run-ovn-kubernetes\") pod \"ovnkube-node-rcxgh\" (UID: \"5f5c65b0-3ab1-40fe-bf7d-c08c3548d520\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" Jun 09 13:26:27.829118 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.827585 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2fd91b92-5941-41cd-bdaa-4c43cfb8d1b2-registration-dir\") pod \"aws-ebs-csi-driver-node-lzrgp\" (UID: \"2fd91b92-5941-41cd-bdaa-4c43cfb8d1b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lzrgp" Jun 09 13:26:27.829928 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.827599 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/67cfbf1f-7a58-467e-a353-69e78abfa48f-os-release\") pod \"multus-mz5b5\" (UID: \"67cfbf1f-7a58-467e-a353-69e78abfa48f\") " pod="openshift-multus/multus-mz5b5" Jun 09 13:26:27.829928 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.827651 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/67cfbf1f-7a58-467e-a353-69e78abfa48f-multus-socket-dir-parent\") pod \"multus-mz5b5\" (UID: \"67cfbf1f-7a58-467e-a353-69e78abfa48f\") " pod="openshift-multus/multus-mz5b5" Jun 09 13:26:27.829928 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.827697 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2fd91b92-5941-41cd-bdaa-4c43cfb8d1b2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lzrgp\" (UID: \"2fd91b92-5941-41cd-bdaa-4c43cfb8d1b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lzrgp" Jun 09 13:26:27.829928 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:27.827773 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 13:26:27.829928 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.827480 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5924b051-0215-4fc3-b719-1368c5d88226-cnibin\") pod \"multus-additional-cni-plugins-bqwlr\" (UID: \"5924b051-0215-4fc3-b719-1368c5d88226\") " pod="openshift-multus/multus-additional-cni-plugins-bqwlr" Jun 09 13:26:27.829928 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:27.827824 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/679c37d9-6d86-41eb-aac4-073d70f2c285-original-pull-secret podName:679c37d9-6d86-41eb-aac4-073d70f2c285 nodeName:}" failed. No retries permitted until 2026-06-09 13:26:28.327803141 +0000 UTC m=+3.028078060 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/679c37d9-6d86-41eb-aac4-073d70f2c285-original-pull-secret") pod "global-pull-secret-syncer-9wk4n" (UID: "679c37d9-6d86-41eb-aac4-073d70f2c285") : object "kube-system"/"original-pull-secret" not registered Jun 09 13:26:27.829928 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.827854 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czjzm\" (UniqueName: \"kubernetes.io/projected/67cfbf1f-7a58-467e-a353-69e78abfa48f-kube-api-access-czjzm\") pod \"multus-mz5b5\" (UID: \"67cfbf1f-7a58-467e-a353-69e78abfa48f\") " pod="openshift-multus/multus-mz5b5" Jun 09 13:26:27.829928 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.827884 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f5c65b0-3ab1-40fe-bf7d-c08c3548d520-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rcxgh\" (UID: \"5f5c65b0-3ab1-40fe-bf7d-c08c3548d520\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" Jun 09 13:26:27.829928 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.827911 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/675b5408-f1a4-4e3a-a7ce-688beba79cb9-etc-sysctl-d\") pod \"tuned-5xhqv\" (UID: \"675b5408-f1a4-4e3a-a7ce-688beba79cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-5xhqv" Jun 09 13:26:27.829928 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.827953 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/675b5408-f1a4-4e3a-a7ce-688beba79cb9-etc-sysctl-conf\") pod \"tuned-5xhqv\" (UID: \"675b5408-f1a4-4e3a-a7ce-688beba79cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-5xhqv" Jun 09 13:26:27.829928 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.827980 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/eab169a4-f873-4234-a2bd-3e592f05ca0c-iptables-alerter-script\") pod \"iptables-alerter-dhvgh\" (UID: \"eab169a4-f873-4234-a2bd-3e592f05ca0c\") " pod="openshift-network-operator/iptables-alerter-dhvgh" Jun 09 13:26:27.829928 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.828019 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eab169a4-f873-4234-a2bd-3e592f05ca0c-host-slash\") pod \"iptables-alerter-dhvgh\" (UID: \"eab169a4-f873-4234-a2bd-3e592f05ca0c\") " pod="openshift-network-operator/iptables-alerter-dhvgh" Jun 09 13:26:27.829928 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.828043 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a0547d16-4dde-4b06-97d4-091c54fd4534-hosts-file\") pod \"node-resolver-hsvg8\" (UID: \"a0547d16-4dde-4b06-97d4-091c54fd4534\") " pod="openshift-dns/node-resolver-hsvg8" Jun 09 13:26:27.829928 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.828068 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h274x\" (UniqueName: \"kubernetes.io/projected/5ee23738-5173-4f32-83d2-4f47140592b3-kube-api-access-h274x\") pod \"network-metrics-daemon-s8xkw\" (UID: \"5ee23738-5173-4f32-83d2-4f47140592b3\") " pod="openshift-multus/network-metrics-daemon-s8xkw" Jun 09 13:26:27.829928 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.828095 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/67cfbf1f-7a58-467e-a353-69e78abfa48f-multus-cni-dir\") pod \"multus-mz5b5\" (UID: \"67cfbf1f-7a58-467e-a353-69e78abfa48f\") " pod="openshift-multus/multus-mz5b5" Jun 09 13:26:27.829928 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.828120 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f5c65b0-3ab1-40fe-bf7d-c08c3548d520-run-openvswitch\") pod \"ovnkube-node-rcxgh\" (UID: \"5f5c65b0-3ab1-40fe-bf7d-c08c3548d520\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" Jun 09 13:26:27.829928 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.828144 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5f5c65b0-3ab1-40fe-bf7d-c08c3548d520-node-log\") pod \"ovnkube-node-rcxgh\" (UID: \"5f5c65b0-3ab1-40fe-bf7d-c08c3548d520\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" Jun 09 13:26:27.830752 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.828168 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5f5c65b0-3ab1-40fe-bf7d-c08c3548d520-ovn-node-metrics-cert\") pod \"ovnkube-node-rcxgh\" (UID: \"5f5c65b0-3ab1-40fe-bf7d-c08c3548d520\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" Jun 09 13:26:27.830752 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.828203 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/67cfbf1f-7a58-467e-a353-69e78abfa48f-multus-cni-dir\") pod \"multus-mz5b5\" (UID: \"67cfbf1f-7a58-467e-a353-69e78abfa48f\") " pod="openshift-multus/multus-mz5b5" Jun 09 13:26:27.830752 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.828212 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a65851db-7a9b-4f6f-a791-203591fb7e17-konnectivity-ca\") pod \"konnectivity-agent-h65nk\" (UID: \"a65851db-7a9b-4f6f-a791-203591fb7e17\") " pod="kube-system/konnectivity-agent-h65nk" Jun 09 13:26:27.830752 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.828257 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f5c65b0-3ab1-40fe-bf7d-c08c3548d520-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rcxgh\" (UID: \"5f5c65b0-3ab1-40fe-bf7d-c08c3548d520\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" Jun 09 13:26:27.830752 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.828281 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/675b5408-f1a4-4e3a-a7ce-688beba79cb9-etc-modprobe-d\") pod \"tuned-5xhqv\" (UID: \"675b5408-f1a4-4e3a-a7ce-688beba79cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-5xhqv" Jun 09 13:26:27.830752 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.828308 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmvbm\" (UniqueName: \"kubernetes.io/projected/5924b051-0215-4fc3-b719-1368c5d88226-kube-api-access-fmvbm\") pod \"multus-additional-cni-plugins-bqwlr\" (UID: \"5924b051-0215-4fc3-b719-1368c5d88226\") " pod="openshift-multus/multus-additional-cni-plugins-bqwlr" Jun 09 13:26:27.830752 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.828334 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/67cfbf1f-7a58-467e-a353-69e78abfa48f-cni-binary-copy\") pod \"multus-mz5b5\" (UID: \"67cfbf1f-7a58-467e-a353-69e78abfa48f\") " pod="openshift-multus/multus-mz5b5" Jun 09 13:26:27.830752 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.828360 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5f5c65b0-3ab1-40fe-bf7d-c08c3548d520-run-systemd\") pod \"ovnkube-node-rcxgh\" (UID: \"5f5c65b0-3ab1-40fe-bf7d-c08c3548d520\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" Jun 09 13:26:27.830752 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.828385 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1ab8fa81-0942-447f-9c26-6f448848c07d-host\") pod \"node-ca-gb54t\" (UID: \"1ab8fa81-0942-447f-9c26-6f448848c07d\") " pod="openshift-image-registry/node-ca-gb54t" Jun 09 13:26:27.830752 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.828440 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1ab8fa81-0942-447f-9c26-6f448848c07d-serviceca\") pod \"node-ca-gb54t\" (UID: \"1ab8fa81-0942-447f-9c26-6f448848c07d\") " pod="openshift-image-registry/node-ca-gb54t" Jun 09 13:26:27.830752 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.828466 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/67cfbf1f-7a58-467e-a353-69e78abfa48f-multus-daemon-config\") pod \"multus-mz5b5\" (UID: \"67cfbf1f-7a58-467e-a353-69e78abfa48f\") " pod="openshift-multus/multus-mz5b5" Jun 09 13:26:27.830752 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.828491 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5f5c65b0-3ab1-40fe-bf7d-c08c3548d520-host-slash\") pod \"ovnkube-node-rcxgh\" (UID: \"5f5c65b0-3ab1-40fe-bf7d-c08c3548d520\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" Jun 09 13:26:27.830752 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.828513 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5f5c65b0-3ab1-40fe-bf7d-c08c3548d520-host-cni-netd\") pod \"ovnkube-node-rcxgh\" (UID: \"5f5c65b0-3ab1-40fe-bf7d-c08c3548d520\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" Jun 09 13:26:27.830752 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.828538 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5f5c65b0-3ab1-40fe-bf7d-c08c3548d520-env-overrides\") pod \"ovnkube-node-rcxgh\" (UID: \"5f5c65b0-3ab1-40fe-bf7d-c08c3548d520\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" Jun 09 13:26:27.830752 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.828561 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5f5c65b0-3ab1-40fe-bf7d-c08c3548d520-ovnkube-script-lib\") pod \"ovnkube-node-rcxgh\" (UID: \"5f5c65b0-3ab1-40fe-bf7d-c08c3548d520\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" Jun 09 13:26:27.830752 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.828584 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/675b5408-f1a4-4e3a-a7ce-688beba79cb9-etc-tuned\") pod \"tuned-5xhqv\" (UID: \"675b5408-f1a4-4e3a-a7ce-688beba79cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-5xhqv" Jun 09 13:26:27.830752 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.828669 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/67cfbf1f-7a58-467e-a353-69e78abfa48f-host-run-netns\") pod \"multus-mz5b5\" (UID: \"67cfbf1f-7a58-467e-a353-69e78abfa48f\") " pod="openshift-multus/multus-mz5b5" Jun 09 13:26:27.831578 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.828695 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/67cfbf1f-7a58-467e-a353-69e78abfa48f-host-run-multus-certs\") pod \"multus-mz5b5\" (UID: \"67cfbf1f-7a58-467e-a353-69e78abfa48f\") " pod="openshift-multus/multus-mz5b5" Jun 09 13:26:27.831578 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.828720 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2fd91b92-5941-41cd-bdaa-4c43cfb8d1b2-socket-dir\") pod \"aws-ebs-csi-driver-node-lzrgp\" (UID: \"2fd91b92-5941-41cd-bdaa-4c43cfb8d1b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lzrgp" Jun 09 13:26:27.831578 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.828733 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f5c65b0-3ab1-40fe-bf7d-c08c3548d520-run-openvswitch\") pod \"ovnkube-node-rcxgh\" (UID: \"5f5c65b0-3ab1-40fe-bf7d-c08c3548d520\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" Jun 09 13:26:27.831578 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.828745 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5f5c65b0-3ab1-40fe-bf7d-c08c3548d520-run-ovn\") pod \"ovnkube-node-rcxgh\" (UID: \"5f5c65b0-3ab1-40fe-bf7d-c08c3548d520\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" Jun 09 13:26:27.831578 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.828760 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a65851db-7a9b-4f6f-a791-203591fb7e17-konnectivity-ca\") pod \"konnectivity-agent-h65nk\" (UID: \"a65851db-7a9b-4f6f-a791-203591fb7e17\") " pod="kube-system/konnectivity-agent-h65nk" Jun 09 13:26:27.831578 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.828779 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5f5c65b0-3ab1-40fe-bf7d-c08c3548d520-node-log\") pod \"ovnkube-node-rcxgh\" (UID: \"5f5c65b0-3ab1-40fe-bf7d-c08c3548d520\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" Jun 09 13:26:27.831578 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.828785 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/679c37d9-6d86-41eb-aac4-073d70f2c285-dbus\") pod \"global-pull-secret-syncer-9wk4n\" (UID: \"679c37d9-6d86-41eb-aac4-073d70f2c285\") " pod="kube-system/global-pull-secret-syncer-9wk4n" Jun 09 13:26:27.831578 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.828814 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5924b051-0215-4fc3-b719-1368c5d88226-os-release\") pod \"multus-additional-cni-plugins-bqwlr\" (UID: \"5924b051-0215-4fc3-b719-1368c5d88226\") " pod="openshift-multus/multus-additional-cni-plugins-bqwlr" Jun 09 13:26:27.831578 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.828825 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5f5c65b0-3ab1-40fe-bf7d-c08c3548d520-host-slash\") pod \"ovnkube-node-rcxgh\" (UID: \"5f5c65b0-3ab1-40fe-bf7d-c08c3548d520\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" Jun 09 13:26:27.831578 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.828840 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5924b051-0215-4fc3-b719-1368c5d88226-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bqwlr\" (UID: \"5924b051-0215-4fc3-b719-1368c5d88226\") " pod="openshift-multus/multus-additional-cni-plugins-bqwlr" Jun 09 13:26:27.831578 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.828860 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5f5c65b0-3ab1-40fe-bf7d-c08c3548d520-host-cni-netd\") pod \"ovnkube-node-rcxgh\" (UID: \"5f5c65b0-3ab1-40fe-bf7d-c08c3548d520\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" Jun 09 13:26:27.831578 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.828870 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0547d16-4dde-4b06-97d4-091c54fd4534-tmp-dir\") pod \"node-resolver-hsvg8\" (UID: \"a0547d16-4dde-4b06-97d4-091c54fd4534\") " pod="openshift-dns/node-resolver-hsvg8" Jun 09 13:26:27.831578 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.829278 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5f5c65b0-3ab1-40fe-bf7d-c08c3548d520-env-overrides\") pod \"ovnkube-node-rcxgh\" (UID: \"5f5c65b0-3ab1-40fe-bf7d-c08c3548d520\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" Jun 09 13:26:27.831578 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.829293 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/67cfbf1f-7a58-467e-a353-69e78abfa48f-multus-daemon-config\") pod \"multus-mz5b5\" (UID: \"67cfbf1f-7a58-467e-a353-69e78abfa48f\") " pod="openshift-multus/multus-mz5b5" Jun 09 13:26:27.831578 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.829388 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/67cfbf1f-7a58-467e-a353-69e78abfa48f-host-run-netns\") pod \"multus-mz5b5\" (UID: \"67cfbf1f-7a58-467e-a353-69e78abfa48f\") " pod="openshift-multus/multus-mz5b5" Jun 09 13:26:27.831578 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.829429 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/67cfbf1f-7a58-467e-a353-69e78abfa48f-host-run-multus-certs\") pod \"multus-mz5b5\" (UID: \"67cfbf1f-7a58-467e-a353-69e78abfa48f\") " pod="openshift-multus/multus-mz5b5" Jun 09 13:26:27.831578 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.829461 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5f5c65b0-3ab1-40fe-bf7d-c08c3548d520-ovnkube-script-lib\") pod \"ovnkube-node-rcxgh\" (UID: \"5f5c65b0-3ab1-40fe-bf7d-c08c3548d520\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" Jun 09 13:26:27.832461 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.829527 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2fd91b92-5941-41cd-bdaa-4c43cfb8d1b2-socket-dir\") pod \"aws-ebs-csi-driver-node-lzrgp\" (UID: \"2fd91b92-5941-41cd-bdaa-4c43cfb8d1b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lzrgp" Jun 09 13:26:27.832461 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.829531 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5f5c65b0-3ab1-40fe-bf7d-c08c3548d520-run-ovn\") pod \"ovnkube-node-rcxgh\" (UID: \"5f5c65b0-3ab1-40fe-bf7d-c08c3548d520\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" Jun 09 13:26:27.832461 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.829580 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5f5c65b0-3ab1-40fe-bf7d-c08c3548d520-run-systemd\") pod \"ovnkube-node-rcxgh\" (UID: \"5f5c65b0-3ab1-40fe-bf7d-c08c3548d520\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" Jun 09 13:26:27.832461 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.829635 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/679c37d9-6d86-41eb-aac4-073d70f2c285-dbus\") pod \"global-pull-secret-syncer-9wk4n\" (UID: \"679c37d9-6d86-41eb-aac4-073d70f2c285\") " pod="kube-system/global-pull-secret-syncer-9wk4n" Jun 09 13:26:27.832461 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.829717 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/67cfbf1f-7a58-467e-a353-69e78abfa48f-cni-binary-copy\") pod \"multus-mz5b5\" (UID: \"67cfbf1f-7a58-467e-a353-69e78abfa48f\") " pod="openshift-multus/multus-mz5b5" Jun 09 13:26:27.832461 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.831256 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5f5c65b0-3ab1-40fe-bf7d-c08c3548d520-ovn-node-metrics-cert\") pod \"ovnkube-node-rcxgh\" (UID: \"5f5c65b0-3ab1-40fe-bf7d-c08c3548d520\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" Jun 09 13:26:27.832461 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.831435 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a65851db-7a9b-4f6f-a791-203591fb7e17-agent-certs\") pod \"konnectivity-agent-h65nk\" (UID: \"a65851db-7a9b-4f6f-a791-203591fb7e17\") " pod="kube-system/konnectivity-agent-h65nk" Jun 09 13:26:27.836242 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.836113 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-czjzm\" (UniqueName: \"kubernetes.io/projected/67cfbf1f-7a58-467e-a353-69e78abfa48f-kube-api-access-czjzm\") pod \"multus-mz5b5\" (UID: \"67cfbf1f-7a58-467e-a353-69e78abfa48f\") " pod="openshift-multus/multus-mz5b5" Jun 09 13:26:27.836591 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.836570 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xlv8\" (UniqueName: \"kubernetes.io/projected/5f5c65b0-3ab1-40fe-bf7d-c08c3548d520-kube-api-access-4xlv8\") pod \"ovnkube-node-rcxgh\" (UID: \"5f5c65b0-3ab1-40fe-bf7d-c08c3548d520\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" Jun 09 13:26:27.836988 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.836969 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pj7g6\" (UniqueName: \"kubernetes.io/projected/2fd91b92-5941-41cd-bdaa-4c43cfb8d1b2-kube-api-access-pj7g6\") pod \"aws-ebs-csi-driver-node-lzrgp\" (UID: \"2fd91b92-5941-41cd-bdaa-4c43cfb8d1b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lzrgp" Jun 09 13:26:27.837076 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.837049 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h274x\" (UniqueName: \"kubernetes.io/projected/5ee23738-5173-4f32-83d2-4f47140592b3-kube-api-access-h274x\") pod \"network-metrics-daemon-s8xkw\" (UID: \"5ee23738-5173-4f32-83d2-4f47140592b3\") " pod="openshift-multus/network-metrics-daemon-s8xkw" Jun 09 13:26:27.929816 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.929774 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5924b051-0215-4fc3-b719-1368c5d88226-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bqwlr\" (UID: \"5924b051-0215-4fc3-b719-1368c5d88226\") " pod="openshift-multus/multus-additional-cni-plugins-bqwlr" Jun 09 13:26:27.929998 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.929838 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5924b051-0215-4fc3-b719-1368c5d88226-system-cni-dir\") pod \"multus-additional-cni-plugins-bqwlr\" (UID: \"5924b051-0215-4fc3-b719-1368c5d88226\") " pod="openshift-multus/multus-additional-cni-plugins-bqwlr" Jun 09 13:26:27.929998 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.929868 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5924b051-0215-4fc3-b719-1368c5d88226-cnibin\") pod \"multus-additional-cni-plugins-bqwlr\" (UID: \"5924b051-0215-4fc3-b719-1368c5d88226\") " pod="openshift-multus/multus-additional-cni-plugins-bqwlr" Jun 09 13:26:27.929998 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.929893 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/675b5408-f1a4-4e3a-a7ce-688beba79cb9-etc-sysctl-d\") pod \"tuned-5xhqv\" (UID: \"675b5408-f1a4-4e3a-a7ce-688beba79cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-5xhqv" Jun 09 13:26:27.929998 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.929916 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/675b5408-f1a4-4e3a-a7ce-688beba79cb9-etc-sysctl-conf\") pod \"tuned-5xhqv\" (UID: \"675b5408-f1a4-4e3a-a7ce-688beba79cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-5xhqv" Jun 09 13:26:27.929998 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.929942 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/eab169a4-f873-4234-a2bd-3e592f05ca0c-iptables-alerter-script\") pod \"iptables-alerter-dhvgh\" (UID: \"eab169a4-f873-4234-a2bd-3e592f05ca0c\") " pod="openshift-network-operator/iptables-alerter-dhvgh" Jun 09 13:26:27.929998 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.929961 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5924b051-0215-4fc3-b719-1368c5d88226-cnibin\") pod \"multus-additional-cni-plugins-bqwlr\" (UID: \"5924b051-0215-4fc3-b719-1368c5d88226\") " pod="openshift-multus/multus-additional-cni-plugins-bqwlr" Jun 09 13:26:27.929998 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.929966 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eab169a4-f873-4234-a2bd-3e592f05ca0c-host-slash\") pod \"iptables-alerter-dhvgh\" (UID: \"eab169a4-f873-4234-a2bd-3e592f05ca0c\") " pod="openshift-network-operator/iptables-alerter-dhvgh" Jun 09 13:26:27.930379 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.930006 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eab169a4-f873-4234-a2bd-3e592f05ca0c-host-slash\") pod \"iptables-alerter-dhvgh\" (UID: \"eab169a4-f873-4234-a2bd-3e592f05ca0c\") " pod="openshift-network-operator/iptables-alerter-dhvgh" Jun 09 13:26:27.930379 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.930023 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a0547d16-4dde-4b06-97d4-091c54fd4534-hosts-file\") pod \"node-resolver-hsvg8\" (UID: \"a0547d16-4dde-4b06-97d4-091c54fd4534\") " pod="openshift-dns/node-resolver-hsvg8" Jun 09 13:26:27.930379 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.930066 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/675b5408-f1a4-4e3a-a7ce-688beba79cb9-etc-modprobe-d\") pod \"tuned-5xhqv\" (UID: \"675b5408-f1a4-4e3a-a7ce-688beba79cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-5xhqv" Jun 09 13:26:27.930379 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.930092 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmvbm\" (UniqueName: \"kubernetes.io/projected/5924b051-0215-4fc3-b719-1368c5d88226-kube-api-access-fmvbm\") pod \"multus-additional-cni-plugins-bqwlr\" (UID: \"5924b051-0215-4fc3-b719-1368c5d88226\") " pod="openshift-multus/multus-additional-cni-plugins-bqwlr" Jun 09 13:26:27.930379 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.930132 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1ab8fa81-0942-447f-9c26-6f448848c07d-host\") pod \"node-ca-gb54t\" (UID: \"1ab8fa81-0942-447f-9c26-6f448848c07d\") " pod="openshift-image-registry/node-ca-gb54t" Jun 09 13:26:27.930379 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.930154 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1ab8fa81-0942-447f-9c26-6f448848c07d-serviceca\") pod \"node-ca-gb54t\" (UID: \"1ab8fa81-0942-447f-9c26-6f448848c07d\") " pod="openshift-image-registry/node-ca-gb54t" Jun 09 13:26:27.930379 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.930163 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/675b5408-f1a4-4e3a-a7ce-688beba79cb9-etc-sysctl-d\") pod \"tuned-5xhqv\" (UID: \"675b5408-f1a4-4e3a-a7ce-688beba79cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-5xhqv" Jun 09 13:26:27.930379 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.930199 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/675b5408-f1a4-4e3a-a7ce-688beba79cb9-etc-tuned\") pod \"tuned-5xhqv\" (UID: \"675b5408-f1a4-4e3a-a7ce-688beba79cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-5xhqv" Jun 09 13:26:27.930379 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.930227 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5924b051-0215-4fc3-b719-1368c5d88226-os-release\") pod \"multus-additional-cni-plugins-bqwlr\" (UID: \"5924b051-0215-4fc3-b719-1368c5d88226\") " pod="openshift-multus/multus-additional-cni-plugins-bqwlr" Jun 09 13:26:27.930379 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.930253 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5924b051-0215-4fc3-b719-1368c5d88226-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bqwlr\" (UID: \"5924b051-0215-4fc3-b719-1368c5d88226\") " pod="openshift-multus/multus-additional-cni-plugins-bqwlr" Jun 09 13:26:27.930379 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.930279 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0547d16-4dde-4b06-97d4-091c54fd4534-tmp-dir\") pod \"node-resolver-hsvg8\" (UID: \"a0547d16-4dde-4b06-97d4-091c54fd4534\") " pod="openshift-dns/node-resolver-hsvg8" Jun 09 13:26:27.930379 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.930304 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/675b5408-f1a4-4e3a-a7ce-688beba79cb9-tmp\") pod \"tuned-5xhqv\" (UID: \"675b5408-f1a4-4e3a-a7ce-688beba79cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-5xhqv" Jun 09 13:26:27.930379 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.930306 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/675b5408-f1a4-4e3a-a7ce-688beba79cb9-etc-sysctl-conf\") pod \"tuned-5xhqv\" (UID: \"675b5408-f1a4-4e3a-a7ce-688beba79cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-5xhqv" Jun 09 13:26:27.930379 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.930329 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wvdt\" (UniqueName: \"kubernetes.io/projected/a9ecc5cb-87e0-4daa-9cc4-156dd0952402-kube-api-access-8wvdt\") pod \"network-check-target-kdbl8\" (UID: \"a9ecc5cb-87e0-4daa-9cc4-156dd0952402\") " pod="openshift-network-diagnostics/network-check-target-kdbl8" Jun 09 13:26:27.930379 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.930367 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltx5d\" (UniqueName: \"kubernetes.io/projected/a0547d16-4dde-4b06-97d4-091c54fd4534-kube-api-access-ltx5d\") pod \"node-resolver-hsvg8\" (UID: \"a0547d16-4dde-4b06-97d4-091c54fd4534\") " pod="openshift-dns/node-resolver-hsvg8" Jun 09 13:26:27.931118 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.930410 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/675b5408-f1a4-4e3a-a7ce-688beba79cb9-etc-kubernetes\") pod \"tuned-5xhqv\" (UID: \"675b5408-f1a4-4e3a-a7ce-688beba79cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-5xhqv" Jun 09 13:26:27.931118 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.930433 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/675b5408-f1a4-4e3a-a7ce-688beba79cb9-host\") pod \"tuned-5xhqv\" (UID: \"675b5408-f1a4-4e3a-a7ce-688beba79cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-5xhqv" Jun 09 13:26:27.931118 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.930433 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a0547d16-4dde-4b06-97d4-091c54fd4534-hosts-file\") pod \"node-resolver-hsvg8\" (UID: \"a0547d16-4dde-4b06-97d4-091c54fd4534\") " pod="openshift-dns/node-resolver-hsvg8" Jun 09 13:26:27.931118 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.930438 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1ab8fa81-0942-447f-9c26-6f448848c07d-host\") pod \"node-ca-gb54t\" (UID: \"1ab8fa81-0942-447f-9c26-6f448848c07d\") " pod="openshift-image-registry/node-ca-gb54t" Jun 09 13:26:27.931118 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.930456 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tr7bn\" (UniqueName: \"kubernetes.io/projected/eab169a4-f873-4234-a2bd-3e592f05ca0c-kube-api-access-tr7bn\") pod \"iptables-alerter-dhvgh\" (UID: \"eab169a4-f873-4234-a2bd-3e592f05ca0c\") " pod="openshift-network-operator/iptables-alerter-dhvgh" Jun 09 13:26:27.931118 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.930495 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/675b5408-f1a4-4e3a-a7ce-688beba79cb9-etc-sysconfig\") pod \"tuned-5xhqv\" (UID: \"675b5408-f1a4-4e3a-a7ce-688beba79cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-5xhqv" Jun 09 13:26:27.931118 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.930531 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/675b5408-f1a4-4e3a-a7ce-688beba79cb9-run\") pod \"tuned-5xhqv\" (UID: \"675b5408-f1a4-4e3a-a7ce-688beba79cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-5xhqv" Jun 09 13:26:27.931118 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.930555 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/675b5408-f1a4-4e3a-a7ce-688beba79cb9-lib-modules\") pod \"tuned-5xhqv\" (UID: \"675b5408-f1a4-4e3a-a7ce-688beba79cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-5xhqv" Jun 09 13:26:27.931118 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.930582 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5924b051-0215-4fc3-b719-1368c5d88226-cni-binary-copy\") pod \"multus-additional-cni-plugins-bqwlr\" (UID: \"5924b051-0215-4fc3-b719-1368c5d88226\") " pod="openshift-multus/multus-additional-cni-plugins-bqwlr" Jun 09 13:26:27.931118 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.930610 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6tsm\" (UniqueName: \"kubernetes.io/projected/675b5408-f1a4-4e3a-a7ce-688beba79cb9-kube-api-access-f6tsm\") pod \"tuned-5xhqv\" (UID: \"675b5408-f1a4-4e3a-a7ce-688beba79cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-5xhqv" Jun 09 13:26:27.931118 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.930636 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9x96k\" (UniqueName: \"kubernetes.io/projected/1ab8fa81-0942-447f-9c26-6f448848c07d-kube-api-access-9x96k\") pod \"node-ca-gb54t\" (UID: \"1ab8fa81-0942-447f-9c26-6f448848c07d\") " pod="openshift-image-registry/node-ca-gb54t" Jun 09 13:26:27.931118 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.930665 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/675b5408-f1a4-4e3a-a7ce-688beba79cb9-var-lib-kubelet\") pod \"tuned-5xhqv\" (UID: \"675b5408-f1a4-4e3a-a7ce-688beba79cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-5xhqv" Jun 09 13:26:27.931118 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.930690 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5924b051-0215-4fc3-b719-1368c5d88226-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bqwlr\" (UID: \"5924b051-0215-4fc3-b719-1368c5d88226\") " pod="openshift-multus/multus-additional-cni-plugins-bqwlr" Jun 09 13:26:27.931118 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.930715 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/675b5408-f1a4-4e3a-a7ce-688beba79cb9-etc-systemd\") pod \"tuned-5xhqv\" (UID: \"675b5408-f1a4-4e3a-a7ce-688beba79cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-5xhqv" Jun 09 13:26:27.931118 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.930738 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/675b5408-f1a4-4e3a-a7ce-688beba79cb9-sys\") pod \"tuned-5xhqv\" (UID: \"675b5408-f1a4-4e3a-a7ce-688beba79cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-5xhqv" Jun 09 13:26:27.931118 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.930823 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/675b5408-f1a4-4e3a-a7ce-688beba79cb9-sys\") pod \"tuned-5xhqv\" (UID: \"675b5408-f1a4-4e3a-a7ce-688beba79cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-5xhqv" Jun 09 13:26:27.931118 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.930829 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1ab8fa81-0942-447f-9c26-6f448848c07d-serviceca\") pod \"node-ca-gb54t\" (UID: \"1ab8fa81-0942-447f-9c26-6f448848c07d\") " pod="openshift-image-registry/node-ca-gb54t" Jun 09 13:26:27.931118 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.930867 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/eab169a4-f873-4234-a2bd-3e592f05ca0c-iptables-alerter-script\") pod \"iptables-alerter-dhvgh\" (UID: \"eab169a4-f873-4234-a2bd-3e592f05ca0c\") " pod="openshift-network-operator/iptables-alerter-dhvgh" Jun 09 13:26:27.931969 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.930895 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/675b5408-f1a4-4e3a-a7ce-688beba79cb9-host\") pod \"tuned-5xhqv\" (UID: \"675b5408-f1a4-4e3a-a7ce-688beba79cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-5xhqv" Jun 09 13:26:27.931969 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.930922 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/675b5408-f1a4-4e3a-a7ce-688beba79cb9-etc-modprobe-d\") pod \"tuned-5xhqv\" (UID: \"675b5408-f1a4-4e3a-a7ce-688beba79cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-5xhqv" Jun 09 13:26:27.931969 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.930952 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/675b5408-f1a4-4e3a-a7ce-688beba79cb9-etc-kubernetes\") pod \"tuned-5xhqv\" (UID: \"675b5408-f1a4-4e3a-a7ce-688beba79cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-5xhqv" Jun 09 13:26:27.931969 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.930953 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5924b051-0215-4fc3-b719-1368c5d88226-os-release\") pod \"multus-additional-cni-plugins-bqwlr\" (UID: \"5924b051-0215-4fc3-b719-1368c5d88226\") " pod="openshift-multus/multus-additional-cni-plugins-bqwlr" Jun 09 13:26:27.931969 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.931121 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/675b5408-f1a4-4e3a-a7ce-688beba79cb9-var-lib-kubelet\") pod \"tuned-5xhqv\" (UID: \"675b5408-f1a4-4e3a-a7ce-688beba79cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-5xhqv" Jun 09 13:26:27.931969 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.931176 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/675b5408-f1a4-4e3a-a7ce-688beba79cb9-etc-systemd\") pod \"tuned-5xhqv\" (UID: \"675b5408-f1a4-4e3a-a7ce-688beba79cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-5xhqv" Jun 09 13:26:27.931969 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.930446 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5924b051-0215-4fc3-b719-1368c5d88226-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bqwlr\" (UID: \"5924b051-0215-4fc3-b719-1368c5d88226\") " pod="openshift-multus/multus-additional-cni-plugins-bqwlr" Jun 09 13:26:27.931969 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.931206 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5924b051-0215-4fc3-b719-1368c5d88226-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bqwlr\" (UID: \"5924b051-0215-4fc3-b719-1368c5d88226\") " pod="openshift-multus/multus-additional-cni-plugins-bqwlr" Jun 09 13:26:27.931969 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.931258 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5924b051-0215-4fc3-b719-1368c5d88226-system-cni-dir\") pod \"multus-additional-cni-plugins-bqwlr\" (UID: \"5924b051-0215-4fc3-b719-1368c5d88226\") " pod="openshift-multus/multus-additional-cni-plugins-bqwlr" Jun 09 13:26:27.931969 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.931260 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5924b051-0215-4fc3-b719-1368c5d88226-cni-binary-copy\") pod \"multus-additional-cni-plugins-bqwlr\" (UID: \"5924b051-0215-4fc3-b719-1368c5d88226\") " pod="openshift-multus/multus-additional-cni-plugins-bqwlr" Jun 09 13:26:27.931969 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.931331 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/675b5408-f1a4-4e3a-a7ce-688beba79cb9-etc-sysconfig\") pod \"tuned-5xhqv\" (UID: \"675b5408-f1a4-4e3a-a7ce-688beba79cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-5xhqv" Jun 09 13:26:27.931969 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.931379 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/675b5408-f1a4-4e3a-a7ce-688beba79cb9-run\") pod \"tuned-5xhqv\" (UID: \"675b5408-f1a4-4e3a-a7ce-688beba79cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-5xhqv" Jun 09 13:26:27.931969 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.931461 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/675b5408-f1a4-4e3a-a7ce-688beba79cb9-lib-modules\") pod \"tuned-5xhqv\" (UID: \"675b5408-f1a4-4e3a-a7ce-688beba79cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-5xhqv" Jun 09 13:26:27.931969 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.931476 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0547d16-4dde-4b06-97d4-091c54fd4534-tmp-dir\") pod \"node-resolver-hsvg8\" (UID: \"a0547d16-4dde-4b06-97d4-091c54fd4534\") " pod="openshift-dns/node-resolver-hsvg8" Jun 09 13:26:27.932636 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.932076 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5924b051-0215-4fc3-b719-1368c5d88226-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bqwlr\" (UID: \"5924b051-0215-4fc3-b719-1368c5d88226\") " pod="openshift-multus/multus-additional-cni-plugins-bqwlr" Jun 09 13:26:27.933563 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.933534 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/675b5408-f1a4-4e3a-a7ce-688beba79cb9-tmp\") pod \"tuned-5xhqv\" (UID: \"675b5408-f1a4-4e3a-a7ce-688beba79cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-5xhqv" Jun 09 13:26:27.934251 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.934230 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/675b5408-f1a4-4e3a-a7ce-688beba79cb9-etc-tuned\") pod \"tuned-5xhqv\" (UID: \"675b5408-f1a4-4e3a-a7ce-688beba79cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-5xhqv" Jun 09 13:26:27.938985 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.938956 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tr7bn\" (UniqueName: \"kubernetes.io/projected/eab169a4-f873-4234-a2bd-3e592f05ca0c-kube-api-access-tr7bn\") pod \"iptables-alerter-dhvgh\" (UID: \"eab169a4-f873-4234-a2bd-3e592f05ca0c\") " pod="openshift-network-operator/iptables-alerter-dhvgh" Jun 09 13:26:27.939814 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:27.939773 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 13:26:27.939814 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:27.939798 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 13:26:27.939814 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:27.939812 2577 projected.go:196] Error preparing data for projected volume kube-api-access-8wvdt for pod openshift-network-diagnostics/network-check-target-kdbl8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 13:26:27.940011 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:27.939869 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a9ecc5cb-87e0-4daa-9cc4-156dd0952402-kube-api-access-8wvdt podName:a9ecc5cb-87e0-4daa-9cc4-156dd0952402 nodeName:}" failed. No retries permitted until 2026-06-09 13:26:28.439850634 +0000 UTC m=+3.140125552 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-8wvdt" (UniqueName: "kubernetes.io/projected/a9ecc5cb-87e0-4daa-9cc4-156dd0952402-kube-api-access-8wvdt") pod "network-check-target-kdbl8" (UID: "a9ecc5cb-87e0-4daa-9cc4-156dd0952402") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 13:26:27.940077 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.940007 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9x96k\" (UniqueName: \"kubernetes.io/projected/1ab8fa81-0942-447f-9c26-6f448848c07d-kube-api-access-9x96k\") pod \"node-ca-gb54t\" (UID: \"1ab8fa81-0942-447f-9c26-6f448848c07d\") " pod="openshift-image-registry/node-ca-gb54t" Jun 09 13:26:27.942650 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.942597 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltx5d\" (UniqueName: \"kubernetes.io/projected/a0547d16-4dde-4b06-97d4-091c54fd4534-kube-api-access-ltx5d\") pod \"node-resolver-hsvg8\" (UID: \"a0547d16-4dde-4b06-97d4-091c54fd4534\") " pod="openshift-dns/node-resolver-hsvg8" Jun 09 13:26:27.943350 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.943308 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmvbm\" (UniqueName: \"kubernetes.io/projected/5924b051-0215-4fc3-b719-1368c5d88226-kube-api-access-fmvbm\") pod \"multus-additional-cni-plugins-bqwlr\" (UID: \"5924b051-0215-4fc3-b719-1368c5d88226\") " pod="openshift-multus/multus-additional-cni-plugins-bqwlr" Jun 09 13:26:27.943470 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:27.943448 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6tsm\" (UniqueName: \"kubernetes.io/projected/675b5408-f1a4-4e3a-a7ce-688beba79cb9-kube-api-access-f6tsm\") pod \"tuned-5xhqv\" (UID: \"675b5408-f1a4-4e3a-a7ce-688beba79cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-5xhqv" Jun 09 13:26:28.016135 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:28.016096 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mz5b5" Jun 09 13:26:28.023123 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:28.023095 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lzrgp" Jun 09 13:26:28.036002 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:28.035974 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" Jun 09 13:26:28.040770 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:28.040569 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-h65nk" Jun 09 13:26:28.049392 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:28.049369 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5xhqv" Jun 09 13:26:28.058216 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:28.058177 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dhvgh" Jun 09 13:26:28.066312 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:28.066288 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bqwlr" Jun 09 13:26:28.074041 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:28.074010 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hsvg8" Jun 09 13:26:28.080992 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:28.080966 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gb54t" Jun 09 13:26:28.230106 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:28.230021 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 13:26:28.335574 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:28.335538 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/679c37d9-6d86-41eb-aac4-073d70f2c285-original-pull-secret\") pod \"global-pull-secret-syncer-9wk4n\" (UID: \"679c37d9-6d86-41eb-aac4-073d70f2c285\") " pod="kube-system/global-pull-secret-syncer-9wk4n" Jun 09 13:26:28.335752 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:28.335616 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ee23738-5173-4f32-83d2-4f47140592b3-metrics-certs\") pod \"network-metrics-daemon-s8xkw\" (UID: \"5ee23738-5173-4f32-83d2-4f47140592b3\") " pod="openshift-multus/network-metrics-daemon-s8xkw" Jun 09 13:26:28.335752 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:28.335715 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 13:26:28.335855 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:28.335751 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 13:26:28.335855 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:28.335796 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/679c37d9-6d86-41eb-aac4-073d70f2c285-original-pull-secret podName:679c37d9-6d86-41eb-aac4-073d70f2c285 nodeName:}" failed. No retries permitted until 2026-06-09 13:26:29.335780866 +0000 UTC m=+4.036055787 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/679c37d9-6d86-41eb-aac4-073d70f2c285-original-pull-secret") pod "global-pull-secret-syncer-9wk4n" (UID: "679c37d9-6d86-41eb-aac4-073d70f2c285") : object "kube-system"/"original-pull-secret" not registered Jun 09 13:26:28.335855 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:28.335814 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ee23738-5173-4f32-83d2-4f47140592b3-metrics-certs podName:5ee23738-5173-4f32-83d2-4f47140592b3 nodeName:}" failed. No retries permitted until 2026-06-09 13:26:29.335804637 +0000 UTC m=+4.036079564 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5ee23738-5173-4f32-83d2-4f47140592b3-metrics-certs") pod "network-metrics-daemon-s8xkw" (UID: "5ee23738-5173-4f32-83d2-4f47140592b3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 13:26:28.537017 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:28.536807 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wvdt\" (UniqueName: \"kubernetes.io/projected/a9ecc5cb-87e0-4daa-9cc4-156dd0952402-kube-api-access-8wvdt\") pod \"network-check-target-kdbl8\" (UID: \"a9ecc5cb-87e0-4daa-9cc4-156dd0952402\") " pod="openshift-network-diagnostics/network-check-target-kdbl8" Jun 09 13:26:28.537017 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:28.536975 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 13:26:28.537017 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:28.536998 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 13:26:28.537017 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:28.537009 2577 projected.go:196] Error preparing data for projected volume kube-api-access-8wvdt for pod openshift-network-diagnostics/network-check-target-kdbl8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 13:26:28.537256 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:28.537075 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a9ecc5cb-87e0-4daa-9cc4-156dd0952402-kube-api-access-8wvdt podName:a9ecc5cb-87e0-4daa-9cc4-156dd0952402 nodeName:}" failed. No retries permitted until 2026-06-09 13:26:29.537047275 +0000 UTC m=+4.237322192 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-8wvdt" (UniqueName: "kubernetes.io/projected/a9ecc5cb-87e0-4daa-9cc4-156dd0952402-kube-api-access-8wvdt") pod "network-check-target-kdbl8" (UID: "a9ecc5cb-87e0-4daa-9cc4-156dd0952402") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 13:26:28.759855 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:28.759811 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 13:21:27 +0000 UTC" deadline="2028-03-21 10:00:52.980543844 +0000 UTC" Jun 09 13:26:28.759855 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:28.759847 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15620h34m24.220701074s" Jun 09 13:26:28.888680 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:28.888646 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5924b051_0215_4fc3_b719_1368c5d88226.slice/crio-2131fe36e5d622ca880864cbf307647f038ed8d4a6adcc270320c4ac66031776 WatchSource:0}: Error finding container 2131fe36e5d622ca880864cbf307647f038ed8d4a6adcc270320c4ac66031776: Status 404 returned error can't find the container with id 2131fe36e5d622ca880864cbf307647f038ed8d4a6adcc270320c4ac66031776 Jun 09 13:26:28.892644 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:28.892617 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda65851db_7a9b_4f6f_a791_203591fb7e17.slice/crio-5a315ed2cf46742ccc87985cc3275064655e8571695ac0b0f04f3eadcd92bcc4 WatchSource:0}: Error finding container 5a315ed2cf46742ccc87985cc3275064655e8571695ac0b0f04f3eadcd92bcc4: Status 404 returned error can't find the container with id 5a315ed2cf46742ccc87985cc3275064655e8571695ac0b0f04f3eadcd92bcc4 Jun 09 13:26:28.894905 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:28.894882 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67cfbf1f_7a58_467e_a353_69e78abfa48f.slice/crio-2b897e56e958e8374c83b76462e4667405c583ab043eb17189a50a05842e5b40 WatchSource:0}: Error finding container 2b897e56e958e8374c83b76462e4667405c583ab043eb17189a50a05842e5b40: Status 404 returned error can't find the container with id 2b897e56e958e8374c83b76462e4667405c583ab043eb17189a50a05842e5b40 Jun 09 13:26:28.896623 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:28.896602 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f5c65b0_3ab1_40fe_bf7d_c08c3548d520.slice/crio-cf1eedce829dfb9fad1aedc7cad74208ef9299d8069c2d903ca8402cc3fe7602 WatchSource:0}: Error finding container cf1eedce829dfb9fad1aedc7cad74208ef9299d8069c2d903ca8402cc3fe7602: Status 404 returned error can't find the container with id cf1eedce829dfb9fad1aedc7cad74208ef9299d8069c2d903ca8402cc3fe7602 Jun 09 13:26:28.897294 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:28.897271 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod675b5408_f1a4_4e3a_a7ce_688beba79cb9.slice/crio-844ce8160a168182420f047e78d73af79eb6fb38b480e1fd78094185b1fe04fe WatchSource:0}: Error finding container 844ce8160a168182420f047e78d73af79eb6fb38b480e1fd78094185b1fe04fe: Status 404 returned error can't find the container with id 844ce8160a168182420f047e78d73af79eb6fb38b480e1fd78094185b1fe04fe Jun 09 13:26:28.921803 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:28.921779 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0547d16_4dde_4b06_97d4_091c54fd4534.slice/crio-cc8b98fb88c4b1cbf7dd092e7fddd8c1ba40d0877909ea5b8c75b4a37f181c9b WatchSource:0}: Error finding container cc8b98fb88c4b1cbf7dd092e7fddd8c1ba40d0877909ea5b8c75b4a37f181c9b: Status 404 returned error can't find the container with id cc8b98fb88c4b1cbf7dd092e7fddd8c1ba40d0877909ea5b8c75b4a37f181c9b Jun 09 13:26:28.922486 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:28.922463 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fd91b92_5941_41cd_bdaa_4c43cfb8d1b2.slice/crio-a2bd12375ee0ea76b1f402ebc78e99d97591a77aab6dda94f1ca3422e1ed4437 WatchSource:0}: Error finding container a2bd12375ee0ea76b1f402ebc78e99d97591a77aab6dda94f1ca3422e1ed4437: Status 404 returned error can't find the container with id a2bd12375ee0ea76b1f402ebc78e99d97591a77aab6dda94f1ca3422e1ed4437 Jun 09 13:26:28.923348 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:28.923325 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ab8fa81_0942_447f_9c26_6f448848c07d.slice/crio-f9bb53f57d5c5a26d5a720b055998343b20e303c45263f7a19ef0274a86994a2 WatchSource:0}: Error finding container f9bb53f57d5c5a26d5a720b055998343b20e303c45263f7a19ef0274a86994a2: Status 404 returned error can't find the container with id f9bb53f57d5c5a26d5a720b055998343b20e303c45263f7a19ef0274a86994a2 Jun 09 13:26:28.924055 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:26:28.924024 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeab169a4_f873_4234_a2bd_3e592f05ca0c.slice/crio-c7e922fc0092fec5539edb4092998df48c029090dd4df935bca1d87dc537e531 WatchSource:0}: Error finding container c7e922fc0092fec5539edb4092998df48c029090dd4df935bca1d87dc537e531: Status 404 returned error can't find the container with id c7e922fc0092fec5539edb4092998df48c029090dd4df935bca1d87dc537e531 Jun 09 13:26:29.343846 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:29.343808 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ee23738-5173-4f32-83d2-4f47140592b3-metrics-certs\") pod \"network-metrics-daemon-s8xkw\" (UID: \"5ee23738-5173-4f32-83d2-4f47140592b3\") " pod="openshift-multus/network-metrics-daemon-s8xkw" Jun 09 13:26:29.344005 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:29.343894 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/679c37d9-6d86-41eb-aac4-073d70f2c285-original-pull-secret\") pod \"global-pull-secret-syncer-9wk4n\" (UID: \"679c37d9-6d86-41eb-aac4-073d70f2c285\") " pod="kube-system/global-pull-secret-syncer-9wk4n" Jun 09 13:26:29.344005 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:29.343947 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 13:26:29.344199 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:29.344011 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 13:26:29.344199 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:29.344033 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ee23738-5173-4f32-83d2-4f47140592b3-metrics-certs podName:5ee23738-5173-4f32-83d2-4f47140592b3 nodeName:}" failed. No retries permitted until 2026-06-09 13:26:31.344012629 +0000 UTC m=+6.044287549 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5ee23738-5173-4f32-83d2-4f47140592b3-metrics-certs") pod "network-metrics-daemon-s8xkw" (UID: "5ee23738-5173-4f32-83d2-4f47140592b3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 13:26:29.344199 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:29.344072 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/679c37d9-6d86-41eb-aac4-073d70f2c285-original-pull-secret podName:679c37d9-6d86-41eb-aac4-073d70f2c285 nodeName:}" failed. No retries permitted until 2026-06-09 13:26:31.344054967 +0000 UTC m=+6.044329890 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/679c37d9-6d86-41eb-aac4-073d70f2c285-original-pull-secret") pod "global-pull-secret-syncer-9wk4n" (UID: "679c37d9-6d86-41eb-aac4-073d70f2c285") : object "kube-system"/"original-pull-secret" not registered Jun 09 13:26:29.546327 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:29.546236 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wvdt\" (UniqueName: \"kubernetes.io/projected/a9ecc5cb-87e0-4daa-9cc4-156dd0952402-kube-api-access-8wvdt\") pod \"network-check-target-kdbl8\" (UID: \"a9ecc5cb-87e0-4daa-9cc4-156dd0952402\") " pod="openshift-network-diagnostics/network-check-target-kdbl8" Jun 09 13:26:29.546516 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:29.546499 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 13:26:29.546595 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:29.546524 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 13:26:29.546595 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:29.546538 2577 projected.go:196] Error preparing data for projected volume kube-api-access-8wvdt for pod openshift-network-diagnostics/network-check-target-kdbl8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 13:26:29.546690 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:29.546599 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a9ecc5cb-87e0-4daa-9cc4-156dd0952402-kube-api-access-8wvdt podName:a9ecc5cb-87e0-4daa-9cc4-156dd0952402 nodeName:}" failed. No retries permitted until 2026-06-09 13:26:31.546580561 +0000 UTC m=+6.246855483 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-8wvdt" (UniqueName: "kubernetes.io/projected/a9ecc5cb-87e0-4daa-9cc4-156dd0952402-kube-api-access-8wvdt") pod "network-check-target-kdbl8" (UID: "a9ecc5cb-87e0-4daa-9cc4-156dd0952402") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 13:26:29.760412 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:29.760347 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 13:21:27 +0000 UTC" deadline="2027-12-15 20:46:29.573664461 +0000 UTC" Jun 09 13:26:29.760412 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:29.760410 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13303h19m59.813258401s" Jun 09 13:26:29.785509 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:29.784855 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s8xkw" Jun 09 13:26:29.785509 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:29.784983 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s8xkw" podUID="5ee23738-5173-4f32-83d2-4f47140592b3" Jun 09 13:26:29.785509 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:29.785377 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kdbl8" Jun 09 13:26:29.785509 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:29.785469 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kdbl8" podUID="a9ecc5cb-87e0-4daa-9cc4-156dd0952402" Jun 09 13:26:29.786062 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:29.785909 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9wk4n" Jun 09 13:26:29.786062 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:29.786005 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9wk4n" podUID="679c37d9-6d86-41eb-aac4-073d70f2c285" Jun 09 13:26:29.805881 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:29.805804 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mz5b5" event={"ID":"67cfbf1f-7a58-467e-a353-69e78abfa48f","Type":"ContainerStarted","Data":"2b897e56e958e8374c83b76462e4667405c583ab043eb17189a50a05842e5b40"} Jun 09 13:26:29.820127 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:29.820058 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-125.ec2.internal" event={"ID":"27417b22d6fa8d5909b4f4f539649658","Type":"ContainerStarted","Data":"87e09bc8f2970c63a1e021eebe81905722acc826b8274072ce78cb699737a5ca"} Jun 09 13:26:29.827782 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:29.827153 2577 generic.go:356] "Generic (PLEG): container finished" podID="63d271a837858141719cb90b8e166f85" containerID="fd74ddc175473b182717a86782b04fa7ff936379d1f94a520336123b3006702a" exitCode=0 Jun 09 13:26:29.827782 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:29.827251 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-125.ec2.internal" event={"ID":"63d271a837858141719cb90b8e166f85","Type":"ContainerDied","Data":"fd74ddc175473b182717a86782b04fa7ff936379d1f94a520336123b3006702a"} Jun 09 13:26:29.834641 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:29.834131 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dhvgh" event={"ID":"eab169a4-f873-4234-a2bd-3e592f05ca0c","Type":"ContainerStarted","Data":"c7e922fc0092fec5539edb4092998df48c029090dd4df935bca1d87dc537e531"} Jun 09 13:26:29.848125 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:29.848095 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hsvg8" event={"ID":"a0547d16-4dde-4b06-97d4-091c54fd4534","Type":"ContainerStarted","Data":"cc8b98fb88c4b1cbf7dd092e7fddd8c1ba40d0877909ea5b8c75b4a37f181c9b"} Jun 09 13:26:29.856091 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:29.855385 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-125.ec2.internal" podStartSLOduration=3.855364367 podStartE2EDuration="3.855364367s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 13:26:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:26:29.836768417 +0000 UTC m=+4.537043358" watchObservedRunningTime="2026-06-09 13:26:29.855364367 +0000 UTC m=+4.555639308" Jun 09 13:26:29.866970 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:29.866932 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5xhqv" event={"ID":"675b5408-f1a4-4e3a-a7ce-688beba79cb9","Type":"ContainerStarted","Data":"844ce8160a168182420f047e78d73af79eb6fb38b480e1fd78094185b1fe04fe"} Jun 09 13:26:29.885528 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:29.885323 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" event={"ID":"5f5c65b0-3ab1-40fe-bf7d-c08c3548d520","Type":"ContainerStarted","Data":"cf1eedce829dfb9fad1aedc7cad74208ef9299d8069c2d903ca8402cc3fe7602"} Jun 09 13:26:29.901107 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:29.901072 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-h65nk" event={"ID":"a65851db-7a9b-4f6f-a791-203591fb7e17","Type":"ContainerStarted","Data":"5a315ed2cf46742ccc87985cc3275064655e8571695ac0b0f04f3eadcd92bcc4"} Jun 09 13:26:29.905444 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:29.905414 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bqwlr" event={"ID":"5924b051-0215-4fc3-b719-1368c5d88226","Type":"ContainerStarted","Data":"2131fe36e5d622ca880864cbf307647f038ed8d4a6adcc270320c4ac66031776"} Jun 09 13:26:29.922763 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:29.922726 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gb54t" event={"ID":"1ab8fa81-0942-447f-9c26-6f448848c07d","Type":"ContainerStarted","Data":"f9bb53f57d5c5a26d5a720b055998343b20e303c45263f7a19ef0274a86994a2"} Jun 09 13:26:29.935753 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:29.935678 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lzrgp" event={"ID":"2fd91b92-5941-41cd-bdaa-4c43cfb8d1b2","Type":"ContainerStarted","Data":"a2bd12375ee0ea76b1f402ebc78e99d97591a77aab6dda94f1ca3422e1ed4437"} Jun 09 13:26:30.956208 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:30.955840 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-125.ec2.internal" event={"ID":"63d271a837858141719cb90b8e166f85","Type":"ContainerStarted","Data":"49c748f3d86e4ec976602467f0b6689a23ff9308fd9738264877d865f414df47"} Jun 09 13:26:30.980956 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:30.980664 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-125.ec2.internal" podStartSLOduration=4.980639074 podStartE2EDuration="4.980639074s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 13:26:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:26:30.979862937 +0000 UTC m=+5.680137878" watchObservedRunningTime="2026-06-09 13:26:30.980639074 +0000 UTC m=+5.680914016" Jun 09 13:26:31.362959 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:31.361575 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/679c37d9-6d86-41eb-aac4-073d70f2c285-original-pull-secret\") pod \"global-pull-secret-syncer-9wk4n\" (UID: \"679c37d9-6d86-41eb-aac4-073d70f2c285\") " pod="kube-system/global-pull-secret-syncer-9wk4n" Jun 09 13:26:31.362959 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:31.361665 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ee23738-5173-4f32-83d2-4f47140592b3-metrics-certs\") pod \"network-metrics-daemon-s8xkw\" (UID: \"5ee23738-5173-4f32-83d2-4f47140592b3\") " pod="openshift-multus/network-metrics-daemon-s8xkw" Jun 09 13:26:31.362959 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:31.361798 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 13:26:31.362959 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:31.361857 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ee23738-5173-4f32-83d2-4f47140592b3-metrics-certs podName:5ee23738-5173-4f32-83d2-4f47140592b3 nodeName:}" failed. No retries permitted until 2026-06-09 13:26:35.361839866 +0000 UTC m=+10.062114798 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5ee23738-5173-4f32-83d2-4f47140592b3-metrics-certs") pod "network-metrics-daemon-s8xkw" (UID: "5ee23738-5173-4f32-83d2-4f47140592b3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 13:26:31.362959 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:31.361936 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 13:26:31.362959 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:31.361968 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/679c37d9-6d86-41eb-aac4-073d70f2c285-original-pull-secret podName:679c37d9-6d86-41eb-aac4-073d70f2c285 nodeName:}" failed. No retries permitted until 2026-06-09 13:26:35.361956688 +0000 UTC m=+10.062231617 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/679c37d9-6d86-41eb-aac4-073d70f2c285-original-pull-secret") pod "global-pull-secret-syncer-9wk4n" (UID: "679c37d9-6d86-41eb-aac4-073d70f2c285") : object "kube-system"/"original-pull-secret" not registered Jun 09 13:26:31.563829 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:31.563791 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wvdt\" (UniqueName: \"kubernetes.io/projected/a9ecc5cb-87e0-4daa-9cc4-156dd0952402-kube-api-access-8wvdt\") pod \"network-check-target-kdbl8\" (UID: \"a9ecc5cb-87e0-4daa-9cc4-156dd0952402\") " pod="openshift-network-diagnostics/network-check-target-kdbl8" Jun 09 13:26:31.564039 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:31.564019 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 13:26:31.564039 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:31.564042 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 13:26:31.564166 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:31.564053 2577 projected.go:196] Error preparing data for projected volume kube-api-access-8wvdt for pod openshift-network-diagnostics/network-check-target-kdbl8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 13:26:31.564166 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:31.564115 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a9ecc5cb-87e0-4daa-9cc4-156dd0952402-kube-api-access-8wvdt podName:a9ecc5cb-87e0-4daa-9cc4-156dd0952402 nodeName:}" failed. No retries permitted until 2026-06-09 13:26:35.564096057 +0000 UTC m=+10.264370981 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-8wvdt" (UniqueName: "kubernetes.io/projected/a9ecc5cb-87e0-4daa-9cc4-156dd0952402-kube-api-access-8wvdt") pod "network-check-target-kdbl8" (UID: "a9ecc5cb-87e0-4daa-9cc4-156dd0952402") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 13:26:31.786870 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:31.786340 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9wk4n" Jun 09 13:26:31.786870 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:31.786379 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s8xkw" Jun 09 13:26:31.786870 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:31.786340 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kdbl8" Jun 09 13:26:31.786870 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:31.786482 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9wk4n" podUID="679c37d9-6d86-41eb-aac4-073d70f2c285" Jun 09 13:26:31.786870 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:31.786530 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s8xkw" podUID="5ee23738-5173-4f32-83d2-4f47140592b3" Jun 09 13:26:31.786870 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:31.786597 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kdbl8" podUID="a9ecc5cb-87e0-4daa-9cc4-156dd0952402" Jun 09 13:26:33.788409 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:33.787711 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9wk4n" Jun 09 13:26:33.788409 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:33.787798 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9wk4n" podUID="679c37d9-6d86-41eb-aac4-073d70f2c285" Jun 09 13:26:33.788409 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:33.788139 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s8xkw" Jun 09 13:26:33.788409 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:33.788271 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s8xkw" podUID="5ee23738-5173-4f32-83d2-4f47140592b3" Jun 09 13:26:33.788409 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:33.788327 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kdbl8" Jun 09 13:26:33.788409 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:33.788380 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kdbl8" podUID="a9ecc5cb-87e0-4daa-9cc4-156dd0952402" Jun 09 13:26:35.399169 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:35.398989 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/679c37d9-6d86-41eb-aac4-073d70f2c285-original-pull-secret\") pod \"global-pull-secret-syncer-9wk4n\" (UID: \"679c37d9-6d86-41eb-aac4-073d70f2c285\") " pod="kube-system/global-pull-secret-syncer-9wk4n" Jun 09 13:26:35.399169 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:35.399085 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ee23738-5173-4f32-83d2-4f47140592b3-metrics-certs\") pod \"network-metrics-daemon-s8xkw\" (UID: \"5ee23738-5173-4f32-83d2-4f47140592b3\") " pod="openshift-multus/network-metrics-daemon-s8xkw" Jun 09 13:26:35.399169 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:35.399157 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 13:26:35.399708 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:35.399242 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/679c37d9-6d86-41eb-aac4-073d70f2c285-original-pull-secret podName:679c37d9-6d86-41eb-aac4-073d70f2c285 nodeName:}" failed. No retries permitted until 2026-06-09 13:26:43.399220965 +0000 UTC m=+18.099495888 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/679c37d9-6d86-41eb-aac4-073d70f2c285-original-pull-secret") pod "global-pull-secret-syncer-9wk4n" (UID: "679c37d9-6d86-41eb-aac4-073d70f2c285") : object "kube-system"/"original-pull-secret" not registered Jun 09 13:26:35.399708 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:35.399251 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 13:26:35.399708 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:35.399313 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ee23738-5173-4f32-83d2-4f47140592b3-metrics-certs podName:5ee23738-5173-4f32-83d2-4f47140592b3 nodeName:}" failed. No retries permitted until 2026-06-09 13:26:43.399295628 +0000 UTC m=+18.099570567 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5ee23738-5173-4f32-83d2-4f47140592b3-metrics-certs") pod "network-metrics-daemon-s8xkw" (UID: "5ee23738-5173-4f32-83d2-4f47140592b3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 13:26:35.600764 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:35.600729 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wvdt\" (UniqueName: \"kubernetes.io/projected/a9ecc5cb-87e0-4daa-9cc4-156dd0952402-kube-api-access-8wvdt\") pod \"network-check-target-kdbl8\" (UID: \"a9ecc5cb-87e0-4daa-9cc4-156dd0952402\") " pod="openshift-network-diagnostics/network-check-target-kdbl8" Jun 09 13:26:35.600930 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:35.600899 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 13:26:35.600982 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:35.600931 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 13:26:35.600982 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:35.600948 2577 projected.go:196] Error preparing data for projected volume kube-api-access-8wvdt for pod openshift-network-diagnostics/network-check-target-kdbl8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 13:26:35.601056 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:35.601019 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a9ecc5cb-87e0-4daa-9cc4-156dd0952402-kube-api-access-8wvdt podName:a9ecc5cb-87e0-4daa-9cc4-156dd0952402 nodeName:}" failed. No retries permitted until 2026-06-09 13:26:43.600996505 +0000 UTC m=+18.301271438 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-8wvdt" (UniqueName: "kubernetes.io/projected/a9ecc5cb-87e0-4daa-9cc4-156dd0952402-kube-api-access-8wvdt") pod "network-check-target-kdbl8" (UID: "a9ecc5cb-87e0-4daa-9cc4-156dd0952402") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 13:26:35.787141 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:35.787030 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9wk4n" Jun 09 13:26:35.787295 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:35.787146 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s8xkw" Jun 09 13:26:35.787295 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:35.787151 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9wk4n" podUID="679c37d9-6d86-41eb-aac4-073d70f2c285" Jun 09 13:26:35.787295 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:35.787276 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s8xkw" podUID="5ee23738-5173-4f32-83d2-4f47140592b3" Jun 09 13:26:35.787460 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:35.787322 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kdbl8" Jun 09 13:26:35.787460 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:35.787397 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kdbl8" podUID="a9ecc5cb-87e0-4daa-9cc4-156dd0952402" Jun 09 13:26:37.784804 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:37.784705 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s8xkw" Jun 09 13:26:37.785264 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:37.784862 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s8xkw" podUID="5ee23738-5173-4f32-83d2-4f47140592b3" Jun 09 13:26:37.785264 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:37.784922 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9wk4n" Jun 09 13:26:37.785264 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:37.785032 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9wk4n" podUID="679c37d9-6d86-41eb-aac4-073d70f2c285" Jun 09 13:26:37.785264 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:37.785098 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kdbl8" Jun 09 13:26:37.785264 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:37.785163 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kdbl8" podUID="a9ecc5cb-87e0-4daa-9cc4-156dd0952402" Jun 09 13:26:39.784407 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:39.784195 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kdbl8" Jun 09 13:26:39.785068 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:39.784203 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9wk4n" Jun 09 13:26:39.785068 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:39.784250 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s8xkw" Jun 09 13:26:39.785068 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:39.784511 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kdbl8" podUID="a9ecc5cb-87e0-4daa-9cc4-156dd0952402" Jun 09 13:26:39.785068 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:39.784615 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s8xkw" podUID="5ee23738-5173-4f32-83d2-4f47140592b3" Jun 09 13:26:39.785068 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:39.784691 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9wk4n" podUID="679c37d9-6d86-41eb-aac4-073d70f2c285" Jun 09 13:26:39.975854 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:39.975769 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bqwlr" event={"ID":"5924b051-0215-4fc3-b719-1368c5d88226","Type":"ContainerStarted","Data":"9e0da47152d0059d05ba796fbb19aa816d1985c573a39a552b28486bd86f56f5"} Jun 09 13:26:39.977933 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:39.977902 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gb54t" event={"ID":"1ab8fa81-0942-447f-9c26-6f448848c07d","Type":"ContainerStarted","Data":"81a456bb52a547ef1d1411f2ea9e1aea507c03c2e73b40822d571ecfb31caebd"} Jun 09 13:26:39.980057 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:39.980034 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lzrgp" event={"ID":"2fd91b92-5941-41cd-bdaa-4c43cfb8d1b2","Type":"ContainerStarted","Data":"c046701e1dc1ce2542a418c23adad7e70ff13ccdf6b841cdc417ae4619de8176"} Jun 09 13:26:39.981733 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:39.981689 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hsvg8" event={"ID":"a0547d16-4dde-4b06-97d4-091c54fd4534","Type":"ContainerStarted","Data":"72e4b3166e11b598ac7f427c7b46cad15d676c0819559127221cd2a8723fcb53"} Jun 09 13:26:39.983570 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:39.983524 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5xhqv" event={"ID":"675b5408-f1a4-4e3a-a7ce-688beba79cb9","Type":"ContainerStarted","Data":"4719a2ebcd6206af8f413e422c0ecb72a5344c839cade08e95ddc684f0b29555"} Jun 09 13:26:39.985229 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:39.985203 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-h65nk" event={"ID":"a65851db-7a9b-4f6f-a791-203591fb7e17","Type":"ContainerStarted","Data":"f455e0e2840ec654d60468522f3253155e6dca94f9beb692ff14f469d440ccf3"} Jun 09 13:26:40.014116 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:40.014054 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-hsvg8" podStartSLOduration=3.7828073509999998 podStartE2EDuration="14.014028175s" totalImagesPullingTime="10.231220824s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 13:26:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:26:40.013793059 +0000 UTC m=+14.714068025" watchObservedRunningTime="2026-06-09 13:26:40.014028175 +0000 UTC m=+14.714303114" Jun 09 13:26:40.028209 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:40.028111 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-h65nk" podStartSLOduration=4.797374188 podStartE2EDuration="15.028090323s" totalImagesPullingTime="10.230716135s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:26:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:26:40.027766326 +0000 UTC m=+14.728041272" watchObservedRunningTime="2026-06-09 13:26:40.028090323 +0000 UTC m=+14.728365262" Jun 09 13:26:40.045760 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:40.045700 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-5xhqv" podStartSLOduration=3.559074228 podStartE2EDuration="14.04568535s" totalImagesPullingTime="10.486611122s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 13:26:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:26:40.04549681 +0000 UTC m=+14.745771773" watchObservedRunningTime="2026-06-09 13:26:40.04568535 +0000 UTC m=+14.745960289" Jun 09 13:26:40.062286 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:40.062234 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-gb54t" podStartSLOduration=3.840616524 podStartE2EDuration="14.062210961s" totalImagesPullingTime="10.221594437s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 13:26:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:26:40.062148911 +0000 UTC m=+14.762423889" watchObservedRunningTime="2026-06-09 13:26:40.062210961 +0000 UTC m=+14.762485902" Jun 09 13:26:40.989564 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:40.989526 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dhvgh" event={"ID":"eab169a4-f873-4234-a2bd-3e592f05ca0c","Type":"ContainerStarted","Data":"41926dc2e10101ba4d6537bbaeecd595b4d0914c1f62cab10d537796ca9d8a32"} Jun 09 13:26:41.004929 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:41.004876 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-dhvgh" podStartSLOduration=4.782518312 podStartE2EDuration="15.00485569s" totalImagesPullingTime="10.222337378s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 13:26:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:26:41.004632762 +0000 UTC m=+15.704907702" watchObservedRunningTime="2026-06-09 13:26:41.00485569 +0000 UTC m=+15.705130630" Jun 09 13:26:41.784717 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:41.784673 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9wk4n" Jun 09 13:26:41.784915 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:41.784676 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s8xkw" Jun 09 13:26:41.784915 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:41.784841 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9wk4n" podUID="679c37d9-6d86-41eb-aac4-073d70f2c285" Jun 09 13:26:41.784915 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:41.784854 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kdbl8" Jun 09 13:26:41.785063 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:41.784997 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s8xkw" podUID="5ee23738-5173-4f32-83d2-4f47140592b3" Jun 09 13:26:41.785145 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:41.785120 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kdbl8" podUID="a9ecc5cb-87e0-4daa-9cc4-156dd0952402" Jun 09 13:26:43.463649 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:43.463605 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/679c37d9-6d86-41eb-aac4-073d70f2c285-original-pull-secret\") pod \"global-pull-secret-syncer-9wk4n\" (UID: \"679c37d9-6d86-41eb-aac4-073d70f2c285\") " pod="kube-system/global-pull-secret-syncer-9wk4n" Jun 09 13:26:43.464299 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:43.463779 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ee23738-5173-4f32-83d2-4f47140592b3-metrics-certs\") pod \"network-metrics-daemon-s8xkw\" (UID: \"5ee23738-5173-4f32-83d2-4f47140592b3\") " pod="openshift-multus/network-metrics-daemon-s8xkw" Jun 09 13:26:43.464299 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:43.463795 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 13:26:43.464299 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:43.463874 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/679c37d9-6d86-41eb-aac4-073d70f2c285-original-pull-secret podName:679c37d9-6d86-41eb-aac4-073d70f2c285 nodeName:}" failed. No retries permitted until 2026-06-09 13:26:59.463853931 +0000 UTC m=+34.164128868 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/679c37d9-6d86-41eb-aac4-073d70f2c285-original-pull-secret") pod "global-pull-secret-syncer-9wk4n" (UID: "679c37d9-6d86-41eb-aac4-073d70f2c285") : object "kube-system"/"original-pull-secret" not registered Jun 09 13:26:43.464299 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:43.463896 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 13:26:43.464299 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:43.463950 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ee23738-5173-4f32-83d2-4f47140592b3-metrics-certs podName:5ee23738-5173-4f32-83d2-4f47140592b3 nodeName:}" failed. No retries permitted until 2026-06-09 13:26:59.463933368 +0000 UTC m=+34.164208289 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5ee23738-5173-4f32-83d2-4f47140592b3-metrics-certs") pod "network-metrics-daemon-s8xkw" (UID: "5ee23738-5173-4f32-83d2-4f47140592b3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 13:26:43.665762 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:43.665567 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wvdt\" (UniqueName: \"kubernetes.io/projected/a9ecc5cb-87e0-4daa-9cc4-156dd0952402-kube-api-access-8wvdt\") pod \"network-check-target-kdbl8\" (UID: \"a9ecc5cb-87e0-4daa-9cc4-156dd0952402\") " pod="openshift-network-diagnostics/network-check-target-kdbl8" Jun 09 13:26:43.665934 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:43.665725 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 13:26:43.665934 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:43.665840 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 13:26:43.665934 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:43.665852 2577 projected.go:196] Error preparing data for projected volume kube-api-access-8wvdt for pod openshift-network-diagnostics/network-check-target-kdbl8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 13:26:43.665934 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:43.665899 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a9ecc5cb-87e0-4daa-9cc4-156dd0952402-kube-api-access-8wvdt podName:a9ecc5cb-87e0-4daa-9cc4-156dd0952402 nodeName:}" failed. No retries permitted until 2026-06-09 13:26:59.665885912 +0000 UTC m=+34.366160833 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-8wvdt" (UniqueName: "kubernetes.io/projected/a9ecc5cb-87e0-4daa-9cc4-156dd0952402-kube-api-access-8wvdt") pod "network-check-target-kdbl8" (UID: "a9ecc5cb-87e0-4daa-9cc4-156dd0952402") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 13:26:43.783688 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:43.783654 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s8xkw" Jun 09 13:26:43.783877 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:43.783661 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9wk4n" Jun 09 13:26:43.783877 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:43.783797 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s8xkw" podUID="5ee23738-5173-4f32-83d2-4f47140592b3" Jun 09 13:26:43.783877 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:43.783666 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kdbl8" Jun 09 13:26:43.784045 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:43.783875 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9wk4n" podUID="679c37d9-6d86-41eb-aac4-073d70f2c285" Jun 09 13:26:43.784045 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:43.783961 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kdbl8" podUID="a9ecc5cb-87e0-4daa-9cc4-156dd0952402" Jun 09 13:26:43.997379 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:43.997334 2577 generic.go:356] "Generic (PLEG): container finished" podID="5924b051-0215-4fc3-b719-1368c5d88226" containerID="9e0da47152d0059d05ba796fbb19aa816d1985c573a39a552b28486bd86f56f5" exitCode=0 Jun 09 13:26:43.997543 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:43.997393 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bqwlr" event={"ID":"5924b051-0215-4fc3-b719-1368c5d88226","Type":"ContainerDied","Data":"9e0da47152d0059d05ba796fbb19aa816d1985c573a39a552b28486bd86f56f5"} Jun 09 13:26:44.829749 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:44.829706 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-h65nk" Jun 09 13:26:44.830682 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:44.830662 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-h65nk" Jun 09 13:26:44.999340 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:44.999309 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-h65nk" Jun 09 13:26:45.002490 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:45.000136 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-h65nk" Jun 09 13:26:45.788145 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:45.787946 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9wk4n" Jun 09 13:26:45.788145 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:45.788062 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s8xkw" Jun 09 13:26:45.788145 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:45.788066 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kdbl8" Jun 09 13:26:45.788451 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:45.788063 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9wk4n" podUID="679c37d9-6d86-41eb-aac4-073d70f2c285" Jun 09 13:26:45.788451 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:45.788233 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s8xkw" podUID="5ee23738-5173-4f32-83d2-4f47140592b3" Jun 09 13:26:45.788451 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:45.788285 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kdbl8" podUID="a9ecc5cb-87e0-4daa-9cc4-156dd0952402" Jun 09 13:26:47.787462 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:47.787434 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kdbl8" Jun 09 13:26:47.787972 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:47.787434 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9wk4n" Jun 09 13:26:47.787972 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:47.787535 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kdbl8" podUID="a9ecc5cb-87e0-4daa-9cc4-156dd0952402" Jun 09 13:26:47.787972 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:47.787439 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s8xkw" Jun 09 13:26:47.787972 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:47.787609 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9wk4n" podUID="679c37d9-6d86-41eb-aac4-073d70f2c285" Jun 09 13:26:47.787972 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:47.787675 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s8xkw" podUID="5ee23738-5173-4f32-83d2-4f47140592b3" Jun 09 13:26:48.185472 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:48.184989 2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 09 13:26:48.783077 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:48.782962 2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-09T13:26:48.185234853Z","UUID":"82998eaa-ff58-4c27-99d2-b2b21400823c","Handler":null,"Name":"","Endpoint":""} Jun 09 13:26:48.784965 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:48.784933 2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 09 13:26:48.785085 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:48.784983 2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 09 13:26:49.010973 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:49.010939 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lzrgp" event={"ID":"2fd91b92-5941-41cd-bdaa-4c43cfb8d1b2","Type":"ContainerStarted","Data":"43b3f0d795be742d8d2007d227912cec67fc9d69163c9e57046ea85fab7440e9"} Jun 09 13:26:49.012808 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:49.012780 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mz5b5" event={"ID":"67cfbf1f-7a58-467e-a353-69e78abfa48f","Type":"ContainerStarted","Data":"58cc0a66f6940f7258a8c85f1e3b356993742f3db34cfc0fa3a42e201a898d4b"} Jun 09 13:26:49.016846 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:49.016810 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" event={"ID":"5f5c65b0-3ab1-40fe-bf7d-c08c3548d520","Type":"ContainerStarted","Data":"907a1d281daa004c35041c6229c07075d251a346a0a5170eea2cb99402d86024"} Jun 09 13:26:49.016952 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:49.016891 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" event={"ID":"5f5c65b0-3ab1-40fe-bf7d-c08c3548d520","Type":"ContainerStarted","Data":"8c415ca2d8b213ddd96f94a128b3a6d8a6e8619cccee002b9fcf64238122a713"} Jun 09 13:26:49.016952 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:49.016939 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" event={"ID":"5f5c65b0-3ab1-40fe-bf7d-c08c3548d520","Type":"ContainerStarted","Data":"d611adb6ff031d5eb307c2607c0996754d611b79993d1d883228a2ff73bb8913"} Jun 09 13:26:49.017068 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:49.017000 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" event={"ID":"5f5c65b0-3ab1-40fe-bf7d-c08c3548d520","Type":"ContainerStarted","Data":"b3875f0decb436f3e839458fab49a4518bb2b0adaf6d24ec51ed9e5fc8bc2182"} Jun 09 13:26:49.017068 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:49.017048 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" event={"ID":"5f5c65b0-3ab1-40fe-bf7d-c08c3548d520","Type":"ContainerStarted","Data":"70dd96a129f72268b33c609f795e6b97cfbf2bde78ca1587bc95ceec6b167ea5"} Jun 09 13:26:49.017164 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:49.017094 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" event={"ID":"5f5c65b0-3ab1-40fe-bf7d-c08c3548d520","Type":"ContainerStarted","Data":"9e929e589967ff81f777b83d53195e32c2e69b2777ca77db323c2d284d045f9e"} Jun 09 13:26:49.030622 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:49.030573 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-mz5b5" podStartSLOduration=4.928716945 podStartE2EDuration="24.030555891s" totalImagesPullingTime="19.101838946s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 13:26:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:26:49.030270003 +0000 UTC m=+23.730544957" watchObservedRunningTime="2026-06-09 13:26:49.030555891 +0000 UTC m=+23.730830832" Jun 09 13:26:49.784201 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:49.784157 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kdbl8" Jun 09 13:26:49.784374 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:49.784156 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s8xkw" Jun 09 13:26:49.784374 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:49.784306 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kdbl8" podUID="a9ecc5cb-87e0-4daa-9cc4-156dd0952402" Jun 09 13:26:49.784374 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:49.784327 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9wk4n" Jun 09 13:26:49.784531 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:49.784433 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s8xkw" podUID="5ee23738-5173-4f32-83d2-4f47140592b3" Jun 09 13:26:49.784585 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:49.784541 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9wk4n" podUID="679c37d9-6d86-41eb-aac4-073d70f2c285" Jun 09 13:26:50.022253 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:50.022215 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lzrgp" event={"ID":"2fd91b92-5941-41cd-bdaa-4c43cfb8d1b2","Type":"ContainerStarted","Data":"eeb072b389e06bbf69f4b98783200a0fc5a35f3cb8c7221be0cccf156560a994"} Jun 09 13:26:51.787315 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:51.787282 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kdbl8" Jun 09 13:26:51.787727 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:51.787367 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9wk4n" Jun 09 13:26:51.787727 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:51.787376 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kdbl8" podUID="a9ecc5cb-87e0-4daa-9cc4-156dd0952402" Jun 09 13:26:51.787727 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:51.787392 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s8xkw" Jun 09 13:26:51.787727 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:51.787460 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9wk4n" podUID="679c37d9-6d86-41eb-aac4-073d70f2c285" Jun 09 13:26:51.787727 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:51.787523 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s8xkw" podUID="5ee23738-5173-4f32-83d2-4f47140592b3" Jun 09 13:26:52.029457 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:52.029418 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" event={"ID":"5f5c65b0-3ab1-40fe-bf7d-c08c3548d520","Type":"ContainerStarted","Data":"57670e3e34e3b0535ccac0a77641cf485fe6995080c1809909acf523af4b2db2"} Jun 09 13:26:53.033457 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:53.033425 2577 generic.go:356] "Generic (PLEG): container finished" podID="5924b051-0215-4fc3-b719-1368c5d88226" containerID="bb8596bdc55a7dac03d87790bd555d31e8332c68e8194ba9a0bc58c379a95b06" exitCode=0 Jun 09 13:26:53.033940 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:53.033471 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bqwlr" event={"ID":"5924b051-0215-4fc3-b719-1368c5d88226","Type":"ContainerDied","Data":"bb8596bdc55a7dac03d87790bd555d31e8332c68e8194ba9a0bc58c379a95b06"} Jun 09 13:26:53.058909 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:53.058859 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lzrgp" podStartSLOduration=7.821733276 podStartE2EDuration="28.058843217s" totalImagesPullingTime="20.237109941s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 13:26:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:26:50.039607363 +0000 UTC m=+24.739882304" watchObservedRunningTime="2026-06-09 13:26:53.058843217 +0000 UTC m=+27.759118156" Jun 09 13:26:53.783826 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:53.783788 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s8xkw" Jun 09 13:26:53.784075 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:53.783798 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kdbl8" Jun 09 13:26:53.784075 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:53.783907 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s8xkw" podUID="5ee23738-5173-4f32-83d2-4f47140592b3" Jun 09 13:26:53.784075 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:53.783804 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9wk4n" Jun 09 13:26:53.784075 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:53.783962 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kdbl8" podUID="a9ecc5cb-87e0-4daa-9cc4-156dd0952402" Jun 09 13:26:53.784256 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:53.784071 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9wk4n" podUID="679c37d9-6d86-41eb-aac4-073d70f2c285" Jun 09 13:26:55.043772 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:55.043532 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" event={"ID":"5f5c65b0-3ab1-40fe-bf7d-c08c3548d520","Type":"ContainerStarted","Data":"4013f75947f26bb0c8d745640e1633780849bcbf59cf7aa6231411c7ebaf98c0"} Jun 09 13:26:55.044400 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:55.043867 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" Jun 09 13:26:55.044400 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:55.043909 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" Jun 09 13:26:55.044400 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:55.043937 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" Jun 09 13:26:55.045861 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:55.045833 2577 generic.go:356] "Generic (PLEG): container finished" podID="5924b051-0215-4fc3-b719-1368c5d88226" containerID="9ee5c607c4e601e5f5ffe3e1e1b4c79f549d91a8efb7a166e6095b6fef924624" exitCode=0 Jun 09 13:26:55.045958 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:55.045875 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bqwlr" event={"ID":"5924b051-0215-4fc3-b719-1368c5d88226","Type":"ContainerDied","Data":"9ee5c607c4e601e5f5ffe3e1e1b4c79f549d91a8efb7a166e6095b6fef924624"} Jun 09 13:26:55.059539 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:55.059516 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" Jun 09 13:26:55.059655 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:55.059614 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" Jun 09 13:26:55.070258 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:55.070216 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" podStartSLOduration=10.968139233 podStartE2EDuration="30.070201901s" totalImagesPullingTime="19.102062668s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 13:26:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:26:55.069919279 +0000 UTC m=+29.770194219" watchObservedRunningTime="2026-06-09 13:26:55.070201901 +0000 UTC m=+29.770476841" Jun 09 13:26:55.784913 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:55.784886 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9wk4n" Jun 09 13:26:55.785128 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:55.784976 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9wk4n" podUID="679c37d9-6d86-41eb-aac4-073d70f2c285" Jun 09 13:26:55.785128 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:55.785004 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kdbl8" Jun 09 13:26:55.785128 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:55.785033 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s8xkw" Jun 09 13:26:55.785347 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:55.785124 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kdbl8" podUID="a9ecc5cb-87e0-4daa-9cc4-156dd0952402" Jun 09 13:26:55.785456 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:55.785433 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s8xkw" podUID="5ee23738-5173-4f32-83d2-4f47140592b3" Jun 09 13:26:56.434712 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:56.434680 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9wk4n"] Jun 09 13:26:56.435096 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:56.434836 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9wk4n" Jun 09 13:26:56.435096 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:56.434924 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9wk4n" podUID="679c37d9-6d86-41eb-aac4-073d70f2c285" Jun 09 13:26:56.438295 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:56.438230 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kdbl8"] Jun 09 13:26:56.438440 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:56.438348 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kdbl8" Jun 09 13:26:56.438481 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:56.438446 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kdbl8" podUID="a9ecc5cb-87e0-4daa-9cc4-156dd0952402" Jun 09 13:26:56.448461 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:56.448434 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-s8xkw"] Jun 09 13:26:56.448588 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:56.448547 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s8xkw" Jun 09 13:26:56.448677 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:56.448656 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s8xkw" podUID="5ee23738-5173-4f32-83d2-4f47140592b3" Jun 09 13:26:57.052948 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:57.052773 2577 generic.go:356] "Generic (PLEG): container finished" podID="5924b051-0215-4fc3-b719-1368c5d88226" containerID="6b8741c675397bae80aaf8984de701f15826c6a6dc915dec93250a27e119e363" exitCode=0 Jun 09 13:26:57.053101 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:57.052840 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bqwlr" event={"ID":"5924b051-0215-4fc3-b719-1368c5d88226","Type":"ContainerDied","Data":"6b8741c675397bae80aaf8984de701f15826c6a6dc915dec93250a27e119e363"} Jun 09 13:26:57.783988 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:57.783958 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kdbl8" Jun 09 13:26:57.784613 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:57.784065 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kdbl8" podUID="a9ecc5cb-87e0-4daa-9cc4-156dd0952402" Jun 09 13:26:58.784661 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:58.784622 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9wk4n" Jun 09 13:26:58.784661 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:58.784661 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s8xkw" Jun 09 13:26:58.785161 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:58.784754 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9wk4n" podUID="679c37d9-6d86-41eb-aac4-073d70f2c285" Jun 09 13:26:58.785161 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:58.784811 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s8xkw" podUID="5ee23738-5173-4f32-83d2-4f47140592b3" Jun 09 13:26:59.486453 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:59.486416 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/679c37d9-6d86-41eb-aac4-073d70f2c285-original-pull-secret\") pod \"global-pull-secret-syncer-9wk4n\" (UID: \"679c37d9-6d86-41eb-aac4-073d70f2c285\") " pod="kube-system/global-pull-secret-syncer-9wk4n" Jun 09 13:26:59.486616 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:59.486502 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ee23738-5173-4f32-83d2-4f47140592b3-metrics-certs\") pod \"network-metrics-daemon-s8xkw\" (UID: \"5ee23738-5173-4f32-83d2-4f47140592b3\") " pod="openshift-multus/network-metrics-daemon-s8xkw" Jun 09 13:26:59.486616 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:59.486542 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 13:26:59.486720 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:59.486622 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 13:26:59.486720 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:59.486628 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/679c37d9-6d86-41eb-aac4-073d70f2c285-original-pull-secret podName:679c37d9-6d86-41eb-aac4-073d70f2c285 nodeName:}" failed. No retries permitted until 2026-06-09 13:27:31.486603296 +0000 UTC m=+66.186878227 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/679c37d9-6d86-41eb-aac4-073d70f2c285-original-pull-secret") pod "global-pull-secret-syncer-9wk4n" (UID: "679c37d9-6d86-41eb-aac4-073d70f2c285") : object "kube-system"/"original-pull-secret" not registered Jun 09 13:26:59.486720 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:59.486701 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ee23738-5173-4f32-83d2-4f47140592b3-metrics-certs podName:5ee23738-5173-4f32-83d2-4f47140592b3 nodeName:}" failed. No retries permitted until 2026-06-09 13:27:31.486682856 +0000 UTC m=+66.186957782 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5ee23738-5173-4f32-83d2-4f47140592b3-metrics-certs") pod "network-metrics-daemon-s8xkw" (UID: "5ee23738-5173-4f32-83d2-4f47140592b3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 13:26:59.688154 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:59.688108 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wvdt\" (UniqueName: \"kubernetes.io/projected/a9ecc5cb-87e0-4daa-9cc4-156dd0952402-kube-api-access-8wvdt\") pod \"network-check-target-kdbl8\" (UID: \"a9ecc5cb-87e0-4daa-9cc4-156dd0952402\") " pod="openshift-network-diagnostics/network-check-target-kdbl8" Jun 09 13:26:59.688357 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:59.688334 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 13:26:59.688403 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:59.688363 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 13:26:59.688403 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:59.688377 2577 projected.go:196] Error preparing data for projected volume kube-api-access-8wvdt for pod openshift-network-diagnostics/network-check-target-kdbl8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 13:26:59.688491 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:59.688439 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a9ecc5cb-87e0-4daa-9cc4-156dd0952402-kube-api-access-8wvdt podName:a9ecc5cb-87e0-4daa-9cc4-156dd0952402 nodeName:}" failed. No retries permitted until 2026-06-09 13:27:31.688420165 +0000 UTC m=+66.388695101 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-8wvdt" (UniqueName: "kubernetes.io/projected/a9ecc5cb-87e0-4daa-9cc4-156dd0952402-kube-api-access-8wvdt") pod "network-check-target-kdbl8" (UID: "a9ecc5cb-87e0-4daa-9cc4-156dd0952402") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 13:26:59.784225 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:26:59.784125 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kdbl8" Jun 09 13:26:59.784375 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:26:59.784275 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kdbl8" podUID="a9ecc5cb-87e0-4daa-9cc4-156dd0952402" Jun 09 13:27:00.615951 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.615918 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-125.ec2.internal" event="NodeReady" Jun 09 13:27:00.616477 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.616064 2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 09 13:27:00.651085 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.651039 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-qvkpz"] Jun 09 13:27:00.656311 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.656281 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-997fbf97b-x4zg5"] Jun 09 13:27:00.656448 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.656412 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qvkpz" Jun 09 13:27:00.658781 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.658566 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 09 13:27:00.658781 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.658583 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 09 13:27:00.658781 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.658630 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-dsh7m\"" Jun 09 13:27:00.659211 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.659168 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-997fbf97b-x4zg5" Jun 09 13:27:00.661524 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.661504 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 09 13:27:00.661621 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.661505 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 09 13:27:00.661621 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.661509 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 09 13:27:00.661830 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.661814 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2ppl8\"" Jun 09 13:27:00.664744 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.664723 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-qvkpz"] Jun 09 13:27:00.668123 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.668098 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 09 13:27:00.668284 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.668202 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hzv2v"] Jun 09 13:27:00.672374 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.672354 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-997fbf97b-x4zg5"] Jun 09 13:27:00.672505 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.672392 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-bsxfs"] Jun 09 13:27:00.672651 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.672633 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hzv2v" Jun 09 13:27:00.675291 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.675273 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 09 13:27:00.675555 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.675537 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bsxfs" Jun 09 13:27:00.675727 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.675663 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 09 13:27:00.679748 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.676208 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wkzw9\"" Jun 09 13:27:00.679748 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.679450 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 09 13:27:00.679748 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.679485 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 09 13:27:00.679748 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.679543 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 09 13:27:00.679748 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.679630 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-78nqh\"" Jun 09 13:27:00.682730 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.682644 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hzv2v"] Jun 09 13:27:00.684375 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.683932 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bsxfs"] Jun 09 13:27:00.784518 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.784482 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9wk4n" Jun 09 13:27:00.784663 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.784647 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s8xkw" Jun 09 13:27:00.786974 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.786950 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 13:27:00.787097 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.787030 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 13:27:00.787097 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.786960 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8wq29\"" Jun 09 13:27:00.795137 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.795110 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8c588445-d514-4c1c-a4b4-b1a0f03728fd-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-qvkpz\" (UID: \"8c588445-d514-4c1c-a4b4-b1a0f03728fd\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qvkpz" Jun 09 13:27:00.795287 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.795152 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8f7fd79-6891-4136-ae3a-03ed6d7c4d96-metrics-tls\") pod \"dns-default-hzv2v\" (UID: \"c8f7fd79-6891-4136-ae3a-03ed6d7c4d96\") " pod="openshift-dns/dns-default-hzv2v" Jun 09 13:27:00.795287 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.795226 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/495960e5-1fad-4f40-91e4-0962570569ec-trusted-ca\") pod \"image-registry-997fbf97b-x4zg5\" (UID: \"495960e5-1fad-4f40-91e4-0962570569ec\") " pod="openshift-image-registry/image-registry-997fbf97b-x4zg5" Jun 09 13:27:00.795287 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.795265 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/495960e5-1fad-4f40-91e4-0962570569ec-bound-sa-token\") pod \"image-registry-997fbf97b-x4zg5\" (UID: \"495960e5-1fad-4f40-91e4-0962570569ec\") " pod="openshift-image-registry/image-registry-997fbf97b-x4zg5" Jun 09 13:27:00.795430 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.795300 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48kpk\" (UniqueName: \"kubernetes.io/projected/c8f7fd79-6891-4136-ae3a-03ed6d7c4d96-kube-api-access-48kpk\") pod \"dns-default-hzv2v\" (UID: \"c8f7fd79-6891-4136-ae3a-03ed6d7c4d96\") " pod="openshift-dns/dns-default-hzv2v" Jun 09 13:27:00.795430 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.795330 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/495960e5-1fad-4f40-91e4-0962570569ec-registry-tls\") pod \"image-registry-997fbf97b-x4zg5\" (UID: \"495960e5-1fad-4f40-91e4-0962570569ec\") " pod="openshift-image-registry/image-registry-997fbf97b-x4zg5" Jun 09 13:27:00.795430 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.795352 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8c588445-d514-4c1c-a4b4-b1a0f03728fd-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-qvkpz\" (UID: \"8c588445-d514-4c1c-a4b4-b1a0f03728fd\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qvkpz" Jun 09 13:27:00.795430 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.795418 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/af72438c-c400-45ba-941f-94637383ca93-cert\") pod \"ingress-canary-bsxfs\" (UID: \"af72438c-c400-45ba-941f-94637383ca93\") " pod="openshift-ingress-canary/ingress-canary-bsxfs" Jun 09 13:27:00.795598 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.795468 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbbj5\" (UniqueName: \"kubernetes.io/projected/af72438c-c400-45ba-941f-94637383ca93-kube-api-access-qbbj5\") pod \"ingress-canary-bsxfs\" (UID: \"af72438c-c400-45ba-941f-94637383ca93\") " pod="openshift-ingress-canary/ingress-canary-bsxfs" Jun 09 13:27:00.795598 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.795507 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/495960e5-1fad-4f40-91e4-0962570569ec-image-registry-private-configuration\") pod \"image-registry-997fbf97b-x4zg5\" (UID: \"495960e5-1fad-4f40-91e4-0962570569ec\") " pod="openshift-image-registry/image-registry-997fbf97b-x4zg5" Jun 09 13:27:00.795598 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.795538 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/495960e5-1fad-4f40-91e4-0962570569ec-ca-trust-extracted\") pod \"image-registry-997fbf97b-x4zg5\" (UID: \"495960e5-1fad-4f40-91e4-0962570569ec\") " pod="openshift-image-registry/image-registry-997fbf97b-x4zg5" Jun 09 13:27:00.795598 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.795558 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/495960e5-1fad-4f40-91e4-0962570569ec-registry-certificates\") pod \"image-registry-997fbf97b-x4zg5\" (UID: \"495960e5-1fad-4f40-91e4-0962570569ec\") " pod="openshift-image-registry/image-registry-997fbf97b-x4zg5" Jun 09 13:27:00.795598 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.795586 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/495960e5-1fad-4f40-91e4-0962570569ec-installation-pull-secrets\") pod \"image-registry-997fbf97b-x4zg5\" (UID: \"495960e5-1fad-4f40-91e4-0962570569ec\") " pod="openshift-image-registry/image-registry-997fbf97b-x4zg5" Jun 09 13:27:00.795781 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.795638 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8f7fd79-6891-4136-ae3a-03ed6d7c4d96-tmp-dir\") pod \"dns-default-hzv2v\" (UID: \"c8f7fd79-6891-4136-ae3a-03ed6d7c4d96\") " pod="openshift-dns/dns-default-hzv2v" Jun 09 13:27:00.795781 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.795676 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cssh4\" (UniqueName: \"kubernetes.io/projected/495960e5-1fad-4f40-91e4-0962570569ec-kube-api-access-cssh4\") pod \"image-registry-997fbf97b-x4zg5\" (UID: \"495960e5-1fad-4f40-91e4-0962570569ec\") " pod="openshift-image-registry/image-registry-997fbf97b-x4zg5" Jun 09 13:27:00.795781 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.795695 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c8f7fd79-6891-4136-ae3a-03ed6d7c4d96-config-volume\") pod \"dns-default-hzv2v\" (UID: \"c8f7fd79-6891-4136-ae3a-03ed6d7c4d96\") " pod="openshift-dns/dns-default-hzv2v" Jun 09 13:27:00.896402 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.896363 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/495960e5-1fad-4f40-91e4-0962570569ec-ca-trust-extracted\") pod \"image-registry-997fbf97b-x4zg5\" (UID: \"495960e5-1fad-4f40-91e4-0962570569ec\") " pod="openshift-image-registry/image-registry-997fbf97b-x4zg5" Jun 09 13:27:00.896550 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.896412 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/495960e5-1fad-4f40-91e4-0962570569ec-registry-certificates\") pod \"image-registry-997fbf97b-x4zg5\" (UID: \"495960e5-1fad-4f40-91e4-0962570569ec\") " pod="openshift-image-registry/image-registry-997fbf97b-x4zg5" Jun 09 13:27:00.896550 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.896447 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/495960e5-1fad-4f40-91e4-0962570569ec-installation-pull-secrets\") pod \"image-registry-997fbf97b-x4zg5\" (UID: \"495960e5-1fad-4f40-91e4-0962570569ec\") " pod="openshift-image-registry/image-registry-997fbf97b-x4zg5" Jun 09 13:27:00.896550 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.896496 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8f7fd79-6891-4136-ae3a-03ed6d7c4d96-tmp-dir\") pod \"dns-default-hzv2v\" (UID: \"c8f7fd79-6891-4136-ae3a-03ed6d7c4d96\") " pod="openshift-dns/dns-default-hzv2v" Jun 09 13:27:00.896550 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.896539 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cssh4\" (UniqueName: \"kubernetes.io/projected/495960e5-1fad-4f40-91e4-0962570569ec-kube-api-access-cssh4\") pod \"image-registry-997fbf97b-x4zg5\" (UID: \"495960e5-1fad-4f40-91e4-0962570569ec\") " pod="openshift-image-registry/image-registry-997fbf97b-x4zg5" Jun 09 13:27:00.896902 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.896563 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c8f7fd79-6891-4136-ae3a-03ed6d7c4d96-config-volume\") pod \"dns-default-hzv2v\" (UID: \"c8f7fd79-6891-4136-ae3a-03ed6d7c4d96\") " pod="openshift-dns/dns-default-hzv2v" Jun 09 13:27:00.896902 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.896691 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8c588445-d514-4c1c-a4b4-b1a0f03728fd-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-qvkpz\" (UID: \"8c588445-d514-4c1c-a4b4-b1a0f03728fd\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qvkpz" Jun 09 13:27:00.896902 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.896744 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8f7fd79-6891-4136-ae3a-03ed6d7c4d96-metrics-tls\") pod \"dns-default-hzv2v\" (UID: \"c8f7fd79-6891-4136-ae3a-03ed6d7c4d96\") " pod="openshift-dns/dns-default-hzv2v" Jun 09 13:27:00.896902 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.896774 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/495960e5-1fad-4f40-91e4-0962570569ec-trusted-ca\") pod \"image-registry-997fbf97b-x4zg5\" (UID: \"495960e5-1fad-4f40-91e4-0962570569ec\") " pod="openshift-image-registry/image-registry-997fbf97b-x4zg5" Jun 09 13:27:00.896902 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.896797 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/495960e5-1fad-4f40-91e4-0962570569ec-bound-sa-token\") pod \"image-registry-997fbf97b-x4zg5\" (UID: \"495960e5-1fad-4f40-91e4-0962570569ec\") " pod="openshift-image-registry/image-registry-997fbf97b-x4zg5" Jun 09 13:27:00.896902 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.896821 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48kpk\" (UniqueName: \"kubernetes.io/projected/c8f7fd79-6891-4136-ae3a-03ed6d7c4d96-kube-api-access-48kpk\") pod \"dns-default-hzv2v\" (UID: \"c8f7fd79-6891-4136-ae3a-03ed6d7c4d96\") " pod="openshift-dns/dns-default-hzv2v" Jun 09 13:27:00.896902 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.896822 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/495960e5-1fad-4f40-91e4-0962570569ec-ca-trust-extracted\") pod \"image-registry-997fbf97b-x4zg5\" (UID: \"495960e5-1fad-4f40-91e4-0962570569ec\") " pod="openshift-image-registry/image-registry-997fbf97b-x4zg5" Jun 09 13:27:00.896902 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.896851 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/495960e5-1fad-4f40-91e4-0962570569ec-registry-tls\") pod \"image-registry-997fbf97b-x4zg5\" (UID: \"495960e5-1fad-4f40-91e4-0962570569ec\") " pod="openshift-image-registry/image-registry-997fbf97b-x4zg5" Jun 09 13:27:00.896902 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.896878 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8c588445-d514-4c1c-a4b4-b1a0f03728fd-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-qvkpz\" (UID: \"8c588445-d514-4c1c-a4b4-b1a0f03728fd\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qvkpz" Jun 09 13:27:00.896902 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.896893 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8f7fd79-6891-4136-ae3a-03ed6d7c4d96-tmp-dir\") pod \"dns-default-hzv2v\" (UID: \"c8f7fd79-6891-4136-ae3a-03ed6d7c4d96\") " pod="openshift-dns/dns-default-hzv2v" Jun 09 13:27:00.897328 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.896915 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/af72438c-c400-45ba-941f-94637383ca93-cert\") pod \"ingress-canary-bsxfs\" (UID: \"af72438c-c400-45ba-941f-94637383ca93\") " pod="openshift-ingress-canary/ingress-canary-bsxfs" Jun 09 13:27:00.897328 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:27:00.896925 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 13:27:00.897328 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:27:00.896981 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8f7fd79-6891-4136-ae3a-03ed6d7c4d96-metrics-tls podName:c8f7fd79-6891-4136-ae3a-03ed6d7c4d96 nodeName:}" failed. No retries permitted until 2026-06-09 13:27:01.396963379 +0000 UTC m=+36.097238309 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c8f7fd79-6891-4136-ae3a-03ed6d7c4d96-metrics-tls") pod "dns-default-hzv2v" (UID: "c8f7fd79-6891-4136-ae3a-03ed6d7c4d96") : secret "dns-default-metrics-tls" not found Jun 09 13:27:00.897328 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.897022 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbbj5\" (UniqueName: \"kubernetes.io/projected/af72438c-c400-45ba-941f-94637383ca93-kube-api-access-qbbj5\") pod \"ingress-canary-bsxfs\" (UID: \"af72438c-c400-45ba-941f-94637383ca93\") " pod="openshift-ingress-canary/ingress-canary-bsxfs" Jun 09 13:27:00.897328 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.897053 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/495960e5-1fad-4f40-91e4-0962570569ec-image-registry-private-configuration\") pod \"image-registry-997fbf97b-x4zg5\" (UID: \"495960e5-1fad-4f40-91e4-0962570569ec\") " pod="openshift-image-registry/image-registry-997fbf97b-x4zg5" Jun 09 13:27:00.897328 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.897073 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/495960e5-1fad-4f40-91e4-0962570569ec-registry-certificates\") pod \"image-registry-997fbf97b-x4zg5\" (UID: \"495960e5-1fad-4f40-91e4-0962570569ec\") " pod="openshift-image-registry/image-registry-997fbf97b-x4zg5" Jun 09 13:27:00.897328 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.897205 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c8f7fd79-6891-4136-ae3a-03ed6d7c4d96-config-volume\") pod \"dns-default-hzv2v\" (UID: \"c8f7fd79-6891-4136-ae3a-03ed6d7c4d96\") " pod="openshift-dns/dns-default-hzv2v" Jun 09 13:27:00.897328 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:27:00.897026 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 13:27:00.897328 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:27:00.897304 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c588445-d514-4c1c-a4b4-b1a0f03728fd-networking-console-plugin-cert podName:8c588445-d514-4c1c-a4b4-b1a0f03728fd nodeName:}" failed. No retries permitted until 2026-06-09 13:27:01.397283051 +0000 UTC m=+36.097557983 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8c588445-d514-4c1c-a4b4-b1a0f03728fd-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-qvkpz" (UID: "8c588445-d514-4c1c-a4b4-b1a0f03728fd") : secret "networking-console-plugin-cert" not found Jun 09 13:27:00.897723 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:27:00.897393 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 13:27:00.897723 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:27:00.897411 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-997fbf97b-x4zg5: secret "image-registry-tls" not found Jun 09 13:27:00.897723 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:27:00.897464 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/495960e5-1fad-4f40-91e4-0962570569ec-registry-tls podName:495960e5-1fad-4f40-91e4-0962570569ec nodeName:}" failed. No retries permitted until 2026-06-09 13:27:01.397447572 +0000 UTC m=+36.097722522 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/495960e5-1fad-4f40-91e4-0962570569ec-registry-tls") pod "image-registry-997fbf97b-x4zg5" (UID: "495960e5-1fad-4f40-91e4-0962570569ec") : secret "image-registry-tls" not found Jun 09 13:27:00.898010 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.897989 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/495960e5-1fad-4f40-91e4-0962570569ec-trusted-ca\") pod \"image-registry-997fbf97b-x4zg5\" (UID: \"495960e5-1fad-4f40-91e4-0962570569ec\") " pod="openshift-image-registry/image-registry-997fbf97b-x4zg5" Jun 09 13:27:00.898091 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.898055 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8c588445-d514-4c1c-a4b4-b1a0f03728fd-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-qvkpz\" (UID: \"8c588445-d514-4c1c-a4b4-b1a0f03728fd\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qvkpz" Jun 09 13:27:00.901468 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.901447 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/495960e5-1fad-4f40-91e4-0962570569ec-installation-pull-secrets\") pod \"image-registry-997fbf97b-x4zg5\" (UID: \"495960e5-1fad-4f40-91e4-0962570569ec\") " pod="openshift-image-registry/image-registry-997fbf97b-x4zg5" Jun 09 13:27:00.901468 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.901454 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/495960e5-1fad-4f40-91e4-0962570569ec-image-registry-private-configuration\") pod \"image-registry-997fbf97b-x4zg5\" (UID: \"495960e5-1fad-4f40-91e4-0962570569ec\") " pod="openshift-image-registry/image-registry-997fbf97b-x4zg5" Jun 09 13:27:00.901641 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.901552 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/af72438c-c400-45ba-941f-94637383ca93-cert\") pod \"ingress-canary-bsxfs\" (UID: \"af72438c-c400-45ba-941f-94637383ca93\") " pod="openshift-ingress-canary/ingress-canary-bsxfs" Jun 09 13:27:00.905746 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.905703 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cssh4\" (UniqueName: \"kubernetes.io/projected/495960e5-1fad-4f40-91e4-0962570569ec-kube-api-access-cssh4\") pod \"image-registry-997fbf97b-x4zg5\" (UID: \"495960e5-1fad-4f40-91e4-0962570569ec\") " pod="openshift-image-registry/image-registry-997fbf97b-x4zg5" Jun 09 13:27:00.906617 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.906597 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-48kpk\" (UniqueName: \"kubernetes.io/projected/c8f7fd79-6891-4136-ae3a-03ed6d7c4d96-kube-api-access-48kpk\") pod \"dns-default-hzv2v\" (UID: \"c8f7fd79-6891-4136-ae3a-03ed6d7c4d96\") " pod="openshift-dns/dns-default-hzv2v" Jun 09 13:27:00.907039 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.907014 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/495960e5-1fad-4f40-91e4-0962570569ec-bound-sa-token\") pod \"image-registry-997fbf97b-x4zg5\" (UID: \"495960e5-1fad-4f40-91e4-0962570569ec\") " pod="openshift-image-registry/image-registry-997fbf97b-x4zg5" Jun 09 13:27:00.907235 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.907161 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbbj5\" (UniqueName: \"kubernetes.io/projected/af72438c-c400-45ba-941f-94637383ca93-kube-api-access-qbbj5\") pod \"ingress-canary-bsxfs\" (UID: \"af72438c-c400-45ba-941f-94637383ca93\") " pod="openshift-ingress-canary/ingress-canary-bsxfs" Jun 09 13:27:00.996200 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:00.996153 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bsxfs" Jun 09 13:27:01.155228 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:01.155170 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bsxfs"] Jun 09 13:27:01.159812 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:27:01.159789 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf72438c_c400_45ba_941f_94637383ca93.slice/crio-14dbb81888a2d48b39c2964ecca3431946f96365775888ce2fe72d7aeb5c62b7 WatchSource:0}: Error finding container 14dbb81888a2d48b39c2964ecca3431946f96365775888ce2fe72d7aeb5c62b7: Status 404 returned error can't find the container with id 14dbb81888a2d48b39c2964ecca3431946f96365775888ce2fe72d7aeb5c62b7 Jun 09 13:27:01.401470 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:01.401432 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8c588445-d514-4c1c-a4b4-b1a0f03728fd-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-qvkpz\" (UID: \"8c588445-d514-4c1c-a4b4-b1a0f03728fd\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qvkpz" Jun 09 13:27:01.401470 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:01.401469 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8f7fd79-6891-4136-ae3a-03ed6d7c4d96-metrics-tls\") pod \"dns-default-hzv2v\" (UID: \"c8f7fd79-6891-4136-ae3a-03ed6d7c4d96\") " pod="openshift-dns/dns-default-hzv2v" Jun 09 13:27:01.401677 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:01.401490 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/495960e5-1fad-4f40-91e4-0962570569ec-registry-tls\") pod \"image-registry-997fbf97b-x4zg5\" (UID: \"495960e5-1fad-4f40-91e4-0962570569ec\") " pod="openshift-image-registry/image-registry-997fbf97b-x4zg5" Jun 09 13:27:01.401677 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:27:01.401590 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 13:27:01.401677 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:27:01.401602 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-997fbf97b-x4zg5: secret "image-registry-tls" not found Jun 09 13:27:01.401677 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:27:01.401655 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/495960e5-1fad-4f40-91e4-0962570569ec-registry-tls podName:495960e5-1fad-4f40-91e4-0962570569ec nodeName:}" failed. No retries permitted until 2026-06-09 13:27:02.40164244 +0000 UTC m=+37.101917358 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/495960e5-1fad-4f40-91e4-0962570569ec-registry-tls") pod "image-registry-997fbf97b-x4zg5" (UID: "495960e5-1fad-4f40-91e4-0962570569ec") : secret "image-registry-tls" not found Jun 09 13:27:01.401677 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:27:01.401589 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 13:27:01.401893 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:27:01.401729 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8f7fd79-6891-4136-ae3a-03ed6d7c4d96-metrics-tls podName:c8f7fd79-6891-4136-ae3a-03ed6d7c4d96 nodeName:}" failed. No retries permitted until 2026-06-09 13:27:02.401712495 +0000 UTC m=+37.101987441 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c8f7fd79-6891-4136-ae3a-03ed6d7c4d96-metrics-tls") pod "dns-default-hzv2v" (UID: "c8f7fd79-6891-4136-ae3a-03ed6d7c4d96") : secret "dns-default-metrics-tls" not found Jun 09 13:27:01.401893 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:27:01.401589 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 13:27:01.401893 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:27:01.401780 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c588445-d514-4c1c-a4b4-b1a0f03728fd-networking-console-plugin-cert podName:8c588445-d514-4c1c-a4b4-b1a0f03728fd nodeName:}" failed. No retries permitted until 2026-06-09 13:27:02.401769581 +0000 UTC m=+37.102044501 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8c588445-d514-4c1c-a4b4-b1a0f03728fd-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-qvkpz" (UID: "8c588445-d514-4c1c-a4b4-b1a0f03728fd") : secret "networking-console-plugin-cert" not found Jun 09 13:27:01.784425 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:01.784386 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kdbl8" Jun 09 13:27:01.787001 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:01.786976 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 13:27:01.787704 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:01.787680 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 13:27:01.787796 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:01.787700 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5lgxf\"" Jun 09 13:27:02.068691 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:02.068614 2577 generic.go:356] "Generic (PLEG): container finished" podID="5924b051-0215-4fc3-b719-1368c5d88226" containerID="18c689a1cf94da1b2723d77195f438dc0221ce1a07df548de83ef97b4bdfca41" exitCode=0 Jun 09 13:27:02.068691 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:02.068682 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bqwlr" event={"ID":"5924b051-0215-4fc3-b719-1368c5d88226","Type":"ContainerDied","Data":"18c689a1cf94da1b2723d77195f438dc0221ce1a07df548de83ef97b4bdfca41"} Jun 09 13:27:02.069978 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:02.069813 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bsxfs" event={"ID":"af72438c-c400-45ba-941f-94637383ca93","Type":"ContainerStarted","Data":"14dbb81888a2d48b39c2964ecca3431946f96365775888ce2fe72d7aeb5c62b7"} Jun 09 13:27:02.409843 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:02.409768 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8c588445-d514-4c1c-a4b4-b1a0f03728fd-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-qvkpz\" (UID: \"8c588445-d514-4c1c-a4b4-b1a0f03728fd\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qvkpz" Jun 09 13:27:02.409843 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:02.409805 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8f7fd79-6891-4136-ae3a-03ed6d7c4d96-metrics-tls\") pod \"dns-default-hzv2v\" (UID: \"c8f7fd79-6891-4136-ae3a-03ed6d7c4d96\") " pod="openshift-dns/dns-default-hzv2v" Jun 09 13:27:02.409843 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:02.409836 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/495960e5-1fad-4f40-91e4-0962570569ec-registry-tls\") pod \"image-registry-997fbf97b-x4zg5\" (UID: \"495960e5-1fad-4f40-91e4-0962570569ec\") " pod="openshift-image-registry/image-registry-997fbf97b-x4zg5" Jun 09 13:27:02.410108 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:27:02.409933 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 13:27:02.410108 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:27:02.409941 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 13:27:02.410108 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:27:02.409935 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 13:27:02.410108 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:27:02.410005 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c588445-d514-4c1c-a4b4-b1a0f03728fd-networking-console-plugin-cert podName:8c588445-d514-4c1c-a4b4-b1a0f03728fd nodeName:}" failed. No retries permitted until 2026-06-09 13:27:04.409984699 +0000 UTC m=+39.110259630 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8c588445-d514-4c1c-a4b4-b1a0f03728fd-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-qvkpz" (UID: "8c588445-d514-4c1c-a4b4-b1a0f03728fd") : secret "networking-console-plugin-cert" not found Jun 09 13:27:02.410108 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:27:02.410025 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8f7fd79-6891-4136-ae3a-03ed6d7c4d96-metrics-tls podName:c8f7fd79-6891-4136-ae3a-03ed6d7c4d96 nodeName:}" failed. No retries permitted until 2026-06-09 13:27:04.410015543 +0000 UTC m=+39.110290470 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c8f7fd79-6891-4136-ae3a-03ed6d7c4d96-metrics-tls") pod "dns-default-hzv2v" (UID: "c8f7fd79-6891-4136-ae3a-03ed6d7c4d96") : secret "dns-default-metrics-tls" not found Jun 09 13:27:02.410108 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:27:02.410006 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-997fbf97b-x4zg5: secret "image-registry-tls" not found Jun 09 13:27:02.410108 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:27:02.410097 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/495960e5-1fad-4f40-91e4-0962570569ec-registry-tls podName:495960e5-1fad-4f40-91e4-0962570569ec nodeName:}" failed. No retries permitted until 2026-06-09 13:27:04.4100793 +0000 UTC m=+39.110354238 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/495960e5-1fad-4f40-91e4-0962570569ec-registry-tls") pod "image-registry-997fbf97b-x4zg5" (UID: "495960e5-1fad-4f40-91e4-0962570569ec") : secret "image-registry-tls" not found Jun 09 13:27:03.075608 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:03.075571 2577 generic.go:356] "Generic (PLEG): container finished" podID="5924b051-0215-4fc3-b719-1368c5d88226" containerID="ce31a818b54b05ccddcc21c967d2463f3fd37ceda01c4a9909b9d9f73fca7145" exitCode=0 Jun 09 13:27:03.076016 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:03.075603 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bqwlr" event={"ID":"5924b051-0215-4fc3-b719-1368c5d88226","Type":"ContainerDied","Data":"ce31a818b54b05ccddcc21c967d2463f3fd37ceda01c4a9909b9d9f73fca7145"} Jun 09 13:27:04.081244 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:04.080980 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bqwlr" event={"ID":"5924b051-0215-4fc3-b719-1368c5d88226","Type":"ContainerStarted","Data":"1e2311cb572f7af77b4e082e820cd4a792e95838a80af365d0f6de1a45c4cba2"} Jun 09 13:27:04.082409 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:04.082390 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bsxfs" event={"ID":"af72438c-c400-45ba-941f-94637383ca93","Type":"ContainerStarted","Data":"26103c8f8d672670ed2d8ca27c1d4ea3cdebfb840b76c4e28c1bf0950fdbf6a4"} Jun 09 13:27:04.106120 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:04.106073 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-bqwlr" podStartSLOduration=13.658888777 podStartE2EDuration="38.106056656s" totalImagesPullingTime="24.447167879s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 13:26:26 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:27:04.104927989 +0000 UTC m=+38.805202928" watchObservedRunningTime="2026-06-09 13:27:04.106056656 +0000 UTC m=+38.806331574" Jun 09 13:27:04.131615 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:04.131568 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-bsxfs" podStartSLOduration=1.492130756 podStartE2EDuration="4.131548153s" totalImagesPullingTime="2.639417397s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:27:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:27:04.130539297 +0000 UTC m=+38.830814238" watchObservedRunningTime="2026-06-09 13:27:04.131548153 +0000 UTC m=+38.831823118" Jun 09 13:27:04.396723 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:04.396632 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h65nk_a65851db-7a9b-4f6f-a791-203591fb7e17/konnectivity-agent/0.log" limit=1024 Jun 09 13:27:04.424820 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:04.424790 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8c588445-d514-4c1c-a4b4-b1a0f03728fd-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-qvkpz\" (UID: \"8c588445-d514-4c1c-a4b4-b1a0f03728fd\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qvkpz" Jun 09 13:27:04.424964 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:04.424825 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8f7fd79-6891-4136-ae3a-03ed6d7c4d96-metrics-tls\") pod \"dns-default-hzv2v\" (UID: \"c8f7fd79-6891-4136-ae3a-03ed6d7c4d96\") " pod="openshift-dns/dns-default-hzv2v" Jun 09 13:27:04.424964 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:04.424847 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/495960e5-1fad-4f40-91e4-0962570569ec-registry-tls\") pod \"image-registry-997fbf97b-x4zg5\" (UID: \"495960e5-1fad-4f40-91e4-0962570569ec\") " pod="openshift-image-registry/image-registry-997fbf97b-x4zg5" Jun 09 13:27:04.424964 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:27:04.424933 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 13:27:04.424964 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:27:04.424940 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 13:27:04.425166 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:27:04.425023 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8f7fd79-6891-4136-ae3a-03ed6d7c4d96-metrics-tls podName:c8f7fd79-6891-4136-ae3a-03ed6d7c4d96 nodeName:}" failed. No retries permitted until 2026-06-09 13:27:08.425000975 +0000 UTC m=+43.125275894 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c8f7fd79-6891-4136-ae3a-03ed6d7c4d96-metrics-tls") pod "dns-default-hzv2v" (UID: "c8f7fd79-6891-4136-ae3a-03ed6d7c4d96") : secret "dns-default-metrics-tls" not found Jun 09 13:27:04.425166 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:27:04.424948 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-997fbf97b-x4zg5: secret "image-registry-tls" not found Jun 09 13:27:04.425166 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:27:04.425076 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/495960e5-1fad-4f40-91e4-0962570569ec-registry-tls podName:495960e5-1fad-4f40-91e4-0962570569ec nodeName:}" failed. No retries permitted until 2026-06-09 13:27:08.425065199 +0000 UTC m=+43.125340116 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/495960e5-1fad-4f40-91e4-0962570569ec-registry-tls") pod "image-registry-997fbf97b-x4zg5" (UID: "495960e5-1fad-4f40-91e4-0962570569ec") : secret "image-registry-tls" not found Jun 09 13:27:04.425166 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:27:04.424932 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 13:27:04.425166 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:27:04.425104 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c588445-d514-4c1c-a4b4-b1a0f03728fd-networking-console-plugin-cert podName:8c588445-d514-4c1c-a4b4-b1a0f03728fd nodeName:}" failed. No retries permitted until 2026-06-09 13:27:08.425097733 +0000 UTC m=+43.125372650 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8c588445-d514-4c1c-a4b4-b1a0f03728fd-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-qvkpz" (UID: "8c588445-d514-4c1c-a4b4-b1a0f03728fd") : secret "networking-console-plugin-cert" not found Jun 09 13:27:04.486628 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:04.486585 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h65nk_a65851db-7a9b-4f6f-a791-203591fb7e17/konnectivity-agent/0.log" limit=1024 Jun 09 13:27:06.479278 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:06.479225 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h65nk_a65851db-7a9b-4f6f-a791-203591fb7e17/konnectivity-agent/0.log" limit=1024 Jun 09 13:27:06.579282 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:06.579247 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h65nk_a65851db-7a9b-4f6f-a791-203591fb7e17/konnectivity-agent/0.log" limit=1024 Jun 09 13:27:06.680280 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:06.680248 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h65nk_a65851db-7a9b-4f6f-a791-203591fb7e17/konnectivity-agent/0.log" limit=1024 Jun 09 13:27:06.842707 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:06.842670 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h65nk_a65851db-7a9b-4f6f-a791-203591fb7e17/konnectivity-agent/0.log" limit=1024 Jun 09 13:27:06.929917 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:06.929883 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h65nk_a65851db-7a9b-4f6f-a791-203591fb7e17/konnectivity-agent/0.log" limit=1024 Jun 09 13:27:07.025982 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:07.025937 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h65nk_a65851db-7a9b-4f6f-a791-203591fb7e17/konnectivity-agent/0.log" limit=1024 Jun 09 13:27:07.126249 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:07.126141 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h65nk_a65851db-7a9b-4f6f-a791-203591fb7e17/konnectivity-agent/0.log" limit=1024 Jun 09 13:27:08.456026 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:08.455985 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/495960e5-1fad-4f40-91e4-0962570569ec-registry-tls\") pod \"image-registry-997fbf97b-x4zg5\" (UID: \"495960e5-1fad-4f40-91e4-0962570569ec\") " pod="openshift-image-registry/image-registry-997fbf97b-x4zg5" Jun 09 13:27:08.456535 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:08.456076 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8c588445-d514-4c1c-a4b4-b1a0f03728fd-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-qvkpz\" (UID: \"8c588445-d514-4c1c-a4b4-b1a0f03728fd\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qvkpz" Jun 09 13:27:08.456535 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:08.456096 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8f7fd79-6891-4136-ae3a-03ed6d7c4d96-metrics-tls\") pod \"dns-default-hzv2v\" (UID: \"c8f7fd79-6891-4136-ae3a-03ed6d7c4d96\") " pod="openshift-dns/dns-default-hzv2v" Jun 09 13:27:08.456535 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:27:08.456134 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 13:27:08.456535 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:27:08.456158 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-997fbf97b-x4zg5: secret "image-registry-tls" not found Jun 09 13:27:08.456535 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:27:08.456241 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 13:27:08.456535 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:27:08.456255 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 13:27:08.456535 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:27:08.456249 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/495960e5-1fad-4f40-91e4-0962570569ec-registry-tls podName:495960e5-1fad-4f40-91e4-0962570569ec nodeName:}" failed. No retries permitted until 2026-06-09 13:27:16.45622474 +0000 UTC m=+51.156499674 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/495960e5-1fad-4f40-91e4-0962570569ec-registry-tls") pod "image-registry-997fbf97b-x4zg5" (UID: "495960e5-1fad-4f40-91e4-0962570569ec") : secret "image-registry-tls" not found Jun 09 13:27:08.456535 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:27:08.456302 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8f7fd79-6891-4136-ae3a-03ed6d7c4d96-metrics-tls podName:c8f7fd79-6891-4136-ae3a-03ed6d7c4d96 nodeName:}" failed. No retries permitted until 2026-06-09 13:27:16.456285922 +0000 UTC m=+51.156560852 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c8f7fd79-6891-4136-ae3a-03ed6d7c4d96-metrics-tls") pod "dns-default-hzv2v" (UID: "c8f7fd79-6891-4136-ae3a-03ed6d7c4d96") : secret "dns-default-metrics-tls" not found Jun 09 13:27:08.456535 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:27:08.456316 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c588445-d514-4c1c-a4b4-b1a0f03728fd-networking-console-plugin-cert podName:8c588445-d514-4c1c-a4b4-b1a0f03728fd nodeName:}" failed. No retries permitted until 2026-06-09 13:27:16.456310581 +0000 UTC m=+51.156585499 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8c588445-d514-4c1c-a4b4-b1a0f03728fd-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-qvkpz" (UID: "8c588445-d514-4c1c-a4b4-b1a0f03728fd") : secret "networking-console-plugin-cert" not found Jun 09 13:27:16.516994 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:16.516956 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8c588445-d514-4c1c-a4b4-b1a0f03728fd-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-qvkpz\" (UID: \"8c588445-d514-4c1c-a4b4-b1a0f03728fd\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qvkpz" Jun 09 13:27:16.516994 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:16.517007 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8f7fd79-6891-4136-ae3a-03ed6d7c4d96-metrics-tls\") pod \"dns-default-hzv2v\" (UID: \"c8f7fd79-6891-4136-ae3a-03ed6d7c4d96\") " pod="openshift-dns/dns-default-hzv2v" Jun 09 13:27:16.517747 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:16.517038 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/495960e5-1fad-4f40-91e4-0962570569ec-registry-tls\") pod \"image-registry-997fbf97b-x4zg5\" (UID: \"495960e5-1fad-4f40-91e4-0962570569ec\") " pod="openshift-image-registry/image-registry-997fbf97b-x4zg5" Jun 09 13:27:16.517747 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:27:16.517117 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 13:27:16.517747 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:27:16.517171 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 13:27:16.517747 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:27:16.517204 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-997fbf97b-x4zg5: secret "image-registry-tls" not found Jun 09 13:27:16.517747 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:27:16.517177 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8f7fd79-6891-4136-ae3a-03ed6d7c4d96-metrics-tls podName:c8f7fd79-6891-4136-ae3a-03ed6d7c4d96 nodeName:}" failed. No retries permitted until 2026-06-09 13:27:32.517162129 +0000 UTC m=+67.217437047 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c8f7fd79-6891-4136-ae3a-03ed6d7c4d96-metrics-tls") pod "dns-default-hzv2v" (UID: "c8f7fd79-6891-4136-ae3a-03ed6d7c4d96") : secret "dns-default-metrics-tls" not found Jun 09 13:27:16.517747 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:27:16.517250 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/495960e5-1fad-4f40-91e4-0962570569ec-registry-tls podName:495960e5-1fad-4f40-91e4-0962570569ec nodeName:}" failed. No retries permitted until 2026-06-09 13:27:32.517234727 +0000 UTC m=+67.217509663 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/495960e5-1fad-4f40-91e4-0962570569ec-registry-tls") pod "image-registry-997fbf97b-x4zg5" (UID: "495960e5-1fad-4f40-91e4-0962570569ec") : secret "image-registry-tls" not found Jun 09 13:27:16.517747 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:27:16.517116 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 13:27:16.517747 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:27:16.517286 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c588445-d514-4c1c-a4b4-b1a0f03728fd-networking-console-plugin-cert podName:8c588445-d514-4c1c-a4b4-b1a0f03728fd nodeName:}" failed. No retries permitted until 2026-06-09 13:27:32.51727821 +0000 UTC m=+67.217553159 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8c588445-d514-4c1c-a4b4-b1a0f03728fd-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-qvkpz" (UID: "8c588445-d514-4c1c-a4b4-b1a0f03728fd") : secret "networking-console-plugin-cert" not found Jun 09 13:27:27.063397 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:27.063368 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rcxgh" Jun 09 13:27:30.903643 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:30.903607 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fbf464cc6-zrhrd"] Jun 09 13:27:30.909322 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:30.909302 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fbf464cc6-zrhrd" Jun 09 13:27:30.912562 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:30.912540 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 09 13:27:30.912825 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:30.912805 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 09 13:27:30.912889 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:30.912805 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 09 13:27:30.913519 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:30.913501 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 09 13:27:30.918419 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:30.918391 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fbf464cc6-zrhrd"] Jun 09 13:27:31.023623 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:31.023584 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/211fd49b-3ec3-41c3-a403-52d769643b01-tmp\") pod \"klusterlet-addon-workmgr-7fbf464cc6-zrhrd\" (UID: \"211fd49b-3ec3-41c3-a403-52d769643b01\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fbf464cc6-zrhrd" Jun 09 13:27:31.023797 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:31.023641 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8csd5\" (UniqueName: \"kubernetes.io/projected/211fd49b-3ec3-41c3-a403-52d769643b01-kube-api-access-8csd5\") pod \"klusterlet-addon-workmgr-7fbf464cc6-zrhrd\" (UID: \"211fd49b-3ec3-41c3-a403-52d769643b01\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fbf464cc6-zrhrd" Jun 09 13:27:31.023797 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:31.023672 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/211fd49b-3ec3-41c3-a403-52d769643b01-klusterlet-config\") pod \"klusterlet-addon-workmgr-7fbf464cc6-zrhrd\" (UID: \"211fd49b-3ec3-41c3-a403-52d769643b01\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fbf464cc6-zrhrd" Jun 09 13:27:31.124247 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:31.124208 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/211fd49b-3ec3-41c3-a403-52d769643b01-tmp\") pod \"klusterlet-addon-workmgr-7fbf464cc6-zrhrd\" (UID: \"211fd49b-3ec3-41c3-a403-52d769643b01\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fbf464cc6-zrhrd" Jun 09 13:27:31.124404 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:31.124264 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8csd5\" (UniqueName: \"kubernetes.io/projected/211fd49b-3ec3-41c3-a403-52d769643b01-kube-api-access-8csd5\") pod \"klusterlet-addon-workmgr-7fbf464cc6-zrhrd\" (UID: \"211fd49b-3ec3-41c3-a403-52d769643b01\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fbf464cc6-zrhrd" Jun 09 13:27:31.124404 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:31.124289 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/211fd49b-3ec3-41c3-a403-52d769643b01-klusterlet-config\") pod \"klusterlet-addon-workmgr-7fbf464cc6-zrhrd\" (UID: \"211fd49b-3ec3-41c3-a403-52d769643b01\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fbf464cc6-zrhrd" Jun 09 13:27:31.124688 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:31.124667 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/211fd49b-3ec3-41c3-a403-52d769643b01-tmp\") pod \"klusterlet-addon-workmgr-7fbf464cc6-zrhrd\" (UID: \"211fd49b-3ec3-41c3-a403-52d769643b01\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fbf464cc6-zrhrd" Jun 09 13:27:31.128590 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:31.128566 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/211fd49b-3ec3-41c3-a403-52d769643b01-klusterlet-config\") pod \"klusterlet-addon-workmgr-7fbf464cc6-zrhrd\" (UID: \"211fd49b-3ec3-41c3-a403-52d769643b01\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fbf464cc6-zrhrd" Jun 09 13:27:31.133238 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:31.133217 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8csd5\" (UniqueName: \"kubernetes.io/projected/211fd49b-3ec3-41c3-a403-52d769643b01-kube-api-access-8csd5\") pod \"klusterlet-addon-workmgr-7fbf464cc6-zrhrd\" (UID: \"211fd49b-3ec3-41c3-a403-52d769643b01\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fbf464cc6-zrhrd" Jun 09 13:27:31.219265 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:31.219163 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fbf464cc6-zrhrd" Jun 09 13:27:31.358492 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:31.358458 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fbf464cc6-zrhrd"] Jun 09 13:27:31.527965 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:31.527929 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/679c37d9-6d86-41eb-aac4-073d70f2c285-original-pull-secret\") pod \"global-pull-secret-syncer-9wk4n\" (UID: \"679c37d9-6d86-41eb-aac4-073d70f2c285\") " pod="kube-system/global-pull-secret-syncer-9wk4n" Jun 09 13:27:31.528155 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:31.527990 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ee23738-5173-4f32-83d2-4f47140592b3-metrics-certs\") pod \"network-metrics-daemon-s8xkw\" (UID: \"5ee23738-5173-4f32-83d2-4f47140592b3\") " pod="openshift-multus/network-metrics-daemon-s8xkw" Jun 09 13:27:31.530653 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:31.530635 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 13:27:31.530765 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:31.530635 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 13:27:31.538613 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:27:31.538596 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 13:27:31.538707 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:27:31.538696 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ee23738-5173-4f32-83d2-4f47140592b3-metrics-certs podName:5ee23738-5173-4f32-83d2-4f47140592b3 nodeName:}" failed. No retries permitted until 2026-06-09 13:28:35.538674539 +0000 UTC m=+130.238949464 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5ee23738-5173-4f32-83d2-4f47140592b3-metrics-certs") pod "network-metrics-daemon-s8xkw" (UID: "5ee23738-5173-4f32-83d2-4f47140592b3") : secret "metrics-daemon-secret" not found Jun 09 13:27:31.540809 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:31.540793 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/679c37d9-6d86-41eb-aac4-073d70f2c285-original-pull-secret\") pod \"global-pull-secret-syncer-9wk4n\" (UID: \"679c37d9-6d86-41eb-aac4-073d70f2c285\") " pod="kube-system/global-pull-secret-syncer-9wk4n" Jun 09 13:27:31.696139 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:31.696100 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9wk4n" Jun 09 13:27:31.729715 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:31.729688 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wvdt\" (UniqueName: \"kubernetes.io/projected/a9ecc5cb-87e0-4daa-9cc4-156dd0952402-kube-api-access-8wvdt\") pod \"network-check-target-kdbl8\" (UID: \"a9ecc5cb-87e0-4daa-9cc4-156dd0952402\") " pod="openshift-network-diagnostics/network-check-target-kdbl8" Jun 09 13:27:31.732303 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:31.732283 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 13:27:31.742464 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:31.742443 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 13:27:31.753273 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:31.753246 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wvdt\" (UniqueName: \"kubernetes.io/projected/a9ecc5cb-87e0-4daa-9cc4-156dd0952402-kube-api-access-8wvdt\") pod \"network-check-target-kdbl8\" (UID: \"a9ecc5cb-87e0-4daa-9cc4-156dd0952402\") " pod="openshift-network-diagnostics/network-check-target-kdbl8" Jun 09 13:27:31.798351 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:31.798313 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5lgxf\"" Jun 09 13:27:31.806123 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:31.806089 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kdbl8" Jun 09 13:27:31.835017 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:31.834982 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9wk4n"] Jun 09 13:27:31.838136 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:27:31.838096 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod679c37d9_6d86_41eb_aac4_073d70f2c285.slice/crio-893158aa9d282f2e26a619cf21329c2b8b81aaf3ed2e4e6dd398fac639dcceca WatchSource:0}: Error finding container 893158aa9d282f2e26a619cf21329c2b8b81aaf3ed2e4e6dd398fac639dcceca: Status 404 returned error can't find the container with id 893158aa9d282f2e26a619cf21329c2b8b81aaf3ed2e4e6dd398fac639dcceca Jun 09 13:27:31.962652 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:31.962620 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kdbl8"] Jun 09 13:27:31.965582 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:27:31.965543 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9ecc5cb_87e0_4daa_9cc4_156dd0952402.slice/crio-1307a8e0d67fcb201bc7cef6a6fe2f5685b8d964b1c4dba416c83c4b484d8c0a WatchSource:0}: Error finding container 1307a8e0d67fcb201bc7cef6a6fe2f5685b8d964b1c4dba416c83c4b484d8c0a: Status 404 returned error can't find the container with id 1307a8e0d67fcb201bc7cef6a6fe2f5685b8d964b1c4dba416c83c4b484d8c0a Jun 09 13:27:32.150331 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:32.150242 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kdbl8" event={"ID":"a9ecc5cb-87e0-4daa-9cc4-156dd0952402","Type":"ContainerStarted","Data":"1307a8e0d67fcb201bc7cef6a6fe2f5685b8d964b1c4dba416c83c4b484d8c0a"} Jun 09 13:27:32.151650 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:32.151622 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fbf464cc6-zrhrd" event={"ID":"211fd49b-3ec3-41c3-a403-52d769643b01","Type":"ContainerStarted","Data":"080da39a8d4ab37c848812ee631c679fa7e0b01772b8e4ef16c7675effa4f2aa"} Jun 09 13:27:32.152893 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:32.152864 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9wk4n" event={"ID":"679c37d9-6d86-41eb-aac4-073d70f2c285","Type":"ContainerStarted","Data":"893158aa9d282f2e26a619cf21329c2b8b81aaf3ed2e4e6dd398fac639dcceca"} Jun 09 13:27:32.537686 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:32.537353 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8c588445-d514-4c1c-a4b4-b1a0f03728fd-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-qvkpz\" (UID: \"8c588445-d514-4c1c-a4b4-b1a0f03728fd\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qvkpz" Jun 09 13:27:32.537686 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:32.537402 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8f7fd79-6891-4136-ae3a-03ed6d7c4d96-metrics-tls\") pod \"dns-default-hzv2v\" (UID: \"c8f7fd79-6891-4136-ae3a-03ed6d7c4d96\") " pod="openshift-dns/dns-default-hzv2v" Jun 09 13:27:32.537686 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:32.537479 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/495960e5-1fad-4f40-91e4-0962570569ec-registry-tls\") pod \"image-registry-997fbf97b-x4zg5\" (UID: \"495960e5-1fad-4f40-91e4-0962570569ec\") " pod="openshift-image-registry/image-registry-997fbf97b-x4zg5" Jun 09 13:27:32.537686 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:27:32.537547 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 13:27:32.537686 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:27:32.537651 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c588445-d514-4c1c-a4b4-b1a0f03728fd-networking-console-plugin-cert podName:8c588445-d514-4c1c-a4b4-b1a0f03728fd nodeName:}" failed. No retries permitted until 2026-06-09 13:28:04.537629822 +0000 UTC m=+99.237904745 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8c588445-d514-4c1c-a4b4-b1a0f03728fd-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-qvkpz" (UID: "8c588445-d514-4c1c-a4b4-b1a0f03728fd") : secret "networking-console-plugin-cert" not found Jun 09 13:27:32.537686 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:27:32.537717 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 13:27:32.538145 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:27:32.537737 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-997fbf97b-x4zg5: secret "image-registry-tls" not found Jun 09 13:27:32.538145 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:27:32.537791 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/495960e5-1fad-4f40-91e4-0962570569ec-registry-tls podName:495960e5-1fad-4f40-91e4-0962570569ec nodeName:}" failed. No retries permitted until 2026-06-09 13:28:04.537774188 +0000 UTC m=+99.238049126 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/495960e5-1fad-4f40-91e4-0962570569ec-registry-tls") pod "image-registry-997fbf97b-x4zg5" (UID: "495960e5-1fad-4f40-91e4-0962570569ec") : secret "image-registry-tls" not found Jun 09 13:27:32.538145 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:27:32.537825 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 13:27:32.538145 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:27:32.537861 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8f7fd79-6891-4136-ae3a-03ed6d7c4d96-metrics-tls podName:c8f7fd79-6891-4136-ae3a-03ed6d7c4d96 nodeName:}" failed. No retries permitted until 2026-06-09 13:28:04.537849716 +0000 UTC m=+99.238124641 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c8f7fd79-6891-4136-ae3a-03ed6d7c4d96-metrics-tls") pod "dns-default-hzv2v" (UID: "c8f7fd79-6891-4136-ae3a-03ed6d7c4d96") : secret "dns-default-metrics-tls" not found Jun 09 13:27:37.170812 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:37.170771 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kdbl8" event={"ID":"a9ecc5cb-87e0-4daa-9cc4-156dd0952402","Type":"ContainerStarted","Data":"3ab7270a4a3524423cd180b61ed9d5bd49a4a1d13658ba4f4f138848cf553013"} Jun 09 13:27:37.171329 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:37.170855 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-kdbl8" Jun 09 13:27:37.172261 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:37.172238 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fbf464cc6-zrhrd" event={"ID":"211fd49b-3ec3-41c3-a403-52d769643b01","Type":"ContainerStarted","Data":"831ea98843abd2e6cecfa098b16b46d3e3755bd6435fc6ba6721ff8d035c60b3"} Jun 09 13:27:37.172433 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:37.172423 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fbf464cc6-zrhrd" Jun 09 13:27:37.174978 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:37.174953 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fbf464cc6-zrhrd" Jun 09 13:27:37.186969 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:37.186916 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-kdbl8" podStartSLOduration=66.534416088 podStartE2EDuration="1m11.186900801s" totalImagesPullingTime="4.652484713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:26:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:27:37.186495357 +0000 UTC m=+71.886770300" watchObservedRunningTime="2026-06-09 13:27:37.186900801 +0000 UTC m=+71.887175741" Jun 09 13:27:37.201240 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:37.201165 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fbf464cc6-zrhrd" podStartSLOduration=1.932788873 podStartE2EDuration="7.201147933s" totalImagesPullingTime="5.26835906s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:27:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:27:37.200239013 +0000 UTC m=+71.900513952" watchObservedRunningTime="2026-06-09 13:27:37.201147933 +0000 UTC m=+71.901422872" Jun 09 13:27:39.179048 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:39.179011 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9wk4n" event={"ID":"679c37d9-6d86-41eb-aac4-073d70f2c285","Type":"ContainerStarted","Data":"243a60dd7bbd95ceecbfa54eefb42626b45490ad9ca329a646e8ca4c31d0ff98"} Jun 09 13:27:39.194997 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:27:39.194939 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9wk4n" podStartSLOduration=65.992693387 podStartE2EDuration="1m13.194919765s" totalImagesPullingTime="7.202226378s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 13:26:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:27:39.194325973 +0000 UTC m=+73.894600945" watchObservedRunningTime="2026-06-09 13:27:39.194919765 +0000 UTC m=+73.895194715" Jun 09 13:28:04.586892 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:28:04.586842 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8c588445-d514-4c1c-a4b4-b1a0f03728fd-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-qvkpz\" (UID: \"8c588445-d514-4c1c-a4b4-b1a0f03728fd\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qvkpz" Jun 09 13:28:04.586892 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:28:04.586890 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8f7fd79-6891-4136-ae3a-03ed6d7c4d96-metrics-tls\") pod \"dns-default-hzv2v\" (UID: \"c8f7fd79-6891-4136-ae3a-03ed6d7c4d96\") " pod="openshift-dns/dns-default-hzv2v" Jun 09 13:28:04.586892 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:28:04.586914 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/495960e5-1fad-4f40-91e4-0962570569ec-registry-tls\") pod \"image-registry-997fbf97b-x4zg5\" (UID: \"495960e5-1fad-4f40-91e4-0962570569ec\") " pod="openshift-image-registry/image-registry-997fbf97b-x4zg5" Jun 09 13:28:04.587513 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:28:04.587010 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 13:28:04.587513 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:28:04.587026 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-997fbf97b-x4zg5: secret "image-registry-tls" not found Jun 09 13:28:04.587513 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:28:04.587027 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 13:28:04.587513 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:28:04.587079 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/495960e5-1fad-4f40-91e4-0962570569ec-registry-tls podName:495960e5-1fad-4f40-91e4-0962570569ec nodeName:}" failed. No retries permitted until 2026-06-09 13:29:08.587064921 +0000 UTC m=+163.287339839 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/495960e5-1fad-4f40-91e4-0962570569ec-registry-tls") pod "image-registry-997fbf97b-x4zg5" (UID: "495960e5-1fad-4f40-91e4-0962570569ec") : secret "image-registry-tls" not found Jun 09 13:28:04.587513 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:28:04.587118 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8f7fd79-6891-4136-ae3a-03ed6d7c4d96-metrics-tls podName:c8f7fd79-6891-4136-ae3a-03ed6d7c4d96 nodeName:}" failed. No retries permitted until 2026-06-09 13:29:08.587098343 +0000 UTC m=+163.287373261 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c8f7fd79-6891-4136-ae3a-03ed6d7c4d96-metrics-tls") pod "dns-default-hzv2v" (UID: "c8f7fd79-6891-4136-ae3a-03ed6d7c4d96") : secret "dns-default-metrics-tls" not found Jun 09 13:28:04.587513 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:28:04.587009 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 13:28:04.587513 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:28:04.587161 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c588445-d514-4c1c-a4b4-b1a0f03728fd-networking-console-plugin-cert podName:8c588445-d514-4c1c-a4b4-b1a0f03728fd nodeName:}" failed. No retries permitted until 2026-06-09 13:29:08.587150477 +0000 UTC m=+163.287425396 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8c588445-d514-4c1c-a4b4-b1a0f03728fd-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-qvkpz" (UID: "8c588445-d514-4c1c-a4b4-b1a0f03728fd") : secret "networking-console-plugin-cert" not found Jun 09 13:28:08.176684 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:28:08.176658 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-kdbl8" Jun 09 13:28:35.617972 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:28:35.617936 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ee23738-5173-4f32-83d2-4f47140592b3-metrics-certs\") pod \"network-metrics-daemon-s8xkw\" (UID: \"5ee23738-5173-4f32-83d2-4f47140592b3\") " pod="openshift-multus/network-metrics-daemon-s8xkw" Jun 09 13:28:35.618509 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:28:35.618097 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 13:28:35.618509 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:28:35.618202 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ee23738-5173-4f32-83d2-4f47140592b3-metrics-certs podName:5ee23738-5173-4f32-83d2-4f47140592b3 nodeName:}" failed. No retries permitted until 2026-06-09 13:30:37.618162712 +0000 UTC m=+252.318437631 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5ee23738-5173-4f32-83d2-4f47140592b3-metrics-certs") pod "network-metrics-daemon-s8xkw" (UID: "5ee23738-5173-4f32-83d2-4f47140592b3") : secret "metrics-daemon-secret" not found Jun 09 13:29:03.672925 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:29:03.672875 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qvkpz" podUID="8c588445-d514-4c1c-a4b4-b1a0f03728fd" Jun 09 13:29:03.680056 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:29:03.680028 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-997fbf97b-x4zg5" podUID="495960e5-1fad-4f40-91e4-0962570569ec" Jun 09 13:29:03.688223 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:29:03.688172 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-hzv2v" podUID="c8f7fd79-6891-4136-ae3a-03ed6d7c4d96" Jun 09 13:29:03.801278 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:29:03.801237 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-s8xkw" podUID="5ee23738-5173-4f32-83d2-4f47140592b3" Jun 09 13:29:04.385551 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:29:04.385521 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hzv2v" Jun 09 13:29:04.385726 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:29:04.385521 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-997fbf97b-x4zg5" Jun 09 13:29:04.385726 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:29:04.385521 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qvkpz" Jun 09 13:29:08.660946 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:29:08.660892 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8c588445-d514-4c1c-a4b4-b1a0f03728fd-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-qvkpz\" (UID: \"8c588445-d514-4c1c-a4b4-b1a0f03728fd\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qvkpz" Jun 09 13:29:08.660946 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:29:08.660943 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8f7fd79-6891-4136-ae3a-03ed6d7c4d96-metrics-tls\") pod \"dns-default-hzv2v\" (UID: \"c8f7fd79-6891-4136-ae3a-03ed6d7c4d96\") " pod="openshift-dns/dns-default-hzv2v" Jun 09 13:29:08.661468 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:29:08.660963 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/495960e5-1fad-4f40-91e4-0962570569ec-registry-tls\") pod \"image-registry-997fbf97b-x4zg5\" (UID: \"495960e5-1fad-4f40-91e4-0962570569ec\") " pod="openshift-image-registry/image-registry-997fbf97b-x4zg5" Jun 09 13:29:08.661468 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:29:08.661049 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 13:29:08.661468 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:29:08.661061 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-997fbf97b-x4zg5: secret "image-registry-tls" not found Jun 09 13:29:08.661468 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:29:08.661104 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/495960e5-1fad-4f40-91e4-0962570569ec-registry-tls podName:495960e5-1fad-4f40-91e4-0962570569ec nodeName:}" failed. No retries permitted until 2026-06-09 13:31:10.661090979 +0000 UTC m=+285.361365897 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/495960e5-1fad-4f40-91e4-0962570569ec-registry-tls") pod "image-registry-997fbf97b-x4zg5" (UID: "495960e5-1fad-4f40-91e4-0962570569ec") : secret "image-registry-tls" not found Jun 09 13:29:08.661468 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:29:08.661048 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 13:29:08.661468 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:29:08.661049 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 13:29:08.661468 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:29:08.661210 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8f7fd79-6891-4136-ae3a-03ed6d7c4d96-metrics-tls podName:c8f7fd79-6891-4136-ae3a-03ed6d7c4d96 nodeName:}" failed. No retries permitted until 2026-06-09 13:31:10.66117344 +0000 UTC m=+285.361448358 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c8f7fd79-6891-4136-ae3a-03ed6d7c4d96-metrics-tls") pod "dns-default-hzv2v" (UID: "c8f7fd79-6891-4136-ae3a-03ed6d7c4d96") : secret "dns-default-metrics-tls" not found Jun 09 13:29:08.661468 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:29:08.661250 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c588445-d514-4c1c-a4b4-b1a0f03728fd-networking-console-plugin-cert podName:8c588445-d514-4c1c-a4b4-b1a0f03728fd nodeName:}" failed. No retries permitted until 2026-06-09 13:31:10.661238152 +0000 UTC m=+285.361513069 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8c588445-d514-4c1c-a4b4-b1a0f03728fd-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-qvkpz" (UID: "8c588445-d514-4c1c-a4b4-b1a0f03728fd") : secret "networking-console-plugin-cert" not found Jun 09 13:29:17.784670 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:29:17.784583 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s8xkw" Jun 09 13:29:37.173094 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:29:37.173038 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fbf464cc6-zrhrd" podUID="211fd49b-3ec3-41c3-a403-52d769643b01" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.10:8000/readyz\": dial tcp 10.132.0.10:8000: connect: connection refused" Jun 09 13:29:37.466751 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:29:37.466666 2577 generic.go:356] "Generic (PLEG): container finished" podID="211fd49b-3ec3-41c3-a403-52d769643b01" containerID="831ea98843abd2e6cecfa098b16b46d3e3755bd6435fc6ba6721ff8d035c60b3" exitCode=1 Jun 09 13:29:37.466751 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:29:37.466737 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fbf464cc6-zrhrd" event={"ID":"211fd49b-3ec3-41c3-a403-52d769643b01","Type":"ContainerDied","Data":"831ea98843abd2e6cecfa098b16b46d3e3755bd6435fc6ba6721ff8d035c60b3"} Jun 09 13:29:37.467061 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:29:37.467048 2577 scope.go:117] "RemoveContainer" containerID="831ea98843abd2e6cecfa098b16b46d3e3755bd6435fc6ba6721ff8d035c60b3" Jun 09 13:29:38.471260 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:29:38.471228 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fbf464cc6-zrhrd" event={"ID":"211fd49b-3ec3-41c3-a403-52d769643b01","Type":"ContainerStarted","Data":"1536d4ce1e2e0697f6434307928fdeabc8792b97224da8608bc1c47aab875c19"} Jun 09 13:29:38.471675 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:29:38.471507 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fbf464cc6-zrhrd" Jun 09 13:29:38.472039 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:29:38.472024 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fbf464cc6-zrhrd" Jun 09 13:30:37.696691 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:30:37.696635 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ee23738-5173-4f32-83d2-4f47140592b3-metrics-certs\") pod \"network-metrics-daemon-s8xkw\" (UID: \"5ee23738-5173-4f32-83d2-4f47140592b3\") " pod="openshift-multus/network-metrics-daemon-s8xkw" Jun 09 13:30:37.697134 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:30:37.696786 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 13:30:37.697134 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:30:37.696862 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ee23738-5173-4f32-83d2-4f47140592b3-metrics-certs podName:5ee23738-5173-4f32-83d2-4f47140592b3 nodeName:}" failed. No retries permitted until 2026-06-09 13:32:39.696845235 +0000 UTC m=+374.397120152 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5ee23738-5173-4f32-83d2-4f47140592b3-metrics-certs") pod "network-metrics-daemon-s8xkw" (UID: "5ee23738-5173-4f32-83d2-4f47140592b3") : secret "metrics-daemon-secret" not found Jun 09 13:30:51.353776 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:30:51.353652 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-5hlz6"] Jun 09 13:30:51.356531 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:30:51.356515 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-5hlz6" Jun 09 13:30:51.358651 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:30:51.358625 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 09 13:30:51.361275 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:30:51.359287 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 09 13:30:51.361275 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:30:51.359773 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 09 13:30:51.361275 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:30:51.359887 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 09 13:30:51.361275 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:30:51.360341 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-s74wd\"" Jun 09 13:30:51.365258 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:30:51.365237 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-jsfhk"] Jun 09 13:30:51.368314 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:30:51.368300 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-jsfhk" Jun 09 13:30:51.370375 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:30:51.370354 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 09 13:30:51.370604 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:30:51.370589 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 09 13:30:51.370694 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:30:51.370602 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 09 13:30:51.370756 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:30:51.370739 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-5hlz6"] Jun 09 13:30:51.371143 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:30:51.371129 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-z4v6g\"" Jun 09 13:30:51.379931 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:30:51.379903 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-jsfhk"] Jun 09 13:30:51.501828 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:30:51.501791 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klhjq\" (UniqueName: \"kubernetes.io/projected/5550c977-76e2-4825-ab9c-32aa65e219a3-kube-api-access-klhjq\") pod \"cluster-samples-operator-854f8b96b6-jsfhk\" (UID: \"5550c977-76e2-4825-ab9c-32aa65e219a3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-jsfhk" Jun 09 13:30:51.501992 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:30:51.501877 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftrhv\" (UniqueName: \"kubernetes.io/projected/484d59bc-77c0-4d36-a527-2f0898f1a744-kube-api-access-ftrhv\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-5hlz6\" (UID: \"484d59bc-77c0-4d36-a527-2f0898f1a744\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-5hlz6" Jun 09 13:30:51.501992 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:30:51.501911 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/484d59bc-77c0-4d36-a527-2f0898f1a744-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-5hlz6\" (UID: \"484d59bc-77c0-4d36-a527-2f0898f1a744\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-5hlz6" Jun 09 13:30:51.501992 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:30:51.501945 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5550c977-76e2-4825-ab9c-32aa65e219a3-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-jsfhk\" (UID: \"5550c977-76e2-4825-ab9c-32aa65e219a3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-jsfhk" Jun 09 13:30:51.502115 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:30:51.501995 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/484d59bc-77c0-4d36-a527-2f0898f1a744-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-5hlz6\" (UID: \"484d59bc-77c0-4d36-a527-2f0898f1a744\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-5hlz6" Jun 09 13:30:51.603089 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:30:51.603041 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klhjq\" (UniqueName: \"kubernetes.io/projected/5550c977-76e2-4825-ab9c-32aa65e219a3-kube-api-access-klhjq\") pod \"cluster-samples-operator-854f8b96b6-jsfhk\" (UID: \"5550c977-76e2-4825-ab9c-32aa65e219a3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-jsfhk" Jun 09 13:30:51.603277 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:30:51.603134 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftrhv\" (UniqueName: \"kubernetes.io/projected/484d59bc-77c0-4d36-a527-2f0898f1a744-kube-api-access-ftrhv\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-5hlz6\" (UID: \"484d59bc-77c0-4d36-a527-2f0898f1a744\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-5hlz6" Jun 09 13:30:51.603277 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:30:51.603152 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/484d59bc-77c0-4d36-a527-2f0898f1a744-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-5hlz6\" (UID: \"484d59bc-77c0-4d36-a527-2f0898f1a744\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-5hlz6" Jun 09 13:30:51.603277 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:30:51.603204 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5550c977-76e2-4825-ab9c-32aa65e219a3-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-jsfhk\" (UID: \"5550c977-76e2-4825-ab9c-32aa65e219a3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-jsfhk" Jun 09 13:30:51.603402 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:30:51.603284 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 13:30:51.603402 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:30:51.603324 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/484d59bc-77c0-4d36-a527-2f0898f1a744-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-5hlz6\" (UID: \"484d59bc-77c0-4d36-a527-2f0898f1a744\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-5hlz6" Jun 09 13:30:51.603402 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:30:51.603342 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5550c977-76e2-4825-ab9c-32aa65e219a3-samples-operator-tls podName:5550c977-76e2-4825-ab9c-32aa65e219a3 nodeName:}" failed. No retries permitted until 2026-06-09 13:30:52.103321576 +0000 UTC m=+266.803596501 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5550c977-76e2-4825-ab9c-32aa65e219a3-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-jsfhk" (UID: "5550c977-76e2-4825-ab9c-32aa65e219a3") : secret "samples-operator-tls" not found Jun 09 13:30:51.603831 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:30:51.603782 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/484d59bc-77c0-4d36-a527-2f0898f1a744-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-5hlz6\" (UID: \"484d59bc-77c0-4d36-a527-2f0898f1a744\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-5hlz6" Jun 09 13:30:51.605409 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:30:51.605391 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/484d59bc-77c0-4d36-a527-2f0898f1a744-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-5hlz6\" (UID: \"484d59bc-77c0-4d36-a527-2f0898f1a744\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-5hlz6" Jun 09 13:30:51.610838 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:30:51.610814 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftrhv\" (UniqueName: \"kubernetes.io/projected/484d59bc-77c0-4d36-a527-2f0898f1a744-kube-api-access-ftrhv\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-5hlz6\" (UID: \"484d59bc-77c0-4d36-a527-2f0898f1a744\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-5hlz6" Jun 09 13:30:51.610946 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:30:51.610909 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-klhjq\" (UniqueName: \"kubernetes.io/projected/5550c977-76e2-4825-ab9c-32aa65e219a3-kube-api-access-klhjq\") pod \"cluster-samples-operator-854f8b96b6-jsfhk\" (UID: \"5550c977-76e2-4825-ab9c-32aa65e219a3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-jsfhk" Jun 09 13:30:51.667579 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:30:51.667544 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-5hlz6" Jun 09 13:30:51.788519 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:30:51.788493 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-5hlz6"] Jun 09 13:30:51.791672 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:30:51.791645 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod484d59bc_77c0_4d36_a527_2f0898f1a744.slice/crio-a7e22a826dbee062fb62f46f2ebad3452fbc78418e7163a9cb547cda56c9e8b1 WatchSource:0}: Error finding container a7e22a826dbee062fb62f46f2ebad3452fbc78418e7163a9cb547cda56c9e8b1: Status 404 returned error can't find the container with id a7e22a826dbee062fb62f46f2ebad3452fbc78418e7163a9cb547cda56c9e8b1 Jun 09 13:30:52.107059 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:30:52.107019 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5550c977-76e2-4825-ab9c-32aa65e219a3-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-jsfhk\" (UID: \"5550c977-76e2-4825-ab9c-32aa65e219a3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-jsfhk" Jun 09 13:30:52.107254 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:30:52.107171 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 13:30:52.107297 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:30:52.107258 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5550c977-76e2-4825-ab9c-32aa65e219a3-samples-operator-tls podName:5550c977-76e2-4825-ab9c-32aa65e219a3 nodeName:}" failed. No retries permitted until 2026-06-09 13:30:53.107241581 +0000 UTC m=+267.807516500 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5550c977-76e2-4825-ab9c-32aa65e219a3-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-jsfhk" (UID: "5550c977-76e2-4825-ab9c-32aa65e219a3") : secret "samples-operator-tls" not found Jun 09 13:30:52.649323 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:30:52.649288 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-5hlz6" event={"ID":"484d59bc-77c0-4d36-a527-2f0898f1a744","Type":"ContainerStarted","Data":"a7e22a826dbee062fb62f46f2ebad3452fbc78418e7163a9cb547cda56c9e8b1"} Jun 09 13:30:53.114538 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:30:53.114492 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5550c977-76e2-4825-ab9c-32aa65e219a3-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-jsfhk\" (UID: \"5550c977-76e2-4825-ab9c-32aa65e219a3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-jsfhk" Jun 09 13:30:53.114727 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:30:53.114675 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 13:30:53.114777 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:30:53.114753 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5550c977-76e2-4825-ab9c-32aa65e219a3-samples-operator-tls podName:5550c977-76e2-4825-ab9c-32aa65e219a3 nodeName:}" failed. No retries permitted until 2026-06-09 13:30:55.114735682 +0000 UTC m=+269.815010605 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5550c977-76e2-4825-ab9c-32aa65e219a3-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-jsfhk" (UID: "5550c977-76e2-4825-ab9c-32aa65e219a3") : secret "samples-operator-tls" not found Jun 09 13:30:55.132653 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:30:55.132613 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5550c977-76e2-4825-ab9c-32aa65e219a3-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-jsfhk\" (UID: \"5550c977-76e2-4825-ab9c-32aa65e219a3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-jsfhk" Jun 09 13:30:55.133047 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:30:55.132739 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 13:30:55.133047 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:30:55.132798 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5550c977-76e2-4825-ab9c-32aa65e219a3-samples-operator-tls podName:5550c977-76e2-4825-ab9c-32aa65e219a3 nodeName:}" failed. No retries permitted until 2026-06-09 13:30:59.132779385 +0000 UTC m=+273.833054303 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5550c977-76e2-4825-ab9c-32aa65e219a3-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-jsfhk" (UID: "5550c977-76e2-4825-ab9c-32aa65e219a3") : secret "samples-operator-tls" not found Jun 09 13:30:55.659782 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:30:55.659738 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-5hlz6" event={"ID":"484d59bc-77c0-4d36-a527-2f0898f1a744","Type":"ContainerStarted","Data":"b02fcd9011d2c2e2588f806a33950783eadddd39e8d7317f3a157c95d842d12a"} Jun 09 13:30:55.677789 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:30:55.677741 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-5hlz6" podStartSLOduration=1.8601484670000001 podStartE2EDuration="4.677725906s" totalImagesPullingTime="2.817577439s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:30:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:30:55.676001259 +0000 UTC m=+270.376276196" watchObservedRunningTime="2026-06-09 13:30:55.677725906 +0000 UTC m=+270.378000846" Jun 09 13:30:56.637675 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:30:56.637639 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-4lrrq"] Jun 09 13:30:56.640989 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:30:56.640966 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-4lrrq" Jun 09 13:30:56.643294 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:30:56.643275 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 09 13:30:56.643400 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:30:56.643321 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 09 13:30:56.644967 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:30:56.644949 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-h7fcf\"" Jun 09 13:30:56.650276 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:30:56.650254 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-4lrrq"] Jun 09 13:30:56.743670 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:30:56.743626 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hd66n\" (UniqueName: \"kubernetes.io/projected/c835e0e7-65b5-423a-adb4-2c11e9d1760b-kube-api-access-hd66n\") pod \"migrator-955ffdf5f-4lrrq\" (UID: \"c835e0e7-65b5-423a-adb4-2c11e9d1760b\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-4lrrq" Jun 09 13:30:56.845040 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:30:56.845005 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hd66n\" (UniqueName: \"kubernetes.io/projected/c835e0e7-65b5-423a-adb4-2c11e9d1760b-kube-api-access-hd66n\") pod \"migrator-955ffdf5f-4lrrq\" (UID: \"c835e0e7-65b5-423a-adb4-2c11e9d1760b\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-4lrrq" Jun 09 13:30:56.853337 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:30:56.853308 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hd66n\" (UniqueName: \"kubernetes.io/projected/c835e0e7-65b5-423a-adb4-2c11e9d1760b-kube-api-access-hd66n\") pod \"migrator-955ffdf5f-4lrrq\" (UID: \"c835e0e7-65b5-423a-adb4-2c11e9d1760b\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-4lrrq" Jun 09 13:30:56.949554 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:30:56.949462 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-4lrrq" Jun 09 13:30:57.073358 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:30:57.073330 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-4lrrq"] Jun 09 13:30:57.076975 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:30:57.076949 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc835e0e7_65b5_423a_adb4_2c11e9d1760b.slice/crio-c03a975ba329df4487f40a71cb5ae224a2d33a164e2544f25aba0f999dd5820f WatchSource:0}: Error finding container c03a975ba329df4487f40a71cb5ae224a2d33a164e2544f25aba0f999dd5820f: Status 404 returned error can't find the container with id c03a975ba329df4487f40a71cb5ae224a2d33a164e2544f25aba0f999dd5820f Jun 09 13:30:57.667285 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:30:57.667252 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-4lrrq" event={"ID":"c835e0e7-65b5-423a-adb4-2c11e9d1760b","Type":"ContainerStarted","Data":"c03a975ba329df4487f40a71cb5ae224a2d33a164e2544f25aba0f999dd5820f"} Jun 09 13:30:57.853105 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:30:57.853072 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-wwkct"] Jun 09 13:30:57.856039 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:30:57.856009 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-wwkct" Jun 09 13:30:57.858501 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:30:57.858416 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 09 13:30:57.858628 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:30:57.858526 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-c8dlj\"" Jun 09 13:30:57.858705 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:30:57.858660 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 09 13:30:57.859444 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:30:57.859425 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 09 13:30:57.859444 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:30:57.859439 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 09 13:30:57.863491 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:30:57.863472 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-wwkct"] Jun 09 13:30:57.954149 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:30:57.954051 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e0f85224-2a7f-47aa-b237-565efafc05c1-signing-key\") pod \"service-ca-7d74d578b8-wwkct\" (UID: \"e0f85224-2a7f-47aa-b237-565efafc05c1\") " pod="openshift-service-ca/service-ca-7d74d578b8-wwkct" Jun 09 13:30:57.954149 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:30:57.954102 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e0f85224-2a7f-47aa-b237-565efafc05c1-signing-cabundle\") pod \"service-ca-7d74d578b8-wwkct\" (UID: \"e0f85224-2a7f-47aa-b237-565efafc05c1\") " pod="openshift-service-ca/service-ca-7d74d578b8-wwkct" Jun 09 13:30:57.954386 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:30:57.954311 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8d48\" (UniqueName: \"kubernetes.io/projected/e0f85224-2a7f-47aa-b237-565efafc05c1-kube-api-access-q8d48\") pod \"service-ca-7d74d578b8-wwkct\" (UID: \"e0f85224-2a7f-47aa-b237-565efafc05c1\") " pod="openshift-service-ca/service-ca-7d74d578b8-wwkct" Jun 09 13:30:58.055177 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:30:58.055142 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e0f85224-2a7f-47aa-b237-565efafc05c1-signing-key\") pod \"service-ca-7d74d578b8-wwkct\" (UID: \"e0f85224-2a7f-47aa-b237-565efafc05c1\") " pod="openshift-service-ca/service-ca-7d74d578b8-wwkct" Jun 09 13:30:58.055177 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:30:58.055197 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e0f85224-2a7f-47aa-b237-565efafc05c1-signing-cabundle\") pod \"service-ca-7d74d578b8-wwkct\" (UID: \"e0f85224-2a7f-47aa-b237-565efafc05c1\") " pod="openshift-service-ca/service-ca-7d74d578b8-wwkct" Jun 09 13:30:58.055427 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:30:58.055278 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8d48\" (UniqueName: \"kubernetes.io/projected/e0f85224-2a7f-47aa-b237-565efafc05c1-kube-api-access-q8d48\") pod \"service-ca-7d74d578b8-wwkct\" (UID: \"e0f85224-2a7f-47aa-b237-565efafc05c1\") " pod="openshift-service-ca/service-ca-7d74d578b8-wwkct" Jun 09 13:30:58.056106 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:30:58.056084 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e0f85224-2a7f-47aa-b237-565efafc05c1-signing-cabundle\") pod \"service-ca-7d74d578b8-wwkct\" (UID: \"e0f85224-2a7f-47aa-b237-565efafc05c1\") " pod="openshift-service-ca/service-ca-7d74d578b8-wwkct" Jun 09 13:30:58.057871 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:30:58.057850 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e0f85224-2a7f-47aa-b237-565efafc05c1-signing-key\") pod \"service-ca-7d74d578b8-wwkct\" (UID: \"e0f85224-2a7f-47aa-b237-565efafc05c1\") " pod="openshift-service-ca/service-ca-7d74d578b8-wwkct" Jun 09 13:30:58.064479 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:30:58.064457 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8d48\" (UniqueName: \"kubernetes.io/projected/e0f85224-2a7f-47aa-b237-565efafc05c1-kube-api-access-q8d48\") pod \"service-ca-7d74d578b8-wwkct\" (UID: \"e0f85224-2a7f-47aa-b237-565efafc05c1\") " pod="openshift-service-ca/service-ca-7d74d578b8-wwkct" Jun 09 13:30:58.166805 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:30:58.166765 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-wwkct" Jun 09 13:30:58.316534 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:30:58.316505 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-wwkct"] Jun 09 13:30:58.319768 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:30:58.319741 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0f85224_2a7f_47aa_b237_565efafc05c1.slice/crio-3be2b1f2020b47ea2fcb170d63d354a46a0a12b7f94bd76ff8c149ac0f63d710 WatchSource:0}: Error finding container 3be2b1f2020b47ea2fcb170d63d354a46a0a12b7f94bd76ff8c149ac0f63d710: Status 404 returned error can't find the container with id 3be2b1f2020b47ea2fcb170d63d354a46a0a12b7f94bd76ff8c149ac0f63d710 Jun 09 13:30:58.670953 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:30:58.670864 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-wwkct" event={"ID":"e0f85224-2a7f-47aa-b237-565efafc05c1","Type":"ContainerStarted","Data":"3be2b1f2020b47ea2fcb170d63d354a46a0a12b7f94bd76ff8c149ac0f63d710"} Jun 09 13:30:58.672475 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:30:58.672453 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-4lrrq" event={"ID":"c835e0e7-65b5-423a-adb4-2c11e9d1760b","Type":"ContainerStarted","Data":"987fc3c35e2d8d94fea34f1faa67019d65c9948139a2d35830681614958e2b05"} Jun 09 13:30:58.672529 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:30:58.672496 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-4lrrq" event={"ID":"c835e0e7-65b5-423a-adb4-2c11e9d1760b","Type":"ContainerStarted","Data":"0a8406a6ae059dcbc9ba8fbafb1bc2627640dae63873f3792b237e925fc8426c"} Jun 09 13:30:58.688845 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:30:58.688798 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-4lrrq" podStartSLOduration=1.5309203729999998 podStartE2EDuration="2.688784201s" totalImagesPullingTime="1.157863828s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:30:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:30:58.688119511 +0000 UTC m=+273.388394461" watchObservedRunningTime="2026-06-09 13:30:58.688784201 +0000 UTC m=+273.389059161" Jun 09 13:30:59.164922 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:30:59.164882 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5550c977-76e2-4825-ab9c-32aa65e219a3-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-jsfhk\" (UID: \"5550c977-76e2-4825-ab9c-32aa65e219a3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-jsfhk" Jun 09 13:30:59.165116 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:30:59.165065 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 13:30:59.165212 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:30:59.165149 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5550c977-76e2-4825-ab9c-32aa65e219a3-samples-operator-tls podName:5550c977-76e2-4825-ab9c-32aa65e219a3 nodeName:}" failed. No retries permitted until 2026-06-09 13:31:07.165126129 +0000 UTC m=+281.865401062 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5550c977-76e2-4825-ab9c-32aa65e219a3-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-jsfhk" (UID: "5550c977-76e2-4825-ab9c-32aa65e219a3") : secret "samples-operator-tls" not found Jun 09 13:31:00.319263 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:00.319242 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hsvg8_a0547d16-4dde-4b06-97d4-091c54fd4534/dns-node-resolver/0.log" Jun 09 13:31:00.680532 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:00.680449 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-wwkct" event={"ID":"e0f85224-2a7f-47aa-b237-565efafc05c1","Type":"ContainerStarted","Data":"e9203b540a8463c7e033f6bfa46d6629c9767b471694b8d5e12b49a172fc307f"} Jun 09 13:31:00.698752 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:00.698700 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-wwkct" podStartSLOduration=1.7618664069999999 podStartE2EDuration="3.698683063s" totalImagesPullingTime="1.936816656s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:30:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:31:00.697109768 +0000 UTC m=+275.397384707" watchObservedRunningTime="2026-06-09 13:31:00.698683063 +0000 UTC m=+275.398958003" Jun 09 13:31:01.123374 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:01.123263 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gb54t_1ab8fa81-0942-447f-9c26-6f448848c07d/node-ca/0.log" Jun 09 13:31:01.920611 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:01.920584 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bsxfs_af72438c-c400-45ba-941f-94637383ca93/serve-healthcheck-canary/0.log" Jun 09 13:31:02.320023 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:02.319994 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-4lrrq_c835e0e7-65b5-423a-adb4-2c11e9d1760b/migrator/0.log" Jun 09 13:31:02.519951 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:02.519922 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-4lrrq_c835e0e7-65b5-423a-adb4-2c11e9d1760b/graceful-termination/0.log" Jun 09 13:31:02.720147 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:02.720065 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-5hlz6_484d59bc-77c0-4d36-a527-2f0898f1a744/kube-storage-version-migrator-operator/0.log" Jun 09 13:31:07.234110 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:07.234065 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5550c977-76e2-4825-ab9c-32aa65e219a3-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-jsfhk\" (UID: \"5550c977-76e2-4825-ab9c-32aa65e219a3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-jsfhk" Jun 09 13:31:07.236684 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:07.236660 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5550c977-76e2-4825-ab9c-32aa65e219a3-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-jsfhk\" (UID: \"5550c977-76e2-4825-ab9c-32aa65e219a3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-jsfhk" Jun 09 13:31:07.277700 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:07.277664 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-jsfhk" Jun 09 13:31:07.386580 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:31:07.386538 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qvkpz" podUID="8c588445-d514-4c1c-a4b4-b1a0f03728fd" Jun 09 13:31:07.386723 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:31:07.386546 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-997fbf97b-x4zg5" podUID="495960e5-1fad-4f40-91e4-0962570569ec" Jun 09 13:31:07.386723 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:31:07.386546 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-hzv2v" podUID="c8f7fd79-6891-4136-ae3a-03ed6d7c4d96" Jun 09 13:31:07.405820 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:07.405789 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-jsfhk"] Jun 09 13:31:07.702854 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:07.702762 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hzv2v" Jun 09 13:31:07.702854 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:07.702792 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-jsfhk" event={"ID":"5550c977-76e2-4825-ab9c-32aa65e219a3","Type":"ContainerStarted","Data":"b114541587675b759b0cf934517ae2a034594129f95b5dc5110f5e238ca3c24a"} Jun 09 13:31:07.702854 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:07.702800 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-997fbf97b-x4zg5" Jun 09 13:31:07.702854 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:07.702773 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qvkpz" Jun 09 13:31:09.711470 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:09.711435 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-jsfhk" event={"ID":"5550c977-76e2-4825-ab9c-32aa65e219a3","Type":"ContainerStarted","Data":"74c7b9c766a4526d5364ee83243e183c7585607bbe2d3f74748dd0a7de3b6a67"} Jun 09 13:31:09.711917 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:09.711498 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-jsfhk" event={"ID":"5550c977-76e2-4825-ab9c-32aa65e219a3","Type":"ContainerStarted","Data":"db2d160a86fed29bcc554e49a11d249acff92b5101181bc6639df19827f21e3b"} Jun 09 13:31:09.732141 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:09.732087 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-jsfhk" podStartSLOduration=16.64814521 podStartE2EDuration="18.732070589s" totalImagesPullingTime="2.083925379s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:30:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:31:09.731595714 +0000 UTC m=+284.431870655" watchObservedRunningTime="2026-06-09 13:31:09.732070589 +0000 UTC m=+284.432345528" Jun 09 13:31:10.664833 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:10.664793 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8c588445-d514-4c1c-a4b4-b1a0f03728fd-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-qvkpz\" (UID: \"8c588445-d514-4c1c-a4b4-b1a0f03728fd\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qvkpz" Jun 09 13:31:10.664833 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:10.664836 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8f7fd79-6891-4136-ae3a-03ed6d7c4d96-metrics-tls\") pod \"dns-default-hzv2v\" (UID: \"c8f7fd79-6891-4136-ae3a-03ed6d7c4d96\") " pod="openshift-dns/dns-default-hzv2v" Jun 09 13:31:10.665064 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:10.664856 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/495960e5-1fad-4f40-91e4-0962570569ec-registry-tls\") pod \"image-registry-997fbf97b-x4zg5\" (UID: \"495960e5-1fad-4f40-91e4-0962570569ec\") " pod="openshift-image-registry/image-registry-997fbf97b-x4zg5" Jun 09 13:31:10.667288 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:10.667254 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8f7fd79-6891-4136-ae3a-03ed6d7c4d96-metrics-tls\") pod \"dns-default-hzv2v\" (UID: \"c8f7fd79-6891-4136-ae3a-03ed6d7c4d96\") " pod="openshift-dns/dns-default-hzv2v" Jun 09 13:31:10.667402 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:10.667317 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/495960e5-1fad-4f40-91e4-0962570569ec-registry-tls\") pod \"image-registry-997fbf97b-x4zg5\" (UID: \"495960e5-1fad-4f40-91e4-0962570569ec\") " pod="openshift-image-registry/image-registry-997fbf97b-x4zg5" Jun 09 13:31:10.667402 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:10.667380 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8c588445-d514-4c1c-a4b4-b1a0f03728fd-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-qvkpz\" (UID: \"8c588445-d514-4c1c-a4b4-b1a0f03728fd\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qvkpz" Jun 09 13:31:10.706421 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:10.706389 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wkzw9\"" Jun 09 13:31:10.706421 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:10.706392 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-dsh7m\"" Jun 09 13:31:10.706617 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:10.706443 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2ppl8\"" Jun 09 13:31:10.713831 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:10.713797 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hzv2v" Jun 09 13:31:10.714170 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:10.713897 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qvkpz" Jun 09 13:31:10.714170 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:10.713941 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-997fbf97b-x4zg5" Jun 09 13:31:10.869475 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:10.869444 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hzv2v"] Jun 09 13:31:10.872723 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:31:10.872694 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8f7fd79_6891_4136_ae3a_03ed6d7c4d96.slice/crio-63d1cbd93d272dbbcedb093511951440decd58c9b41041deef41284d23da6b04 WatchSource:0}: Error finding container 63d1cbd93d272dbbcedb093511951440decd58c9b41041deef41284d23da6b04: Status 404 returned error can't find the container with id 63d1cbd93d272dbbcedb093511951440decd58c9b41041deef41284d23da6b04 Jun 09 13:31:11.092967 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:11.092936 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-qvkpz"] Jun 09 13:31:11.095939 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:31:11.095912 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c588445_d514_4c1c_a4b4_b1a0f03728fd.slice/crio-165e5c2122eb8f9f4b2ff5ddeb30836adfb1f03c728110889ac887d227d3d08f WatchSource:0}: Error finding container 165e5c2122eb8f9f4b2ff5ddeb30836adfb1f03c728110889ac887d227d3d08f: Status 404 returned error can't find the container with id 165e5c2122eb8f9f4b2ff5ddeb30836adfb1f03c728110889ac887d227d3d08f Jun 09 13:31:11.098202 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:11.098055 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-997fbf97b-x4zg5"] Jun 09 13:31:11.101638 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:31:11.101615 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod495960e5_1fad_4f40_91e4_0962570569ec.slice/crio-1f9e12dc7f606774a18fce91ab2aa321801a46ee1fc1675abb6029fef8a1cf71 WatchSource:0}: Error finding container 1f9e12dc7f606774a18fce91ab2aa321801a46ee1fc1675abb6029fef8a1cf71: Status 404 returned error can't find the container with id 1f9e12dc7f606774a18fce91ab2aa321801a46ee1fc1675abb6029fef8a1cf71 Jun 09 13:31:11.719412 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:11.719371 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qvkpz" event={"ID":"8c588445-d514-4c1c-a4b4-b1a0f03728fd","Type":"ContainerStarted","Data":"165e5c2122eb8f9f4b2ff5ddeb30836adfb1f03c728110889ac887d227d3d08f"} Jun 09 13:31:11.720665 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:11.720643 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-997fbf97b-x4zg5" event={"ID":"495960e5-1fad-4f40-91e4-0962570569ec","Type":"ContainerStarted","Data":"54df1aa7d8fd9cdb64d966a8921bc909589b8755ae5602c1c51b81693b2192af"} Jun 09 13:31:11.720783 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:11.720678 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-997fbf97b-x4zg5" event={"ID":"495960e5-1fad-4f40-91e4-0962570569ec","Type":"ContainerStarted","Data":"1f9e12dc7f606774a18fce91ab2aa321801a46ee1fc1675abb6029fef8a1cf71"} Jun 09 13:31:11.720783 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:11.720727 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-997fbf97b-x4zg5" Jun 09 13:31:11.721702 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:11.721685 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hzv2v" event={"ID":"c8f7fd79-6891-4136-ae3a-03ed6d7c4d96","Type":"ContainerStarted","Data":"63d1cbd93d272dbbcedb093511951440decd58c9b41041deef41284d23da6b04"} Jun 09 13:31:11.743610 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:11.743553 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-997fbf97b-x4zg5" podStartSLOduration=285.743536493 podStartE2EDuration="4m45.743536493s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:26:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:31:11.743299289 +0000 UTC m=+286.443574249" watchObservedRunningTime="2026-06-09 13:31:11.743536493 +0000 UTC m=+286.443811433" Jun 09 13:31:12.730813 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:12.730716 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qvkpz" event={"ID":"8c588445-d514-4c1c-a4b4-b1a0f03728fd","Type":"ContainerStarted","Data":"14dd077194c0978e0b9f291c2f78dd9f3ce06e1f5265f5924d5c0e310fd94eae"} Jun 09 13:31:12.746610 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:12.746552 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qvkpz" podStartSLOduration=281.454269331 podStartE2EDuration="4m42.746536217s" totalImagesPullingTime="1.292266886s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:26:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:31:12.745483057 +0000 UTC m=+287.445757998" watchObservedRunningTime="2026-06-09 13:31:12.746536217 +0000 UTC m=+287.446811213" Jun 09 13:31:13.736758 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:13.736719 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hzv2v" event={"ID":"c8f7fd79-6891-4136-ae3a-03ed6d7c4d96","Type":"ContainerStarted","Data":"09bd1aaed81dc5372162ae4bc50d48975c24528c9d4c94b35088d696ff02c1b5"} Jun 09 13:31:13.737248 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:13.736781 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hzv2v" event={"ID":"c8f7fd79-6891-4136-ae3a-03ed6d7c4d96","Type":"ContainerStarted","Data":"7a505b1bbfbbcf351f81992b1beca2ac68f798d3b745e5b6749c4fd5bbbd5da0"} Jun 09 13:31:13.756938 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:13.756889 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-hzv2v" podStartSLOduration=251.523573522 podStartE2EDuration="4m13.756871913s" totalImagesPullingTime="2.233298391s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:27:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:31:13.755571024 +0000 UTC m=+288.455845965" watchObservedRunningTime="2026-06-09 13:31:13.756871913 +0000 UTC m=+288.457146882" Jun 09 13:31:14.739621 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:14.739586 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hzv2v" Jun 09 13:31:17.449455 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:17.449421 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-q7sfg"] Jun 09 13:31:17.454627 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:17.454605 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-q7sfg" Jun 09 13:31:17.457367 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:17.457346 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 09 13:31:17.457473 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:17.457384 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 09 13:31:17.458589 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:17.458572 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 09 13:31:17.458759 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:17.458745 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 09 13:31:17.460126 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:17.460110 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-drc55\"" Jun 09 13:31:17.478908 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:17.478880 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-q7sfg"] Jun 09 13:31:17.515421 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:17.515382 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f54afc59-1b5a-414f-8bf5-8419bbe55252-data-volume\") pod \"insights-runtime-extractor-q7sfg\" (UID: \"f54afc59-1b5a-414f-8bf5-8419bbe55252\") " pod="openshift-insights/insights-runtime-extractor-q7sfg" Jun 09 13:31:17.515612 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:17.515431 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f54afc59-1b5a-414f-8bf5-8419bbe55252-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q7sfg\" (UID: \"f54afc59-1b5a-414f-8bf5-8419bbe55252\") " pod="openshift-insights/insights-runtime-extractor-q7sfg" Jun 09 13:31:17.515612 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:17.515484 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmt5x\" (UniqueName: \"kubernetes.io/projected/f54afc59-1b5a-414f-8bf5-8419bbe55252-kube-api-access-dmt5x\") pod \"insights-runtime-extractor-q7sfg\" (UID: \"f54afc59-1b5a-414f-8bf5-8419bbe55252\") " pod="openshift-insights/insights-runtime-extractor-q7sfg" Jun 09 13:31:17.515612 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:17.515518 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f54afc59-1b5a-414f-8bf5-8419bbe55252-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q7sfg\" (UID: \"f54afc59-1b5a-414f-8bf5-8419bbe55252\") " pod="openshift-insights/insights-runtime-extractor-q7sfg" Jun 09 13:31:17.515612 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:17.515563 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f54afc59-1b5a-414f-8bf5-8419bbe55252-crio-socket\") pod \"insights-runtime-extractor-q7sfg\" (UID: \"f54afc59-1b5a-414f-8bf5-8419bbe55252\") " pod="openshift-insights/insights-runtime-extractor-q7sfg" Jun 09 13:31:17.616435 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:17.616395 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmt5x\" (UniqueName: \"kubernetes.io/projected/f54afc59-1b5a-414f-8bf5-8419bbe55252-kube-api-access-dmt5x\") pod \"insights-runtime-extractor-q7sfg\" (UID: \"f54afc59-1b5a-414f-8bf5-8419bbe55252\") " pod="openshift-insights/insights-runtime-extractor-q7sfg" Jun 09 13:31:17.616435 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:17.616438 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f54afc59-1b5a-414f-8bf5-8419bbe55252-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q7sfg\" (UID: \"f54afc59-1b5a-414f-8bf5-8419bbe55252\") " pod="openshift-insights/insights-runtime-extractor-q7sfg" Jun 09 13:31:17.616698 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:17.616462 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f54afc59-1b5a-414f-8bf5-8419bbe55252-crio-socket\") pod \"insights-runtime-extractor-q7sfg\" (UID: \"f54afc59-1b5a-414f-8bf5-8419bbe55252\") " pod="openshift-insights/insights-runtime-extractor-q7sfg" Jun 09 13:31:17.616698 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:17.616490 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f54afc59-1b5a-414f-8bf5-8419bbe55252-data-volume\") pod \"insights-runtime-extractor-q7sfg\" (UID: \"f54afc59-1b5a-414f-8bf5-8419bbe55252\") " pod="openshift-insights/insights-runtime-extractor-q7sfg" Jun 09 13:31:17.616698 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:17.616514 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f54afc59-1b5a-414f-8bf5-8419bbe55252-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q7sfg\" (UID: \"f54afc59-1b5a-414f-8bf5-8419bbe55252\") " pod="openshift-insights/insights-runtime-extractor-q7sfg" Jun 09 13:31:17.616698 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:17.616606 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f54afc59-1b5a-414f-8bf5-8419bbe55252-crio-socket\") pod \"insights-runtime-extractor-q7sfg\" (UID: \"f54afc59-1b5a-414f-8bf5-8419bbe55252\") " pod="openshift-insights/insights-runtime-extractor-q7sfg" Jun 09 13:31:17.616940 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:17.616919 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f54afc59-1b5a-414f-8bf5-8419bbe55252-data-volume\") pod \"insights-runtime-extractor-q7sfg\" (UID: \"f54afc59-1b5a-414f-8bf5-8419bbe55252\") " pod="openshift-insights/insights-runtime-extractor-q7sfg" Jun 09 13:31:17.617115 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:17.617100 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f54afc59-1b5a-414f-8bf5-8419bbe55252-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q7sfg\" (UID: \"f54afc59-1b5a-414f-8bf5-8419bbe55252\") " pod="openshift-insights/insights-runtime-extractor-q7sfg" Jun 09 13:31:17.618753 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:17.618738 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f54afc59-1b5a-414f-8bf5-8419bbe55252-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q7sfg\" (UID: \"f54afc59-1b5a-414f-8bf5-8419bbe55252\") " pod="openshift-insights/insights-runtime-extractor-q7sfg" Jun 09 13:31:17.625736 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:17.625713 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmt5x\" (UniqueName: \"kubernetes.io/projected/f54afc59-1b5a-414f-8bf5-8419bbe55252-kube-api-access-dmt5x\") pod \"insights-runtime-extractor-q7sfg\" (UID: \"f54afc59-1b5a-414f-8bf5-8419bbe55252\") " pod="openshift-insights/insights-runtime-extractor-q7sfg" Jun 09 13:31:17.763239 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:17.763209 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-q7sfg" Jun 09 13:31:17.901519 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:17.901470 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-q7sfg"] Jun 09 13:31:17.903741 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:31:17.903712 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf54afc59_1b5a_414f_8bf5_8419bbe55252.slice/crio-c746d93b07631a79b1254eabac83b21aafd33b12ea72e688af8871362535dc8c WatchSource:0}: Error finding container c746d93b07631a79b1254eabac83b21aafd33b12ea72e688af8871362535dc8c: Status 404 returned error can't find the container with id c746d93b07631a79b1254eabac83b21aafd33b12ea72e688af8871362535dc8c Jun 09 13:31:18.753528 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:18.753496 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q7sfg" event={"ID":"f54afc59-1b5a-414f-8bf5-8419bbe55252","Type":"ContainerStarted","Data":"40308c570d17f77d741a70a1d4f2d7539009a700fa88a1216b11b87d5f6a97ea"} Jun 09 13:31:18.753898 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:18.753560 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q7sfg" event={"ID":"f54afc59-1b5a-414f-8bf5-8419bbe55252","Type":"ContainerStarted","Data":"6928f1ce89d918cd57126568f3a903b066b10cdf08a44bf8f9654d8fdd4bca64"} Jun 09 13:31:18.753898 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:18.753583 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q7sfg" event={"ID":"f54afc59-1b5a-414f-8bf5-8419bbe55252","Type":"ContainerStarted","Data":"c746d93b07631a79b1254eabac83b21aafd33b12ea72e688af8871362535dc8c"} Jun 09 13:31:20.761835 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:20.761802 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q7sfg" event={"ID":"f54afc59-1b5a-414f-8bf5-8419bbe55252","Type":"ContainerStarted","Data":"f04255a80ff741bdcef168feca2dc58ddbdaa4c763492c94abb0d21b9aa08013"} Jun 09 13:31:20.782097 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:20.782042 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-q7sfg" podStartSLOduration=1.6172102769999999 podStartE2EDuration="3.782025191s" totalImagesPullingTime="2.164814914s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 13:31:17 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:31:20.781790933 +0000 UTC m=+295.482065874" watchObservedRunningTime="2026-06-09 13:31:20.782025191 +0000 UTC m=+295.482300132" Jun 09 13:31:20.785066 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:31:20.785043 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-s8xkw" podUID="5ee23738-5173-4f32-83d2-4f47140592b3" Jun 09 13:31:24.744948 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:24.744914 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hzv2v" Jun 09 13:31:25.738356 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:25.738330 2577 kubelet.go:1648] "Image garbage collection succeeded" Jun 09 13:31:30.718813 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:30.718778 2577 patch_prober.go:28] interesting pod/image-registry-997fbf97b-x4zg5 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 13:31:30.719257 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:30.718830 2577 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-997fbf97b-x4zg5" podUID="495960e5-1fad-4f40-91e4-0962570569ec" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 13:31:32.735084 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:32.735053 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-997fbf97b-x4zg5" Jun 09 13:31:32.783845 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:32.783808 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s8xkw" Jun 09 13:31:35.206874 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:35.206836 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-2f8xq"] Jun 09 13:31:35.212004 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:35.211984 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2f8xq" Jun 09 13:31:35.214932 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:35.214903 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 09 13:31:35.214932 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:35.214924 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 09 13:31:35.215134 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:35.214953 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 09 13:31:35.215255 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:35.215229 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 09 13:31:35.215948 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:35.215928 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-kjfn8\"" Jun 09 13:31:35.216026 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:35.215986 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 09 13:31:35.224503 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:35.224479 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-sqhmh"] Jun 09 13:31:35.228999 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:35.228980 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-2f8xq"] Jun 09 13:31:35.229102 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:35.229087 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-sqhmh" Jun 09 13:31:35.231497 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:35.231478 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-v5v56\"" Jun 09 13:31:35.231857 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:35.231800 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 09 13:31:35.231997 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:35.231908 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 09 13:31:35.232864 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:35.232846 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 09 13:31:35.242001 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:35.241981 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9d192875-479d-49a8-9222-b387deab3488-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-2f8xq\" (UID: \"9d192875-479d-49a8-9222-b387deab3488\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2f8xq" Jun 09 13:31:35.242113 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:35.242011 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d192875-479d-49a8-9222-b387deab3488-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-2f8xq\" (UID: \"9d192875-479d-49a8-9222-b387deab3488\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2f8xq" Jun 09 13:31:35.242162 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:35.242112 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9d192875-479d-49a8-9222-b387deab3488-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-2f8xq\" (UID: \"9d192875-479d-49a8-9222-b387deab3488\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2f8xq" Jun 09 13:31:35.242218 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:35.242163 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4tmw\" (UniqueName: \"kubernetes.io/projected/9d192875-479d-49a8-9222-b387deab3488-kube-api-access-b4tmw\") pod \"openshift-state-metrics-65f78d5c66-2f8xq\" (UID: \"9d192875-479d-49a8-9222-b387deab3488\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2f8xq" Jun 09 13:31:35.343370 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:35.343333 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c0e56023-ee42-4cc6-ada8-15c0376673fb-node-exporter-accelerators-collector-config\") pod \"node-exporter-sqhmh\" (UID: \"c0e56023-ee42-4cc6-ada8-15c0376673fb\") " pod="openshift-monitoring/node-exporter-sqhmh" Jun 09 13:31:35.343585 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:35.343382 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c0e56023-ee42-4cc6-ada8-15c0376673fb-node-exporter-tls\") pod \"node-exporter-sqhmh\" (UID: \"c0e56023-ee42-4cc6-ada8-15c0376673fb\") " pod="openshift-monitoring/node-exporter-sqhmh" Jun 09 13:31:35.343585 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:35.343411 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9d192875-479d-49a8-9222-b387deab3488-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-2f8xq\" (UID: \"9d192875-479d-49a8-9222-b387deab3488\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2f8xq" Jun 09 13:31:35.343585 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:35.343430 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d192875-479d-49a8-9222-b387deab3488-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-2f8xq\" (UID: \"9d192875-479d-49a8-9222-b387deab3488\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2f8xq" Jun 09 13:31:35.343585 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:35.343497 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9d192875-479d-49a8-9222-b387deab3488-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-2f8xq\" (UID: \"9d192875-479d-49a8-9222-b387deab3488\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2f8xq" Jun 09 13:31:35.343585 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:35.343562 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c0e56023-ee42-4cc6-ada8-15c0376673fb-metrics-client-ca\") pod \"node-exporter-sqhmh\" (UID: \"c0e56023-ee42-4cc6-ada8-15c0376673fb\") " pod="openshift-monitoring/node-exporter-sqhmh" Jun 09 13:31:35.343841 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:35.343594 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c0e56023-ee42-4cc6-ada8-15c0376673fb-node-exporter-textfile\") pod \"node-exporter-sqhmh\" (UID: \"c0e56023-ee42-4cc6-ada8-15c0376673fb\") " pod="openshift-monitoring/node-exporter-sqhmh" Jun 09 13:31:35.343841 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:35.343618 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c0e56023-ee42-4cc6-ada8-15c0376673fb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sqhmh\" (UID: \"c0e56023-ee42-4cc6-ada8-15c0376673fb\") " pod="openshift-monitoring/node-exporter-sqhmh" Jun 09 13:31:35.343841 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:35.343645 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c0e56023-ee42-4cc6-ada8-15c0376673fb-node-exporter-wtmp\") pod \"node-exporter-sqhmh\" (UID: \"c0e56023-ee42-4cc6-ada8-15c0376673fb\") " pod="openshift-monitoring/node-exporter-sqhmh" Jun 09 13:31:35.343841 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:35.343671 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c0e56023-ee42-4cc6-ada8-15c0376673fb-sys\") pod \"node-exporter-sqhmh\" (UID: \"c0e56023-ee42-4cc6-ada8-15c0376673fb\") " pod="openshift-monitoring/node-exporter-sqhmh" Jun 09 13:31:35.343841 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:35.343693 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c0e56023-ee42-4cc6-ada8-15c0376673fb-root\") pod \"node-exporter-sqhmh\" (UID: \"c0e56023-ee42-4cc6-ada8-15c0376673fb\") " pod="openshift-monitoring/node-exporter-sqhmh" Jun 09 13:31:35.343841 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:35.343728 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4tmw\" (UniqueName: \"kubernetes.io/projected/9d192875-479d-49a8-9222-b387deab3488-kube-api-access-b4tmw\") pod \"openshift-state-metrics-65f78d5c66-2f8xq\" (UID: \"9d192875-479d-49a8-9222-b387deab3488\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2f8xq" Jun 09 13:31:35.343841 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:35.343751 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kvts\" (UniqueName: \"kubernetes.io/projected/c0e56023-ee42-4cc6-ada8-15c0376673fb-kube-api-access-7kvts\") pod \"node-exporter-sqhmh\" (UID: \"c0e56023-ee42-4cc6-ada8-15c0376673fb\") " pod="openshift-monitoring/node-exporter-sqhmh" Jun 09 13:31:35.344361 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:35.344312 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9d192875-479d-49a8-9222-b387deab3488-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-2f8xq\" (UID: \"9d192875-479d-49a8-9222-b387deab3488\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2f8xq" Jun 09 13:31:35.346094 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:35.346064 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9d192875-479d-49a8-9222-b387deab3488-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-2f8xq\" (UID: \"9d192875-479d-49a8-9222-b387deab3488\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2f8xq" Jun 09 13:31:35.347047 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:35.347022 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d192875-479d-49a8-9222-b387deab3488-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-2f8xq\" (UID: \"9d192875-479d-49a8-9222-b387deab3488\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2f8xq" Jun 09 13:31:35.353004 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:35.352984 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4tmw\" (UniqueName: \"kubernetes.io/projected/9d192875-479d-49a8-9222-b387deab3488-kube-api-access-b4tmw\") pod \"openshift-state-metrics-65f78d5c66-2f8xq\" (UID: \"9d192875-479d-49a8-9222-b387deab3488\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2f8xq" Jun 09 13:31:35.444596 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:35.444559 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c0e56023-ee42-4cc6-ada8-15c0376673fb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sqhmh\" (UID: \"c0e56023-ee42-4cc6-ada8-15c0376673fb\") " pod="openshift-monitoring/node-exporter-sqhmh" Jun 09 13:31:35.444797 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:35.444608 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c0e56023-ee42-4cc6-ada8-15c0376673fb-node-exporter-wtmp\") pod \"node-exporter-sqhmh\" (UID: \"c0e56023-ee42-4cc6-ada8-15c0376673fb\") " pod="openshift-monitoring/node-exporter-sqhmh" Jun 09 13:31:35.444797 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:35.444634 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c0e56023-ee42-4cc6-ada8-15c0376673fb-sys\") pod \"node-exporter-sqhmh\" (UID: \"c0e56023-ee42-4cc6-ada8-15c0376673fb\") " pod="openshift-monitoring/node-exporter-sqhmh" Jun 09 13:31:35.444797 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:35.444659 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c0e56023-ee42-4cc6-ada8-15c0376673fb-root\") pod \"node-exporter-sqhmh\" (UID: \"c0e56023-ee42-4cc6-ada8-15c0376673fb\") " pod="openshift-monitoring/node-exporter-sqhmh" Jun 09 13:31:35.444797 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:35.444689 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kvts\" (UniqueName: \"kubernetes.io/projected/c0e56023-ee42-4cc6-ada8-15c0376673fb-kube-api-access-7kvts\") pod \"node-exporter-sqhmh\" (UID: \"c0e56023-ee42-4cc6-ada8-15c0376673fb\") " pod="openshift-monitoring/node-exporter-sqhmh" Jun 09 13:31:35.444797 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:35.444722 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c0e56023-ee42-4cc6-ada8-15c0376673fb-node-exporter-accelerators-collector-config\") pod \"node-exporter-sqhmh\" (UID: \"c0e56023-ee42-4cc6-ada8-15c0376673fb\") " pod="openshift-monitoring/node-exporter-sqhmh" Jun 09 13:31:35.444797 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:35.444759 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c0e56023-ee42-4cc6-ada8-15c0376673fb-node-exporter-tls\") pod \"node-exporter-sqhmh\" (UID: \"c0e56023-ee42-4cc6-ada8-15c0376673fb\") " pod="openshift-monitoring/node-exporter-sqhmh" Jun 09 13:31:35.445135 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:35.444828 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c0e56023-ee42-4cc6-ada8-15c0376673fb-metrics-client-ca\") pod \"node-exporter-sqhmh\" (UID: \"c0e56023-ee42-4cc6-ada8-15c0376673fb\") " pod="openshift-monitoring/node-exporter-sqhmh" Jun 09 13:31:35.445135 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:35.444857 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c0e56023-ee42-4cc6-ada8-15c0376673fb-node-exporter-textfile\") pod \"node-exporter-sqhmh\" (UID: \"c0e56023-ee42-4cc6-ada8-15c0376673fb\") " pod="openshift-monitoring/node-exporter-sqhmh" Jun 09 13:31:35.445264 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:35.445226 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c0e56023-ee42-4cc6-ada8-15c0376673fb-node-exporter-textfile\") pod \"node-exporter-sqhmh\" (UID: \"c0e56023-ee42-4cc6-ada8-15c0376673fb\") " pod="openshift-monitoring/node-exporter-sqhmh" Jun 09 13:31:35.446808 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:35.445583 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c0e56023-ee42-4cc6-ada8-15c0376673fb-sys\") pod \"node-exporter-sqhmh\" (UID: \"c0e56023-ee42-4cc6-ada8-15c0376673fb\") " pod="openshift-monitoring/node-exporter-sqhmh" Jun 09 13:31:35.446808 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:35.445734 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c0e56023-ee42-4cc6-ada8-15c0376673fb-node-exporter-wtmp\") pod \"node-exporter-sqhmh\" (UID: \"c0e56023-ee42-4cc6-ada8-15c0376673fb\") " pod="openshift-monitoring/node-exporter-sqhmh" Jun 09 13:31:35.446808 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:31:35.445826 2577 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 09 13:31:35.446808 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:31:35.445891 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0e56023-ee42-4cc6-ada8-15c0376673fb-node-exporter-tls podName:c0e56023-ee42-4cc6-ada8-15c0376673fb nodeName:}" failed. No retries permitted until 2026-06-09 13:31:35.945871348 +0000 UTC m=+310.646146285 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/c0e56023-ee42-4cc6-ada8-15c0376673fb-node-exporter-tls") pod "node-exporter-sqhmh" (UID: "c0e56023-ee42-4cc6-ada8-15c0376673fb") : secret "node-exporter-tls" not found Jun 09 13:31:35.446808 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:35.446690 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c0e56023-ee42-4cc6-ada8-15c0376673fb-node-exporter-accelerators-collector-config\") pod \"node-exporter-sqhmh\" (UID: \"c0e56023-ee42-4cc6-ada8-15c0376673fb\") " pod="openshift-monitoring/node-exporter-sqhmh" Jun 09 13:31:35.446808 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:35.446703 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c0e56023-ee42-4cc6-ada8-15c0376673fb-metrics-client-ca\") pod \"node-exporter-sqhmh\" (UID: \"c0e56023-ee42-4cc6-ada8-15c0376673fb\") " pod="openshift-monitoring/node-exporter-sqhmh" Jun 09 13:31:35.446808 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:35.446766 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c0e56023-ee42-4cc6-ada8-15c0376673fb-root\") pod \"node-exporter-sqhmh\" (UID: \"c0e56023-ee42-4cc6-ada8-15c0376673fb\") " pod="openshift-monitoring/node-exporter-sqhmh" Jun 09 13:31:35.448038 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:35.448017 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c0e56023-ee42-4cc6-ada8-15c0376673fb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sqhmh\" (UID: \"c0e56023-ee42-4cc6-ada8-15c0376673fb\") " pod="openshift-monitoring/node-exporter-sqhmh" Jun 09 13:31:35.455534 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:35.455484 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kvts\" (UniqueName: \"kubernetes.io/projected/c0e56023-ee42-4cc6-ada8-15c0376673fb-kube-api-access-7kvts\") pod \"node-exporter-sqhmh\" (UID: \"c0e56023-ee42-4cc6-ada8-15c0376673fb\") " pod="openshift-monitoring/node-exporter-sqhmh" Jun 09 13:31:35.524430 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:35.524395 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2f8xq" Jun 09 13:31:35.675979 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:35.675951 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-2f8xq"] Jun 09 13:31:35.678777 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:31:35.678750 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d192875_479d_49a8_9222_b387deab3488.slice/crio-607adeca210468329a342e1204e2230f0fb0b2159f5236ad5c57a71d5e2584cc WatchSource:0}: Error finding container 607adeca210468329a342e1204e2230f0fb0b2159f5236ad5c57a71d5e2584cc: Status 404 returned error can't find the container with id 607adeca210468329a342e1204e2230f0fb0b2159f5236ad5c57a71d5e2584cc Jun 09 13:31:35.813267 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:35.813233 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2f8xq" event={"ID":"9d192875-479d-49a8-9222-b387deab3488","Type":"ContainerStarted","Data":"c0e15c9e7e401bd163810dafb1a40893a179dcb00b3c5f35e23ff73f192b372c"} Jun 09 13:31:35.813393 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:35.813304 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2f8xq" event={"ID":"9d192875-479d-49a8-9222-b387deab3488","Type":"ContainerStarted","Data":"607adeca210468329a342e1204e2230f0fb0b2159f5236ad5c57a71d5e2584cc"} Jun 09 13:31:35.830651 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:35.830629 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 13:31:35.949947 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:35.949912 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c0e56023-ee42-4cc6-ada8-15c0376673fb-node-exporter-tls\") pod \"node-exporter-sqhmh\" (UID: \"c0e56023-ee42-4cc6-ada8-15c0376673fb\") " pod="openshift-monitoring/node-exporter-sqhmh" Jun 09 13:31:35.952290 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:35.952266 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c0e56023-ee42-4cc6-ada8-15c0376673fb-node-exporter-tls\") pod \"node-exporter-sqhmh\" (UID: \"c0e56023-ee42-4cc6-ada8-15c0376673fb\") " pod="openshift-monitoring/node-exporter-sqhmh" Jun 09 13:31:36.138828 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:36.138742 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-sqhmh" Jun 09 13:31:36.150700 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:31:36.150672 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0e56023_ee42_4cc6_ada8_15c0376673fb.slice/crio-be06a4b8464ad27be5d64a1f908b5418019226bac1bbefdfc930ae2bd8a03ba2 WatchSource:0}: Error finding container be06a4b8464ad27be5d64a1f908b5418019226bac1bbefdfc930ae2bd8a03ba2: Status 404 returned error can't find the container with id be06a4b8464ad27be5d64a1f908b5418019226bac1bbefdfc930ae2bd8a03ba2 Jun 09 13:31:36.296281 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:36.296244 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 13:31:36.301335 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:36.301307 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:31:36.303679 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:36.303655 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 09 13:31:36.303804 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:36.303709 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 09 13:31:36.303915 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:36.303901 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 09 13:31:36.303982 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:36.303965 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 09 13:31:36.304031 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:36.303986 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 09 13:31:36.304124 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:36.304104 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 09 13:31:36.304193 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:36.304108 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-fc2gl\"" Jun 09 13:31:36.304279 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:36.304261 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 09 13:31:36.304437 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:36.304416 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 09 13:31:36.305109 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:36.305091 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 09 13:31:36.324605 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:36.321998 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 13:31:36.353200 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:36.353150 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c028f01a-ed3b-4b34-bb9b-e67e85aff192-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c028f01a-ed3b-4b34-bb9b-e67e85aff192\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:31:36.353356 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:36.353208 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c028f01a-ed3b-4b34-bb9b-e67e85aff192-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c028f01a-ed3b-4b34-bb9b-e67e85aff192\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:31:36.353356 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:36.353278 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c028f01a-ed3b-4b34-bb9b-e67e85aff192-config-out\") pod \"alertmanager-main-0\" (UID: \"c028f01a-ed3b-4b34-bb9b-e67e85aff192\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:31:36.353356 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:36.353320 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c028f01a-ed3b-4b34-bb9b-e67e85aff192-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c028f01a-ed3b-4b34-bb9b-e67e85aff192\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:31:36.353478 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:36.353358 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c028f01a-ed3b-4b34-bb9b-e67e85aff192-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c028f01a-ed3b-4b34-bb9b-e67e85aff192\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:31:36.353478 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:36.353400 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c028f01a-ed3b-4b34-bb9b-e67e85aff192-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c028f01a-ed3b-4b34-bb9b-e67e85aff192\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:31:36.353478 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:36.353423 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c028f01a-ed3b-4b34-bb9b-e67e85aff192-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c028f01a-ed3b-4b34-bb9b-e67e85aff192\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:31:36.353478 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:36.353448 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c028f01a-ed3b-4b34-bb9b-e67e85aff192-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c028f01a-ed3b-4b34-bb9b-e67e85aff192\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:31:36.353592 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:36.353490 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c028f01a-ed3b-4b34-bb9b-e67e85aff192-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c028f01a-ed3b-4b34-bb9b-e67e85aff192\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:31:36.353592 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:36.353538 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c028f01a-ed3b-4b34-bb9b-e67e85aff192-config-volume\") pod \"alertmanager-main-0\" (UID: \"c028f01a-ed3b-4b34-bb9b-e67e85aff192\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:31:36.353592 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:36.353569 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c028f01a-ed3b-4b34-bb9b-e67e85aff192-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c028f01a-ed3b-4b34-bb9b-e67e85aff192\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:31:36.353682 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:36.353628 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c028f01a-ed3b-4b34-bb9b-e67e85aff192-web-config\") pod \"alertmanager-main-0\" (UID: \"c028f01a-ed3b-4b34-bb9b-e67e85aff192\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:31:36.353682 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:36.353663 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgn7w\" (UniqueName: \"kubernetes.io/projected/c028f01a-ed3b-4b34-bb9b-e67e85aff192-kube-api-access-fgn7w\") pod \"alertmanager-main-0\" (UID: \"c028f01a-ed3b-4b34-bb9b-e67e85aff192\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:31:36.454165 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:36.454059 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c028f01a-ed3b-4b34-bb9b-e67e85aff192-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c028f01a-ed3b-4b34-bb9b-e67e85aff192\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:31:36.454165 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:36.454121 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c028f01a-ed3b-4b34-bb9b-e67e85aff192-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c028f01a-ed3b-4b34-bb9b-e67e85aff192\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:31:36.454165 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:36.454151 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c028f01a-ed3b-4b34-bb9b-e67e85aff192-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c028f01a-ed3b-4b34-bb9b-e67e85aff192\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:31:36.454458 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:31:36.454250 2577 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 09 13:31:36.454458 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:36.454269 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c028f01a-ed3b-4b34-bb9b-e67e85aff192-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c028f01a-ed3b-4b34-bb9b-e67e85aff192\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:31:36.454458 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:36.454311 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c028f01a-ed3b-4b34-bb9b-e67e85aff192-config-volume\") pod \"alertmanager-main-0\" (UID: \"c028f01a-ed3b-4b34-bb9b-e67e85aff192\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:31:36.454458 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:31:36.454340 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c028f01a-ed3b-4b34-bb9b-e67e85aff192-secret-alertmanager-main-tls podName:c028f01a-ed3b-4b34-bb9b-e67e85aff192 nodeName:}" failed. No retries permitted until 2026-06-09 13:31:36.95431771 +0000 UTC m=+311.654592635 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/c028f01a-ed3b-4b34-bb9b-e67e85aff192-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "c028f01a-ed3b-4b34-bb9b-e67e85aff192") : secret "alertmanager-main-tls" not found Jun 09 13:31:36.454458 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:36.454381 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c028f01a-ed3b-4b34-bb9b-e67e85aff192-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c028f01a-ed3b-4b34-bb9b-e67e85aff192\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:31:36.454458 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:36.454432 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c028f01a-ed3b-4b34-bb9b-e67e85aff192-web-config\") pod \"alertmanager-main-0\" (UID: \"c028f01a-ed3b-4b34-bb9b-e67e85aff192\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:31:36.454760 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:36.454474 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgn7w\" (UniqueName: \"kubernetes.io/projected/c028f01a-ed3b-4b34-bb9b-e67e85aff192-kube-api-access-fgn7w\") pod \"alertmanager-main-0\" (UID: \"c028f01a-ed3b-4b34-bb9b-e67e85aff192\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:31:36.454760 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:36.454511 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c028f01a-ed3b-4b34-bb9b-e67e85aff192-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c028f01a-ed3b-4b34-bb9b-e67e85aff192\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:31:36.454760 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:36.454544 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c028f01a-ed3b-4b34-bb9b-e67e85aff192-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c028f01a-ed3b-4b34-bb9b-e67e85aff192\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:31:36.454760 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:36.454580 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c028f01a-ed3b-4b34-bb9b-e67e85aff192-config-out\") pod \"alertmanager-main-0\" (UID: \"c028f01a-ed3b-4b34-bb9b-e67e85aff192\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:31:36.454760 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:36.454604 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c028f01a-ed3b-4b34-bb9b-e67e85aff192-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c028f01a-ed3b-4b34-bb9b-e67e85aff192\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:31:36.454760 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:36.454638 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c028f01a-ed3b-4b34-bb9b-e67e85aff192-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c028f01a-ed3b-4b34-bb9b-e67e85aff192\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:31:36.455058 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:36.455031 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c028f01a-ed3b-4b34-bb9b-e67e85aff192-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c028f01a-ed3b-4b34-bb9b-e67e85aff192\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:31:36.455327 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:31:36.455174 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c028f01a-ed3b-4b34-bb9b-e67e85aff192-alertmanager-trusted-ca-bundle podName:c028f01a-ed3b-4b34-bb9b-e67e85aff192 nodeName:}" failed. No retries permitted until 2026-06-09 13:31:36.955157225 +0000 UTC m=+311.655432157 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/c028f01a-ed3b-4b34-bb9b-e67e85aff192-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "c028f01a-ed3b-4b34-bb9b-e67e85aff192") : configmap references non-existent config key: ca-bundle.crt Jun 09 13:31:36.457436 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:36.456852 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c028f01a-ed3b-4b34-bb9b-e67e85aff192-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c028f01a-ed3b-4b34-bb9b-e67e85aff192\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:31:36.460113 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:36.458719 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c028f01a-ed3b-4b34-bb9b-e67e85aff192-web-config\") pod \"alertmanager-main-0\" (UID: \"c028f01a-ed3b-4b34-bb9b-e67e85aff192\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:31:36.460113 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:36.459158 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c028f01a-ed3b-4b34-bb9b-e67e85aff192-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c028f01a-ed3b-4b34-bb9b-e67e85aff192\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:31:36.460113 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:36.459429 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c028f01a-ed3b-4b34-bb9b-e67e85aff192-config-out\") pod \"alertmanager-main-0\" (UID: \"c028f01a-ed3b-4b34-bb9b-e67e85aff192\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:31:36.460113 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:36.459731 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c028f01a-ed3b-4b34-bb9b-e67e85aff192-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c028f01a-ed3b-4b34-bb9b-e67e85aff192\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:31:36.460398 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:36.460159 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c028f01a-ed3b-4b34-bb9b-e67e85aff192-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c028f01a-ed3b-4b34-bb9b-e67e85aff192\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:31:36.461288 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:36.461266 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c028f01a-ed3b-4b34-bb9b-e67e85aff192-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c028f01a-ed3b-4b34-bb9b-e67e85aff192\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:31:36.463446 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:36.463405 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c028f01a-ed3b-4b34-bb9b-e67e85aff192-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c028f01a-ed3b-4b34-bb9b-e67e85aff192\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:31:36.463604 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:36.463584 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c028f01a-ed3b-4b34-bb9b-e67e85aff192-config-volume\") pod \"alertmanager-main-0\" (UID: \"c028f01a-ed3b-4b34-bb9b-e67e85aff192\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:31:36.463766 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:36.463728 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgn7w\" (UniqueName: \"kubernetes.io/projected/c028f01a-ed3b-4b34-bb9b-e67e85aff192-kube-api-access-fgn7w\") pod \"alertmanager-main-0\" (UID: \"c028f01a-ed3b-4b34-bb9b-e67e85aff192\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:31:36.819394 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:36.819356 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2f8xq" event={"ID":"9d192875-479d-49a8-9222-b387deab3488","Type":"ContainerStarted","Data":"0a93c48d45cb0dd3781063a52c8cf8e8f4e017895df2ff1e137b875c910e828f"} Jun 09 13:31:36.820591 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:36.820568 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sqhmh" event={"ID":"c0e56023-ee42-4cc6-ada8-15c0376673fb","Type":"ContainerStarted","Data":"be06a4b8464ad27be5d64a1f908b5418019226bac1bbefdfc930ae2bd8a03ba2"} Jun 09 13:31:36.960519 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:36.960478 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c028f01a-ed3b-4b34-bb9b-e67e85aff192-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c028f01a-ed3b-4b34-bb9b-e67e85aff192\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:31:36.960717 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:36.960591 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c028f01a-ed3b-4b34-bb9b-e67e85aff192-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c028f01a-ed3b-4b34-bb9b-e67e85aff192\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:31:36.961681 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:36.961649 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c028f01a-ed3b-4b34-bb9b-e67e85aff192-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c028f01a-ed3b-4b34-bb9b-e67e85aff192\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:31:36.963577 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:36.963546 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c028f01a-ed3b-4b34-bb9b-e67e85aff192-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c028f01a-ed3b-4b34-bb9b-e67e85aff192\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:31:37.212864 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:37.212830 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:31:37.367835 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:37.367757 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 13:31:37.371123 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:31:37.371088 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc028f01a_ed3b_4b34_bb9b_e67e85aff192.slice/crio-0b961848620147f603b168be903833eda8e452ccc617feec938c5424587899ca WatchSource:0}: Error finding container 0b961848620147f603b168be903833eda8e452ccc617feec938c5424587899ca: Status 404 returned error can't find the container with id 0b961848620147f603b168be903833eda8e452ccc617feec938c5424587899ca Jun 09 13:31:37.826494 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:37.826459 2577 generic.go:356] "Generic (PLEG): container finished" podID="c0e56023-ee42-4cc6-ada8-15c0376673fb" containerID="fac5feaf7c7534d0c621282465cc3c02f73c413a270237bc33bb67ea31df53e4" exitCode=0 Jun 09 13:31:37.826679 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:37.826542 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sqhmh" event={"ID":"c0e56023-ee42-4cc6-ada8-15c0376673fb","Type":"ContainerDied","Data":"fac5feaf7c7534d0c621282465cc3c02f73c413a270237bc33bb67ea31df53e4"} Jun 09 13:31:37.827937 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:37.827913 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c028f01a-ed3b-4b34-bb9b-e67e85aff192","Type":"ContainerStarted","Data":"0b961848620147f603b168be903833eda8e452ccc617feec938c5424587899ca"} Jun 09 13:31:37.830390 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:37.830364 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2f8xq" event={"ID":"9d192875-479d-49a8-9222-b387deab3488","Type":"ContainerStarted","Data":"dd9e6a95548749072338641149ee28181c687d143b45a513277178e27c3a1531"} Jun 09 13:31:37.874238 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:37.874166 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2f8xq" podStartSLOduration=1.61799093 podStartE2EDuration="2.874143704s" totalImagesPullingTime="1.256152774s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:31:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:31:37.873635793 +0000 UTC m=+312.573910733" watchObservedRunningTime="2026-06-09 13:31:37.874143704 +0000 UTC m=+312.574418648" Jun 09 13:31:38.836751 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:38.836718 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-zp49d"] Jun 09 13:31:38.842501 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:38.842473 2577 generic.go:356] "Generic (PLEG): container finished" podID="c028f01a-ed3b-4b34-bb9b-e67e85aff192" containerID="886f61ec2e126ded3f503c456e05272432c84c68d16f2fa6b422aee925ebb161" exitCode=0 Jun 09 13:31:38.843049 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:38.843027 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sqhmh" event={"ID":"c0e56023-ee42-4cc6-ada8-15c0376673fb","Type":"ContainerStarted","Data":"106c661b38fcd01e87cf2252b59ac7da8f78f0d60babb0458c5cc8b97e678eff"} Jun 09 13:31:38.843105 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:38.843062 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sqhmh" event={"ID":"c0e56023-ee42-4cc6-ada8-15c0376673fb","Type":"ContainerStarted","Data":"3d4658a8c88d8145ba9aaf1457bec2d87e80fb99f122fd8c6a1a731f7d430579"} Jun 09 13:31:38.843105 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:38.843078 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c028f01a-ed3b-4b34-bb9b-e67e85aff192","Type":"ContainerDied","Data":"886f61ec2e126ded3f503c456e05272432c84c68d16f2fa6b422aee925ebb161"} Jun 09 13:31:38.843220 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:38.843147 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-zp49d" Jun 09 13:31:38.846241 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:38.846223 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 09 13:31:38.846241 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:38.846231 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-mj62z\"" Jun 09 13:31:38.846689 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:38.846672 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 09 13:31:38.851701 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:38.851680 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-zp49d"] Jun 09 13:31:38.863897 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:38.863854 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-sqhmh" podStartSLOduration=2.852578682 podStartE2EDuration="3.863840138s" totalImagesPullingTime="936.594937ms" totalInitContainerRuntime="74.666519ms" isStatefulPod=true podCreationTimestamp="2026-06-09 13:31:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:31:38.863164781 +0000 UTC m=+313.563439721" watchObservedRunningTime="2026-06-09 13:31:38.863840138 +0000 UTC m=+313.564115077" Jun 09 13:31:38.879771 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:38.879739 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftq4p\" (UniqueName: \"kubernetes.io/projected/1ab5424a-30ca-4623-9cae-ecac49d73ffc-kube-api-access-ftq4p\") pod \"downloads-6657875f97-zp49d\" (UID: \"1ab5424a-30ca-4623-9cae-ecac49d73ffc\") " pod="openshift-console/downloads-6657875f97-zp49d" Jun 09 13:31:38.981131 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:38.981099 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftq4p\" (UniqueName: \"kubernetes.io/projected/1ab5424a-30ca-4623-9cae-ecac49d73ffc-kube-api-access-ftq4p\") pod \"downloads-6657875f97-zp49d\" (UID: \"1ab5424a-30ca-4623-9cae-ecac49d73ffc\") " pod="openshift-console/downloads-6657875f97-zp49d" Jun 09 13:31:38.989856 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:38.989819 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftq4p\" (UniqueName: \"kubernetes.io/projected/1ab5424a-30ca-4623-9cae-ecac49d73ffc-kube-api-access-ftq4p\") pod \"downloads-6657875f97-zp49d\" (UID: \"1ab5424a-30ca-4623-9cae-ecac49d73ffc\") " pod="openshift-console/downloads-6657875f97-zp49d" Jun 09 13:31:39.124074 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:39.123985 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-997fbf97b-x4zg5"] Jun 09 13:31:39.153686 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:39.153657 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-zp49d" Jun 09 13:31:39.283162 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:39.283123 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-zp49d"] Jun 09 13:31:39.286475 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:31:39.286448 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ab5424a_30ca_4623_9cae_ecac49d73ffc.slice/crio-694562691ee773c91e9d88e8aaf9edfa55e78effecfd52c5b95d9c1c71883b5a WatchSource:0}: Error finding container 694562691ee773c91e9d88e8aaf9edfa55e78effecfd52c5b95d9c1c71883b5a: Status 404 returned error can't find the container with id 694562691ee773c91e9d88e8aaf9edfa55e78effecfd52c5b95d9c1c71883b5a Jun 09 13:31:39.554546 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:39.554507 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-647ddfdf77-kfhqn"] Jun 09 13:31:39.557917 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:39.557893 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-647ddfdf77-kfhqn" Jun 09 13:31:39.560600 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:39.560581 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 09 13:31:39.560809 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:39.560790 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 09 13:31:39.561590 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:39.561568 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 09 13:31:39.561687 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:39.561611 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-ekavvitl2p781\"" Jun 09 13:31:39.561687 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:39.561624 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 09 13:31:39.561809 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:39.561757 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-lgvzk\"" Jun 09 13:31:39.575756 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:39.575732 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-647ddfdf77-kfhqn"] Jun 09 13:31:39.586099 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:39.586062 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7e1a5795-60bb-43b1-8494-a03103ed9702-metrics-server-audit-profiles\") pod \"metrics-server-647ddfdf77-kfhqn\" (UID: \"7e1a5795-60bb-43b1-8494-a03103ed9702\") " pod="openshift-monitoring/metrics-server-647ddfdf77-kfhqn" Jun 09 13:31:39.586253 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:39.586113 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e1a5795-60bb-43b1-8494-a03103ed9702-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-647ddfdf77-kfhqn\" (UID: \"7e1a5795-60bb-43b1-8494-a03103ed9702\") " pod="openshift-monitoring/metrics-server-647ddfdf77-kfhqn" Jun 09 13:31:39.586253 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:39.586155 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7e1a5795-60bb-43b1-8494-a03103ed9702-secret-metrics-server-client-certs\") pod \"metrics-server-647ddfdf77-kfhqn\" (UID: \"7e1a5795-60bb-43b1-8494-a03103ed9702\") " pod="openshift-monitoring/metrics-server-647ddfdf77-kfhqn" Jun 09 13:31:39.586253 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:39.586202 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7e1a5795-60bb-43b1-8494-a03103ed9702-audit-log\") pod \"metrics-server-647ddfdf77-kfhqn\" (UID: \"7e1a5795-60bb-43b1-8494-a03103ed9702\") " pod="openshift-monitoring/metrics-server-647ddfdf77-kfhqn" Jun 09 13:31:39.586407 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:39.586320 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7e1a5795-60bb-43b1-8494-a03103ed9702-client-ca-bundle\") pod \"metrics-server-647ddfdf77-kfhqn\" (UID: \"7e1a5795-60bb-43b1-8494-a03103ed9702\") " pod="openshift-monitoring/metrics-server-647ddfdf77-kfhqn" Jun 09 13:31:39.586407 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:39.586384 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thn4d\" (UniqueName: \"kubernetes.io/projected/7e1a5795-60bb-43b1-8494-a03103ed9702-kube-api-access-thn4d\") pod \"metrics-server-647ddfdf77-kfhqn\" (UID: \"7e1a5795-60bb-43b1-8494-a03103ed9702\") " pod="openshift-monitoring/metrics-server-647ddfdf77-kfhqn" Jun 09 13:31:39.586500 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:39.586414 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7e1a5795-60bb-43b1-8494-a03103ed9702-secret-metrics-server-tls\") pod \"metrics-server-647ddfdf77-kfhqn\" (UID: \"7e1a5795-60bb-43b1-8494-a03103ed9702\") " pod="openshift-monitoring/metrics-server-647ddfdf77-kfhqn" Jun 09 13:31:39.687237 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:39.687203 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7e1a5795-60bb-43b1-8494-a03103ed9702-secret-metrics-server-client-certs\") pod \"metrics-server-647ddfdf77-kfhqn\" (UID: \"7e1a5795-60bb-43b1-8494-a03103ed9702\") " pod="openshift-monitoring/metrics-server-647ddfdf77-kfhqn" Jun 09 13:31:39.687237 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:39.687239 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7e1a5795-60bb-43b1-8494-a03103ed9702-audit-log\") pod \"metrics-server-647ddfdf77-kfhqn\" (UID: \"7e1a5795-60bb-43b1-8494-a03103ed9702\") " pod="openshift-monitoring/metrics-server-647ddfdf77-kfhqn" Jun 09 13:31:39.687478 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:39.687374 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7e1a5795-60bb-43b1-8494-a03103ed9702-client-ca-bundle\") pod \"metrics-server-647ddfdf77-kfhqn\" (UID: \"7e1a5795-60bb-43b1-8494-a03103ed9702\") " pod="openshift-monitoring/metrics-server-647ddfdf77-kfhqn" Jun 09 13:31:39.687478 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:39.687458 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thn4d\" (UniqueName: \"kubernetes.io/projected/7e1a5795-60bb-43b1-8494-a03103ed9702-kube-api-access-thn4d\") pod \"metrics-server-647ddfdf77-kfhqn\" (UID: \"7e1a5795-60bb-43b1-8494-a03103ed9702\") " pod="openshift-monitoring/metrics-server-647ddfdf77-kfhqn" Jun 09 13:31:39.687590 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:39.687494 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7e1a5795-60bb-43b1-8494-a03103ed9702-secret-metrics-server-tls\") pod \"metrics-server-647ddfdf77-kfhqn\" (UID: \"7e1a5795-60bb-43b1-8494-a03103ed9702\") " pod="openshift-monitoring/metrics-server-647ddfdf77-kfhqn" Jun 09 13:31:39.687590 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:39.687533 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7e1a5795-60bb-43b1-8494-a03103ed9702-metrics-server-audit-profiles\") pod \"metrics-server-647ddfdf77-kfhqn\" (UID: \"7e1a5795-60bb-43b1-8494-a03103ed9702\") " pod="openshift-monitoring/metrics-server-647ddfdf77-kfhqn" Jun 09 13:31:39.687590 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:39.687560 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e1a5795-60bb-43b1-8494-a03103ed9702-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-647ddfdf77-kfhqn\" (UID: \"7e1a5795-60bb-43b1-8494-a03103ed9702\") " pod="openshift-monitoring/metrics-server-647ddfdf77-kfhqn" Jun 09 13:31:39.687590 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:39.687573 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7e1a5795-60bb-43b1-8494-a03103ed9702-audit-log\") pod \"metrics-server-647ddfdf77-kfhqn\" (UID: \"7e1a5795-60bb-43b1-8494-a03103ed9702\") " pod="openshift-monitoring/metrics-server-647ddfdf77-kfhqn" Jun 09 13:31:39.688426 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:39.688400 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e1a5795-60bb-43b1-8494-a03103ed9702-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-647ddfdf77-kfhqn\" (UID: \"7e1a5795-60bb-43b1-8494-a03103ed9702\") " pod="openshift-monitoring/metrics-server-647ddfdf77-kfhqn" Jun 09 13:31:39.688533 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:39.688467 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7e1a5795-60bb-43b1-8494-a03103ed9702-metrics-server-audit-profiles\") pod \"metrics-server-647ddfdf77-kfhqn\" (UID: \"7e1a5795-60bb-43b1-8494-a03103ed9702\") " pod="openshift-monitoring/metrics-server-647ddfdf77-kfhqn" Jun 09 13:31:39.689664 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:39.689637 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7e1a5795-60bb-43b1-8494-a03103ed9702-client-ca-bundle\") pod \"metrics-server-647ddfdf77-kfhqn\" (UID: \"7e1a5795-60bb-43b1-8494-a03103ed9702\") " pod="openshift-monitoring/metrics-server-647ddfdf77-kfhqn" Jun 09 13:31:39.689798 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:39.689779 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7e1a5795-60bb-43b1-8494-a03103ed9702-secret-metrics-server-client-certs\") pod \"metrics-server-647ddfdf77-kfhqn\" (UID: \"7e1a5795-60bb-43b1-8494-a03103ed9702\") " pod="openshift-monitoring/metrics-server-647ddfdf77-kfhqn" Jun 09 13:31:39.689855 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:39.689820 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7e1a5795-60bb-43b1-8494-a03103ed9702-secret-metrics-server-tls\") pod \"metrics-server-647ddfdf77-kfhqn\" (UID: \"7e1a5795-60bb-43b1-8494-a03103ed9702\") " pod="openshift-monitoring/metrics-server-647ddfdf77-kfhqn" Jun 09 13:31:39.695933 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:39.695911 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-thn4d\" (UniqueName: \"kubernetes.io/projected/7e1a5795-60bb-43b1-8494-a03103ed9702-kube-api-access-thn4d\") pod \"metrics-server-647ddfdf77-kfhqn\" (UID: \"7e1a5795-60bb-43b1-8494-a03103ed9702\") " pod="openshift-monitoring/metrics-server-647ddfdf77-kfhqn" Jun 09 13:31:39.848048 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:39.847964 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-zp49d" event={"ID":"1ab5424a-30ca-4623-9cae-ecac49d73ffc","Type":"ContainerStarted","Data":"694562691ee773c91e9d88e8aaf9edfa55e78effecfd52c5b95d9c1c71883b5a"} Jun 09 13:31:39.870848 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:39.870809 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-647ddfdf77-kfhqn" Jun 09 13:31:40.052073 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:40.051988 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-647ddfdf77-kfhqn"] Jun 09 13:31:40.057758 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:31:40.057724 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e1a5795_60bb_43b1_8494_a03103ed9702.slice/crio-ba5edb56d12d98b144da93017b503ebe7ac427305b14549604f86b6f7be58dd4 WatchSource:0}: Error finding container ba5edb56d12d98b144da93017b503ebe7ac427305b14549604f86b6f7be58dd4: Status 404 returned error can't find the container with id ba5edb56d12d98b144da93017b503ebe7ac427305b14549604f86b6f7be58dd4 Jun 09 13:31:40.856239 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:40.856126 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c028f01a-ed3b-4b34-bb9b-e67e85aff192","Type":"ContainerStarted","Data":"7c59a8e2431bf96a333b7e29eaed4d11af953e9cd5a3b6799471c217610e4f59"} Jun 09 13:31:40.858426 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:40.858367 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-647ddfdf77-kfhqn" event={"ID":"7e1a5795-60bb-43b1-8494-a03103ed9702","Type":"ContainerStarted","Data":"ba5edb56d12d98b144da93017b503ebe7ac427305b14549604f86b6f7be58dd4"} Jun 09 13:31:41.546975 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.546934 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 13:31:41.558858 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.558824 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:31:41.561319 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.561290 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 09 13:31:41.561508 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.561325 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 09 13:31:41.561619 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.561599 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 09 13:31:41.562607 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.562589 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 09 13:31:41.562702 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.562661 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 09 13:31:41.562874 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.562857 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 09 13:31:41.563079 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.562916 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 09 13:31:41.563799 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.563778 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 09 13:31:41.564047 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.564024 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 09 13:31:41.564269 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.564252 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 09 13:31:41.564455 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.564435 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 09 13:31:41.564552 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.564522 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-tktsh\"" Jun 09 13:31:41.564895 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.564879 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 09 13:31:41.566600 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.566582 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8nmmc745hch9q\"" Jun 09 13:31:41.567455 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.567290 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 09 13:31:41.573208 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.573003 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 09 13:31:41.573643 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.573624 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 13:31:41.609810 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.609772 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:31:41.609992 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.609823 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:31:41.609992 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.609905 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:31:41.610117 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.609996 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:31:41.610196 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.610156 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:31:41.610333 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.610260 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-web-config\") pod \"prometheus-k8s-0\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:31:41.610333 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.610297 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-config\") pod \"prometheus-k8s-0\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:31:41.610333 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.610325 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:31:41.610503 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.610352 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:31:41.610503 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.610383 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:31:41.610503 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.610407 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5sbd5\" (UniqueName: \"kubernetes.io/projected/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-kube-api-access-5sbd5\") pod \"prometheus-k8s-0\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:31:41.610503 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.610438 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:31:41.610503 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.610476 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:31:41.610773 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.610530 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-config-out\") pod \"prometheus-k8s-0\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:31:41.610773 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.610556 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:31:41.610773 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.610608 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:31:41.610934 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.610784 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:31:41.610934 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.610830 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:31:41.610934 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.610855 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:31:41.610934 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.610908 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:31:41.711893 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.711847 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-web-config\") pod \"prometheus-k8s-0\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:31:41.712066 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.711907 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-config\") pod \"prometheus-k8s-0\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:31:41.712066 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.711934 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:31:41.712066 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.711960 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:31:41.712268 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.712125 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:31:41.712268 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.712166 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sbd5\" (UniqueName: \"kubernetes.io/projected/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-kube-api-access-5sbd5\") pod \"prometheus-k8s-0\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:31:41.712268 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.712234 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:31:41.712421 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.712266 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:31:41.712421 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.712311 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-config-out\") pod \"prometheus-k8s-0\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:31:41.712421 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.712337 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:31:41.712421 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.712368 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:31:41.712421 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.712392 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:31:41.712656 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.712420 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:31:41.712656 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.712444 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:31:41.712656 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.712522 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:31:41.712656 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.712557 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:31:41.712656 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.712584 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:31:41.712656 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.712614 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:31:41.712656 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.712652 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:31:41.712982 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.712699 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:31:41.713758 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.713435 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:31:41.716118 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.714948 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:31:41.716118 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.714949 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:31:41.716118 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.715504 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:31:41.716118 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.715756 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:31:41.716118 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.715813 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:31:41.716118 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.716115 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:31:41.716524 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.716351 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:31:41.716649 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.716626 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:31:41.717306 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.717280 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:31:41.717485 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.717440 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-web-config\") pod \"prometheus-k8s-0\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:31:41.719375 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.719335 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-config\") pod \"prometheus-k8s-0\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:31:41.720217 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.719798 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-config-out\") pod \"prometheus-k8s-0\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:31:41.720217 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.720005 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:31:41.720394 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.720311 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:31:41.720729 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.720691 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:31:41.720991 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.720969 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:31:41.721993 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.721953 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:31:41.722255 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.722200 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:31:41.728605 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.728539 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5sbd5\" (UniqueName: \"kubernetes.io/projected/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-kube-api-access-5sbd5\") pod \"prometheus-k8s-0\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:31:41.869894 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.869816 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c028f01a-ed3b-4b34-bb9b-e67e85aff192","Type":"ContainerStarted","Data":"5c93ab4dbe32e3f086eeadbe48c4863398d020fc5ff1af3a31619c774d441b4c"} Jun 09 13:31:41.869894 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.869894 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c028f01a-ed3b-4b34-bb9b-e67e85aff192","Type":"ContainerStarted","Data":"4415cb77ed7ff837a4eb24b062f34bf61af2008f10ee67fd4e3b7a885b31e1d5"} Jun 09 13:31:41.870429 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.869923 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c028f01a-ed3b-4b34-bb9b-e67e85aff192","Type":"ContainerStarted","Data":"2195f879218c5fd1e0bc52971fb67ae3a30a9797ce168cf131147d4d66f9c4ed"} Jun 09 13:31:41.870429 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.869947 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c028f01a-ed3b-4b34-bb9b-e67e85aff192","Type":"ContainerStarted","Data":"8303603b025bcb55d784876d41277b57213467f2f3ce7eaac02525722eca4f12"} Jun 09 13:31:41.874425 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:41.874390 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:31:42.056773 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:42.056746 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 13:31:42.061370 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:31:42.061238 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b3807ec_80f9_4212_a7d4_d6b2c54fe805.slice/crio-84858d4c438d22c154f869d9a637efe2af44b085daa315d051d6be6f3cd0d93a WatchSource:0}: Error finding container 84858d4c438d22c154f869d9a637efe2af44b085daa315d051d6be6f3cd0d93a: Status 404 returned error can't find the container with id 84858d4c438d22c154f869d9a637efe2af44b085daa315d051d6be6f3cd0d93a Jun 09 13:31:42.876487 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:42.876437 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-647ddfdf77-kfhqn" event={"ID":"7e1a5795-60bb-43b1-8494-a03103ed9702","Type":"ContainerStarted","Data":"670fa385dfc7dd3cf03eb5ccb40dc1835f5f8904e42ca20f27f415fe2716a5f0"} Jun 09 13:31:42.880744 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:42.880665 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c028f01a-ed3b-4b34-bb9b-e67e85aff192","Type":"ContainerStarted","Data":"df2f6ce63e49256856b29afb4032936c60f7f79eba15f660ed4d4ef42a5a721d"} Jun 09 13:31:42.882916 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:42.882883 2577 generic.go:356] "Generic (PLEG): container finished" podID="2b3807ec-80f9-4212-a7d4-d6b2c54fe805" containerID="f6191e0ef0dc3775630ab152f9f945b8e6a291430e5a96a6c30aeb52a3616497" exitCode=0 Jun 09 13:31:42.883047 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:42.882931 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b3807ec-80f9-4212-a7d4-d6b2c54fe805","Type":"ContainerDied","Data":"f6191e0ef0dc3775630ab152f9f945b8e6a291430e5a96a6c30aeb52a3616497"} Jun 09 13:31:42.883047 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:42.882989 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b3807ec-80f9-4212-a7d4-d6b2c54fe805","Type":"ContainerStarted","Data":"84858d4c438d22c154f869d9a637efe2af44b085daa315d051d6be6f3cd0d93a"} Jun 09 13:31:42.895446 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:42.895352 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-647ddfdf77-kfhqn" podStartSLOduration=2.030455548 podStartE2EDuration="3.895334138s" totalImagesPullingTime="1.86487859s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:31:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:31:42.894338632 +0000 UTC m=+317.594613596" watchObservedRunningTime="2026-06-09 13:31:42.895334138 +0000 UTC m=+317.595609078" Jun 09 13:31:42.950681 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:42.950619 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.76784544 podStartE2EDuration="6.950599914s" totalImagesPullingTime="4.162704404s" totalInitContainerRuntime="20.05007ms" isStatefulPod=false podCreationTimestamp="2026-06-09 13:31:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:31:42.949372729 +0000 UTC m=+317.649647695" watchObservedRunningTime="2026-06-09 13:31:42.950599914 +0000 UTC m=+317.650874875" Jun 09 13:31:46.905091 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:46.904998 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b3807ec-80f9-4212-a7d4-d6b2c54fe805","Type":"ContainerStarted","Data":"11d9e819a1c593ad15cdcdbb531968a34f30fe205957a1af55f3bda6ea4bb304"} Jun 09 13:31:46.905512 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:46.905114 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b3807ec-80f9-4212-a7d4-d6b2c54fe805","Type":"ContainerStarted","Data":"8ffc725157d69bccf2c384725a6d25aace3565c884b589e6a21630c3a510f474"} Jun 09 13:31:48.918688 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:48.918647 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b3807ec-80f9-4212-a7d4-d6b2c54fe805","Type":"ContainerStarted","Data":"a536d82b268f506ce4c1dbdf9a88e909deb665f0afbc665b0e45ef7cb1c66e14"} Jun 09 13:31:48.919111 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:48.918727 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b3807ec-80f9-4212-a7d4-d6b2c54fe805","Type":"ContainerStarted","Data":"b63436ddb82aeeb2cc97f9cedf817adb64fe59c81d12385b7a669127f80ec3c7"} Jun 09 13:31:48.919111 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:48.918763 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b3807ec-80f9-4212-a7d4-d6b2c54fe805","Type":"ContainerStarted","Data":"ce79e38c36406f3ca13fea3e9d903eea75d136e975af91beae0e3d31ad44304b"} Jun 09 13:31:48.919111 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:48.918793 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b3807ec-80f9-4212-a7d4-d6b2c54fe805","Type":"ContainerStarted","Data":"643d5b99b01c5ff84444aadd97b3d4ce8f643ef234fad69fe04fdc266c397c39"} Jun 09 13:31:48.945875 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:48.945812 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.425021875 podStartE2EDuration="7.945796816s" totalImagesPullingTime="5.48788787s" totalInitContainerRuntime="32.887071ms" isStatefulPod=false podCreationTimestamp="2026-06-09 13:31:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:31:48.945288964 +0000 UTC m=+323.645563926" watchObservedRunningTime="2026-06-09 13:31:48.945796816 +0000 UTC m=+323.646071757" Jun 09 13:31:51.875204 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:51.875152 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:31:56.959977 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:56.959931 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-zp49d" event={"ID":"1ab5424a-30ca-4623-9cae-ecac49d73ffc","Type":"ContainerStarted","Data":"9c0fa7d7bf8892a713eebe6b13c81dc32eb18e68b6a430e0b81bf66cb0d6c898"} Jun 09 13:31:56.960463 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:56.960039 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-zp49d" Jun 09 13:31:56.976579 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:56.976543 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-zp49d" Jun 09 13:31:56.978053 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:56.978003 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-zp49d" podStartSLOduration=1.782656163 podStartE2EDuration="18.977984439s" totalImagesPullingTime="17.195328276s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:31:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:31:56.976120563 +0000 UTC m=+331.676395526" watchObservedRunningTime="2026-06-09 13:31:56.977984439 +0000 UTC m=+331.678259379" Jun 09 13:31:59.871090 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:59.871049 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-647ddfdf77-kfhqn" Jun 09 13:31:59.871630 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:31:59.871115 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-647ddfdf77-kfhqn" Jun 09 13:32:04.144810 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:04.144737 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-997fbf97b-x4zg5" podUID="495960e5-1fad-4f40-91e4-0962570569ec" containerName="registry" containerID="cri-o://54df1aa7d8fd9cdb64d966a8921bc909589b8755ae5602c1c51b81693b2192af" gracePeriod=30 Jun 09 13:32:04.453019 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:04.452985 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-997fbf97b-x4zg5" Jun 09 13:32:04.543467 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:04.543428 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/495960e5-1fad-4f40-91e4-0962570569ec-ca-trust-extracted\") pod \"495960e5-1fad-4f40-91e4-0962570569ec\" (UID: \"495960e5-1fad-4f40-91e4-0962570569ec\") " Jun 09 13:32:04.543660 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:04.543495 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cssh4\" (UniqueName: \"kubernetes.io/projected/495960e5-1fad-4f40-91e4-0962570569ec-kube-api-access-cssh4\") pod \"495960e5-1fad-4f40-91e4-0962570569ec\" (UID: \"495960e5-1fad-4f40-91e4-0962570569ec\") " Jun 09 13:32:04.543660 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:04.543520 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/495960e5-1fad-4f40-91e4-0962570569ec-bound-sa-token\") pod \"495960e5-1fad-4f40-91e4-0962570569ec\" (UID: \"495960e5-1fad-4f40-91e4-0962570569ec\") " Jun 09 13:32:04.543660 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:04.543551 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/495960e5-1fad-4f40-91e4-0962570569ec-image-registry-private-configuration\") pod \"495960e5-1fad-4f40-91e4-0962570569ec\" (UID: \"495960e5-1fad-4f40-91e4-0962570569ec\") " Jun 09 13:32:04.543660 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:04.543586 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/495960e5-1fad-4f40-91e4-0962570569ec-trusted-ca\") pod \"495960e5-1fad-4f40-91e4-0962570569ec\" (UID: \"495960e5-1fad-4f40-91e4-0962570569ec\") " Jun 09 13:32:04.543660 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:04.543631 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/495960e5-1fad-4f40-91e4-0962570569ec-registry-tls\") pod \"495960e5-1fad-4f40-91e4-0962570569ec\" (UID: \"495960e5-1fad-4f40-91e4-0962570569ec\") " Jun 09 13:32:04.543660 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:04.543654 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/495960e5-1fad-4f40-91e4-0962570569ec-installation-pull-secrets\") pod \"495960e5-1fad-4f40-91e4-0962570569ec\" (UID: \"495960e5-1fad-4f40-91e4-0962570569ec\") " Jun 09 13:32:04.543950 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:04.543698 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/495960e5-1fad-4f40-91e4-0962570569ec-registry-certificates\") pod \"495960e5-1fad-4f40-91e4-0962570569ec\" (UID: \"495960e5-1fad-4f40-91e4-0962570569ec\") " Jun 09 13:32:04.544361 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:04.544302 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/495960e5-1fad-4f40-91e4-0962570569ec-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "495960e5-1fad-4f40-91e4-0962570569ec" (UID: "495960e5-1fad-4f40-91e4-0962570569ec"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 13:32:04.544683 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:04.544615 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/495960e5-1fad-4f40-91e4-0962570569ec-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "495960e5-1fad-4f40-91e4-0962570569ec" (UID: "495960e5-1fad-4f40-91e4-0962570569ec"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 13:32:04.547298 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:04.547205 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/495960e5-1fad-4f40-91e4-0962570569ec-kube-api-access-cssh4" (OuterVolumeSpecName: "kube-api-access-cssh4") pod "495960e5-1fad-4f40-91e4-0962570569ec" (UID: "495960e5-1fad-4f40-91e4-0962570569ec"). InnerVolumeSpecName "kube-api-access-cssh4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 13:32:04.547543 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:04.547503 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/495960e5-1fad-4f40-91e4-0962570569ec-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "495960e5-1fad-4f40-91e4-0962570569ec" (UID: "495960e5-1fad-4f40-91e4-0962570569ec"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 13:32:04.547543 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:04.547532 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/495960e5-1fad-4f40-91e4-0962570569ec-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "495960e5-1fad-4f40-91e4-0962570569ec" (UID: "495960e5-1fad-4f40-91e4-0962570569ec"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 13:32:04.547543 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:04.547514 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/495960e5-1fad-4f40-91e4-0962570569ec-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "495960e5-1fad-4f40-91e4-0962570569ec" (UID: "495960e5-1fad-4f40-91e4-0962570569ec"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 13:32:04.547725 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:04.547680 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/495960e5-1fad-4f40-91e4-0962570569ec-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "495960e5-1fad-4f40-91e4-0962570569ec" (UID: "495960e5-1fad-4f40-91e4-0962570569ec"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 13:32:04.556438 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:04.556413 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/495960e5-1fad-4f40-91e4-0962570569ec-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "495960e5-1fad-4f40-91e4-0962570569ec" (UID: "495960e5-1fad-4f40-91e4-0962570569ec"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 13:32:04.644897 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:04.644851 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cssh4\" (UniqueName: \"kubernetes.io/projected/495960e5-1fad-4f40-91e4-0962570569ec-kube-api-access-cssh4\") on node \"ip-10-0-135-125.ec2.internal\" DevicePath \"\"" Jun 09 13:32:04.644897 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:04.644892 2577 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/495960e5-1fad-4f40-91e4-0962570569ec-bound-sa-token\") on node \"ip-10-0-135-125.ec2.internal\" DevicePath \"\"" Jun 09 13:32:04.644897 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:04.644906 2577 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/495960e5-1fad-4f40-91e4-0962570569ec-image-registry-private-configuration\") on node \"ip-10-0-135-125.ec2.internal\" DevicePath \"\"" Jun 09 13:32:04.645149 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:04.644920 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/495960e5-1fad-4f40-91e4-0962570569ec-trusted-ca\") on node \"ip-10-0-135-125.ec2.internal\" DevicePath \"\"" Jun 09 13:32:04.645149 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:04.644933 2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/495960e5-1fad-4f40-91e4-0962570569ec-registry-tls\") on node \"ip-10-0-135-125.ec2.internal\" DevicePath \"\"" Jun 09 13:32:04.645149 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:04.644946 2577 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/495960e5-1fad-4f40-91e4-0962570569ec-installation-pull-secrets\") on node \"ip-10-0-135-125.ec2.internal\" DevicePath \"\"" Jun 09 13:32:04.645149 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:04.644956 2577 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/495960e5-1fad-4f40-91e4-0962570569ec-registry-certificates\") on node \"ip-10-0-135-125.ec2.internal\" DevicePath \"\"" Jun 09 13:32:04.645149 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:04.644968 2577 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/495960e5-1fad-4f40-91e4-0962570569ec-ca-trust-extracted\") on node \"ip-10-0-135-125.ec2.internal\" DevicePath \"\"" Jun 09 13:32:04.998476 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:04.998441 2577 generic.go:356] "Generic (PLEG): container finished" podID="495960e5-1fad-4f40-91e4-0962570569ec" containerID="54df1aa7d8fd9cdb64d966a8921bc909589b8755ae5602c1c51b81693b2192af" exitCode=0 Jun 09 13:32:04.998668 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:04.998491 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-997fbf97b-x4zg5" Jun 09 13:32:04.998668 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:04.998508 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-997fbf97b-x4zg5" event={"ID":"495960e5-1fad-4f40-91e4-0962570569ec","Type":"ContainerDied","Data":"54df1aa7d8fd9cdb64d966a8921bc909589b8755ae5602c1c51b81693b2192af"} Jun 09 13:32:04.998668 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:04.998555 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-997fbf97b-x4zg5" event={"ID":"495960e5-1fad-4f40-91e4-0962570569ec","Type":"ContainerDied","Data":"1f9e12dc7f606774a18fce91ab2aa321801a46ee1fc1675abb6029fef8a1cf71"} Jun 09 13:32:04.998668 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:04.998578 2577 scope.go:117] "RemoveContainer" containerID="54df1aa7d8fd9cdb64d966a8921bc909589b8755ae5602c1c51b81693b2192af" Jun 09 13:32:05.009556 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:05.009533 2577 scope.go:117] "RemoveContainer" containerID="54df1aa7d8fd9cdb64d966a8921bc909589b8755ae5602c1c51b81693b2192af" Jun 09 13:32:05.009941 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:32:05.009886 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54df1aa7d8fd9cdb64d966a8921bc909589b8755ae5602c1c51b81693b2192af\": container with ID starting with 54df1aa7d8fd9cdb64d966a8921bc909589b8755ae5602c1c51b81693b2192af not found: ID does not exist" containerID="54df1aa7d8fd9cdb64d966a8921bc909589b8755ae5602c1c51b81693b2192af" Jun 09 13:32:05.010027 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:05.009946 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54df1aa7d8fd9cdb64d966a8921bc909589b8755ae5602c1c51b81693b2192af"} err="failed to get container status \"54df1aa7d8fd9cdb64d966a8921bc909589b8755ae5602c1c51b81693b2192af\": rpc error: code = NotFound desc = could not find container \"54df1aa7d8fd9cdb64d966a8921bc909589b8755ae5602c1c51b81693b2192af\": container with ID starting with 54df1aa7d8fd9cdb64d966a8921bc909589b8755ae5602c1c51b81693b2192af not found: ID does not exist" Jun 09 13:32:05.021699 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:05.021663 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-997fbf97b-x4zg5"] Jun 09 13:32:05.026170 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:05.026139 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-997fbf97b-x4zg5"] Jun 09 13:32:05.789480 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:05.789448 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="495960e5-1fad-4f40-91e4-0962570569ec" path="/var/lib/kubelet/pods/495960e5-1fad-4f40-91e4-0962570569ec/volumes" Jun 09 13:32:11.024884 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:11.024847 2577 generic.go:356] "Generic (PLEG): container finished" podID="484d59bc-77c0-4d36-a527-2f0898f1a744" containerID="b02fcd9011d2c2e2588f806a33950783eadddd39e8d7317f3a157c95d842d12a" exitCode=0 Jun 09 13:32:11.025320 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:11.024925 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-5hlz6" event={"ID":"484d59bc-77c0-4d36-a527-2f0898f1a744","Type":"ContainerDied","Data":"b02fcd9011d2c2e2588f806a33950783eadddd39e8d7317f3a157c95d842d12a"} Jun 09 13:32:11.025320 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:11.025251 2577 scope.go:117] "RemoveContainer" containerID="b02fcd9011d2c2e2588f806a33950783eadddd39e8d7317f3a157c95d842d12a" Jun 09 13:32:12.030246 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:12.030213 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-5hlz6" event={"ID":"484d59bc-77c0-4d36-a527-2f0898f1a744","Type":"ContainerStarted","Data":"cf42f349a95ed510076bc1c29419ef3bfe9f70636e671722c68f9df7162d7de1"} Jun 09 13:32:19.876119 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:19.876041 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-647ddfdf77-kfhqn" Jun 09 13:32:19.879875 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:19.879853 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-647ddfdf77-kfhqn" Jun 09 13:32:39.760473 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:39.760412 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ee23738-5173-4f32-83d2-4f47140592b3-metrics-certs\") pod \"network-metrics-daemon-s8xkw\" (UID: \"5ee23738-5173-4f32-83d2-4f47140592b3\") " pod="openshift-multus/network-metrics-daemon-s8xkw" Jun 09 13:32:39.762788 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:39.762760 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ee23738-5173-4f32-83d2-4f47140592b3-metrics-certs\") pod \"network-metrics-daemon-s8xkw\" (UID: \"5ee23738-5173-4f32-83d2-4f47140592b3\") " pod="openshift-multus/network-metrics-daemon-s8xkw" Jun 09 13:32:39.990413 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:39.990376 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8wq29\"" Jun 09 13:32:39.995491 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:39.995467 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s8xkw" Jun 09 13:32:40.189272 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:40.189238 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-s8xkw"] Jun 09 13:32:40.192345 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:32:40.192308 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ee23738_5173_4f32_83d2_4f47140592b3.slice/crio-7da76cc9220815384f0530c270321bba2b67924ac06f121568b60dcd0ac22723 WatchSource:0}: Error finding container 7da76cc9220815384f0530c270321bba2b67924ac06f121568b60dcd0ac22723: Status 404 returned error can't find the container with id 7da76cc9220815384f0530c270321bba2b67924ac06f121568b60dcd0ac22723 Jun 09 13:32:41.141866 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:41.141829 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-s8xkw" event={"ID":"5ee23738-5173-4f32-83d2-4f47140592b3","Type":"ContainerStarted","Data":"7da76cc9220815384f0530c270321bba2b67924ac06f121568b60dcd0ac22723"} Jun 09 13:32:41.875883 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:41.875058 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:32:41.946879 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:41.946848 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:32:42.151722 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:42.151685 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-s8xkw" event={"ID":"5ee23738-5173-4f32-83d2-4f47140592b3","Type":"ContainerStarted","Data":"91bc02abc53817f8d48b6de7d582be884c4950ee8316e54e0b7c7d14eb0c6f78"} Jun 09 13:32:42.152073 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:42.151745 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-s8xkw" event={"ID":"5ee23738-5173-4f32-83d2-4f47140592b3","Type":"ContainerStarted","Data":"5853ad289bee2cfeaf2d831a37893d5a3c3765fa77a43fb0a9158e6ac6bdcb96"} Jun 09 13:32:42.180207 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:42.177672 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-s8xkw" podStartSLOduration=375.653665039 podStartE2EDuration="6m17.177644123s" totalImagesPullingTime="1.523979084s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:26:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:32:42.168591343 +0000 UTC m=+376.868866305" watchObservedRunningTime="2026-06-09 13:32:42.177644123 +0000 UTC m=+376.877919063" Jun 09 13:32:42.184404 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:42.184380 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:32:55.676167 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:55.676127 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 13:32:55.676670 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:55.676437 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c028f01a-ed3b-4b34-bb9b-e67e85aff192" containerName="alertmanager" containerID="cri-o://7c59a8e2431bf96a333b7e29eaed4d11af953e9cd5a3b6799471c217610e4f59" gracePeriod=120 Jun 09 13:32:55.676670 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:55.676490 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c028f01a-ed3b-4b34-bb9b-e67e85aff192" containerName="kube-rbac-proxy-metric" containerID="cri-o://5c93ab4dbe32e3f086eeadbe48c4863398d020fc5ff1af3a31619c774d441b4c" gracePeriod=120 Jun 09 13:32:55.676670 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:55.676534 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c028f01a-ed3b-4b34-bb9b-e67e85aff192" containerName="config-reloader" containerID="cri-o://8303603b025bcb55d784876d41277b57213467f2f3ce7eaac02525722eca4f12" gracePeriod=120 Jun 09 13:32:55.676670 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:55.676576 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c028f01a-ed3b-4b34-bb9b-e67e85aff192" containerName="kube-rbac-proxy" containerID="cri-o://4415cb77ed7ff837a4eb24b062f34bf61af2008f10ee67fd4e3b7a885b31e1d5" gracePeriod=120 Jun 09 13:32:55.676670 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:55.676586 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c028f01a-ed3b-4b34-bb9b-e67e85aff192" containerName="prom-label-proxy" containerID="cri-o://df2f6ce63e49256856b29afb4032936c60f7f79eba15f660ed4d4ef42a5a721d" gracePeriod=120 Jun 09 13:32:55.676670 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:55.676523 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c028f01a-ed3b-4b34-bb9b-e67e85aff192" containerName="kube-rbac-proxy-web" containerID="cri-o://2195f879218c5fd1e0bc52971fb67ae3a30a9797ce168cf131147d4d66f9c4ed" gracePeriod=120 Jun 09 13:32:56.210425 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:56.210393 2577 generic.go:356] "Generic (PLEG): container finished" podID="c028f01a-ed3b-4b34-bb9b-e67e85aff192" containerID="df2f6ce63e49256856b29afb4032936c60f7f79eba15f660ed4d4ef42a5a721d" exitCode=0 Jun 09 13:32:56.210425 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:56.210418 2577 generic.go:356] "Generic (PLEG): container finished" podID="c028f01a-ed3b-4b34-bb9b-e67e85aff192" containerID="5c93ab4dbe32e3f086eeadbe48c4863398d020fc5ff1af3a31619c774d441b4c" exitCode=0 Jun 09 13:32:56.210425 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:56.210426 2577 generic.go:356] "Generic (PLEG): container finished" podID="c028f01a-ed3b-4b34-bb9b-e67e85aff192" containerID="4415cb77ed7ff837a4eb24b062f34bf61af2008f10ee67fd4e3b7a885b31e1d5" exitCode=0 Jun 09 13:32:56.210425 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:56.210434 2577 generic.go:356] "Generic (PLEG): container finished" podID="c028f01a-ed3b-4b34-bb9b-e67e85aff192" containerID="8303603b025bcb55d784876d41277b57213467f2f3ce7eaac02525722eca4f12" exitCode=0 Jun 09 13:32:56.210425 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:56.210442 2577 generic.go:356] "Generic (PLEG): container finished" podID="c028f01a-ed3b-4b34-bb9b-e67e85aff192" containerID="7c59a8e2431bf96a333b7e29eaed4d11af953e9cd5a3b6799471c217610e4f59" exitCode=0 Jun 09 13:32:56.210732 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:56.210472 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c028f01a-ed3b-4b34-bb9b-e67e85aff192","Type":"ContainerDied","Data":"df2f6ce63e49256856b29afb4032936c60f7f79eba15f660ed4d4ef42a5a721d"} Jun 09 13:32:56.210732 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:56.210541 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c028f01a-ed3b-4b34-bb9b-e67e85aff192","Type":"ContainerDied","Data":"5c93ab4dbe32e3f086eeadbe48c4863398d020fc5ff1af3a31619c774d441b4c"} Jun 09 13:32:56.210732 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:56.210568 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c028f01a-ed3b-4b34-bb9b-e67e85aff192","Type":"ContainerDied","Data":"4415cb77ed7ff837a4eb24b062f34bf61af2008f10ee67fd4e3b7a885b31e1d5"} Jun 09 13:32:56.210732 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:56.210592 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c028f01a-ed3b-4b34-bb9b-e67e85aff192","Type":"ContainerDied","Data":"8303603b025bcb55d784876d41277b57213467f2f3ce7eaac02525722eca4f12"} Jun 09 13:32:56.210732 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:56.210616 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c028f01a-ed3b-4b34-bb9b-e67e85aff192","Type":"ContainerDied","Data":"7c59a8e2431bf96a333b7e29eaed4d11af953e9cd5a3b6799471c217610e4f59"} Jun 09 13:32:56.931975 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:56.931948 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:32:57.027255 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.027163 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c028f01a-ed3b-4b34-bb9b-e67e85aff192-alertmanager-trusted-ca-bundle\") pod \"c028f01a-ed3b-4b34-bb9b-e67e85aff192\" (UID: \"c028f01a-ed3b-4b34-bb9b-e67e85aff192\") " Jun 09 13:32:57.027255 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.027236 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c028f01a-ed3b-4b34-bb9b-e67e85aff192-metrics-client-ca\") pod \"c028f01a-ed3b-4b34-bb9b-e67e85aff192\" (UID: \"c028f01a-ed3b-4b34-bb9b-e67e85aff192\") " Jun 09 13:32:57.027478 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.027262 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c028f01a-ed3b-4b34-bb9b-e67e85aff192-config-out\") pod \"c028f01a-ed3b-4b34-bb9b-e67e85aff192\" (UID: \"c028f01a-ed3b-4b34-bb9b-e67e85aff192\") " Jun 09 13:32:57.027478 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.027278 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c028f01a-ed3b-4b34-bb9b-e67e85aff192-alertmanager-main-db\") pod \"c028f01a-ed3b-4b34-bb9b-e67e85aff192\" (UID: \"c028f01a-ed3b-4b34-bb9b-e67e85aff192\") " Jun 09 13:32:57.027478 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.027300 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fgn7w\" (UniqueName: \"kubernetes.io/projected/c028f01a-ed3b-4b34-bb9b-e67e85aff192-kube-api-access-fgn7w\") pod \"c028f01a-ed3b-4b34-bb9b-e67e85aff192\" (UID: \"c028f01a-ed3b-4b34-bb9b-e67e85aff192\") " Jun 09 13:32:57.027478 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.027348 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c028f01a-ed3b-4b34-bb9b-e67e85aff192-web-config\") pod \"c028f01a-ed3b-4b34-bb9b-e67e85aff192\" (UID: \"c028f01a-ed3b-4b34-bb9b-e67e85aff192\") " Jun 09 13:32:57.027478 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.027382 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c028f01a-ed3b-4b34-bb9b-e67e85aff192-cluster-tls-config\") pod \"c028f01a-ed3b-4b34-bb9b-e67e85aff192\" (UID: \"c028f01a-ed3b-4b34-bb9b-e67e85aff192\") " Jun 09 13:32:57.027478 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.027419 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c028f01a-ed3b-4b34-bb9b-e67e85aff192-secret-alertmanager-kube-rbac-proxy-metric\") pod \"c028f01a-ed3b-4b34-bb9b-e67e85aff192\" (UID: \"c028f01a-ed3b-4b34-bb9b-e67e85aff192\") " Jun 09 13:32:57.027478 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.027449 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c028f01a-ed3b-4b34-bb9b-e67e85aff192-secret-alertmanager-kube-rbac-proxy\") pod \"c028f01a-ed3b-4b34-bb9b-e67e85aff192\" (UID: \"c028f01a-ed3b-4b34-bb9b-e67e85aff192\") " Jun 09 13:32:57.027478 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.027478 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c028f01a-ed3b-4b34-bb9b-e67e85aff192-secret-alertmanager-kube-rbac-proxy-web\") pod \"c028f01a-ed3b-4b34-bb9b-e67e85aff192\" (UID: \"c028f01a-ed3b-4b34-bb9b-e67e85aff192\") " Jun 09 13:32:57.027824 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.027528 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c028f01a-ed3b-4b34-bb9b-e67e85aff192-secret-alertmanager-main-tls\") pod \"c028f01a-ed3b-4b34-bb9b-e67e85aff192\" (UID: \"c028f01a-ed3b-4b34-bb9b-e67e85aff192\") " Jun 09 13:32:57.027824 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.027560 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c028f01a-ed3b-4b34-bb9b-e67e85aff192-config-volume\") pod \"c028f01a-ed3b-4b34-bb9b-e67e85aff192\" (UID: \"c028f01a-ed3b-4b34-bb9b-e67e85aff192\") " Jun 09 13:32:57.027824 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.027589 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c028f01a-ed3b-4b34-bb9b-e67e85aff192-tls-assets\") pod \"c028f01a-ed3b-4b34-bb9b-e67e85aff192\" (UID: \"c028f01a-ed3b-4b34-bb9b-e67e85aff192\") " Jun 09 13:32:57.027824 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.027585 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c028f01a-ed3b-4b34-bb9b-e67e85aff192-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "c028f01a-ed3b-4b34-bb9b-e67e85aff192" (UID: "c028f01a-ed3b-4b34-bb9b-e67e85aff192"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 13:32:57.027824 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.027636 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c028f01a-ed3b-4b34-bb9b-e67e85aff192-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "c028f01a-ed3b-4b34-bb9b-e67e85aff192" (UID: "c028f01a-ed3b-4b34-bb9b-e67e85aff192"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 13:32:57.028217 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.027876 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c028f01a-ed3b-4b34-bb9b-e67e85aff192-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "c028f01a-ed3b-4b34-bb9b-e67e85aff192" (UID: "c028f01a-ed3b-4b34-bb9b-e67e85aff192"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 13:32:57.028372 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.028318 2577 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c028f01a-ed3b-4b34-bb9b-e67e85aff192-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-135-125.ec2.internal\" DevicePath \"\"" Jun 09 13:32:57.028372 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.028354 2577 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c028f01a-ed3b-4b34-bb9b-e67e85aff192-metrics-client-ca\") on node \"ip-10-0-135-125.ec2.internal\" DevicePath \"\"" Jun 09 13:32:57.028481 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.028375 2577 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c028f01a-ed3b-4b34-bb9b-e67e85aff192-alertmanager-main-db\") on node \"ip-10-0-135-125.ec2.internal\" DevicePath \"\"" Jun 09 13:32:57.030908 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.030802 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c028f01a-ed3b-4b34-bb9b-e67e85aff192-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "c028f01a-ed3b-4b34-bb9b-e67e85aff192" (UID: "c028f01a-ed3b-4b34-bb9b-e67e85aff192"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 13:32:57.036805 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.031676 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c028f01a-ed3b-4b34-bb9b-e67e85aff192-config-out" (OuterVolumeSpecName: "config-out") pod "c028f01a-ed3b-4b34-bb9b-e67e85aff192" (UID: "c028f01a-ed3b-4b34-bb9b-e67e85aff192"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 13:32:57.036805 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.035673 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c028f01a-ed3b-4b34-bb9b-e67e85aff192-kube-api-access-fgn7w" (OuterVolumeSpecName: "kube-api-access-fgn7w") pod "c028f01a-ed3b-4b34-bb9b-e67e85aff192" (UID: "c028f01a-ed3b-4b34-bb9b-e67e85aff192"). InnerVolumeSpecName "kube-api-access-fgn7w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 13:32:57.037042 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.036956 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c028f01a-ed3b-4b34-bb9b-e67e85aff192-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "c028f01a-ed3b-4b34-bb9b-e67e85aff192" (UID: "c028f01a-ed3b-4b34-bb9b-e67e85aff192"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 13:32:57.038304 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.038276 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c028f01a-ed3b-4b34-bb9b-e67e85aff192-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "c028f01a-ed3b-4b34-bb9b-e67e85aff192" (UID: "c028f01a-ed3b-4b34-bb9b-e67e85aff192"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 13:32:57.038419 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.038258 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c028f01a-ed3b-4b34-bb9b-e67e85aff192-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "c028f01a-ed3b-4b34-bb9b-e67e85aff192" (UID: "c028f01a-ed3b-4b34-bb9b-e67e85aff192"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 13:32:57.038726 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.038702 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c028f01a-ed3b-4b34-bb9b-e67e85aff192-config-volume" (OuterVolumeSpecName: "config-volume") pod "c028f01a-ed3b-4b34-bb9b-e67e85aff192" (UID: "c028f01a-ed3b-4b34-bb9b-e67e85aff192"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 13:32:57.039836 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.039808 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c028f01a-ed3b-4b34-bb9b-e67e85aff192-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "c028f01a-ed3b-4b34-bb9b-e67e85aff192" (UID: "c028f01a-ed3b-4b34-bb9b-e67e85aff192"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 13:32:57.041656 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.041632 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c028f01a-ed3b-4b34-bb9b-e67e85aff192-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "c028f01a-ed3b-4b34-bb9b-e67e85aff192" (UID: "c028f01a-ed3b-4b34-bb9b-e67e85aff192"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 13:32:57.045091 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.045072 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c028f01a-ed3b-4b34-bb9b-e67e85aff192-web-config" (OuterVolumeSpecName: "web-config") pod "c028f01a-ed3b-4b34-bb9b-e67e85aff192" (UID: "c028f01a-ed3b-4b34-bb9b-e67e85aff192"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 13:32:57.129260 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.129173 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c028f01a-ed3b-4b34-bb9b-e67e85aff192-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-135-125.ec2.internal\" DevicePath \"\"" Jun 09 13:32:57.129260 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.129255 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c028f01a-ed3b-4b34-bb9b-e67e85aff192-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-135-125.ec2.internal\" DevicePath \"\"" Jun 09 13:32:57.129260 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.129267 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c028f01a-ed3b-4b34-bb9b-e67e85aff192-secret-alertmanager-main-tls\") on node \"ip-10-0-135-125.ec2.internal\" DevicePath \"\"" Jun 09 13:32:57.129260 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.129277 2577 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c028f01a-ed3b-4b34-bb9b-e67e85aff192-config-volume\") on node \"ip-10-0-135-125.ec2.internal\" DevicePath \"\"" Jun 09 13:32:57.129519 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.129285 2577 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c028f01a-ed3b-4b34-bb9b-e67e85aff192-tls-assets\") on node \"ip-10-0-135-125.ec2.internal\" DevicePath \"\"" Jun 09 13:32:57.129519 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.129293 2577 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c028f01a-ed3b-4b34-bb9b-e67e85aff192-config-out\") on node \"ip-10-0-135-125.ec2.internal\" DevicePath \"\"" Jun 09 13:32:57.129519 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.129301 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fgn7w\" (UniqueName: \"kubernetes.io/projected/c028f01a-ed3b-4b34-bb9b-e67e85aff192-kube-api-access-fgn7w\") on node \"ip-10-0-135-125.ec2.internal\" DevicePath \"\"" Jun 09 13:32:57.129519 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.129326 2577 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c028f01a-ed3b-4b34-bb9b-e67e85aff192-web-config\") on node \"ip-10-0-135-125.ec2.internal\" DevicePath \"\"" Jun 09 13:32:57.129519 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.129336 2577 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c028f01a-ed3b-4b34-bb9b-e67e85aff192-cluster-tls-config\") on node \"ip-10-0-135-125.ec2.internal\" DevicePath \"\"" Jun 09 13:32:57.129519 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.129344 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c028f01a-ed3b-4b34-bb9b-e67e85aff192-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-135-125.ec2.internal\" DevicePath \"\"" Jun 09 13:32:57.218012 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.217976 2577 generic.go:356] "Generic (PLEG): container finished" podID="c028f01a-ed3b-4b34-bb9b-e67e85aff192" containerID="2195f879218c5fd1e0bc52971fb67ae3a30a9797ce168cf131147d4d66f9c4ed" exitCode=0 Jun 09 13:32:57.218171 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.218057 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c028f01a-ed3b-4b34-bb9b-e67e85aff192","Type":"ContainerDied","Data":"2195f879218c5fd1e0bc52971fb67ae3a30a9797ce168cf131147d4d66f9c4ed"} Jun 09 13:32:57.218171 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.218079 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:32:57.218171 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.218166 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c028f01a-ed3b-4b34-bb9b-e67e85aff192","Type":"ContainerDied","Data":"0b961848620147f603b168be903833eda8e452ccc617feec938c5424587899ca"} Jun 09 13:32:57.218396 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.218211 2577 scope.go:117] "RemoveContainer" containerID="df2f6ce63e49256856b29afb4032936c60f7f79eba15f660ed4d4ef42a5a721d" Jun 09 13:32:57.226993 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.226974 2577 scope.go:117] "RemoveContainer" containerID="5c93ab4dbe32e3f086eeadbe48c4863398d020fc5ff1af3a31619c774d441b4c" Jun 09 13:32:57.234290 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.234268 2577 scope.go:117] "RemoveContainer" containerID="4415cb77ed7ff837a4eb24b062f34bf61af2008f10ee67fd4e3b7a885b31e1d5" Jun 09 13:32:57.241852 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.241815 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 13:32:57.241909 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.241879 2577 scope.go:117] "RemoveContainer" containerID="2195f879218c5fd1e0bc52971fb67ae3a30a9797ce168cf131147d4d66f9c4ed" Jun 09 13:32:57.245966 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.245941 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 13:32:57.250214 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.250165 2577 scope.go:117] "RemoveContainer" containerID="8303603b025bcb55d784876d41277b57213467f2f3ce7eaac02525722eca4f12" Jun 09 13:32:57.257052 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.257036 2577 scope.go:117] "RemoveContainer" containerID="7c59a8e2431bf96a333b7e29eaed4d11af953e9cd5a3b6799471c217610e4f59" Jun 09 13:32:57.264052 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.264027 2577 scope.go:117] "RemoveContainer" containerID="886f61ec2e126ded3f503c456e05272432c84c68d16f2fa6b422aee925ebb161" Jun 09 13:32:57.270991 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.270963 2577 scope.go:117] "RemoveContainer" containerID="df2f6ce63e49256856b29afb4032936c60f7f79eba15f660ed4d4ef42a5a721d" Jun 09 13:32:57.271394 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:32:57.271359 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df2f6ce63e49256856b29afb4032936c60f7f79eba15f660ed4d4ef42a5a721d\": container with ID starting with df2f6ce63e49256856b29afb4032936c60f7f79eba15f660ed4d4ef42a5a721d not found: ID does not exist" containerID="df2f6ce63e49256856b29afb4032936c60f7f79eba15f660ed4d4ef42a5a721d" Jun 09 13:32:57.271512 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.271394 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df2f6ce63e49256856b29afb4032936c60f7f79eba15f660ed4d4ef42a5a721d"} err="failed to get container status \"df2f6ce63e49256856b29afb4032936c60f7f79eba15f660ed4d4ef42a5a721d\": rpc error: code = NotFound desc = could not find container \"df2f6ce63e49256856b29afb4032936c60f7f79eba15f660ed4d4ef42a5a721d\": container with ID starting with df2f6ce63e49256856b29afb4032936c60f7f79eba15f660ed4d4ef42a5a721d not found: ID does not exist" Jun 09 13:32:57.271512 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.271414 2577 scope.go:117] "RemoveContainer" containerID="5c93ab4dbe32e3f086eeadbe48c4863398d020fc5ff1af3a31619c774d441b4c" Jun 09 13:32:57.271856 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:32:57.271667 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c93ab4dbe32e3f086eeadbe48c4863398d020fc5ff1af3a31619c774d441b4c\": container with ID starting with 5c93ab4dbe32e3f086eeadbe48c4863398d020fc5ff1af3a31619c774d441b4c not found: ID does not exist" containerID="5c93ab4dbe32e3f086eeadbe48c4863398d020fc5ff1af3a31619c774d441b4c" Jun 09 13:32:57.271856 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.271697 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c93ab4dbe32e3f086eeadbe48c4863398d020fc5ff1af3a31619c774d441b4c"} err="failed to get container status \"5c93ab4dbe32e3f086eeadbe48c4863398d020fc5ff1af3a31619c774d441b4c\": rpc error: code = NotFound desc = could not find container \"5c93ab4dbe32e3f086eeadbe48c4863398d020fc5ff1af3a31619c774d441b4c\": container with ID starting with 5c93ab4dbe32e3f086eeadbe48c4863398d020fc5ff1af3a31619c774d441b4c not found: ID does not exist" Jun 09 13:32:57.271856 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.271717 2577 scope.go:117] "RemoveContainer" containerID="4415cb77ed7ff837a4eb24b062f34bf61af2008f10ee67fd4e3b7a885b31e1d5" Jun 09 13:32:57.272044 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:32:57.271968 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4415cb77ed7ff837a4eb24b062f34bf61af2008f10ee67fd4e3b7a885b31e1d5\": container with ID starting with 4415cb77ed7ff837a4eb24b062f34bf61af2008f10ee67fd4e3b7a885b31e1d5 not found: ID does not exist" containerID="4415cb77ed7ff837a4eb24b062f34bf61af2008f10ee67fd4e3b7a885b31e1d5" Jun 09 13:32:57.272044 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.271994 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4415cb77ed7ff837a4eb24b062f34bf61af2008f10ee67fd4e3b7a885b31e1d5"} err="failed to get container status \"4415cb77ed7ff837a4eb24b062f34bf61af2008f10ee67fd4e3b7a885b31e1d5\": rpc error: code = NotFound desc = could not find container \"4415cb77ed7ff837a4eb24b062f34bf61af2008f10ee67fd4e3b7a885b31e1d5\": container with ID starting with 4415cb77ed7ff837a4eb24b062f34bf61af2008f10ee67fd4e3b7a885b31e1d5 not found: ID does not exist" Jun 09 13:32:57.272044 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.272009 2577 scope.go:117] "RemoveContainer" containerID="2195f879218c5fd1e0bc52971fb67ae3a30a9797ce168cf131147d4d66f9c4ed" Jun 09 13:32:57.272296 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:32:57.272273 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2195f879218c5fd1e0bc52971fb67ae3a30a9797ce168cf131147d4d66f9c4ed\": container with ID starting with 2195f879218c5fd1e0bc52971fb67ae3a30a9797ce168cf131147d4d66f9c4ed not found: ID does not exist" containerID="2195f879218c5fd1e0bc52971fb67ae3a30a9797ce168cf131147d4d66f9c4ed" Jun 09 13:32:57.272353 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.272301 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2195f879218c5fd1e0bc52971fb67ae3a30a9797ce168cf131147d4d66f9c4ed"} err="failed to get container status \"2195f879218c5fd1e0bc52971fb67ae3a30a9797ce168cf131147d4d66f9c4ed\": rpc error: code = NotFound desc = could not find container \"2195f879218c5fd1e0bc52971fb67ae3a30a9797ce168cf131147d4d66f9c4ed\": container with ID starting with 2195f879218c5fd1e0bc52971fb67ae3a30a9797ce168cf131147d4d66f9c4ed not found: ID does not exist" Jun 09 13:32:57.272353 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.272314 2577 scope.go:117] "RemoveContainer" containerID="8303603b025bcb55d784876d41277b57213467f2f3ce7eaac02525722eca4f12" Jun 09 13:32:57.272521 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:32:57.272506 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8303603b025bcb55d784876d41277b57213467f2f3ce7eaac02525722eca4f12\": container with ID starting with 8303603b025bcb55d784876d41277b57213467f2f3ce7eaac02525722eca4f12 not found: ID does not exist" containerID="8303603b025bcb55d784876d41277b57213467f2f3ce7eaac02525722eca4f12" Jun 09 13:32:57.272579 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.272524 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8303603b025bcb55d784876d41277b57213467f2f3ce7eaac02525722eca4f12"} err="failed to get container status \"8303603b025bcb55d784876d41277b57213467f2f3ce7eaac02525722eca4f12\": rpc error: code = NotFound desc = could not find container \"8303603b025bcb55d784876d41277b57213467f2f3ce7eaac02525722eca4f12\": container with ID starting with 8303603b025bcb55d784876d41277b57213467f2f3ce7eaac02525722eca4f12 not found: ID does not exist" Jun 09 13:32:57.272579 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.272535 2577 scope.go:117] "RemoveContainer" containerID="7c59a8e2431bf96a333b7e29eaed4d11af953e9cd5a3b6799471c217610e4f59" Jun 09 13:32:57.272751 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:32:57.272735 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c59a8e2431bf96a333b7e29eaed4d11af953e9cd5a3b6799471c217610e4f59\": container with ID starting with 7c59a8e2431bf96a333b7e29eaed4d11af953e9cd5a3b6799471c217610e4f59 not found: ID does not exist" containerID="7c59a8e2431bf96a333b7e29eaed4d11af953e9cd5a3b6799471c217610e4f59" Jun 09 13:32:57.272805 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.272754 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c59a8e2431bf96a333b7e29eaed4d11af953e9cd5a3b6799471c217610e4f59"} err="failed to get container status \"7c59a8e2431bf96a333b7e29eaed4d11af953e9cd5a3b6799471c217610e4f59\": rpc error: code = NotFound desc = could not find container \"7c59a8e2431bf96a333b7e29eaed4d11af953e9cd5a3b6799471c217610e4f59\": container with ID starting with 7c59a8e2431bf96a333b7e29eaed4d11af953e9cd5a3b6799471c217610e4f59 not found: ID does not exist" Jun 09 13:32:57.272805 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.272766 2577 scope.go:117] "RemoveContainer" containerID="886f61ec2e126ded3f503c456e05272432c84c68d16f2fa6b422aee925ebb161" Jun 09 13:32:57.273029 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:32:57.273012 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"886f61ec2e126ded3f503c456e05272432c84c68d16f2fa6b422aee925ebb161\": container with ID starting with 886f61ec2e126ded3f503c456e05272432c84c68d16f2fa6b422aee925ebb161 not found: ID does not exist" containerID="886f61ec2e126ded3f503c456e05272432c84c68d16f2fa6b422aee925ebb161" Jun 09 13:32:57.273085 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.273033 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"886f61ec2e126ded3f503c456e05272432c84c68d16f2fa6b422aee925ebb161"} err="failed to get container status \"886f61ec2e126ded3f503c456e05272432c84c68d16f2fa6b422aee925ebb161\": rpc error: code = NotFound desc = could not find container \"886f61ec2e126ded3f503c456e05272432c84c68d16f2fa6b422aee925ebb161\": container with ID starting with 886f61ec2e126ded3f503c456e05272432c84c68d16f2fa6b422aee925ebb161 not found: ID does not exist" Jun 09 13:32:57.273138 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.273117 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 13:32:57.273458 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.273441 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c028f01a-ed3b-4b34-bb9b-e67e85aff192" containerName="kube-rbac-proxy-web" Jun 09 13:32:57.273536 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.273460 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c028f01a-ed3b-4b34-bb9b-e67e85aff192" containerName="kube-rbac-proxy-web" Jun 09 13:32:57.273536 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.273483 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="495960e5-1fad-4f40-91e4-0962570569ec" containerName="registry" Jun 09 13:32:57.273536 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.273491 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="495960e5-1fad-4f40-91e4-0962570569ec" containerName="registry" Jun 09 13:32:57.273536 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.273503 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c028f01a-ed3b-4b34-bb9b-e67e85aff192" containerName="config-reloader" Jun 09 13:32:57.273536 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.273512 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c028f01a-ed3b-4b34-bb9b-e67e85aff192" containerName="config-reloader" Jun 09 13:32:57.273536 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.273530 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c028f01a-ed3b-4b34-bb9b-e67e85aff192" containerName="prom-label-proxy" Jun 09 13:32:57.273536 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.273538 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c028f01a-ed3b-4b34-bb9b-e67e85aff192" containerName="prom-label-proxy" Jun 09 13:32:57.273867 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.273551 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c028f01a-ed3b-4b34-bb9b-e67e85aff192" containerName="kube-rbac-proxy-metric" Jun 09 13:32:57.273867 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.273559 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c028f01a-ed3b-4b34-bb9b-e67e85aff192" containerName="kube-rbac-proxy-metric" Jun 09 13:32:57.273867 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.273577 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c028f01a-ed3b-4b34-bb9b-e67e85aff192" containerName="init-config-reloader" Jun 09 13:32:57.273867 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.273586 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c028f01a-ed3b-4b34-bb9b-e67e85aff192" containerName="init-config-reloader" Jun 09 13:32:57.273867 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.273596 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c028f01a-ed3b-4b34-bb9b-e67e85aff192" containerName="alertmanager" Jun 09 13:32:57.273867 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.273605 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c028f01a-ed3b-4b34-bb9b-e67e85aff192" containerName="alertmanager" Jun 09 13:32:57.273867 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.273616 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c028f01a-ed3b-4b34-bb9b-e67e85aff192" containerName="kube-rbac-proxy" Jun 09 13:32:57.273867 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.273625 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c028f01a-ed3b-4b34-bb9b-e67e85aff192" containerName="kube-rbac-proxy" Jun 09 13:32:57.273867 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.273698 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="495960e5-1fad-4f40-91e4-0962570569ec" containerName="registry" Jun 09 13:32:57.273867 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.273711 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c028f01a-ed3b-4b34-bb9b-e67e85aff192" containerName="alertmanager" Jun 09 13:32:57.273867 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.273722 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c028f01a-ed3b-4b34-bb9b-e67e85aff192" containerName="kube-rbac-proxy-web" Jun 09 13:32:57.273867 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.273731 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c028f01a-ed3b-4b34-bb9b-e67e85aff192" containerName="kube-rbac-proxy" Jun 09 13:32:57.273867 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.273742 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c028f01a-ed3b-4b34-bb9b-e67e85aff192" containerName="kube-rbac-proxy-metric" Jun 09 13:32:57.273867 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.273753 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c028f01a-ed3b-4b34-bb9b-e67e85aff192" containerName="prom-label-proxy" Jun 09 13:32:57.273867 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.273761 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c028f01a-ed3b-4b34-bb9b-e67e85aff192" containerName="config-reloader" Jun 09 13:32:57.278804 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.278756 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:32:57.281153 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.281136 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-fc2gl\"" Jun 09 13:32:57.281282 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.281264 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 09 13:32:57.281372 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.281357 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 09 13:32:57.281459 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.281444 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 09 13:32:57.281524 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.281449 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 09 13:32:57.281701 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.281685 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 09 13:32:57.282044 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.282027 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 09 13:32:57.282243 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.282055 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 09 13:32:57.282243 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.282150 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 09 13:32:57.286353 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.286335 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 09 13:32:57.293490 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.293468 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 13:32:57.330654 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.330623 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6d380652-f181-4b10-914d-bafb30cbce75-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6d380652-f181-4b10-914d-bafb30cbce75\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:32:57.330858 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.330664 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6d380652-f181-4b10-914d-bafb30cbce75-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6d380652-f181-4b10-914d-bafb30cbce75\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:32:57.330858 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.330681 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6d380652-f181-4b10-914d-bafb30cbce75-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6d380652-f181-4b10-914d-bafb30cbce75\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:32:57.330858 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.330735 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6d380652-f181-4b10-914d-bafb30cbce75-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6d380652-f181-4b10-914d-bafb30cbce75\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:32:57.330858 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.330782 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6d380652-f181-4b10-914d-bafb30cbce75-web-config\") pod \"alertmanager-main-0\" (UID: \"6d380652-f181-4b10-914d-bafb30cbce75\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:32:57.330858 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.330805 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6d380652-f181-4b10-914d-bafb30cbce75-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6d380652-f181-4b10-914d-bafb30cbce75\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:32:57.330858 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.330840 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6d380652-f181-4b10-914d-bafb30cbce75-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6d380652-f181-4b10-914d-bafb30cbce75\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:32:57.331084 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.330898 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6d380652-f181-4b10-914d-bafb30cbce75-config-volume\") pod \"alertmanager-main-0\" (UID: \"6d380652-f181-4b10-914d-bafb30cbce75\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:32:57.331084 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.330929 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6d380652-f181-4b10-914d-bafb30cbce75-config-out\") pod \"alertmanager-main-0\" (UID: \"6d380652-f181-4b10-914d-bafb30cbce75\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:32:57.331084 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.330945 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d380652-f181-4b10-914d-bafb30cbce75-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6d380652-f181-4b10-914d-bafb30cbce75\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:32:57.331084 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.330986 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6d380652-f181-4b10-914d-bafb30cbce75-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6d380652-f181-4b10-914d-bafb30cbce75\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:32:57.331084 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.331032 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7k5dt\" (UniqueName: \"kubernetes.io/projected/6d380652-f181-4b10-914d-bafb30cbce75-kube-api-access-7k5dt\") pod \"alertmanager-main-0\" (UID: \"6d380652-f181-4b10-914d-bafb30cbce75\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:32:57.331084 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.331058 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d380652-f181-4b10-914d-bafb30cbce75-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6d380652-f181-4b10-914d-bafb30cbce75\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:32:57.432481 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.432446 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7k5dt\" (UniqueName: \"kubernetes.io/projected/6d380652-f181-4b10-914d-bafb30cbce75-kube-api-access-7k5dt\") pod \"alertmanager-main-0\" (UID: \"6d380652-f181-4b10-914d-bafb30cbce75\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:32:57.432481 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.432487 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d380652-f181-4b10-914d-bafb30cbce75-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6d380652-f181-4b10-914d-bafb30cbce75\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:32:57.432745 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.432582 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6d380652-f181-4b10-914d-bafb30cbce75-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6d380652-f181-4b10-914d-bafb30cbce75\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:32:57.432745 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.432632 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6d380652-f181-4b10-914d-bafb30cbce75-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6d380652-f181-4b10-914d-bafb30cbce75\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:32:57.432745 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.432658 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6d380652-f181-4b10-914d-bafb30cbce75-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6d380652-f181-4b10-914d-bafb30cbce75\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:32:57.432911 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.432775 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6d380652-f181-4b10-914d-bafb30cbce75-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6d380652-f181-4b10-914d-bafb30cbce75\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:32:57.432911 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.432819 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6d380652-f181-4b10-914d-bafb30cbce75-web-config\") pod \"alertmanager-main-0\" (UID: \"6d380652-f181-4b10-914d-bafb30cbce75\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:32:57.432911 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.432844 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6d380652-f181-4b10-914d-bafb30cbce75-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6d380652-f181-4b10-914d-bafb30cbce75\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:32:57.432911 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.432888 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6d380652-f181-4b10-914d-bafb30cbce75-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6d380652-f181-4b10-914d-bafb30cbce75\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:32:57.433116 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.432922 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6d380652-f181-4b10-914d-bafb30cbce75-config-volume\") pod \"alertmanager-main-0\" (UID: \"6d380652-f181-4b10-914d-bafb30cbce75\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:32:57.433116 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.432944 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6d380652-f181-4b10-914d-bafb30cbce75-config-out\") pod \"alertmanager-main-0\" (UID: \"6d380652-f181-4b10-914d-bafb30cbce75\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:32:57.433116 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.432967 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d380652-f181-4b10-914d-bafb30cbce75-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6d380652-f181-4b10-914d-bafb30cbce75\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:32:57.433116 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.433026 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6d380652-f181-4b10-914d-bafb30cbce75-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6d380652-f181-4b10-914d-bafb30cbce75\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:32:57.433455 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.433432 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d380652-f181-4b10-914d-bafb30cbce75-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6d380652-f181-4b10-914d-bafb30cbce75\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:32:57.435846 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.435818 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6d380652-f181-4b10-914d-bafb30cbce75-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6d380652-f181-4b10-914d-bafb30cbce75\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:32:57.435846 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.435839 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6d380652-f181-4b10-914d-bafb30cbce75-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6d380652-f181-4b10-914d-bafb30cbce75\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:32:57.436021 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.435819 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6d380652-f181-4b10-914d-bafb30cbce75-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6d380652-f181-4b10-914d-bafb30cbce75\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:32:57.436021 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.435980 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6d380652-f181-4b10-914d-bafb30cbce75-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6d380652-f181-4b10-914d-bafb30cbce75\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:32:57.436124 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.436054 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6d380652-f181-4b10-914d-bafb30cbce75-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6d380652-f181-4b10-914d-bafb30cbce75\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:32:57.436124 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.436098 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6d380652-f181-4b10-914d-bafb30cbce75-config-volume\") pod \"alertmanager-main-0\" (UID: \"6d380652-f181-4b10-914d-bafb30cbce75\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:32:57.436124 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.436113 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6d380652-f181-4b10-914d-bafb30cbce75-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6d380652-f181-4b10-914d-bafb30cbce75\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:32:57.436314 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.436106 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6d380652-f181-4b10-914d-bafb30cbce75-web-config\") pod \"alertmanager-main-0\" (UID: \"6d380652-f181-4b10-914d-bafb30cbce75\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:32:57.436459 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.436441 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6d380652-f181-4b10-914d-bafb30cbce75-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6d380652-f181-4b10-914d-bafb30cbce75\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:32:57.436516 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.436460 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d380652-f181-4b10-914d-bafb30cbce75-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6d380652-f181-4b10-914d-bafb30cbce75\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:32:57.437589 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.437572 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6d380652-f181-4b10-914d-bafb30cbce75-config-out\") pod \"alertmanager-main-0\" (UID: \"6d380652-f181-4b10-914d-bafb30cbce75\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:32:57.440322 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.440299 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7k5dt\" (UniqueName: \"kubernetes.io/projected/6d380652-f181-4b10-914d-bafb30cbce75-kube-api-access-7k5dt\") pod \"alertmanager-main-0\" (UID: \"6d380652-f181-4b10-914d-bafb30cbce75\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:32:57.588372 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.588270 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:32:57.724062 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.723968 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 13:32:57.726479 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:32:57.726453 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d380652_f181_4b10_914d_bafb30cbce75.slice/crio-650ab88ce7dd0e547844497f5e515ef04a6d693d519895c43beeb901a061ccb4 WatchSource:0}: Error finding container 650ab88ce7dd0e547844497f5e515ef04a6d693d519895c43beeb901a061ccb4: Status 404 returned error can't find the container with id 650ab88ce7dd0e547844497f5e515ef04a6d693d519895c43beeb901a061ccb4 Jun 09 13:32:57.791088 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:57.791059 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c028f01a-ed3b-4b34-bb9b-e67e85aff192" path="/var/lib/kubelet/pods/c028f01a-ed3b-4b34-bb9b-e67e85aff192/volumes" Jun 09 13:32:58.223271 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:58.223240 2577 generic.go:356] "Generic (PLEG): container finished" podID="6d380652-f181-4b10-914d-bafb30cbce75" containerID="a7f2493468c934f3d7c891f70e7c7926b8f7f7421cfabc9d16923b79e67f0d0e" exitCode=0 Jun 09 13:32:58.223673 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:58.223329 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6d380652-f181-4b10-914d-bafb30cbce75","Type":"ContainerDied","Data":"a7f2493468c934f3d7c891f70e7c7926b8f7f7421cfabc9d16923b79e67f0d0e"} Jun 09 13:32:58.223673 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:58.223395 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6d380652-f181-4b10-914d-bafb30cbce75","Type":"ContainerStarted","Data":"650ab88ce7dd0e547844497f5e515ef04a6d693d519895c43beeb901a061ccb4"} Jun 09 13:32:59.229932 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:59.229893 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6d380652-f181-4b10-914d-bafb30cbce75","Type":"ContainerStarted","Data":"87ae1e0d55399333b366c043b38eebdaaa8a1a331e90d399fe65f64d2fde49b9"} Jun 09 13:32:59.230308 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:59.230011 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6d380652-f181-4b10-914d-bafb30cbce75","Type":"ContainerStarted","Data":"1a91f7661b346a5937947e025a81df6dbe93fdd6703762719e16b4d6617548d0"} Jun 09 13:32:59.230308 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:59.230051 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6d380652-f181-4b10-914d-bafb30cbce75","Type":"ContainerStarted","Data":"12d6b22a305575a737f505c6d59e28a364098a3594f76d2288e60981eb55cffd"} Jun 09 13:32:59.230308 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:59.230086 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6d380652-f181-4b10-914d-bafb30cbce75","Type":"ContainerStarted","Data":"a039a3bfab792f8d255bda69608e0672faee380912759263d9fa4dc86a369871"} Jun 09 13:32:59.230308 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:59.230122 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6d380652-f181-4b10-914d-bafb30cbce75","Type":"ContainerStarted","Data":"5b7eb3dfb67ed980dfe0ec011226c14bfc89bcd5ddec9ca707653a635ac87a0c"} Jun 09 13:32:59.230308 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:59.230166 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6d380652-f181-4b10-914d-bafb30cbce75","Type":"ContainerStarted","Data":"7ff2dfe7c9edf9c2c4be219287122d6599febe43614d37adfd2b40e01afe8804"} Jun 09 13:32:59.260756 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:59.260697 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.245850955 podStartE2EDuration="2.26067951s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.828555ms" isStatefulPod=false podCreationTimestamp="2026-06-09 13:32:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:32:59.260122718 +0000 UTC m=+393.960397675" watchObservedRunningTime="2026-06-09 13:32:59.26067951 +0000 UTC m=+393.960954449" Jun 09 13:32:59.917816 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:59.917786 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 13:32:59.918427 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:59.918071 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2b3807ec-80f9-4212-a7d4-d6b2c54fe805" containerName="prometheus" containerID="cri-o://8ffc725157d69bccf2c384725a6d25aace3565c884b589e6a21630c3a510f474" gracePeriod=600 Jun 09 13:32:59.918427 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:59.918106 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2b3807ec-80f9-4212-a7d4-d6b2c54fe805" containerName="thanos-sidecar" containerID="cri-o://643d5b99b01c5ff84444aadd97b3d4ce8f643ef234fad69fe04fdc266c397c39" gracePeriod=600 Jun 09 13:32:59.918427 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:59.918123 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2b3807ec-80f9-4212-a7d4-d6b2c54fe805" containerName="kube-rbac-proxy-web" containerID="cri-o://ce79e38c36406f3ca13fea3e9d903eea75d136e975af91beae0e3d31ad44304b" gracePeriod=600 Jun 09 13:32:59.918427 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:59.918159 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2b3807ec-80f9-4212-a7d4-d6b2c54fe805" containerName="kube-rbac-proxy-thanos" containerID="cri-o://a536d82b268f506ce4c1dbdf9a88e909deb665f0afbc665b0e45ef7cb1c66e14" gracePeriod=600 Jun 09 13:32:59.918427 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:59.918159 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2b3807ec-80f9-4212-a7d4-d6b2c54fe805" containerName="config-reloader" containerID="cri-o://11d9e819a1c593ad15cdcdbb531968a34f30fe205957a1af55f3bda6ea4bb304" gracePeriod=600 Jun 09 13:32:59.918427 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:32:59.918092 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2b3807ec-80f9-4212-a7d4-d6b2c54fe805" containerName="kube-rbac-proxy" containerID="cri-o://b63436ddb82aeeb2cc97f9cedf817adb64fe59c81d12385b7a669127f80ec3c7" gracePeriod=600 Jun 09 13:33:00.238612 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:00.238577 2577 generic.go:356] "Generic (PLEG): container finished" podID="2b3807ec-80f9-4212-a7d4-d6b2c54fe805" containerID="a536d82b268f506ce4c1dbdf9a88e909deb665f0afbc665b0e45ef7cb1c66e14" exitCode=0 Jun 09 13:33:00.238612 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:00.238602 2577 generic.go:356] "Generic (PLEG): container finished" podID="2b3807ec-80f9-4212-a7d4-d6b2c54fe805" containerID="b63436ddb82aeeb2cc97f9cedf817adb64fe59c81d12385b7a669127f80ec3c7" exitCode=0 Jun 09 13:33:00.238612 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:00.238611 2577 generic.go:356] "Generic (PLEG): container finished" podID="2b3807ec-80f9-4212-a7d4-d6b2c54fe805" containerID="643d5b99b01c5ff84444aadd97b3d4ce8f643ef234fad69fe04fdc266c397c39" exitCode=0 Jun 09 13:33:00.238612 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:00.238617 2577 generic.go:356] "Generic (PLEG): container finished" podID="2b3807ec-80f9-4212-a7d4-d6b2c54fe805" containerID="11d9e819a1c593ad15cdcdbb531968a34f30fe205957a1af55f3bda6ea4bb304" exitCode=0 Jun 09 13:33:00.238612 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:00.238623 2577 generic.go:356] "Generic (PLEG): container finished" podID="2b3807ec-80f9-4212-a7d4-d6b2c54fe805" containerID="8ffc725157d69bccf2c384725a6d25aace3565c884b589e6a21630c3a510f474" exitCode=0 Jun 09 13:33:00.239090 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:00.238648 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b3807ec-80f9-4212-a7d4-d6b2c54fe805","Type":"ContainerDied","Data":"a536d82b268f506ce4c1dbdf9a88e909deb665f0afbc665b0e45ef7cb1c66e14"} Jun 09 13:33:00.239090 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:00.238708 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b3807ec-80f9-4212-a7d4-d6b2c54fe805","Type":"ContainerDied","Data":"b63436ddb82aeeb2cc97f9cedf817adb64fe59c81d12385b7a669127f80ec3c7"} Jun 09 13:33:00.239090 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:00.238736 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b3807ec-80f9-4212-a7d4-d6b2c54fe805","Type":"ContainerDied","Data":"643d5b99b01c5ff84444aadd97b3d4ce8f643ef234fad69fe04fdc266c397c39"} Jun 09 13:33:00.239090 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:00.238761 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b3807ec-80f9-4212-a7d4-d6b2c54fe805","Type":"ContainerDied","Data":"11d9e819a1c593ad15cdcdbb531968a34f30fe205957a1af55f3bda6ea4bb304"} Jun 09 13:33:00.239090 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:00.238785 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b3807ec-80f9-4212-a7d4-d6b2c54fe805","Type":"ContainerDied","Data":"8ffc725157d69bccf2c384725a6d25aace3565c884b589e6a21630c3a510f474"} Jun 09 13:33:01.170353 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.170327 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:01.247269 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.247167 2577 generic.go:356] "Generic (PLEG): container finished" podID="2b3807ec-80f9-4212-a7d4-d6b2c54fe805" containerID="ce79e38c36406f3ca13fea3e9d903eea75d136e975af91beae0e3d31ad44304b" exitCode=0 Jun 09 13:33:01.247269 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.247219 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b3807ec-80f9-4212-a7d4-d6b2c54fe805","Type":"ContainerDied","Data":"ce79e38c36406f3ca13fea3e9d903eea75d136e975af91beae0e3d31ad44304b"} Jun 09 13:33:01.247735 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.247281 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:01.247735 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.247308 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b3807ec-80f9-4212-a7d4-d6b2c54fe805","Type":"ContainerDied","Data":"84858d4c438d22c154f869d9a637efe2af44b085daa315d051d6be6f3cd0d93a"} Jun 09 13:33:01.247735 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.247355 2577 scope.go:117] "RemoveContainer" containerID="a536d82b268f506ce4c1dbdf9a88e909deb665f0afbc665b0e45ef7cb1c66e14" Jun 09 13:33:01.255912 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.255895 2577 scope.go:117] "RemoveContainer" containerID="b63436ddb82aeeb2cc97f9cedf817adb64fe59c81d12385b7a669127f80ec3c7" Jun 09 13:33:01.262739 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.262723 2577 scope.go:117] "RemoveContainer" containerID="ce79e38c36406f3ca13fea3e9d903eea75d136e975af91beae0e3d31ad44304b" Jun 09 13:33:01.263528 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.263511 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-configmap-serving-certs-ca-bundle\") pod \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " Jun 09 13:33:01.263595 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.263548 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-prometheus-k8s-rulefiles-1\") pod \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " Jun 09 13:33:01.263595 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.263572 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-tls-assets\") pod \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " Jun 09 13:33:01.263753 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.263647 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " Jun 09 13:33:01.263753 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.263705 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-secret-prometheus-k8s-tls\") pod \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " Jun 09 13:33:01.263753 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.263731 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-config\") pod \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " Jun 09 13:33:01.264025 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.263884 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "2b3807ec-80f9-4212-a7d4-d6b2c54fe805" (UID: "2b3807ec-80f9-4212-a7d4-d6b2c54fe805"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 13:33:01.264025 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.263931 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-prometheus-k8s-db\") pod \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " Jun 09 13:33:01.264025 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.263960 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-config-out\") pod \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " Jun 09 13:33:01.264212 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.264111 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-configmap-kubelet-serving-ca-bundle\") pod \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " Jun 09 13:33:01.264212 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.264143 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5sbd5\" (UniqueName: \"kubernetes.io/projected/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-kube-api-access-5sbd5\") pod \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " Jun 09 13:33:01.264212 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.264167 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-secret-grpc-tls\") pod \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " Jun 09 13:33:01.264358 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.264150 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "2b3807ec-80f9-4212-a7d4-d6b2c54fe805" (UID: "2b3807ec-80f9-4212-a7d4-d6b2c54fe805"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 13:33:01.264358 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.264223 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-prometheus-trusted-ca-bundle\") pod \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " Jun 09 13:33:01.264358 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.264252 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " Jun 09 13:33:01.264515 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.264288 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-configmap-metrics-client-ca\") pod \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " Jun 09 13:33:01.264515 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.264457 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-secret-kube-rbac-proxy\") pod \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " Jun 09 13:33:01.264801 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.264777 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-prometheus-k8s-rulefiles-0\") pod \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " Jun 09 13:33:01.264801 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.264792 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "2b3807ec-80f9-4212-a7d4-d6b2c54fe805" (UID: "2b3807ec-80f9-4212-a7d4-d6b2c54fe805"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 13:33:01.264926 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.264838 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-prometheus-k8s-rulefiles-2\") pod \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " Jun 09 13:33:01.264926 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.264839 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "2b3807ec-80f9-4212-a7d4-d6b2c54fe805" (UID: "2b3807ec-80f9-4212-a7d4-d6b2c54fe805"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 13:33:01.264926 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.264868 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-web-config\") pod \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " Jun 09 13:33:01.265480 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.264963 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "2b3807ec-80f9-4212-a7d4-d6b2c54fe805" (UID: "2b3807ec-80f9-4212-a7d4-d6b2c54fe805"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 13:33:01.265578 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.265535 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "2b3807ec-80f9-4212-a7d4-d6b2c54fe805" (UID: "2b3807ec-80f9-4212-a7d4-d6b2c54fe805"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 13:33:01.265642 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.265580 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-secret-metrics-client-certs\") pod \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " Jun 09 13:33:01.265642 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.265617 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-thanos-prometheus-http-client-file\") pod \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\" (UID: \"2b3807ec-80f9-4212-a7d4-d6b2c54fe805\") " Jun 09 13:33:01.266250 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.265879 2577 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-135-125.ec2.internal\" DevicePath \"\"" Jun 09 13:33:01.266250 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.265902 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-135-125.ec2.internal\" DevicePath \"\"" Jun 09 13:33:01.266250 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.265916 2577 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-135-125.ec2.internal\" DevicePath \"\"" Jun 09 13:33:01.266250 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.265929 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-prometheus-trusted-ca-bundle\") on node \"ip-10-0-135-125.ec2.internal\" DevicePath \"\"" Jun 09 13:33:01.266250 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.265943 2577 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-configmap-metrics-client-ca\") on node \"ip-10-0-135-125.ec2.internal\" DevicePath \"\"" Jun 09 13:33:01.266250 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.265957 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-135-125.ec2.internal\" DevicePath \"\"" Jun 09 13:33:01.266586 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.266473 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "2b3807ec-80f9-4212-a7d4-d6b2c54fe805" (UID: "2b3807ec-80f9-4212-a7d4-d6b2c54fe805"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 13:33:01.266586 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.266549 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "2b3807ec-80f9-4212-a7d4-d6b2c54fe805" (UID: "2b3807ec-80f9-4212-a7d4-d6b2c54fe805"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 13:33:01.266813 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.266779 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "2b3807ec-80f9-4212-a7d4-d6b2c54fe805" (UID: "2b3807ec-80f9-4212-a7d4-d6b2c54fe805"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 13:33:01.267992 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.267964 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "2b3807ec-80f9-4212-a7d4-d6b2c54fe805" (UID: "2b3807ec-80f9-4212-a7d4-d6b2c54fe805"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 13:33:01.268128 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.268104 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "2b3807ec-80f9-4212-a7d4-d6b2c54fe805" (UID: "2b3807ec-80f9-4212-a7d4-d6b2c54fe805"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 13:33:01.268567 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.268528 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-config-out" (OuterVolumeSpecName: "config-out") pod "2b3807ec-80f9-4212-a7d4-d6b2c54fe805" (UID: "2b3807ec-80f9-4212-a7d4-d6b2c54fe805"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 13:33:01.268680 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.268616 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "2b3807ec-80f9-4212-a7d4-d6b2c54fe805" (UID: "2b3807ec-80f9-4212-a7d4-d6b2c54fe805"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 13:33:01.268941 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.268919 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "2b3807ec-80f9-4212-a7d4-d6b2c54fe805" (UID: "2b3807ec-80f9-4212-a7d4-d6b2c54fe805"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 13:33:01.269009 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.268975 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "2b3807ec-80f9-4212-a7d4-d6b2c54fe805" (UID: "2b3807ec-80f9-4212-a7d4-d6b2c54fe805"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 13:33:01.269009 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.268984 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-config" (OuterVolumeSpecName: "config") pod "2b3807ec-80f9-4212-a7d4-d6b2c54fe805" (UID: "2b3807ec-80f9-4212-a7d4-d6b2c54fe805"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 13:33:01.269391 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.269369 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "2b3807ec-80f9-4212-a7d4-d6b2c54fe805" (UID: "2b3807ec-80f9-4212-a7d4-d6b2c54fe805"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 13:33:01.269828 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.269810 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "2b3807ec-80f9-4212-a7d4-d6b2c54fe805" (UID: "2b3807ec-80f9-4212-a7d4-d6b2c54fe805"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 13:33:01.270430 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.270408 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-kube-api-access-5sbd5" (OuterVolumeSpecName: "kube-api-access-5sbd5") pod "2b3807ec-80f9-4212-a7d4-d6b2c54fe805" (UID: "2b3807ec-80f9-4212-a7d4-d6b2c54fe805"). InnerVolumeSpecName "kube-api-access-5sbd5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 13:33:01.278939 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.278918 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-web-config" (OuterVolumeSpecName: "web-config") pod "2b3807ec-80f9-4212-a7d4-d6b2c54fe805" (UID: "2b3807ec-80f9-4212-a7d4-d6b2c54fe805"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 13:33:01.287660 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.287638 2577 scope.go:117] "RemoveContainer" containerID="643d5b99b01c5ff84444aadd97b3d4ce8f643ef234fad69fe04fdc266c397c39" Jun 09 13:33:01.295012 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.294990 2577 scope.go:117] "RemoveContainer" containerID="11d9e819a1c593ad15cdcdbb531968a34f30fe205957a1af55f3bda6ea4bb304" Jun 09 13:33:01.302074 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.302057 2577 scope.go:117] "RemoveContainer" containerID="8ffc725157d69bccf2c384725a6d25aace3565c884b589e6a21630c3a510f474" Jun 09 13:33:01.309419 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.309400 2577 scope.go:117] "RemoveContainer" containerID="f6191e0ef0dc3775630ab152f9f945b8e6a291430e5a96a6c30aeb52a3616497" Jun 09 13:33:01.316382 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.316354 2577 scope.go:117] "RemoveContainer" containerID="a536d82b268f506ce4c1dbdf9a88e909deb665f0afbc665b0e45ef7cb1c66e14" Jun 09 13:33:01.316641 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:33:01.316619 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a536d82b268f506ce4c1dbdf9a88e909deb665f0afbc665b0e45ef7cb1c66e14\": container with ID starting with a536d82b268f506ce4c1dbdf9a88e909deb665f0afbc665b0e45ef7cb1c66e14 not found: ID does not exist" containerID="a536d82b268f506ce4c1dbdf9a88e909deb665f0afbc665b0e45ef7cb1c66e14" Jun 09 13:33:01.316688 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.316651 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a536d82b268f506ce4c1dbdf9a88e909deb665f0afbc665b0e45ef7cb1c66e14"} err="failed to get container status \"a536d82b268f506ce4c1dbdf9a88e909deb665f0afbc665b0e45ef7cb1c66e14\": rpc error: code = NotFound desc = could not find container \"a536d82b268f506ce4c1dbdf9a88e909deb665f0afbc665b0e45ef7cb1c66e14\": container with ID starting with a536d82b268f506ce4c1dbdf9a88e909deb665f0afbc665b0e45ef7cb1c66e14 not found: ID does not exist" Jun 09 13:33:01.316688 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.316669 2577 scope.go:117] "RemoveContainer" containerID="b63436ddb82aeeb2cc97f9cedf817adb64fe59c81d12385b7a669127f80ec3c7" Jun 09 13:33:01.316935 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:33:01.316917 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b63436ddb82aeeb2cc97f9cedf817adb64fe59c81d12385b7a669127f80ec3c7\": container with ID starting with b63436ddb82aeeb2cc97f9cedf817adb64fe59c81d12385b7a669127f80ec3c7 not found: ID does not exist" containerID="b63436ddb82aeeb2cc97f9cedf817adb64fe59c81d12385b7a669127f80ec3c7" Jun 09 13:33:01.316992 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.316947 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b63436ddb82aeeb2cc97f9cedf817adb64fe59c81d12385b7a669127f80ec3c7"} err="failed to get container status \"b63436ddb82aeeb2cc97f9cedf817adb64fe59c81d12385b7a669127f80ec3c7\": rpc error: code = NotFound desc = could not find container \"b63436ddb82aeeb2cc97f9cedf817adb64fe59c81d12385b7a669127f80ec3c7\": container with ID starting with b63436ddb82aeeb2cc97f9cedf817adb64fe59c81d12385b7a669127f80ec3c7 not found: ID does not exist" Jun 09 13:33:01.316992 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.316969 2577 scope.go:117] "RemoveContainer" containerID="ce79e38c36406f3ca13fea3e9d903eea75d136e975af91beae0e3d31ad44304b" Jun 09 13:33:01.317235 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:33:01.317213 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce79e38c36406f3ca13fea3e9d903eea75d136e975af91beae0e3d31ad44304b\": container with ID starting with ce79e38c36406f3ca13fea3e9d903eea75d136e975af91beae0e3d31ad44304b not found: ID does not exist" containerID="ce79e38c36406f3ca13fea3e9d903eea75d136e975af91beae0e3d31ad44304b" Jun 09 13:33:01.317280 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.317242 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce79e38c36406f3ca13fea3e9d903eea75d136e975af91beae0e3d31ad44304b"} err="failed to get container status \"ce79e38c36406f3ca13fea3e9d903eea75d136e975af91beae0e3d31ad44304b\": rpc error: code = NotFound desc = could not find container \"ce79e38c36406f3ca13fea3e9d903eea75d136e975af91beae0e3d31ad44304b\": container with ID starting with ce79e38c36406f3ca13fea3e9d903eea75d136e975af91beae0e3d31ad44304b not found: ID does not exist" Jun 09 13:33:01.317280 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.317256 2577 scope.go:117] "RemoveContainer" containerID="643d5b99b01c5ff84444aadd97b3d4ce8f643ef234fad69fe04fdc266c397c39" Jun 09 13:33:01.317487 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:33:01.317470 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"643d5b99b01c5ff84444aadd97b3d4ce8f643ef234fad69fe04fdc266c397c39\": container with ID starting with 643d5b99b01c5ff84444aadd97b3d4ce8f643ef234fad69fe04fdc266c397c39 not found: ID does not exist" containerID="643d5b99b01c5ff84444aadd97b3d4ce8f643ef234fad69fe04fdc266c397c39" Jun 09 13:33:01.317549 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.317494 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"643d5b99b01c5ff84444aadd97b3d4ce8f643ef234fad69fe04fdc266c397c39"} err="failed to get container status \"643d5b99b01c5ff84444aadd97b3d4ce8f643ef234fad69fe04fdc266c397c39\": rpc error: code = NotFound desc = could not find container \"643d5b99b01c5ff84444aadd97b3d4ce8f643ef234fad69fe04fdc266c397c39\": container with ID starting with 643d5b99b01c5ff84444aadd97b3d4ce8f643ef234fad69fe04fdc266c397c39 not found: ID does not exist" Jun 09 13:33:01.317549 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.317513 2577 scope.go:117] "RemoveContainer" containerID="11d9e819a1c593ad15cdcdbb531968a34f30fe205957a1af55f3bda6ea4bb304" Jun 09 13:33:01.317761 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:33:01.317742 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11d9e819a1c593ad15cdcdbb531968a34f30fe205957a1af55f3bda6ea4bb304\": container with ID starting with 11d9e819a1c593ad15cdcdbb531968a34f30fe205957a1af55f3bda6ea4bb304 not found: ID does not exist" containerID="11d9e819a1c593ad15cdcdbb531968a34f30fe205957a1af55f3bda6ea4bb304" Jun 09 13:33:01.317800 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.317764 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11d9e819a1c593ad15cdcdbb531968a34f30fe205957a1af55f3bda6ea4bb304"} err="failed to get container status \"11d9e819a1c593ad15cdcdbb531968a34f30fe205957a1af55f3bda6ea4bb304\": rpc error: code = NotFound desc = could not find container \"11d9e819a1c593ad15cdcdbb531968a34f30fe205957a1af55f3bda6ea4bb304\": container with ID starting with 11d9e819a1c593ad15cdcdbb531968a34f30fe205957a1af55f3bda6ea4bb304 not found: ID does not exist" Jun 09 13:33:01.317800 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.317777 2577 scope.go:117] "RemoveContainer" containerID="8ffc725157d69bccf2c384725a6d25aace3565c884b589e6a21630c3a510f474" Jun 09 13:33:01.318035 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:33:01.318018 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ffc725157d69bccf2c384725a6d25aace3565c884b589e6a21630c3a510f474\": container with ID starting with 8ffc725157d69bccf2c384725a6d25aace3565c884b589e6a21630c3a510f474 not found: ID does not exist" containerID="8ffc725157d69bccf2c384725a6d25aace3565c884b589e6a21630c3a510f474" Jun 09 13:33:01.318126 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.318039 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ffc725157d69bccf2c384725a6d25aace3565c884b589e6a21630c3a510f474"} err="failed to get container status \"8ffc725157d69bccf2c384725a6d25aace3565c884b589e6a21630c3a510f474\": rpc error: code = NotFound desc = could not find container \"8ffc725157d69bccf2c384725a6d25aace3565c884b589e6a21630c3a510f474\": container with ID starting with 8ffc725157d69bccf2c384725a6d25aace3565c884b589e6a21630c3a510f474 not found: ID does not exist" Jun 09 13:33:01.318126 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.318052 2577 scope.go:117] "RemoveContainer" containerID="f6191e0ef0dc3775630ab152f9f945b8e6a291430e5a96a6c30aeb52a3616497" Jun 09 13:33:01.318309 ip-10-0-135-125 kubenswrapper[2577]: E0609 13:33:01.318292 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6191e0ef0dc3775630ab152f9f945b8e6a291430e5a96a6c30aeb52a3616497\": container with ID starting with f6191e0ef0dc3775630ab152f9f945b8e6a291430e5a96a6c30aeb52a3616497 not found: ID does not exist" containerID="f6191e0ef0dc3775630ab152f9f945b8e6a291430e5a96a6c30aeb52a3616497" Jun 09 13:33:01.318348 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.318313 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6191e0ef0dc3775630ab152f9f945b8e6a291430e5a96a6c30aeb52a3616497"} err="failed to get container status \"f6191e0ef0dc3775630ab152f9f945b8e6a291430e5a96a6c30aeb52a3616497\": rpc error: code = NotFound desc = could not find container \"f6191e0ef0dc3775630ab152f9f945b8e6a291430e5a96a6c30aeb52a3616497\": container with ID starting with f6191e0ef0dc3775630ab152f9f945b8e6a291430e5a96a6c30aeb52a3616497 not found: ID does not exist" Jun 09 13:33:01.367073 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.367045 2577 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-tls-assets\") on node \"ip-10-0-135-125.ec2.internal\" DevicePath \"\"" Jun 09 13:33:01.367073 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.367071 2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-135-125.ec2.internal\" DevicePath \"\"" Jun 09 13:33:01.367302 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.367084 2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-secret-prometheus-k8s-tls\") on node \"ip-10-0-135-125.ec2.internal\" DevicePath \"\"" Jun 09 13:33:01.367302 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.367095 2577 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-config\") on node \"ip-10-0-135-125.ec2.internal\" DevicePath \"\"" Jun 09 13:33:01.367302 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.367103 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-prometheus-k8s-db\") on node \"ip-10-0-135-125.ec2.internal\" DevicePath \"\"" Jun 09 13:33:01.367302 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.367112 2577 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-config-out\") on node \"ip-10-0-135-125.ec2.internal\" DevicePath \"\"" Jun 09 13:33:01.367302 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.367120 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5sbd5\" (UniqueName: \"kubernetes.io/projected/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-kube-api-access-5sbd5\") on node \"ip-10-0-135-125.ec2.internal\" DevicePath \"\"" Jun 09 13:33:01.367302 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.367128 2577 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-secret-grpc-tls\") on node \"ip-10-0-135-125.ec2.internal\" DevicePath \"\"" Jun 09 13:33:01.367302 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.367137 2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-135-125.ec2.internal\" DevicePath \"\"" Jun 09 13:33:01.367302 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.367147 2577 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-secret-kube-rbac-proxy\") on node \"ip-10-0-135-125.ec2.internal\" DevicePath \"\"" Jun 09 13:33:01.367302 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.367155 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-135-125.ec2.internal\" DevicePath \"\"" Jun 09 13:33:01.367302 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.367164 2577 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-web-config\") on node \"ip-10-0-135-125.ec2.internal\" DevicePath \"\"" Jun 09 13:33:01.367302 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.367172 2577 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-secret-metrics-client-certs\") on node \"ip-10-0-135-125.ec2.internal\" DevicePath \"\"" Jun 09 13:33:01.367302 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.367194 2577 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2b3807ec-80f9-4212-a7d4-d6b2c54fe805-thanos-prometheus-http-client-file\") on node \"ip-10-0-135-125.ec2.internal\" DevicePath \"\"" Jun 09 13:33:01.572195 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.572163 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 13:33:01.576770 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.576745 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 13:33:01.606141 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.606110 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 13:33:01.606423 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.606411 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b3807ec-80f9-4212-a7d4-d6b2c54fe805" containerName="prometheus" Jun 09 13:33:01.606462 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.606425 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b3807ec-80f9-4212-a7d4-d6b2c54fe805" containerName="prometheus" Jun 09 13:33:01.606462 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.606433 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b3807ec-80f9-4212-a7d4-d6b2c54fe805" containerName="config-reloader" Jun 09 13:33:01.606462 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.606439 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b3807ec-80f9-4212-a7d4-d6b2c54fe805" containerName="config-reloader" Jun 09 13:33:01.606462 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.606446 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b3807ec-80f9-4212-a7d4-d6b2c54fe805" containerName="kube-rbac-proxy" Jun 09 13:33:01.606462 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.606452 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b3807ec-80f9-4212-a7d4-d6b2c54fe805" containerName="kube-rbac-proxy" Jun 09 13:33:01.606615 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.606463 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b3807ec-80f9-4212-a7d4-d6b2c54fe805" containerName="kube-rbac-proxy-web" Jun 09 13:33:01.606615 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.606470 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b3807ec-80f9-4212-a7d4-d6b2c54fe805" containerName="kube-rbac-proxy-web" Jun 09 13:33:01.606615 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.606477 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b3807ec-80f9-4212-a7d4-d6b2c54fe805" containerName="init-config-reloader" Jun 09 13:33:01.606615 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.606482 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b3807ec-80f9-4212-a7d4-d6b2c54fe805" containerName="init-config-reloader" Jun 09 13:33:01.606615 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.606488 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b3807ec-80f9-4212-a7d4-d6b2c54fe805" containerName="kube-rbac-proxy-thanos" Jun 09 13:33:01.606615 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.606492 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b3807ec-80f9-4212-a7d4-d6b2c54fe805" containerName="kube-rbac-proxy-thanos" Jun 09 13:33:01.606615 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.606506 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b3807ec-80f9-4212-a7d4-d6b2c54fe805" containerName="thanos-sidecar" Jun 09 13:33:01.606615 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.606511 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b3807ec-80f9-4212-a7d4-d6b2c54fe805" containerName="thanos-sidecar" Jun 09 13:33:01.606615 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.606571 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b3807ec-80f9-4212-a7d4-d6b2c54fe805" containerName="prometheus" Jun 09 13:33:01.606615 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.606579 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b3807ec-80f9-4212-a7d4-d6b2c54fe805" containerName="kube-rbac-proxy-web" Jun 09 13:33:01.606615 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.606586 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b3807ec-80f9-4212-a7d4-d6b2c54fe805" containerName="thanos-sidecar" Jun 09 13:33:01.606615 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.606592 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b3807ec-80f9-4212-a7d4-d6b2c54fe805" containerName="kube-rbac-proxy-thanos" Jun 09 13:33:01.606615 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.606597 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b3807ec-80f9-4212-a7d4-d6b2c54fe805" containerName="config-reloader" Jun 09 13:33:01.606615 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.606603 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b3807ec-80f9-4212-a7d4-d6b2c54fe805" containerName="kube-rbac-proxy" Jun 09 13:33:01.611576 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.611559 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:01.614560 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.614537 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8nmmc745hch9q\"" Jun 09 13:33:01.614736 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.614563 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 09 13:33:01.614736 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.614539 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-tktsh\"" Jun 09 13:33:01.614736 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.614610 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 09 13:33:01.614736 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.614632 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 09 13:33:01.614944 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.614832 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 09 13:33:01.615047 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.615033 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 09 13:33:01.615162 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.615145 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 09 13:33:01.615239 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.615174 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 09 13:33:01.615291 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.615257 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 09 13:33:01.615291 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.615283 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 09 13:33:01.615392 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.615310 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 09 13:33:01.615392 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.615365 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 09 13:33:01.615487 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.615390 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 09 13:33:01.623943 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.621823 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 09 13:33:01.625389 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.625369 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 09 13:33:01.630252 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.630229 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 13:33:01.669863 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.669821 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d8c6e13a-6395-449b-a8f7-fb182961d2b6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d8c6e13a-6395-449b-a8f7-fb182961d2b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:01.670055 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.669873 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d8c6e13a-6395-449b-a8f7-fb182961d2b6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d8c6e13a-6395-449b-a8f7-fb182961d2b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:01.670055 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.669903 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8c6e13a-6395-449b-a8f7-fb182961d2b6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d8c6e13a-6395-449b-a8f7-fb182961d2b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:01.670055 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.669948 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d8c6e13a-6395-449b-a8f7-fb182961d2b6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d8c6e13a-6395-449b-a8f7-fb182961d2b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:01.670055 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.669978 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d8c6e13a-6395-449b-a8f7-fb182961d2b6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d8c6e13a-6395-449b-a8f7-fb182961d2b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:01.670055 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.670000 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8c6e13a-6395-449b-a8f7-fb182961d2b6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d8c6e13a-6395-449b-a8f7-fb182961d2b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:01.670321 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.670061 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d8c6e13a-6395-449b-a8f7-fb182961d2b6-config-out\") pod \"prometheus-k8s-0\" (UID: \"d8c6e13a-6395-449b-a8f7-fb182961d2b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:01.670321 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.670094 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d8c6e13a-6395-449b-a8f7-fb182961d2b6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d8c6e13a-6395-449b-a8f7-fb182961d2b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:01.670321 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.670116 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d8c6e13a-6395-449b-a8f7-fb182961d2b6-web-config\") pod \"prometheus-k8s-0\" (UID: \"d8c6e13a-6395-449b-a8f7-fb182961d2b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:01.670321 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.670141 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d8c6e13a-6395-449b-a8f7-fb182961d2b6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d8c6e13a-6395-449b-a8f7-fb182961d2b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:01.670321 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.670168 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqc4j\" (UniqueName: \"kubernetes.io/projected/d8c6e13a-6395-449b-a8f7-fb182961d2b6-kube-api-access-jqc4j\") pod \"prometheus-k8s-0\" (UID: \"d8c6e13a-6395-449b-a8f7-fb182961d2b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:01.670321 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.670254 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d8c6e13a-6395-449b-a8f7-fb182961d2b6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d8c6e13a-6395-449b-a8f7-fb182961d2b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:01.670321 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.670288 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d8c6e13a-6395-449b-a8f7-fb182961d2b6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d8c6e13a-6395-449b-a8f7-fb182961d2b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:01.670321 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.670315 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d8c6e13a-6395-449b-a8f7-fb182961d2b6-config\") pod \"prometheus-k8s-0\" (UID: \"d8c6e13a-6395-449b-a8f7-fb182961d2b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:01.670568 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.670332 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d8c6e13a-6395-449b-a8f7-fb182961d2b6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d8c6e13a-6395-449b-a8f7-fb182961d2b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:01.670568 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.670354 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d8c6e13a-6395-449b-a8f7-fb182961d2b6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d8c6e13a-6395-449b-a8f7-fb182961d2b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:01.670568 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.670368 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d8c6e13a-6395-449b-a8f7-fb182961d2b6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d8c6e13a-6395-449b-a8f7-fb182961d2b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:01.670568 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.670382 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d8c6e13a-6395-449b-a8f7-fb182961d2b6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d8c6e13a-6395-449b-a8f7-fb182961d2b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:01.670568 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.670397 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8c6e13a-6395-449b-a8f7-fb182961d2b6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d8c6e13a-6395-449b-a8f7-fb182961d2b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:01.670568 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.670427 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8c6e13a-6395-449b-a8f7-fb182961d2b6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d8c6e13a-6395-449b-a8f7-fb182961d2b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:01.770979 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.770940 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d8c6e13a-6395-449b-a8f7-fb182961d2b6-config-out\") pod \"prometheus-k8s-0\" (UID: \"d8c6e13a-6395-449b-a8f7-fb182961d2b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:01.770979 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.770981 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d8c6e13a-6395-449b-a8f7-fb182961d2b6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d8c6e13a-6395-449b-a8f7-fb182961d2b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:01.771139 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.770997 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d8c6e13a-6395-449b-a8f7-fb182961d2b6-web-config\") pod \"prometheus-k8s-0\" (UID: \"d8c6e13a-6395-449b-a8f7-fb182961d2b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:01.771139 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.771013 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d8c6e13a-6395-449b-a8f7-fb182961d2b6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d8c6e13a-6395-449b-a8f7-fb182961d2b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:01.771139 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.771031 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqc4j\" (UniqueName: \"kubernetes.io/projected/d8c6e13a-6395-449b-a8f7-fb182961d2b6-kube-api-access-jqc4j\") pod \"prometheus-k8s-0\" (UID: \"d8c6e13a-6395-449b-a8f7-fb182961d2b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:01.771139 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.771048 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d8c6e13a-6395-449b-a8f7-fb182961d2b6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d8c6e13a-6395-449b-a8f7-fb182961d2b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:01.771139 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.771065 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d8c6e13a-6395-449b-a8f7-fb182961d2b6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d8c6e13a-6395-449b-a8f7-fb182961d2b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:01.771139 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.771087 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d8c6e13a-6395-449b-a8f7-fb182961d2b6-config\") pod \"prometheus-k8s-0\" (UID: \"d8c6e13a-6395-449b-a8f7-fb182961d2b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:01.771139 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.771122 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d8c6e13a-6395-449b-a8f7-fb182961d2b6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d8c6e13a-6395-449b-a8f7-fb182961d2b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:01.771508 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.771147 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d8c6e13a-6395-449b-a8f7-fb182961d2b6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d8c6e13a-6395-449b-a8f7-fb182961d2b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:01.771508 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.771170 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d8c6e13a-6395-449b-a8f7-fb182961d2b6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d8c6e13a-6395-449b-a8f7-fb182961d2b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:01.771508 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.771215 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d8c6e13a-6395-449b-a8f7-fb182961d2b6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d8c6e13a-6395-449b-a8f7-fb182961d2b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:01.771508 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.771237 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8c6e13a-6395-449b-a8f7-fb182961d2b6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d8c6e13a-6395-449b-a8f7-fb182961d2b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:01.771508 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.771260 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8c6e13a-6395-449b-a8f7-fb182961d2b6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d8c6e13a-6395-449b-a8f7-fb182961d2b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:01.771508 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.771284 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d8c6e13a-6395-449b-a8f7-fb182961d2b6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d8c6e13a-6395-449b-a8f7-fb182961d2b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:01.771508 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.771324 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d8c6e13a-6395-449b-a8f7-fb182961d2b6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d8c6e13a-6395-449b-a8f7-fb182961d2b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:01.771508 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.771350 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8c6e13a-6395-449b-a8f7-fb182961d2b6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d8c6e13a-6395-449b-a8f7-fb182961d2b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:01.771508 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.771392 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d8c6e13a-6395-449b-a8f7-fb182961d2b6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d8c6e13a-6395-449b-a8f7-fb182961d2b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:01.771508 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.771436 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d8c6e13a-6395-449b-a8f7-fb182961d2b6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d8c6e13a-6395-449b-a8f7-fb182961d2b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:01.771508 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.771468 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8c6e13a-6395-449b-a8f7-fb182961d2b6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d8c6e13a-6395-449b-a8f7-fb182961d2b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:01.772028 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.771834 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d8c6e13a-6395-449b-a8f7-fb182961d2b6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d8c6e13a-6395-449b-a8f7-fb182961d2b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:01.772028 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.771896 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d8c6e13a-6395-449b-a8f7-fb182961d2b6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d8c6e13a-6395-449b-a8f7-fb182961d2b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:01.772129 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.772063 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8c6e13a-6395-449b-a8f7-fb182961d2b6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d8c6e13a-6395-449b-a8f7-fb182961d2b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:01.772623 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.772594 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8c6e13a-6395-449b-a8f7-fb182961d2b6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d8c6e13a-6395-449b-a8f7-fb182961d2b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:01.774981 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.773911 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d8c6e13a-6395-449b-a8f7-fb182961d2b6-config-out\") pod \"prometheus-k8s-0\" (UID: \"d8c6e13a-6395-449b-a8f7-fb182961d2b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:01.774981 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.774206 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d8c6e13a-6395-449b-a8f7-fb182961d2b6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d8c6e13a-6395-449b-a8f7-fb182961d2b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:01.774981 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.774287 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d8c6e13a-6395-449b-a8f7-fb182961d2b6-web-config\") pod \"prometheus-k8s-0\" (UID: \"d8c6e13a-6395-449b-a8f7-fb182961d2b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:01.774981 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.774310 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d8c6e13a-6395-449b-a8f7-fb182961d2b6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d8c6e13a-6395-449b-a8f7-fb182961d2b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:01.774981 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.774364 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d8c6e13a-6395-449b-a8f7-fb182961d2b6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d8c6e13a-6395-449b-a8f7-fb182961d2b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:01.774981 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.774491 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/d8c6e13a-6395-449b-a8f7-fb182961d2b6-config\") pod \"prometheus-k8s-0\" (UID: \"d8c6e13a-6395-449b-a8f7-fb182961d2b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:01.774981 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.774831 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8c6e13a-6395-449b-a8f7-fb182961d2b6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d8c6e13a-6395-449b-a8f7-fb182961d2b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:01.775423 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.774993 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d8c6e13a-6395-449b-a8f7-fb182961d2b6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d8c6e13a-6395-449b-a8f7-fb182961d2b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:01.775423 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.775120 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d8c6e13a-6395-449b-a8f7-fb182961d2b6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d8c6e13a-6395-449b-a8f7-fb182961d2b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:01.775423 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.775170 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8c6e13a-6395-449b-a8f7-fb182961d2b6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d8c6e13a-6395-449b-a8f7-fb182961d2b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:01.775423 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.775278 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d8c6e13a-6395-449b-a8f7-fb182961d2b6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d8c6e13a-6395-449b-a8f7-fb182961d2b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:01.776505 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.776485 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d8c6e13a-6395-449b-a8f7-fb182961d2b6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d8c6e13a-6395-449b-a8f7-fb182961d2b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:01.776812 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.776797 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d8c6e13a-6395-449b-a8f7-fb182961d2b6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d8c6e13a-6395-449b-a8f7-fb182961d2b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:01.776848 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.776811 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d8c6e13a-6395-449b-a8f7-fb182961d2b6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d8c6e13a-6395-449b-a8f7-fb182961d2b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:01.778278 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.778257 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d8c6e13a-6395-449b-a8f7-fb182961d2b6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d8c6e13a-6395-449b-a8f7-fb182961d2b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:01.779289 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.779274 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqc4j\" (UniqueName: \"kubernetes.io/projected/d8c6e13a-6395-449b-a8f7-fb182961d2b6-kube-api-access-jqc4j\") pod \"prometheus-k8s-0\" (UID: \"d8c6e13a-6395-449b-a8f7-fb182961d2b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:01.789845 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.789822 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b3807ec-80f9-4212-a7d4-d6b2c54fe805" path="/var/lib/kubelet/pods/2b3807ec-80f9-4212-a7d4-d6b2c54fe805/volumes" Jun 09 13:33:01.923677 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:01.923598 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:02.062793 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:02.062753 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 13:33:02.066015 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:33:02.065984 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8c6e13a_6395_449b_a8f7_fb182961d2b6.slice/crio-8532a9fc69f1d0120d6481c803d0165c414a018002279164d5958db901a5b334 WatchSource:0}: Error finding container 8532a9fc69f1d0120d6481c803d0165c414a018002279164d5958db901a5b334: Status 404 returned error can't find the container with id 8532a9fc69f1d0120d6481c803d0165c414a018002279164d5958db901a5b334 Jun 09 13:33:02.254164 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:02.254130 2577 generic.go:356] "Generic (PLEG): container finished" podID="d8c6e13a-6395-449b-a8f7-fb182961d2b6" containerID="908d14056f72d35b49b1d8ad3dd4bca129abb8071b9ad4cbe1aead985dcb123d" exitCode=0 Jun 09 13:33:02.254598 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:02.254215 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d8c6e13a-6395-449b-a8f7-fb182961d2b6","Type":"ContainerDied","Data":"908d14056f72d35b49b1d8ad3dd4bca129abb8071b9ad4cbe1aead985dcb123d"} Jun 09 13:33:02.254598 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:02.254279 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d8c6e13a-6395-449b-a8f7-fb182961d2b6","Type":"ContainerStarted","Data":"8532a9fc69f1d0120d6481c803d0165c414a018002279164d5958db901a5b334"} Jun 09 13:33:03.263175 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:03.263075 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d8c6e13a-6395-449b-a8f7-fb182961d2b6","Type":"ContainerStarted","Data":"ebd8f266698cbf4451ae7671b4602c35357d5922cb78464e5a87fa2f084543f8"} Jun 09 13:33:03.263175 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:03.263140 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d8c6e13a-6395-449b-a8f7-fb182961d2b6","Type":"ContainerStarted","Data":"9d712bd1a8552d25da7c9d45a9fee0a54c51f023bce1a0f587688cb48a242ae1"} Jun 09 13:33:03.263175 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:03.263167 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d8c6e13a-6395-449b-a8f7-fb182961d2b6","Type":"ContainerStarted","Data":"e4f05ac98bc06e971bf1429985483431864fa0408872b3cc44382cf5181d81f2"} Jun 09 13:33:03.263676 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:03.263212 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d8c6e13a-6395-449b-a8f7-fb182961d2b6","Type":"ContainerStarted","Data":"db35868546b22eea7808b267f545fd95e25b79f260e50153a09ffac034cf4da2"} Jun 09 13:33:03.263676 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:03.263242 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d8c6e13a-6395-449b-a8f7-fb182961d2b6","Type":"ContainerStarted","Data":"cbf5a3c7d4a0c78c44d37dd7d65eed0d0cff804d861c413615da55cad03a3699"} Jun 09 13:33:03.263676 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:03.263269 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d8c6e13a-6395-449b-a8f7-fb182961d2b6","Type":"ContainerStarted","Data":"10edacdb2f8ea34d391de1a3c61ba36449b1c8a6149c1dee4862a2f29267d57f"} Jun 09 13:33:03.292246 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:03.292080 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.274095979 podStartE2EDuration="2.292057676s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.961697ms" isStatefulPod=false podCreationTimestamp="2026-06-09 13:33:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:33:03.290263737 +0000 UTC m=+397.990538697" watchObservedRunningTime="2026-06-09 13:33:03.292057676 +0000 UTC m=+397.992332630" Jun 09 13:33:06.924133 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:33:06.924095 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:34:01.924124 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:34:01.924017 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:34:01.939550 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:34:01.939523 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:34:02.505060 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:34:02.505029 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:36:00.031156 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:36:00.031122 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-q2lrz"] Jun 09 13:36:00.034375 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:36:00.034359 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-5bc45f897-q2lrz" Jun 09 13:36:00.036916 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:36:00.036885 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\"" Jun 09 13:36:00.036916 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:36:00.036905 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\"" Jun 09 13:36:00.037746 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:36:00.037727 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-operator-dockercfg-x6985\"" Jun 09 13:36:00.047397 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:36:00.047370 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-q2lrz"] Jun 09 13:36:00.193519 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:36:00.193483 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/98966653-d14e-44ee-b449-06df9fc02cb7-tmp\") pod \"jobset-operator-5bc45f897-q2lrz\" (UID: \"98966653-d14e-44ee-b449-06df9fc02cb7\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-q2lrz" Jun 09 13:36:00.193519 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:36:00.193525 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2xpd\" (UniqueName: \"kubernetes.io/projected/98966653-d14e-44ee-b449-06df9fc02cb7-kube-api-access-g2xpd\") pod \"jobset-operator-5bc45f897-q2lrz\" (UID: \"98966653-d14e-44ee-b449-06df9fc02cb7\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-q2lrz" Jun 09 13:36:00.294913 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:36:00.294816 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/98966653-d14e-44ee-b449-06df9fc02cb7-tmp\") pod \"jobset-operator-5bc45f897-q2lrz\" (UID: \"98966653-d14e-44ee-b449-06df9fc02cb7\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-q2lrz" Jun 09 13:36:00.294913 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:36:00.294871 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2xpd\" (UniqueName: \"kubernetes.io/projected/98966653-d14e-44ee-b449-06df9fc02cb7-kube-api-access-g2xpd\") pod \"jobset-operator-5bc45f897-q2lrz\" (UID: \"98966653-d14e-44ee-b449-06df9fc02cb7\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-q2lrz" Jun 09 13:36:00.295221 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:36:00.295173 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/98966653-d14e-44ee-b449-06df9fc02cb7-tmp\") pod \"jobset-operator-5bc45f897-q2lrz\" (UID: \"98966653-d14e-44ee-b449-06df9fc02cb7\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-q2lrz" Jun 09 13:36:00.302874 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:36:00.302848 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2xpd\" (UniqueName: \"kubernetes.io/projected/98966653-d14e-44ee-b449-06df9fc02cb7-kube-api-access-g2xpd\") pod \"jobset-operator-5bc45f897-q2lrz\" (UID: \"98966653-d14e-44ee-b449-06df9fc02cb7\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-q2lrz" Jun 09 13:36:00.354482 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:36:00.354444 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-5bc45f897-q2lrz" Jun 09 13:36:00.482486 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:36:00.482434 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-q2lrz"] Jun 09 13:36:00.485384 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:36:00.485356 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod98966653_d14e_44ee_b449_06df9fc02cb7.slice/crio-3cebeab03763667b4b9c5f084132898b0988fad1581f1f6bbcad880b4edc5496 WatchSource:0}: Error finding container 3cebeab03763667b4b9c5f084132898b0988fad1581f1f6bbcad880b4edc5496: Status 404 returned error can't find the container with id 3cebeab03763667b4b9c5f084132898b0988fad1581f1f6bbcad880b4edc5496 Jun 09 13:36:00.951108 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:36:00.951068 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-5bc45f897-q2lrz" event={"ID":"98966653-d14e-44ee-b449-06df9fc02cb7","Type":"ContainerStarted","Data":"3cebeab03763667b4b9c5f084132898b0988fad1581f1f6bbcad880b4edc5496"} Jun 09 13:36:03.966837 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:36:03.966802 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-5bc45f897-q2lrz" event={"ID":"98966653-d14e-44ee-b449-06df9fc02cb7","Type":"ContainerStarted","Data":"18e837cfc03b231c840cc734395b1a0b9dd1fa22c8d5fb3644ab56bafff0f64b"} Jun 09 13:36:03.983651 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:36:03.983603 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-operator-5bc45f897-q2lrz" podStartSLOduration=1.116359159 podStartE2EDuration="3.983586262s" totalImagesPullingTime="2.867227103s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:36:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:36:03.981979223 +0000 UTC m=+578.682254163" watchObservedRunningTime="2026-06-09 13:36:03.983586262 +0000 UTC m=+578.683861202" Jun 09 13:36:27.249622 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:36:27.249588 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-6c7c765b97-n462v"] Jun 09 13:36:27.252847 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:36:27.252832 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-6c7c765b97-n462v" Jun 09 13:36:27.255332 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:36:27.255309 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-webhook-cert\"" Jun 09 13:36:27.255455 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:36:27.255342 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kubeflow-trainer-config\"" Jun 09 13:36:27.255644 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:36:27.255631 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 09 13:36:27.256356 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:36:27.256336 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-controller-manager-dockercfg-f5jmh\"" Jun 09 13:36:27.256408 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:36:27.256344 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 09 13:36:27.261827 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:36:27.261802 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-6c7c765b97-n462v"] Jun 09 13:36:27.320117 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:36:27.320085 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/a43610d5-efdf-416c-8518-871a82e9c61b-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-6c7c765b97-n462v\" (UID: \"a43610d5-efdf-416c-8518-871a82e9c61b\") " pod="opendatahub/kubeflow-trainer-controller-manager-6c7c765b97-n462v" Jun 09 13:36:27.320345 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:36:27.320140 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a43610d5-efdf-416c-8518-871a82e9c61b-cert\") pod \"kubeflow-trainer-controller-manager-6c7c765b97-n462v\" (UID: \"a43610d5-efdf-416c-8518-871a82e9c61b\") " pod="opendatahub/kubeflow-trainer-controller-manager-6c7c765b97-n462v" Jun 09 13:36:27.320345 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:36:27.320221 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-th2wf\" (UniqueName: \"kubernetes.io/projected/a43610d5-efdf-416c-8518-871a82e9c61b-kube-api-access-th2wf\") pod \"kubeflow-trainer-controller-manager-6c7c765b97-n462v\" (UID: \"a43610d5-efdf-416c-8518-871a82e9c61b\") " pod="opendatahub/kubeflow-trainer-controller-manager-6c7c765b97-n462v" Jun 09 13:36:27.420955 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:36:27.420922 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/a43610d5-efdf-416c-8518-871a82e9c61b-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-6c7c765b97-n462v\" (UID: \"a43610d5-efdf-416c-8518-871a82e9c61b\") " pod="opendatahub/kubeflow-trainer-controller-manager-6c7c765b97-n462v" Jun 09 13:36:27.421113 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:36:27.420971 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a43610d5-efdf-416c-8518-871a82e9c61b-cert\") pod \"kubeflow-trainer-controller-manager-6c7c765b97-n462v\" (UID: \"a43610d5-efdf-416c-8518-871a82e9c61b\") " pod="opendatahub/kubeflow-trainer-controller-manager-6c7c765b97-n462v" Jun 09 13:36:27.421113 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:36:27.420991 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-th2wf\" (UniqueName: \"kubernetes.io/projected/a43610d5-efdf-416c-8518-871a82e9c61b-kube-api-access-th2wf\") pod \"kubeflow-trainer-controller-manager-6c7c765b97-n462v\" (UID: \"a43610d5-efdf-416c-8518-871a82e9c61b\") " pod="opendatahub/kubeflow-trainer-controller-manager-6c7c765b97-n462v" Jun 09 13:36:27.421572 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:36:27.421547 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/a43610d5-efdf-416c-8518-871a82e9c61b-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-6c7c765b97-n462v\" (UID: \"a43610d5-efdf-416c-8518-871a82e9c61b\") " pod="opendatahub/kubeflow-trainer-controller-manager-6c7c765b97-n462v" Jun 09 13:36:27.423414 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:36:27.423389 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a43610d5-efdf-416c-8518-871a82e9c61b-cert\") pod \"kubeflow-trainer-controller-manager-6c7c765b97-n462v\" (UID: \"a43610d5-efdf-416c-8518-871a82e9c61b\") " pod="opendatahub/kubeflow-trainer-controller-manager-6c7c765b97-n462v" Jun 09 13:36:27.431279 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:36:27.431255 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-th2wf\" (UniqueName: \"kubernetes.io/projected/a43610d5-efdf-416c-8518-871a82e9c61b-kube-api-access-th2wf\") pod \"kubeflow-trainer-controller-manager-6c7c765b97-n462v\" (UID: \"a43610d5-efdf-416c-8518-871a82e9c61b\") " pod="opendatahub/kubeflow-trainer-controller-manager-6c7c765b97-n462v" Jun 09 13:36:27.562147 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:36:27.562049 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-6c7c765b97-n462v" Jun 09 13:36:27.698513 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:36:27.698477 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-6c7c765b97-n462v"] Jun 09 13:36:27.702581 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:36:27.702545 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda43610d5_efdf_416c_8518_871a82e9c61b.slice/crio-0026f00d10a2ece7716d566fd9afb646b3339312c903e54ce24cdab1ad050b42 WatchSource:0}: Error finding container 0026f00d10a2ece7716d566fd9afb646b3339312c903e54ce24cdab1ad050b42: Status 404 returned error can't find the container with id 0026f00d10a2ece7716d566fd9afb646b3339312c903e54ce24cdab1ad050b42 Jun 09 13:36:28.068460 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:36:28.068425 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-6c7c765b97-n462v" event={"ID":"a43610d5-efdf-416c-8518-871a82e9c61b","Type":"ContainerStarted","Data":"0026f00d10a2ece7716d566fd9afb646b3339312c903e54ce24cdab1ad050b42"} Jun 09 13:36:31.082891 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:36:31.082856 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-6c7c765b97-n462v" event={"ID":"a43610d5-efdf-416c-8518-871a82e9c61b","Type":"ContainerStarted","Data":"a7e256d2545e2c25bd8ebf3b78a45b21ba102e1c9fdf959e35e5daa06b8284da"} Jun 09 13:36:31.083495 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:36:31.082985 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kubeflow-trainer-controller-manager-6c7c765b97-n462v" Jun 09 13:36:31.098643 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:36:31.098589 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kubeflow-trainer-controller-manager-6c7c765b97-n462v" podStartSLOduration=1.72127663 podStartE2EDuration="4.098570425s" totalImagesPullingTime="2.377293795s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:36:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:36:31.098447505 +0000 UTC m=+605.798722446" watchObservedRunningTime="2026-06-09 13:36:31.098570425 +0000 UTC m=+605.798845367" Jun 09 13:36:47.092948 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:36:47.092878 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kubeflow-trainer-controller-manager-6c7c765b97-n462v" Jun 09 13:38:21.627202 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:38:21.627106 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-gv7vf/progression-enabled-node-0-0-pmqvv"] Jun 09 13:38:21.630439 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:38:21.630424 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-gv7vf/progression-enabled-node-0-0-pmqvv" Jun 09 13:38:21.632785 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:38:21.632765 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-gv7vf\"/\"openshift-service-ca.crt\"" Jun 09 13:38:21.632885 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:38:21.632795 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-gv7vf\"/\"kube-root-ca.crt\"" Jun 09 13:38:21.633495 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:38:21.633477 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-gv7vf\"/\"default-dockercfg-f6rkj\"" Jun 09 13:38:21.646097 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:38:21.646073 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-gv7vf/progression-enabled-node-0-0-pmqvv"] Jun 09 13:38:21.686574 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:38:21.686537 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ff766\" (UniqueName: \"kubernetes.io/projected/e163b3a6-949f-4017-8390-13bcbb32d271-kube-api-access-ff766\") pod \"progression-enabled-node-0-0-pmqvv\" (UID: \"e163b3a6-949f-4017-8390-13bcbb32d271\") " pod="rhai-e2e-progression-gv7vf/progression-enabled-node-0-0-pmqvv" Jun 09 13:38:21.786936 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:38:21.786905 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ff766\" (UniqueName: \"kubernetes.io/projected/e163b3a6-949f-4017-8390-13bcbb32d271-kube-api-access-ff766\") pod \"progression-enabled-node-0-0-pmqvv\" (UID: \"e163b3a6-949f-4017-8390-13bcbb32d271\") " pod="rhai-e2e-progression-gv7vf/progression-enabled-node-0-0-pmqvv" Jun 09 13:38:21.795431 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:38:21.795406 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ff766\" (UniqueName: \"kubernetes.io/projected/e163b3a6-949f-4017-8390-13bcbb32d271-kube-api-access-ff766\") pod \"progression-enabled-node-0-0-pmqvv\" (UID: \"e163b3a6-949f-4017-8390-13bcbb32d271\") " pod="rhai-e2e-progression-gv7vf/progression-enabled-node-0-0-pmqvv" Jun 09 13:38:21.941288 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:38:21.941203 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-gv7vf/progression-enabled-node-0-0-pmqvv" Jun 09 13:38:22.074813 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:38:22.074786 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-gv7vf/progression-enabled-node-0-0-pmqvv"] Jun 09 13:38:22.077349 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:38:22.077309 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode163b3a6_949f_4017_8390_13bcbb32d271.slice/crio-1c7412aa1b12edff5d76944a1f78de420e27951b368e66a2dba12d240b48c320 WatchSource:0}: Error finding container 1c7412aa1b12edff5d76944a1f78de420e27951b368e66a2dba12d240b48c320: Status 404 returned error can't find the container with id 1c7412aa1b12edff5d76944a1f78de420e27951b368e66a2dba12d240b48c320 Jun 09 13:38:22.079583 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:38:22.079567 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 13:38:22.522777 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:38:22.522743 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-gv7vf/progression-enabled-node-0-0-pmqvv" event={"ID":"e163b3a6-949f-4017-8390-13bcbb32d271","Type":"ContainerStarted","Data":"1c7412aa1b12edff5d76944a1f78de420e27951b368e66a2dba12d240b48c320"} Jun 09 13:40:23.084608 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:40:23.084571 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-gv7vf/progression-enabled-node-0-0-pmqvv" event={"ID":"e163b3a6-949f-4017-8390-13bcbb32d271","Type":"ContainerStarted","Data":"b12ced85bdf2cba365e43b412d011e9b5d09f4ed94ef2f8369b45c9c7a227671"} Jun 09 13:40:23.085034 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:40:23.084714 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-gv7vf/progression-enabled-node-0-0-pmqvv" Jun 09 13:40:23.108499 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:40:23.108442 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-gv7vf/progression-enabled-node-0-0-pmqvv" podStartSLOduration=1.495839774 podStartE2EDuration="2m2.108426857s" totalImagesPullingTime="2m0.612587083s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:38:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:40:23.107239778 +0000 UTC m=+837.807514740" watchObservedRunningTime="2026-06-09 13:40:23.108426857 +0000 UTC m=+837.808701821" Jun 09 13:40:24.086811 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:40:24.086774 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-gv7vf/progression-enabled-node-0-0-pmqvv" podUID="e163b3a6-949f-4017-8390-13bcbb32d271" containerName="node" probeResult="failure" output="Get \"http://10.132.0.25:28080/metrics\": dial tcp 10.132.0.25:28080: connect: connection refused" Jun 09 13:40:24.088971 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:40:24.088937 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-gv7vf/progression-enabled-node-0-0-pmqvv" podUID="e163b3a6-949f-4017-8390-13bcbb32d271" containerName="node" probeResult="failure" output="Get \"http://10.132.0.25:28080/metrics\": dial tcp 10.132.0.25:28080: connect: connection refused" Jun 09 13:40:25.090589 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:40:25.090546 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="rhai-e2e-progression-gv7vf/progression-enabled-node-0-0-pmqvv" Jun 09 13:40:46.090146 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:40:46.090099 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-gv7vf/progression-enabled-node-0-0-pmqvv" podUID="e163b3a6-949f-4017-8390-13bcbb32d271" containerName="node" probeResult="failure" output="Get \"http://10.132.0.25:28080/metrics\": dial tcp 10.132.0.25:28080: connect: connection refused" Jun 09 13:40:47.089054 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:40:47.089015 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-gv7vf/progression-enabled-node-0-0-pmqvv" podUID="e163b3a6-949f-4017-8390-13bcbb32d271" containerName="node" probeResult="failure" output="Get \"http://10.132.0.25:28080/metrics\": dial tcp 10.132.0.25:28080: connect: connection refused" Jun 09 13:40:47.089300 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:40:47.089132 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-gv7vf/progression-enabled-node-0-0-pmqvv" Jun 09 13:40:47.089788 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:40:47.089759 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-gv7vf/progression-enabled-node-0-0-pmqvv" podUID="e163b3a6-949f-4017-8390-13bcbb32d271" containerName="node" probeResult="failure" output="Get \"http://10.132.0.25:28080/metrics\": dial tcp 10.132.0.25:28080: connect: connection refused" Jun 09 13:40:47.186988 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:40:47.186952 2577 generic.go:356] "Generic (PLEG): container finished" podID="e163b3a6-949f-4017-8390-13bcbb32d271" containerID="b12ced85bdf2cba365e43b412d011e9b5d09f4ed94ef2f8369b45c9c7a227671" exitCode=0 Jun 09 13:40:47.187490 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:40:47.187023 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-gv7vf/progression-enabled-node-0-0-pmqvv" event={"ID":"e163b3a6-949f-4017-8390-13bcbb32d271","Type":"ContainerDied","Data":"b12ced85bdf2cba365e43b412d011e9b5d09f4ed94ef2f8369b45c9c7a227671"} Jun 09 13:40:48.341755 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:40:48.341715 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-gv7vf/progression-enabled-node-0-0-pmqvv" Jun 09 13:40:48.428931 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:40:48.428897 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ff766\" (UniqueName: \"kubernetes.io/projected/e163b3a6-949f-4017-8390-13bcbb32d271-kube-api-access-ff766\") pod \"e163b3a6-949f-4017-8390-13bcbb32d271\" (UID: \"e163b3a6-949f-4017-8390-13bcbb32d271\") " Jun 09 13:40:48.431164 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:40:48.431129 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e163b3a6-949f-4017-8390-13bcbb32d271-kube-api-access-ff766" (OuterVolumeSpecName: "kube-api-access-ff766") pod "e163b3a6-949f-4017-8390-13bcbb32d271" (UID: "e163b3a6-949f-4017-8390-13bcbb32d271"). InnerVolumeSpecName "kube-api-access-ff766". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 13:40:48.530198 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:40:48.530145 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ff766\" (UniqueName: \"kubernetes.io/projected/e163b3a6-949f-4017-8390-13bcbb32d271-kube-api-access-ff766\") on node \"ip-10-0-135-125.ec2.internal\" DevicePath \"\"" Jun 09 13:40:49.195673 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:40:49.195644 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-gv7vf/progression-enabled-node-0-0-pmqvv" Jun 09 13:40:49.195855 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:40:49.195641 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-gv7vf/progression-enabled-node-0-0-pmqvv" event={"ID":"e163b3a6-949f-4017-8390-13bcbb32d271","Type":"ContainerDied","Data":"1c7412aa1b12edff5d76944a1f78de420e27951b368e66a2dba12d240b48c320"} Jun 09 13:40:49.195855 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:40:49.195769 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1c7412aa1b12edff5d76944a1f78de420e27951b368e66a2dba12d240b48c320" Jun 09 13:40:50.225461 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:40:50.225429 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-gv7vf/progression-disabled-node-0-0-7ncm2"] Jun 09 13:40:50.225830 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:40:50.225738 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e163b3a6-949f-4017-8390-13bcbb32d271" containerName="node" Jun 09 13:40:50.225830 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:40:50.225749 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e163b3a6-949f-4017-8390-13bcbb32d271" containerName="node" Jun 09 13:40:50.225830 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:40:50.225801 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e163b3a6-949f-4017-8390-13bcbb32d271" containerName="node" Jun 09 13:40:50.239341 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:40:50.239319 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-gv7vf/progression-disabled-node-0-0-7ncm2" Jun 09 13:40:50.242042 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:40:50.242010 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-gv7vf\"/\"kube-root-ca.crt\"" Jun 09 13:40:50.243063 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:40:50.243036 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-gv7vf\"/\"openshift-service-ca.crt\"" Jun 09 13:40:50.243365 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:40:50.243346 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-gv7vf\"/\"default-dockercfg-f6rkj\"" Jun 09 13:40:50.245212 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:40:50.245169 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-gv7vf/progression-disabled-node-0-0-7ncm2"] Jun 09 13:40:50.345346 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:40:50.345301 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cflr8\" (UniqueName: \"kubernetes.io/projected/91888e8f-4fe8-4356-a426-3617d09a1ddb-kube-api-access-cflr8\") pod \"progression-disabled-node-0-0-7ncm2\" (UID: \"91888e8f-4fe8-4356-a426-3617d09a1ddb\") " pod="rhai-e2e-progression-gv7vf/progression-disabled-node-0-0-7ncm2" Jun 09 13:40:50.446221 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:40:50.446150 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cflr8\" (UniqueName: \"kubernetes.io/projected/91888e8f-4fe8-4356-a426-3617d09a1ddb-kube-api-access-cflr8\") pod \"progression-disabled-node-0-0-7ncm2\" (UID: \"91888e8f-4fe8-4356-a426-3617d09a1ddb\") " pod="rhai-e2e-progression-gv7vf/progression-disabled-node-0-0-7ncm2" Jun 09 13:40:50.456506 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:40:50.456480 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cflr8\" (UniqueName: \"kubernetes.io/projected/91888e8f-4fe8-4356-a426-3617d09a1ddb-kube-api-access-cflr8\") pod \"progression-disabled-node-0-0-7ncm2\" (UID: \"91888e8f-4fe8-4356-a426-3617d09a1ddb\") " pod="rhai-e2e-progression-gv7vf/progression-disabled-node-0-0-7ncm2" Jun 09 13:40:50.550322 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:40:50.550287 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-gv7vf/progression-disabled-node-0-0-7ncm2" Jun 09 13:40:50.705269 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:40:50.705238 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-gv7vf/progression-disabled-node-0-0-7ncm2"] Jun 09 13:40:50.708514 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:40:50.708487 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91888e8f_4fe8_4356_a426_3617d09a1ddb.slice/crio-01db716d5519cf8402a013cf4da2ab5f97c05955a00946d90df3055d58b9de8c WatchSource:0}: Error finding container 01db716d5519cf8402a013cf4da2ab5f97c05955a00946d90df3055d58b9de8c: Status 404 returned error can't find the container with id 01db716d5519cf8402a013cf4da2ab5f97c05955a00946d90df3055d58b9de8c Jun 09 13:40:51.206730 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:40:51.206640 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-gv7vf/progression-disabled-node-0-0-7ncm2" event={"ID":"91888e8f-4fe8-4356-a426-3617d09a1ddb","Type":"ContainerStarted","Data":"49143ed3b4ae3373b5b0333320174224b476402a210c099ccaca507d7ae787d2"} Jun 09 13:40:51.206730 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:40:51.206707 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-gv7vf/progression-disabled-node-0-0-7ncm2" event={"ID":"91888e8f-4fe8-4356-a426-3617d09a1ddb","Type":"ContainerStarted","Data":"01db716d5519cf8402a013cf4da2ab5f97c05955a00946d90df3055d58b9de8c"} Jun 09 13:40:51.206929 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:40:51.206760 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-gv7vf/progression-disabled-node-0-0-7ncm2" Jun 09 13:40:51.225605 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:40:51.225561 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-gv7vf/progression-disabled-node-0-0-7ncm2" podStartSLOduration=1.225545177 podStartE2EDuration="1.225545177s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:40:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:40:51.223994913 +0000 UTC m=+865.924269881" watchObservedRunningTime="2026-06-09 13:40:51.225545177 +0000 UTC m=+865.925820117" Jun 09 13:40:52.208835 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:40:52.208795 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-gv7vf/progression-disabled-node-0-0-7ncm2" podUID="91888e8f-4fe8-4356-a426-3617d09a1ddb" containerName="node" probeResult="failure" output="Get \"http://10.132.0.26:28080/metrics\": dial tcp 10.132.0.26:28080: connect: connection refused" Jun 09 13:40:52.212028 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:40:52.211988 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-gv7vf/progression-disabled-node-0-0-7ncm2" podUID="91888e8f-4fe8-4356-a426-3617d09a1ddb" containerName="node" probeResult="failure" output="Get \"http://10.132.0.26:28080/metrics\": dial tcp 10.132.0.26:28080: connect: connection refused" Jun 09 13:40:53.214011 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:40:53.213985 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="rhai-e2e-progression-gv7vf/progression-disabled-node-0-0-7ncm2" Jun 09 13:41:14.212877 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:41:14.212788 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-gv7vf/progression-disabled-node-0-0-7ncm2" podUID="91888e8f-4fe8-4356-a426-3617d09a1ddb" containerName="node" probeResult="failure" output="Get \"http://10.132.0.26:28080/metrics\": dial tcp 10.132.0.26:28080: connect: connection refused" Jun 09 13:41:14.314494 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:41:14.314462 2577 generic.go:356] "Generic (PLEG): container finished" podID="91888e8f-4fe8-4356-a426-3617d09a1ddb" containerID="49143ed3b4ae3373b5b0333320174224b476402a210c099ccaca507d7ae787d2" exitCode=0 Jun 09 13:41:14.314662 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:41:14.314529 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-gv7vf/progression-disabled-node-0-0-7ncm2" event={"ID":"91888e8f-4fe8-4356-a426-3617d09a1ddb","Type":"ContainerDied","Data":"49143ed3b4ae3373b5b0333320174224b476402a210c099ccaca507d7ae787d2"} Jun 09 13:41:15.453371 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:41:15.453342 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-gv7vf/progression-disabled-node-0-0-7ncm2" Jun 09 13:41:15.547012 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:41:15.546975 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cflr8\" (UniqueName: \"kubernetes.io/projected/91888e8f-4fe8-4356-a426-3617d09a1ddb-kube-api-access-cflr8\") pod \"91888e8f-4fe8-4356-a426-3617d09a1ddb\" (UID: \"91888e8f-4fe8-4356-a426-3617d09a1ddb\") " Jun 09 13:41:15.549129 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:41:15.549099 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91888e8f-4fe8-4356-a426-3617d09a1ddb-kube-api-access-cflr8" (OuterVolumeSpecName: "kube-api-access-cflr8") pod "91888e8f-4fe8-4356-a426-3617d09a1ddb" (UID: "91888e8f-4fe8-4356-a426-3617d09a1ddb"). InnerVolumeSpecName "kube-api-access-cflr8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 13:41:15.647878 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:41:15.647792 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cflr8\" (UniqueName: \"kubernetes.io/projected/91888e8f-4fe8-4356-a426-3617d09a1ddb-kube-api-access-cflr8\") on node \"ip-10-0-135-125.ec2.internal\" DevicePath \"\"" Jun 09 13:41:16.325240 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:41:16.325201 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-gv7vf/progression-disabled-node-0-0-7ncm2" event={"ID":"91888e8f-4fe8-4356-a426-3617d09a1ddb","Type":"ContainerDied","Data":"01db716d5519cf8402a013cf4da2ab5f97c05955a00946d90df3055d58b9de8c"} Jun 09 13:41:16.325240 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:41:16.325239 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-gv7vf/progression-disabled-node-0-0-7ncm2" Jun 09 13:41:16.325445 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:41:16.325259 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="01db716d5519cf8402a013cf4da2ab5f97c05955a00946d90df3055d58b9de8c" Jun 09 13:41:25.202613 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:41:25.202572 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-gv7vf/progression-invalid-node-0-0-2rzpp"] Jun 09 13:41:25.203098 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:41:25.202893 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91888e8f-4fe8-4356-a426-3617d09a1ddb" containerName="node" Jun 09 13:41:25.203098 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:41:25.202904 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="91888e8f-4fe8-4356-a426-3617d09a1ddb" containerName="node" Jun 09 13:41:25.203098 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:41:25.202965 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="91888e8f-4fe8-4356-a426-3617d09a1ddb" containerName="node" Jun 09 13:41:25.205896 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:41:25.205879 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-gv7vf/progression-invalid-node-0-0-2rzpp" Jun 09 13:41:25.208136 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:41:25.208111 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-gv7vf\"/\"kube-root-ca.crt\"" Jun 09 13:41:25.208267 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:41:25.208160 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-gv7vf\"/\"openshift-service-ca.crt\"" Jun 09 13:41:25.208267 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:41:25.208168 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-gv7vf\"/\"default-dockercfg-f6rkj\"" Jun 09 13:41:25.214605 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:41:25.214576 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-gv7vf/progression-invalid-node-0-0-2rzpp"] Jun 09 13:41:25.219575 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:41:25.219553 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x76z8\" (UniqueName: \"kubernetes.io/projected/04b7a012-4e97-4c82-85bf-57dfd305277a-kube-api-access-x76z8\") pod \"progression-invalid-node-0-0-2rzpp\" (UID: \"04b7a012-4e97-4c82-85bf-57dfd305277a\") " pod="rhai-e2e-progression-gv7vf/progression-invalid-node-0-0-2rzpp" Jun 09 13:41:25.320240 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:41:25.320204 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x76z8\" (UniqueName: \"kubernetes.io/projected/04b7a012-4e97-4c82-85bf-57dfd305277a-kube-api-access-x76z8\") pod \"progression-invalid-node-0-0-2rzpp\" (UID: \"04b7a012-4e97-4c82-85bf-57dfd305277a\") " pod="rhai-e2e-progression-gv7vf/progression-invalid-node-0-0-2rzpp" Jun 09 13:41:25.330470 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:41:25.330432 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x76z8\" (UniqueName: \"kubernetes.io/projected/04b7a012-4e97-4c82-85bf-57dfd305277a-kube-api-access-x76z8\") pod \"progression-invalid-node-0-0-2rzpp\" (UID: \"04b7a012-4e97-4c82-85bf-57dfd305277a\") " pod="rhai-e2e-progression-gv7vf/progression-invalid-node-0-0-2rzpp" Jun 09 13:41:25.516492 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:41:25.516461 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-gv7vf/progression-invalid-node-0-0-2rzpp" Jun 09 13:41:25.648200 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:41:25.648128 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-gv7vf/progression-invalid-node-0-0-2rzpp"] Jun 09 13:41:25.650927 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:41:25.650894 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04b7a012_4e97_4c82_85bf_57dfd305277a.slice/crio-a77b4b0ee1a5f52c21395ca49471031898c06c8c1680c5933bd94c1f49d4ea01 WatchSource:0}: Error finding container a77b4b0ee1a5f52c21395ca49471031898c06c8c1680c5933bd94c1f49d4ea01: Status 404 returned error can't find the container with id a77b4b0ee1a5f52c21395ca49471031898c06c8c1680c5933bd94c1f49d4ea01 Jun 09 13:41:26.384139 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:41:26.384100 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-gv7vf/progression-invalid-node-0-0-2rzpp" event={"ID":"04b7a012-4e97-4c82-85bf-57dfd305277a","Type":"ContainerStarted","Data":"8970b7ec5576c7650ea5a69df7cfa7560ed50cf6fd589d13a121339f308aae0d"} Jun 09 13:41:26.384613 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:41:26.384214 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-gv7vf/progression-invalid-node-0-0-2rzpp" event={"ID":"04b7a012-4e97-4c82-85bf-57dfd305277a","Type":"ContainerStarted","Data":"a77b4b0ee1a5f52c21395ca49471031898c06c8c1680c5933bd94c1f49d4ea01"} Jun 09 13:41:26.384613 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:41:26.384291 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-gv7vf/progression-invalid-node-0-0-2rzpp" Jun 09 13:41:26.402513 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:41:26.402450 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-gv7vf/progression-invalid-node-0-0-2rzpp" podStartSLOduration=1.402428328 podStartE2EDuration="1.402428328s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:41:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:41:26.399521855 +0000 UTC m=+901.099796797" watchObservedRunningTime="2026-06-09 13:41:26.402428328 +0000 UTC m=+901.102703261" Jun 09 13:41:27.386095 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:41:27.386064 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="rhai-e2e-progression-gv7vf/progression-invalid-node-0-0-2rzpp" Jun 09 13:41:49.384873 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:41:49.384827 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-gv7vf/progression-invalid-node-0-0-2rzpp" podUID="04b7a012-4e97-4c82-85bf-57dfd305277a" containerName="node" probeResult="failure" output="Get \"http://10.132.0.27:28080/metrics\": dial tcp 10.132.0.27:28080: connect: connection refused" Jun 09 13:41:49.493146 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:41:49.493112 2577 generic.go:356] "Generic (PLEG): container finished" podID="04b7a012-4e97-4c82-85bf-57dfd305277a" containerID="8970b7ec5576c7650ea5a69df7cfa7560ed50cf6fd589d13a121339f308aae0d" exitCode=0 Jun 09 13:41:49.493329 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:41:49.493211 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-gv7vf/progression-invalid-node-0-0-2rzpp" event={"ID":"04b7a012-4e97-4c82-85bf-57dfd305277a","Type":"ContainerDied","Data":"8970b7ec5576c7650ea5a69df7cfa7560ed50cf6fd589d13a121339f308aae0d"} Jun 09 13:41:50.628238 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:41:50.628215 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-gv7vf/progression-invalid-node-0-0-2rzpp" Jun 09 13:41:50.742033 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:41:50.741993 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x76z8\" (UniqueName: \"kubernetes.io/projected/04b7a012-4e97-4c82-85bf-57dfd305277a-kube-api-access-x76z8\") pod \"04b7a012-4e97-4c82-85bf-57dfd305277a\" (UID: \"04b7a012-4e97-4c82-85bf-57dfd305277a\") " Jun 09 13:41:50.744168 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:41:50.744140 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04b7a012-4e97-4c82-85bf-57dfd305277a-kube-api-access-x76z8" (OuterVolumeSpecName: "kube-api-access-x76z8") pod "04b7a012-4e97-4c82-85bf-57dfd305277a" (UID: "04b7a012-4e97-4c82-85bf-57dfd305277a"). InnerVolumeSpecName "kube-api-access-x76z8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 13:41:50.843275 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:41:50.843235 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x76z8\" (UniqueName: \"kubernetes.io/projected/04b7a012-4e97-4c82-85bf-57dfd305277a-kube-api-access-x76z8\") on node \"ip-10-0-135-125.ec2.internal\" DevicePath \"\"" Jun 09 13:41:51.503558 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:41:51.503526 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-gv7vf/progression-invalid-node-0-0-2rzpp" Jun 09 13:41:51.503558 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:41:51.503545 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-gv7vf/progression-invalid-node-0-0-2rzpp" event={"ID":"04b7a012-4e97-4c82-85bf-57dfd305277a","Type":"ContainerDied","Data":"a77b4b0ee1a5f52c21395ca49471031898c06c8c1680c5933bd94c1f49d4ea01"} Jun 09 13:41:51.503796 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:41:51.503585 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a77b4b0ee1a5f52c21395ca49471031898c06c8c1680c5933bd94c1f49d4ea01" Jun 09 13:44:07.125128 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:44:07.125097 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-gv7vf/progression-no-metrics-node-0-0-68hd2"] Jun 09 13:44:07.125623 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:44:07.125430 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04b7a012-4e97-4c82-85bf-57dfd305277a" containerName="node" Jun 09 13:44:07.125623 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:44:07.125440 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="04b7a012-4e97-4c82-85bf-57dfd305277a" containerName="node" Jun 09 13:44:07.125623 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:44:07.125510 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="04b7a012-4e97-4c82-85bf-57dfd305277a" containerName="node" Jun 09 13:44:07.128407 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:44:07.128390 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-gv7vf/progression-no-metrics-node-0-0-68hd2" Jun 09 13:44:07.130605 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:44:07.130584 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-gv7vf\"/\"default-dockercfg-f6rkj\"" Jun 09 13:44:07.130775 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:44:07.130763 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-gv7vf\"/\"openshift-service-ca.crt\"" Jun 09 13:44:07.131367 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:44:07.131354 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-gv7vf\"/\"kube-root-ca.crt\"" Jun 09 13:44:07.141372 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:44:07.140346 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-gv7vf/progression-no-metrics-node-0-0-68hd2"] Jun 09 13:44:07.195918 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:44:07.195878 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqx7c\" (UniqueName: \"kubernetes.io/projected/de19a0ff-1fc7-47d5-9ff4-a1aa5827a4c9-kube-api-access-nqx7c\") pod \"progression-no-metrics-node-0-0-68hd2\" (UID: \"de19a0ff-1fc7-47d5-9ff4-a1aa5827a4c9\") " pod="rhai-e2e-progression-gv7vf/progression-no-metrics-node-0-0-68hd2" Jun 09 13:44:07.297169 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:44:07.297133 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqx7c\" (UniqueName: \"kubernetes.io/projected/de19a0ff-1fc7-47d5-9ff4-a1aa5827a4c9-kube-api-access-nqx7c\") pod \"progression-no-metrics-node-0-0-68hd2\" (UID: \"de19a0ff-1fc7-47d5-9ff4-a1aa5827a4c9\") " pod="rhai-e2e-progression-gv7vf/progression-no-metrics-node-0-0-68hd2" Jun 09 13:44:07.306114 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:44:07.306068 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqx7c\" (UniqueName: \"kubernetes.io/projected/de19a0ff-1fc7-47d5-9ff4-a1aa5827a4c9-kube-api-access-nqx7c\") pod \"progression-no-metrics-node-0-0-68hd2\" (UID: \"de19a0ff-1fc7-47d5-9ff4-a1aa5827a4c9\") " pod="rhai-e2e-progression-gv7vf/progression-no-metrics-node-0-0-68hd2" Jun 09 13:44:07.438322 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:44:07.438242 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-gv7vf/progression-no-metrics-node-0-0-68hd2" Jun 09 13:44:07.573025 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:44:07.573001 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-gv7vf/progression-no-metrics-node-0-0-68hd2"] Jun 09 13:44:07.575139 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:44:07.575107 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde19a0ff_1fc7_47d5_9ff4_a1aa5827a4c9.slice/crio-767ee986c761fe09b05c590e3d255ff6ef7201d431cb3febbba982c0d2412c25 WatchSource:0}: Error finding container 767ee986c761fe09b05c590e3d255ff6ef7201d431cb3febbba982c0d2412c25: Status 404 returned error can't find the container with id 767ee986c761fe09b05c590e3d255ff6ef7201d431cb3febbba982c0d2412c25 Jun 09 13:44:08.111175 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:44:08.111142 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-gv7vf/progression-no-metrics-node-0-0-68hd2" event={"ID":"de19a0ff-1fc7-47d5-9ff4-a1aa5827a4c9","Type":"ContainerStarted","Data":"a55d381a0c8fe2a0803ff6e374b4b439b0405c8e7db03848aa79e86f86311944"} Jun 09 13:44:08.111377 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:44:08.111212 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-gv7vf/progression-no-metrics-node-0-0-68hd2" event={"ID":"de19a0ff-1fc7-47d5-9ff4-a1aa5827a4c9","Type":"ContainerStarted","Data":"767ee986c761fe09b05c590e3d255ff6ef7201d431cb3febbba982c0d2412c25"} Jun 09 13:44:08.129713 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:44:08.129659 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-gv7vf/progression-no-metrics-node-0-0-68hd2" podStartSLOduration=1.129644824 podStartE2EDuration="1.129644824s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:44:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:44:08.128281034 +0000 UTC m=+1062.828555996" watchObservedRunningTime="2026-06-09 13:44:08.129644824 +0000 UTC m=+1062.829919764" Jun 09 13:44:13.134790 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:44:13.134756 2577 generic.go:356] "Generic (PLEG): container finished" podID="de19a0ff-1fc7-47d5-9ff4-a1aa5827a4c9" containerID="a55d381a0c8fe2a0803ff6e374b4b439b0405c8e7db03848aa79e86f86311944" exitCode=0 Jun 09 13:44:13.135272 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:44:13.134829 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-gv7vf/progression-no-metrics-node-0-0-68hd2" event={"ID":"de19a0ff-1fc7-47d5-9ff4-a1aa5827a4c9","Type":"ContainerDied","Data":"a55d381a0c8fe2a0803ff6e374b4b439b0405c8e7db03848aa79e86f86311944"} Jun 09 13:44:14.272137 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:44:14.272108 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-gv7vf/progression-no-metrics-node-0-0-68hd2" Jun 09 13:44:14.356963 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:44:14.356924 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nqx7c\" (UniqueName: \"kubernetes.io/projected/de19a0ff-1fc7-47d5-9ff4-a1aa5827a4c9-kube-api-access-nqx7c\") pod \"de19a0ff-1fc7-47d5-9ff4-a1aa5827a4c9\" (UID: \"de19a0ff-1fc7-47d5-9ff4-a1aa5827a4c9\") " Jun 09 13:44:14.359033 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:44:14.359000 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de19a0ff-1fc7-47d5-9ff4-a1aa5827a4c9-kube-api-access-nqx7c" (OuterVolumeSpecName: "kube-api-access-nqx7c") pod "de19a0ff-1fc7-47d5-9ff4-a1aa5827a4c9" (UID: "de19a0ff-1fc7-47d5-9ff4-a1aa5827a4c9"). InnerVolumeSpecName "kube-api-access-nqx7c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 13:44:14.458551 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:44:14.458464 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nqx7c\" (UniqueName: \"kubernetes.io/projected/de19a0ff-1fc7-47d5-9ff4-a1aa5827a4c9-kube-api-access-nqx7c\") on node \"ip-10-0-135-125.ec2.internal\" DevicePath \"\"" Jun 09 13:44:15.146238 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:44:15.146131 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-gv7vf/progression-no-metrics-node-0-0-68hd2" Jun 09 13:44:15.146238 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:44:15.146164 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-gv7vf/progression-no-metrics-node-0-0-68hd2" event={"ID":"de19a0ff-1fc7-47d5-9ff4-a1aa5827a4c9","Type":"ContainerDied","Data":"767ee986c761fe09b05c590e3d255ff6ef7201d431cb3febbba982c0d2412c25"} Jun 09 13:44:15.146424 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:44:15.146240 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="767ee986c761fe09b05c590e3d255ff6ef7201d431cb3febbba982c0d2412c25" Jun 09 13:44:24.073447 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:44:24.073411 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-gv7vf/progression-disabled-node-0-0-7ncm2"] Jun 09 13:44:24.077045 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:44:24.077018 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-gv7vf/progression-disabled-node-0-0-7ncm2"] Jun 09 13:44:24.081924 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:44:24.081898 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-gv7vf/progression-enabled-node-0-0-pmqvv"] Jun 09 13:44:24.086745 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:44:24.086723 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-gv7vf/progression-enabled-node-0-0-pmqvv"] Jun 09 13:44:24.091691 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:44:24.091666 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-gv7vf/progression-invalid-node-0-0-2rzpp"] Jun 09 13:44:24.095863 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:44:24.095840 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-gv7vf/progression-invalid-node-0-0-2rzpp"] Jun 09 13:44:24.115553 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:44:24.115520 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-gv7vf/progression-no-metrics-node-0-0-68hd2"] Jun 09 13:44:24.125008 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:44:24.124975 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-gv7vf/progression-no-metrics-node-0-0-68hd2"] Jun 09 13:44:25.789462 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:44:25.789432 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04b7a012-4e97-4c82-85bf-57dfd305277a" path="/var/lib/kubelet/pods/04b7a012-4e97-4c82-85bf-57dfd305277a/volumes" Jun 09 13:44:25.789804 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:44:25.789741 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91888e8f-4fe8-4356-a426-3617d09a1ddb" path="/var/lib/kubelet/pods/91888e8f-4fe8-4356-a426-3617d09a1ddb/volumes" Jun 09 13:44:25.790015 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:44:25.790003 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de19a0ff-1fc7-47d5-9ff4-a1aa5827a4c9" path="/var/lib/kubelet/pods/de19a0ff-1fc7-47d5-9ff4-a1aa5827a4c9/volumes" Jun 09 13:44:25.790333 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:44:25.790321 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e163b3a6-949f-4017-8390-13bcbb32d271" path="/var/lib/kubelet/pods/e163b3a6-949f-4017-8390-13bcbb32d271/volumes" Jun 09 13:44:36.018192 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:44:36.018146 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-6c7c765b97-n462v_a43610d5-efdf-416c-8518-871a82e9c61b/manager/0.log" Jun 09 13:44:36.459256 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:44:36.459144 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-6c7c765b97-n462v_a43610d5-efdf-416c-8518-871a82e9c61b/manager/0.log" Jun 09 13:44:36.907422 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:44:36.907386 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-6c7c765b97-n462v_a43610d5-efdf-416c-8518-871a82e9c61b/manager/0.log" Jun 09 13:45:13.575312 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:13.575274 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pd28m/must-gather-kv5sj"] Jun 09 13:45:13.575781 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:13.575606 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de19a0ff-1fc7-47d5-9ff4-a1aa5827a4c9" containerName="node" Jun 09 13:45:13.575781 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:13.575617 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="de19a0ff-1fc7-47d5-9ff4-a1aa5827a4c9" containerName="node" Jun 09 13:45:13.575781 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:13.575686 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="de19a0ff-1fc7-47d5-9ff4-a1aa5827a4c9" containerName="node" Jun 09 13:45:13.578907 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:13.578884 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pd28m/must-gather-kv5sj" Jun 09 13:45:13.581389 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:13.581359 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pd28m\"/\"openshift-service-ca.crt\"" Jun 09 13:45:13.582215 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:13.582195 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pd28m\"/\"kube-root-ca.crt\"" Jun 09 13:45:13.582299 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:13.582275 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-pd28m\"/\"default-dockercfg-krxnr\"" Jun 09 13:45:13.588324 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:13.588304 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pd28m/must-gather-kv5sj"] Jun 09 13:45:13.669045 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:13.669012 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkrlq\" (UniqueName: \"kubernetes.io/projected/b4bad468-685a-4bf9-ba24-4157d272241d-kube-api-access-dkrlq\") pod \"must-gather-kv5sj\" (UID: \"b4bad468-685a-4bf9-ba24-4157d272241d\") " pod="openshift-must-gather-pd28m/must-gather-kv5sj" Jun 09 13:45:13.669257 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:13.669066 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b4bad468-685a-4bf9-ba24-4157d272241d-must-gather-output\") pod \"must-gather-kv5sj\" (UID: \"b4bad468-685a-4bf9-ba24-4157d272241d\") " pod="openshift-must-gather-pd28m/must-gather-kv5sj" Jun 09 13:45:13.770511 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:13.770476 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkrlq\" (UniqueName: \"kubernetes.io/projected/b4bad468-685a-4bf9-ba24-4157d272241d-kube-api-access-dkrlq\") pod \"must-gather-kv5sj\" (UID: \"b4bad468-685a-4bf9-ba24-4157d272241d\") " pod="openshift-must-gather-pd28m/must-gather-kv5sj" Jun 09 13:45:13.770685 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:13.770528 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b4bad468-685a-4bf9-ba24-4157d272241d-must-gather-output\") pod \"must-gather-kv5sj\" (UID: \"b4bad468-685a-4bf9-ba24-4157d272241d\") " pod="openshift-must-gather-pd28m/must-gather-kv5sj" Jun 09 13:45:13.770829 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:13.770814 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b4bad468-685a-4bf9-ba24-4157d272241d-must-gather-output\") pod \"must-gather-kv5sj\" (UID: \"b4bad468-685a-4bf9-ba24-4157d272241d\") " pod="openshift-must-gather-pd28m/must-gather-kv5sj" Jun 09 13:45:13.778083 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:13.778062 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkrlq\" (UniqueName: \"kubernetes.io/projected/b4bad468-685a-4bf9-ba24-4157d272241d-kube-api-access-dkrlq\") pod \"must-gather-kv5sj\" (UID: \"b4bad468-685a-4bf9-ba24-4157d272241d\") " pod="openshift-must-gather-pd28m/must-gather-kv5sj" Jun 09 13:45:13.888852 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:13.888772 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pd28m/must-gather-kv5sj" Jun 09 13:45:14.019740 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:14.019716 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pd28m/must-gather-kv5sj"] Jun 09 13:45:14.021957 ip-10-0-135-125 kubenswrapper[2577]: W0609 13:45:14.021922 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb4bad468_685a_4bf9_ba24_4157d272241d.slice/crio-5c8a79338e91d7d8f6e916f73bcb607bd39eaba80ddbd8b6a96f61a77b3052ba WatchSource:0}: Error finding container 5c8a79338e91d7d8f6e916f73bcb607bd39eaba80ddbd8b6a96f61a77b3052ba: Status 404 returned error can't find the container with id 5c8a79338e91d7d8f6e916f73bcb607bd39eaba80ddbd8b6a96f61a77b3052ba Jun 09 13:45:14.023826 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:14.023810 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 13:45:14.413735 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:14.413700 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pd28m/must-gather-kv5sj" event={"ID":"b4bad468-685a-4bf9-ba24-4157d272241d","Type":"ContainerStarted","Data":"5c8a79338e91d7d8f6e916f73bcb607bd39eaba80ddbd8b6a96f61a77b3052ba"} Jun 09 13:45:15.421973 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:15.421882 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pd28m/must-gather-kv5sj" event={"ID":"b4bad468-685a-4bf9-ba24-4157d272241d","Type":"ContainerStarted","Data":"7870a786b626a1c585f2a4a47c2e18e511765fcd2918cf4217cf8bce425fd5fd"} Jun 09 13:45:15.421973 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:15.421932 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pd28m/must-gather-kv5sj" event={"ID":"b4bad468-685a-4bf9-ba24-4157d272241d","Type":"ContainerStarted","Data":"a331664a8dc76f1a2d0e5c01822f43aaf87ead2ffbba6f01a913c36168b70a0e"} Jun 09 13:45:15.437603 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:15.437553 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-pd28m/must-gather-kv5sj" podStartSLOduration=1.444594765 podStartE2EDuration="2.437533937s" totalImagesPullingTime="992.939172ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:45:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:45:15.436134654 +0000 UTC m=+1130.136409595" watchObservedRunningTime="2026-06-09 13:45:15.437533937 +0000 UTC m=+1130.137808878" Jun 09 13:45:16.383652 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:16.383622 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9wk4n_679c37d9-6d86-41eb-aac4-073d70f2c285/global-pull-secret-syncer/0.log" Jun 09 13:45:16.482919 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:16.482885 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-h65nk_a65851db-7a9b-4f6f-a791-203591fb7e17/konnectivity-agent/0.log" Jun 09 13:45:16.529820 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:16.529781 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-125.ec2.internal_27417b22d6fa8d5909b4f4f539649658/haproxy/0.log" Jun 09 13:45:20.834604 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:20.834521 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6d380652-f181-4b10-914d-bafb30cbce75/alertmanager/0.log" Jun 09 13:45:20.858090 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:20.858057 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6d380652-f181-4b10-914d-bafb30cbce75/config-reloader/0.log" Jun 09 13:45:20.886240 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:20.886212 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6d380652-f181-4b10-914d-bafb30cbce75/kube-rbac-proxy-web/0.log" Jun 09 13:45:20.909405 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:20.909343 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6d380652-f181-4b10-914d-bafb30cbce75/kube-rbac-proxy/0.log" Jun 09 13:45:20.934626 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:20.934560 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6d380652-f181-4b10-914d-bafb30cbce75/kube-rbac-proxy-metric/0.log" Jun 09 13:45:20.960738 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:20.960632 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6d380652-f181-4b10-914d-bafb30cbce75/prom-label-proxy/0.log" Jun 09 13:45:20.982362 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:20.982289 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6d380652-f181-4b10-914d-bafb30cbce75/init-config-reloader/0.log" Jun 09 13:45:21.139822 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:21.139745 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-647ddfdf77-kfhqn_7e1a5795-60bb-43b1-8494-a03103ed9702/metrics-server/0.log" Jun 09 13:45:21.369966 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:21.369933 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sqhmh_c0e56023-ee42-4cc6-ada8-15c0376673fb/node-exporter/0.log" Jun 09 13:45:21.393642 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:21.393560 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sqhmh_c0e56023-ee42-4cc6-ada8-15c0376673fb/kube-rbac-proxy/0.log" Jun 09 13:45:21.416510 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:21.416482 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sqhmh_c0e56023-ee42-4cc6-ada8-15c0376673fb/init-textfile/0.log" Jun 09 13:45:21.443448 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:21.443423 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-2f8xq_9d192875-479d-49a8-9222-b387deab3488/kube-rbac-proxy-main/0.log" Jun 09 13:45:21.473108 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:21.473064 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-2f8xq_9d192875-479d-49a8-9222-b387deab3488/kube-rbac-proxy-self/0.log" Jun 09 13:45:21.493545 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:21.493491 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-2f8xq_9d192875-479d-49a8-9222-b387deab3488/openshift-state-metrics/0.log" Jun 09 13:45:21.535231 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:21.535171 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d8c6e13a-6395-449b-a8f7-fb182961d2b6/prometheus/0.log" Jun 09 13:45:21.555494 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:21.555460 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d8c6e13a-6395-449b-a8f7-fb182961d2b6/config-reloader/0.log" Jun 09 13:45:21.581384 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:21.581350 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d8c6e13a-6395-449b-a8f7-fb182961d2b6/thanos-sidecar/0.log" Jun 09 13:45:21.609663 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:21.609629 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d8c6e13a-6395-449b-a8f7-fb182961d2b6/kube-rbac-proxy-web/0.log" Jun 09 13:45:21.633839 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:21.633805 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d8c6e13a-6395-449b-a8f7-fb182961d2b6/kube-rbac-proxy/0.log" Jun 09 13:45:21.669398 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:21.669316 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d8c6e13a-6395-449b-a8f7-fb182961d2b6/kube-rbac-proxy-thanos/0.log" Jun 09 13:45:21.693909 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:21.693884 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d8c6e13a-6395-449b-a8f7-fb182961d2b6/init-config-reloader/0.log" Jun 09 13:45:23.214811 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:23.214787 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-qvkpz_8c588445-d514-4c1c-a4b4-b1a0f03728fd/networking-console-plugin/0.log" Jun 09 13:45:24.052980 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:24.052952 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-zp49d_1ab5424a-30ca-4623-9cae-ecac49d73ffc/download-server/0.log" Jun 09 13:45:24.241494 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:24.241458 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pd28m/perf-node-gather-daemonset-qkfq6"] Jun 09 13:45:24.245316 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:24.245291 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pd28m/perf-node-gather-daemonset-qkfq6" Jun 09 13:45:24.254639 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:24.254607 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pd28m/perf-node-gather-daemonset-qkfq6"] Jun 09 13:45:24.375355 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:24.375259 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/408560d4-61d1-4f2d-b1d2-bd936c9dbdec-sys\") pod \"perf-node-gather-daemonset-qkfq6\" (UID: \"408560d4-61d1-4f2d-b1d2-bd936c9dbdec\") " pod="openshift-must-gather-pd28m/perf-node-gather-daemonset-qkfq6" Jun 09 13:45:24.375355 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:24.375318 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/408560d4-61d1-4f2d-b1d2-bd936c9dbdec-proc\") pod \"perf-node-gather-daemonset-qkfq6\" (UID: \"408560d4-61d1-4f2d-b1d2-bd936c9dbdec\") " pod="openshift-must-gather-pd28m/perf-node-gather-daemonset-qkfq6" Jun 09 13:45:24.375584 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:24.375381 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdxv9\" (UniqueName: \"kubernetes.io/projected/408560d4-61d1-4f2d-b1d2-bd936c9dbdec-kube-api-access-jdxv9\") pod \"perf-node-gather-daemonset-qkfq6\" (UID: \"408560d4-61d1-4f2d-b1d2-bd936c9dbdec\") " pod="openshift-must-gather-pd28m/perf-node-gather-daemonset-qkfq6" Jun 09 13:45:24.375584 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:24.375498 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/408560d4-61d1-4f2d-b1d2-bd936c9dbdec-podres\") pod \"perf-node-gather-daemonset-qkfq6\" (UID: \"408560d4-61d1-4f2d-b1d2-bd936c9dbdec\") " pod="openshift-must-gather-pd28m/perf-node-gather-daemonset-qkfq6" Jun 09 13:45:24.375584 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:24.375550 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/408560d4-61d1-4f2d-b1d2-bd936c9dbdec-lib-modules\") pod \"perf-node-gather-daemonset-qkfq6\" (UID: \"408560d4-61d1-4f2d-b1d2-bd936c9dbdec\") " pod="openshift-must-gather-pd28m/perf-node-gather-daemonset-qkfq6" Jun 09 13:45:24.476360 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:24.476322 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/408560d4-61d1-4f2d-b1d2-bd936c9dbdec-lib-modules\") pod \"perf-node-gather-daemonset-qkfq6\" (UID: \"408560d4-61d1-4f2d-b1d2-bd936c9dbdec\") " pod="openshift-must-gather-pd28m/perf-node-gather-daemonset-qkfq6" Jun 09 13:45:24.476559 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:24.476395 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/408560d4-61d1-4f2d-b1d2-bd936c9dbdec-sys\") pod \"perf-node-gather-daemonset-qkfq6\" (UID: \"408560d4-61d1-4f2d-b1d2-bd936c9dbdec\") " pod="openshift-must-gather-pd28m/perf-node-gather-daemonset-qkfq6" Jun 09 13:45:24.476559 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:24.476412 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/408560d4-61d1-4f2d-b1d2-bd936c9dbdec-proc\") pod \"perf-node-gather-daemonset-qkfq6\" (UID: \"408560d4-61d1-4f2d-b1d2-bd936c9dbdec\") " pod="openshift-must-gather-pd28m/perf-node-gather-daemonset-qkfq6" Jun 09 13:45:24.476559 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:24.476451 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdxv9\" (UniqueName: \"kubernetes.io/projected/408560d4-61d1-4f2d-b1d2-bd936c9dbdec-kube-api-access-jdxv9\") pod \"perf-node-gather-daemonset-qkfq6\" (UID: \"408560d4-61d1-4f2d-b1d2-bd936c9dbdec\") " pod="openshift-must-gather-pd28m/perf-node-gather-daemonset-qkfq6" Jun 09 13:45:24.476559 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:24.476484 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/408560d4-61d1-4f2d-b1d2-bd936c9dbdec-podres\") pod \"perf-node-gather-daemonset-qkfq6\" (UID: \"408560d4-61d1-4f2d-b1d2-bd936c9dbdec\") " pod="openshift-must-gather-pd28m/perf-node-gather-daemonset-qkfq6" Jun 09 13:45:24.476559 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:24.476530 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/408560d4-61d1-4f2d-b1d2-bd936c9dbdec-sys\") pod \"perf-node-gather-daemonset-qkfq6\" (UID: \"408560d4-61d1-4f2d-b1d2-bd936c9dbdec\") " pod="openshift-must-gather-pd28m/perf-node-gather-daemonset-qkfq6" Jun 09 13:45:24.476814 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:24.476530 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/408560d4-61d1-4f2d-b1d2-bd936c9dbdec-lib-modules\") pod \"perf-node-gather-daemonset-qkfq6\" (UID: \"408560d4-61d1-4f2d-b1d2-bd936c9dbdec\") " pod="openshift-must-gather-pd28m/perf-node-gather-daemonset-qkfq6" Jun 09 13:45:24.476814 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:24.476578 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/408560d4-61d1-4f2d-b1d2-bd936c9dbdec-proc\") pod \"perf-node-gather-daemonset-qkfq6\" (UID: \"408560d4-61d1-4f2d-b1d2-bd936c9dbdec\") " pod="openshift-must-gather-pd28m/perf-node-gather-daemonset-qkfq6" Jun 09 13:45:24.476814 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:24.476615 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/408560d4-61d1-4f2d-b1d2-bd936c9dbdec-podres\") pod \"perf-node-gather-daemonset-qkfq6\" (UID: \"408560d4-61d1-4f2d-b1d2-bd936c9dbdec\") " pod="openshift-must-gather-pd28m/perf-node-gather-daemonset-qkfq6" Jun 09 13:45:24.485308 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:24.485277 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdxv9\" (UniqueName: \"kubernetes.io/projected/408560d4-61d1-4f2d-b1d2-bd936c9dbdec-kube-api-access-jdxv9\") pod \"perf-node-gather-daemonset-qkfq6\" (UID: \"408560d4-61d1-4f2d-b1d2-bd936c9dbdec\") " pod="openshift-must-gather-pd28m/perf-node-gather-daemonset-qkfq6" Jun 09 13:45:24.560006 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:24.559975 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pd28m/perf-node-gather-daemonset-qkfq6" Jun 09 13:45:24.724571 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:24.724473 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pd28m/perf-node-gather-daemonset-qkfq6"] Jun 09 13:45:25.426437 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:25.426404 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hzv2v_c8f7fd79-6891-4136-ae3a-03ed6d7c4d96/dns/0.log" Jun 09 13:45:25.449967 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:25.449942 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hzv2v_c8f7fd79-6891-4136-ae3a-03ed6d7c4d96/kube-rbac-proxy/0.log" Jun 09 13:45:25.493588 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:25.493554 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pd28m/perf-node-gather-daemonset-qkfq6" event={"ID":"408560d4-61d1-4f2d-b1d2-bd936c9dbdec","Type":"ContainerStarted","Data":"3ae3c26426aff30846f34d033750e0486f86a406d91d24e5a97bfcb540aca1c0"} Jun 09 13:45:25.493746 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:25.493604 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pd28m/perf-node-gather-daemonset-qkfq6" event={"ID":"408560d4-61d1-4f2d-b1d2-bd936c9dbdec","Type":"ContainerStarted","Data":"1a069fe116f7ec3980e4f8e98f252f4f9caf7508f838a9ce2857b94922d1eab7"} Jun 09 13:45:25.493746 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:25.493634 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-pd28m/perf-node-gather-daemonset-qkfq6" Jun 09 13:45:25.509921 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:25.509870 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-pd28m/perf-node-gather-daemonset-qkfq6" podStartSLOduration=1.5098565769999999 podStartE2EDuration="1.509856577s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 13:45:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:45:25.508624623 +0000 UTC m=+1140.208899564" watchObservedRunningTime="2026-06-09 13:45:25.509856577 +0000 UTC m=+1140.210131528" Jun 09 13:45:25.517552 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:25.517524 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hsvg8_a0547d16-4dde-4b06-97d4-091c54fd4534/dns-node-resolver/0.log" Jun 09 13:45:25.960676 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:25.960649 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gb54t_1ab8fa81-0942-447f-9c26-6f448848c07d/node-ca/0.log" Jun 09 13:45:26.992557 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:26.992527 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bsxfs_af72438c-c400-45ba-941f-94637383ca93/serve-healthcheck-canary/0.log" Jun 09 13:45:27.482384 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:27.482361 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-q7sfg_f54afc59-1b5a-414f-8bf5-8419bbe55252/kube-rbac-proxy/0.log" Jun 09 13:45:27.501628 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:27.501600 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-q7sfg_f54afc59-1b5a-414f-8bf5-8419bbe55252/exporter/0.log" Jun 09 13:45:27.522465 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:27.522439 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-q7sfg_f54afc59-1b5a-414f-8bf5-8419bbe55252/extractor/0.log" Jun 09 13:45:29.156378 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:29.156344 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-operator-5bc45f897-q2lrz_98966653-d14e-44ee-b449-06df9fc02cb7/jobset-operator/0.log" Jun 09 13:45:31.511979 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:31.511949 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-pd28m/perf-node-gather-daemonset-qkfq6" Jun 09 13:45:32.137541 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:32.137501 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-4lrrq_c835e0e7-65b5-423a-adb4-2c11e9d1760b/migrator/0.log" Jun 09 13:45:32.157631 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:32.157603 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-4lrrq_c835e0e7-65b5-423a-adb4-2c11e9d1760b/graceful-termination/0.log" Jun 09 13:45:32.511142 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:32.511114 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-5hlz6_484d59bc-77c0-4d36-a527-2f0898f1a744/kube-storage-version-migrator-operator/1.log" Jun 09 13:45:32.512355 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:32.512333 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-5hlz6_484d59bc-77c0-4d36-a527-2f0898f1a744/kube-storage-version-migrator-operator/0.log" Jun 09 13:45:33.547930 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:33.547898 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bqwlr_5924b051-0215-4fc3-b719-1368c5d88226/kube-multus-additional-cni-plugins/0.log" Jun 09 13:45:33.573881 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:33.573854 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bqwlr_5924b051-0215-4fc3-b719-1368c5d88226/egress-router-binary-copy/0.log" Jun 09 13:45:33.596808 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:33.596781 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bqwlr_5924b051-0215-4fc3-b719-1368c5d88226/cni-plugins/0.log" Jun 09 13:45:33.619884 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:33.619854 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bqwlr_5924b051-0215-4fc3-b719-1368c5d88226/bond-cni-plugin/0.log" Jun 09 13:45:33.643651 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:33.643621 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bqwlr_5924b051-0215-4fc3-b719-1368c5d88226/routeoverride-cni/0.log" Jun 09 13:45:33.666512 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:33.666469 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bqwlr_5924b051-0215-4fc3-b719-1368c5d88226/whereabouts-cni-bincopy/0.log" Jun 09 13:45:33.686971 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:33.686946 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bqwlr_5924b051-0215-4fc3-b719-1368c5d88226/whereabouts-cni/0.log" Jun 09 13:45:34.058068 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:34.058039 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-mz5b5_67cfbf1f-7a58-467e-a353-69e78abfa48f/kube-multus/0.log" Jun 09 13:45:34.168160 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:34.168084 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-s8xkw_5ee23738-5173-4f32-83d2-4f47140592b3/network-metrics-daemon/0.log" Jun 09 13:45:34.190195 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:34.190167 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-s8xkw_5ee23738-5173-4f32-83d2-4f47140592b3/kube-rbac-proxy/0.log" Jun 09 13:45:34.921262 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:34.921228 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rcxgh_5f5c65b0-3ab1-40fe-bf7d-c08c3548d520/ovn-controller/0.log" Jun 09 13:45:34.941133 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:34.941100 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rcxgh_5f5c65b0-3ab1-40fe-bf7d-c08c3548d520/ovn-acl-logging/0.log" Jun 09 13:45:34.971452 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:34.971429 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rcxgh_5f5c65b0-3ab1-40fe-bf7d-c08c3548d520/kube-rbac-proxy-node/0.log" Jun 09 13:45:35.000081 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:35.000026 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rcxgh_5f5c65b0-3ab1-40fe-bf7d-c08c3548d520/kube-rbac-proxy-ovn-metrics/0.log" Jun 09 13:45:35.017755 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:35.017722 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rcxgh_5f5c65b0-3ab1-40fe-bf7d-c08c3548d520/northd/0.log" Jun 09 13:45:35.042762 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:35.042736 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rcxgh_5f5c65b0-3ab1-40fe-bf7d-c08c3548d520/nbdb/0.log" Jun 09 13:45:35.066042 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:35.066009 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rcxgh_5f5c65b0-3ab1-40fe-bf7d-c08c3548d520/sbdb/0.log" Jun 09 13:45:35.106095 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:35.106069 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rcxgh_5f5c65b0-3ab1-40fe-bf7d-c08c3548d520/ovnkube-controller/0.log" Jun 09 13:45:36.472212 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:36.472169 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-kdbl8_a9ecc5cb-87e0-4daa-9cc4-156dd0952402/network-check-target-container/0.log" Jun 09 13:45:37.330970 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:37.330944 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-dhvgh_eab169a4-f873-4234-a2bd-3e592f05ca0c/iptables-alerter/0.log" Jun 09 13:45:37.958555 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:37.958532 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-5xhqv_675b5408-f1a4-4e3a-a7ce-688beba79cb9/tuned/0.log" Jun 09 13:45:39.680489 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:39.680455 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-854f8b96b6-jsfhk_5550c977-76e2-4825-ab9c-32aa65e219a3/cluster-samples-operator/0.log" Jun 09 13:45:39.698422 ip-10-0-135-125 kubenswrapper[2577]: I0609 13:45:39.698394 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-854f8b96b6-jsfhk_5550c977-76e2-4825-ab9c-32aa65e219a3/cluster-samples-operator-watch/0.log"