Apr 17 14:26:47.828296 ip-10-0-131-47 systemd[1]: Starting Kubernetes Kubelet... Apr 17 14:26:48.309081 ip-10-0-131-47 kubenswrapper[2573]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Apr 17 14:26:48.309081 ip-10-0-131-47 kubenswrapper[2573]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Apr 17 14:26:48.309081 ip-10-0-131-47 kubenswrapper[2573]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Apr 17 14:26:48.309081 ip-10-0-131-47 kubenswrapper[2573]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Apr 17 14:26:48.309081 ip-10-0-131-47 kubenswrapper[2573]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Apr 17 14:26:48.312719 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.312631 2573 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Apr 17 14:26:48.320422 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320399 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Apr 17 14:26:48.320422 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320418 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Apr 17 14:26:48.320422 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320422 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Apr 17 14:26:48.320422 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320425 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Apr 17 14:26:48.320422 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320428 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Apr 17 14:26:48.320422 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320431 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Apr 17 14:26:48.320652 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320434 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Apr 17 14:26:48.320652 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320437 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Apr 17 14:26:48.320652 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320440 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Apr 17 14:26:48.320652 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320443 2573 feature_gate.go:328] unrecognized feature gate: Example2 Apr 17 14:26:48.320652 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320445 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Apr 17 14:26:48.320652 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320448 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Apr 17 14:26:48.320652 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320453 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Apr 17 14:26:48.320652 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320457 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Apr 17 14:26:48.320652 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320460 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Apr 17 14:26:48.320652 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320463 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Apr 17 14:26:48.320652 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320466 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Apr 17 14:26:48.320652 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320469 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Apr 17 14:26:48.320652 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320471 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Apr 17 14:26:48.320652 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320474 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Apr 17 14:26:48.320652 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320477 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Apr 17 14:26:48.320652 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320480 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Apr 17 14:26:48.320652 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320482 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Apr 17 14:26:48.320652 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320485 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Apr 17 14:26:48.320652 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320488 2573 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Apr 17 14:26:48.320652 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320490 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Apr 17 14:26:48.321147 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320493 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Apr 17 14:26:48.321147 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320495 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Apr 17 14:26:48.321147 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320498 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Apr 17 14:26:48.321147 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320505 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Apr 17 14:26:48.321147 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320508 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Apr 17 14:26:48.321147 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320511 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Apr 17 14:26:48.321147 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320514 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Apr 17 14:26:48.321147 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320516 2573 feature_gate.go:328] unrecognized feature gate: Example Apr 17 14:26:48.321147 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320519 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Apr 17 14:26:48.321147 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320521 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Apr 17 14:26:48.321147 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320524 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Apr 17 14:26:48.321147 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320527 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Apr 17 14:26:48.321147 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320529 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Apr 17 14:26:48.321147 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320533 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Apr 17 14:26:48.321147 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320536 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Apr 17 14:26:48.321147 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320538 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Apr 17 14:26:48.321147 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320541 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Apr 17 14:26:48.321147 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320544 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Apr 17 14:26:48.321147 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320546 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Apr 17 14:26:48.321147 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320549 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Apr 17 14:26:48.321671 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320552 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Apr 17 14:26:48.321671 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320554 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Apr 17 14:26:48.321671 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320557 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Apr 17 14:26:48.321671 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320560 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Apr 17 14:26:48.321671 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320562 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Apr 17 14:26:48.321671 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320565 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Apr 17 14:26:48.321671 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320568 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Apr 17 14:26:48.321671 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320571 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Apr 17 14:26:48.321671 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320574 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Apr 17 14:26:48.321671 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320578 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Apr 17 14:26:48.321671 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320580 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Apr 17 14:26:48.321671 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320583 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Apr 17 14:26:48.321671 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320585 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Apr 17 14:26:48.321671 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320588 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Apr 17 14:26:48.321671 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320590 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Apr 17 14:26:48.321671 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320593 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Apr 17 14:26:48.321671 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320595 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Apr 17 14:26:48.321671 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320598 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Apr 17 14:26:48.321671 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320600 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Apr 17 14:26:48.321671 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320603 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Apr 17 14:26:48.322166 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320606 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Apr 17 14:26:48.322166 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320615 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Apr 17 14:26:48.322166 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320619 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Apr 17 14:26:48.322166 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320621 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Apr 17 14:26:48.322166 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320624 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Apr 17 14:26:48.322166 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320628 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Apr 17 14:26:48.322166 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320631 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Apr 17 14:26:48.322166 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320634 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Apr 17 14:26:48.322166 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320637 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Apr 17 14:26:48.322166 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320639 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Apr 17 14:26:48.322166 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320642 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Apr 17 14:26:48.322166 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320645 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Apr 17 14:26:48.322166 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320649 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Apr 17 14:26:48.322166 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320651 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Apr 17 14:26:48.322166 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320657 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Apr 17 14:26:48.322166 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320661 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Apr 17 14:26:48.322166 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320664 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Apr 17 14:26:48.322166 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320667 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Apr 17 14:26:48.322166 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320670 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Apr 17 14:26:48.322615 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.320673 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Apr 17 14:26:48.322615 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321087 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Apr 17 14:26:48.322615 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321093 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Apr 17 14:26:48.322615 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321096 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Apr 17 14:26:48.322615 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321099 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Apr 17 14:26:48.322615 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321102 2573 feature_gate.go:328] unrecognized feature gate: Example Apr 17 14:26:48.322615 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321104 2573 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Apr 17 14:26:48.322615 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321108 2573 feature_gate.go:328] unrecognized feature gate: Example2 Apr 17 14:26:48.322615 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321110 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Apr 17 14:26:48.322615 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321113 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Apr 17 14:26:48.322615 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321116 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Apr 17 14:26:48.322615 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321119 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Apr 17 14:26:48.322615 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321121 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Apr 17 14:26:48.322615 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321124 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Apr 17 14:26:48.322615 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321127 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Apr 17 14:26:48.322615 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321129 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Apr 17 14:26:48.322615 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321131 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Apr 17 14:26:48.322615 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321135 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Apr 17 14:26:48.322615 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321138 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Apr 17 14:26:48.322615 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321141 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Apr 17 14:26:48.323105 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321144 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Apr 17 14:26:48.323105 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321148 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Apr 17 14:26:48.323105 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321150 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Apr 17 14:26:48.323105 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321153 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Apr 17 14:26:48.323105 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321156 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Apr 17 14:26:48.323105 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321159 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Apr 17 14:26:48.323105 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321162 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Apr 17 14:26:48.323105 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321165 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Apr 17 14:26:48.323105 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321167 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Apr 17 14:26:48.323105 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321170 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Apr 17 14:26:48.323105 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321172 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Apr 17 14:26:48.323105 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321174 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Apr 17 14:26:48.323105 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321177 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Apr 17 14:26:48.323105 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321179 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Apr 17 14:26:48.323105 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321182 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Apr 17 14:26:48.323105 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321185 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Apr 17 14:26:48.323105 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321187 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Apr 17 14:26:48.323105 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321189 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Apr 17 14:26:48.323105 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321192 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Apr 17 14:26:48.323105 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321194 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Apr 17 14:26:48.323594 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321198 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Apr 17 14:26:48.323594 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321202 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Apr 17 14:26:48.323594 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321205 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Apr 17 14:26:48.323594 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321208 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Apr 17 14:26:48.323594 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321211 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Apr 17 14:26:48.323594 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321214 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Apr 17 14:26:48.323594 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321217 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Apr 17 14:26:48.323594 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321219 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Apr 17 14:26:48.323594 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321222 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Apr 17 14:26:48.323594 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321226 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Apr 17 14:26:48.323594 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321229 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Apr 17 14:26:48.323594 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321231 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Apr 17 14:26:48.323594 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321234 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Apr 17 14:26:48.323594 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321236 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Apr 17 14:26:48.323594 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321239 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Apr 17 14:26:48.323594 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321241 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Apr 17 14:26:48.323594 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321244 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Apr 17 14:26:48.323594 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321246 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Apr 17 14:26:48.323594 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321249 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Apr 17 14:26:48.324075 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321252 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Apr 17 14:26:48.324075 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321255 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Apr 17 14:26:48.324075 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321258 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Apr 17 14:26:48.324075 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321260 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Apr 17 14:26:48.324075 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321262 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Apr 17 14:26:48.324075 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321265 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Apr 17 14:26:48.324075 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321267 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Apr 17 14:26:48.324075 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321270 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Apr 17 14:26:48.324075 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321272 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Apr 17 14:26:48.324075 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321276 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Apr 17 14:26:48.324075 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321280 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Apr 17 14:26:48.324075 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321282 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Apr 17 14:26:48.324075 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321285 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Apr 17 14:26:48.324075 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321287 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Apr 17 14:26:48.324075 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321290 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Apr 17 14:26:48.324075 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321292 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Apr 17 14:26:48.324075 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321295 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Apr 17 14:26:48.324075 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321297 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Apr 17 14:26:48.324075 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321300 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Apr 17 14:26:48.324075 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321302 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Apr 17 14:26:48.324559 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321305 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Apr 17 14:26:48.324559 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321308 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Apr 17 14:26:48.324559 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321314 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Apr 17 14:26:48.324559 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321317 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Apr 17 14:26:48.324559 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321320 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Apr 17 14:26:48.324559 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321323 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Apr 17 14:26:48.324559 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321325 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Apr 17 14:26:48.324559 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.321328 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Apr 17 14:26:48.324559 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.322069 2573 flags.go:64] FLAG: --address="0.0.0.0" Apr 17 14:26:48.324559 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.322078 2573 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Apr 17 14:26:48.324559 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.322084 2573 flags.go:64] FLAG: --anonymous-auth="true" Apr 17 14:26:48.324559 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.322089 2573 flags.go:64] FLAG: --application-metrics-count-limit="100" Apr 17 14:26:48.324559 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.322095 2573 flags.go:64] FLAG: --authentication-token-webhook="false" Apr 17 14:26:48.324559 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.322098 2573 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Apr 17 14:26:48.324559 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.322103 2573 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Apr 17 14:26:48.324559 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.322107 2573 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Apr 17 14:26:48.324559 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.322111 2573 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Apr 17 14:26:48.324559 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.322114 2573 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Apr 17 14:26:48.324559 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.322118 2573 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Apr 17 14:26:48.324559 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.322121 2573 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Apr 17 14:26:48.324559 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.322125 2573 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Apr 17 14:26:48.324559 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.322127 2573 flags.go:64] FLAG: --cgroup-root="" Apr 17 14:26:48.325106 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.322130 2573 flags.go:64] FLAG: --cgroups-per-qos="true" Apr 17 14:26:48.325106 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.322133 2573 flags.go:64] FLAG: --client-ca-file="" Apr 17 14:26:48.325106 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.322136 2573 flags.go:64] FLAG: --cloud-config="" Apr 17 14:26:48.325106 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.322139 2573 flags.go:64] FLAG: --cloud-provider="external" Apr 17 14:26:48.325106 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.322142 2573 flags.go:64] FLAG: --cluster-dns="[]" Apr 17 14:26:48.325106 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.322997 2573 flags.go:64] FLAG: --cluster-domain="" Apr 17 14:26:48.325106 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323001 2573 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Apr 17 14:26:48.325106 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323004 2573 flags.go:64] FLAG: --config-dir="" Apr 17 14:26:48.325106 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323008 2573 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Apr 17 14:26:48.325106 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323011 2573 flags.go:64] FLAG: --container-log-max-files="5" Apr 17 14:26:48.325106 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323015 2573 flags.go:64] FLAG: --container-log-max-size="10Mi" Apr 17 14:26:48.325106 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323019 2573 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Apr 17 14:26:48.325106 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323023 2573 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Apr 17 14:26:48.325106 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323027 2573 flags.go:64] FLAG: --containerd-namespace="k8s.io" Apr 17 14:26:48.325106 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323030 2573 flags.go:64] FLAG: --contention-profiling="false" Apr 17 14:26:48.325106 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323033 2573 flags.go:64] FLAG: --cpu-cfs-quota="true" Apr 17 14:26:48.325106 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323036 2573 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Apr 17 14:26:48.325106 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323039 2573 flags.go:64] FLAG: --cpu-manager-policy="none" Apr 17 14:26:48.325106 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323043 2573 flags.go:64] FLAG: --cpu-manager-policy-options="" Apr 17 14:26:48.325106 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323047 2573 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Apr 17 14:26:48.325106 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323050 2573 flags.go:64] FLAG: --enable-controller-attach-detach="true" Apr 17 14:26:48.325106 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323053 2573 flags.go:64] FLAG: --enable-debugging-handlers="true" Apr 17 14:26:48.325106 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323056 2573 flags.go:64] FLAG: --enable-load-reader="false" Apr 17 14:26:48.325106 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323059 2573 flags.go:64] FLAG: --enable-server="true" Apr 17 14:26:48.325106 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323062 2573 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Apr 17 14:26:48.325711 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323067 2573 flags.go:64] FLAG: --event-burst="100" Apr 17 14:26:48.325711 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323070 2573 flags.go:64] FLAG: --event-qps="50" Apr 17 14:26:48.325711 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323073 2573 flags.go:64] FLAG: --event-storage-age-limit="default=0" Apr 17 14:26:48.325711 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323076 2573 flags.go:64] FLAG: --event-storage-event-limit="default=0" Apr 17 14:26:48.325711 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323079 2573 flags.go:64] FLAG: --eviction-hard="" Apr 17 14:26:48.325711 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323083 2573 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Apr 17 14:26:48.325711 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323086 2573 flags.go:64] FLAG: --eviction-minimum-reclaim="" Apr 17 14:26:48.325711 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323089 2573 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Apr 17 14:26:48.325711 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323092 2573 flags.go:64] FLAG: --eviction-soft="" Apr 17 14:26:48.325711 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323095 2573 flags.go:64] FLAG: --eviction-soft-grace-period="" Apr 17 14:26:48.325711 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323098 2573 flags.go:64] FLAG: --exit-on-lock-contention="false" Apr 17 14:26:48.325711 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323101 2573 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Apr 17 14:26:48.325711 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323104 2573 flags.go:64] FLAG: --experimental-mounter-path="" Apr 17 14:26:48.325711 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323107 2573 flags.go:64] FLAG: --fail-cgroupv1="false" Apr 17 14:26:48.325711 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323109 2573 flags.go:64] FLAG: --fail-swap-on="true" Apr 17 14:26:48.325711 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323112 2573 flags.go:64] FLAG: --feature-gates="" Apr 17 14:26:48.325711 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323116 2573 flags.go:64] FLAG: --file-check-frequency="20s" Apr 17 14:26:48.325711 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323120 2573 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Apr 17 14:26:48.325711 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323123 2573 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Apr 17 14:26:48.325711 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323127 2573 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Apr 17 14:26:48.325711 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323130 2573 flags.go:64] FLAG: --healthz-port="10248" Apr 17 14:26:48.325711 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323133 2573 flags.go:64] FLAG: --help="false" Apr 17 14:26:48.325711 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323136 2573 flags.go:64] FLAG: --hostname-override="ip-10-0-131-47.ec2.internal" Apr 17 14:26:48.325711 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323139 2573 flags.go:64] FLAG: --housekeeping-interval="10s" Apr 17 14:26:48.325711 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323143 2573 flags.go:64] FLAG: --http-check-frequency="20s" Apr 17 14:26:48.326346 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323145 2573 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Apr 17 14:26:48.326346 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323149 2573 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Apr 17 14:26:48.326346 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323152 2573 flags.go:64] FLAG: --image-gc-high-threshold="85" Apr 17 14:26:48.326346 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323155 2573 flags.go:64] FLAG: --image-gc-low-threshold="80" Apr 17 14:26:48.326346 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323157 2573 flags.go:64] FLAG: --image-service-endpoint="" Apr 17 14:26:48.326346 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323160 2573 flags.go:64] FLAG: --kernel-memcg-notification="false" Apr 17 14:26:48.326346 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323163 2573 flags.go:64] FLAG: --kube-api-burst="100" Apr 17 14:26:48.326346 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323166 2573 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Apr 17 14:26:48.326346 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323170 2573 flags.go:64] FLAG: --kube-api-qps="50" Apr 17 14:26:48.326346 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323173 2573 flags.go:64] FLAG: --kube-reserved="" Apr 17 14:26:48.326346 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323176 2573 flags.go:64] FLAG: --kube-reserved-cgroup="" Apr 17 14:26:48.326346 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323179 2573 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Apr 17 14:26:48.326346 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323182 2573 flags.go:64] FLAG: --kubelet-cgroups="" Apr 17 14:26:48.326346 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323184 2573 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Apr 17 14:26:48.326346 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323187 2573 flags.go:64] FLAG: --lock-file="" Apr 17 14:26:48.326346 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323190 2573 flags.go:64] FLAG: --log-cadvisor-usage="false" Apr 17 14:26:48.326346 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323193 2573 flags.go:64] FLAG: --log-flush-frequency="5s" Apr 17 14:26:48.326346 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323196 2573 flags.go:64] FLAG: --log-json-info-buffer-size="0" Apr 17 14:26:48.326346 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323202 2573 flags.go:64] FLAG: --log-json-split-stream="false" Apr 17 14:26:48.326346 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323204 2573 flags.go:64] FLAG: --log-text-info-buffer-size="0" Apr 17 14:26:48.326346 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323207 2573 flags.go:64] FLAG: --log-text-split-stream="false" Apr 17 14:26:48.326346 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323210 2573 flags.go:64] FLAG: --logging-format="text" Apr 17 14:26:48.326346 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323213 2573 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Apr 17 14:26:48.326904 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323216 2573 flags.go:64] FLAG: --make-iptables-util-chains="true" Apr 17 14:26:48.326904 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323219 2573 flags.go:64] FLAG: --manifest-url="" Apr 17 14:26:48.326904 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323222 2573 flags.go:64] FLAG: --manifest-url-header="" Apr 17 14:26:48.326904 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323226 2573 flags.go:64] FLAG: --max-housekeeping-interval="15s" Apr 17 14:26:48.326904 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323229 2573 flags.go:64] FLAG: --max-open-files="1000000" Apr 17 14:26:48.326904 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323233 2573 flags.go:64] FLAG: --max-pods="110" Apr 17 14:26:48.326904 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323236 2573 flags.go:64] FLAG: --maximum-dead-containers="-1" Apr 17 14:26:48.326904 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323239 2573 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Apr 17 14:26:48.326904 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323242 2573 flags.go:64] FLAG: --memory-manager-policy="None" Apr 17 14:26:48.326904 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323245 2573 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Apr 17 14:26:48.326904 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323248 2573 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Apr 17 14:26:48.326904 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323251 2573 flags.go:64] FLAG: --node-ip="0.0.0.0" Apr 17 14:26:48.326904 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323254 2573 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Apr 17 14:26:48.326904 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323262 2573 flags.go:64] FLAG: --node-status-max-images="50" Apr 17 14:26:48.326904 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323265 2573 flags.go:64] FLAG: --node-status-update-frequency="10s" Apr 17 14:26:48.326904 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323268 2573 flags.go:64] FLAG: --oom-score-adj="-999" Apr 17 14:26:48.326904 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323271 2573 flags.go:64] FLAG: --pod-cidr="" Apr 17 14:26:48.326904 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323274 2573 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c8cfe89231412ff3ee8cb6207fa0be33cad0f08e88c9c0f1e9f7e8c6f14d6715" Apr 17 14:26:48.326904 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323281 2573 flags.go:64] FLAG: --pod-manifest-path="" Apr 17 14:26:48.326904 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323284 2573 flags.go:64] FLAG: --pod-max-pids="-1" Apr 17 14:26:48.326904 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323286 2573 flags.go:64] FLAG: --pods-per-core="0" Apr 17 14:26:48.326904 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323289 2573 flags.go:64] FLAG: --port="10250" Apr 17 14:26:48.326904 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323292 2573 flags.go:64] FLAG: --protect-kernel-defaults="false" Apr 17 14:26:48.326904 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323295 2573 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b843ac68211c877d" Apr 17 14:26:48.327649 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323298 2573 flags.go:64] FLAG: --qos-reserved="" Apr 17 14:26:48.327649 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323301 2573 flags.go:64] FLAG: --read-only-port="10255" Apr 17 14:26:48.327649 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323304 2573 flags.go:64] FLAG: --register-node="true" Apr 17 14:26:48.327649 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323307 2573 flags.go:64] FLAG: --register-schedulable="true" Apr 17 14:26:48.327649 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323310 2573 flags.go:64] FLAG: --register-with-taints="" Apr 17 14:26:48.327649 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323314 2573 flags.go:64] FLAG: --registry-burst="10" Apr 17 14:26:48.327649 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323316 2573 flags.go:64] FLAG: --registry-qps="5" Apr 17 14:26:48.327649 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323319 2573 flags.go:64] FLAG: --reserved-cpus="" Apr 17 14:26:48.327649 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323322 2573 flags.go:64] FLAG: --reserved-memory="" Apr 17 14:26:48.327649 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323325 2573 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Apr 17 14:26:48.327649 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323328 2573 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Apr 17 14:26:48.327649 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323335 2573 flags.go:64] FLAG: --rotate-certificates="false" Apr 17 14:26:48.327649 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323339 2573 flags.go:64] FLAG: --rotate-server-certificates="false" Apr 17 14:26:48.327649 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323341 2573 flags.go:64] FLAG: --runonce="false" Apr 17 14:26:48.327649 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323344 2573 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Apr 17 14:26:48.327649 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323347 2573 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Apr 17 14:26:48.327649 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323350 2573 flags.go:64] FLAG: --seccomp-default="false" Apr 17 14:26:48.327649 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323353 2573 flags.go:64] FLAG: --serialize-image-pulls="true" Apr 17 14:26:48.327649 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323356 2573 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Apr 17 14:26:48.327649 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323359 2573 flags.go:64] FLAG: --storage-driver-db="cadvisor" Apr 17 14:26:48.327649 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323362 2573 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Apr 17 14:26:48.327649 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323365 2573 flags.go:64] FLAG: --storage-driver-password="root" Apr 17 14:26:48.327649 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323368 2573 flags.go:64] FLAG: --storage-driver-secure="false" Apr 17 14:26:48.327649 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323371 2573 flags.go:64] FLAG: --storage-driver-table="stats" Apr 17 14:26:48.327649 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323374 2573 flags.go:64] FLAG: --storage-driver-user="root" Apr 17 14:26:48.327649 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323377 2573 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Apr 17 14:26:48.328297 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323380 2573 flags.go:64] FLAG: --sync-frequency="1m0s" Apr 17 14:26:48.328297 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323383 2573 flags.go:64] FLAG: --system-cgroups="" Apr 17 14:26:48.328297 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323387 2573 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Apr 17 14:26:48.328297 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323392 2573 flags.go:64] FLAG: --system-reserved-cgroup="" Apr 17 14:26:48.328297 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323395 2573 flags.go:64] FLAG: --tls-cert-file="" Apr 17 14:26:48.328297 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323398 2573 flags.go:64] FLAG: --tls-cipher-suites="[]" Apr 17 14:26:48.328297 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323402 2573 flags.go:64] FLAG: --tls-min-version="" Apr 17 14:26:48.328297 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323405 2573 flags.go:64] FLAG: --tls-private-key-file="" Apr 17 14:26:48.328297 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323408 2573 flags.go:64] FLAG: --topology-manager-policy="none" Apr 17 14:26:48.328297 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323411 2573 flags.go:64] FLAG: --topology-manager-policy-options="" Apr 17 14:26:48.328297 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323414 2573 flags.go:64] FLAG: --topology-manager-scope="container" Apr 17 14:26:48.328297 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323417 2573 flags.go:64] FLAG: --v="2" Apr 17 14:26:48.328297 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323421 2573 flags.go:64] FLAG: --version="false" Apr 17 14:26:48.328297 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323425 2573 flags.go:64] FLAG: --vmodule="" Apr 17 14:26:48.328297 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323429 2573 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Apr 17 14:26:48.328297 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.323433 2573 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Apr 17 14:26:48.328297 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323531 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Apr 17 14:26:48.328297 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323538 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Apr 17 14:26:48.328297 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323541 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Apr 17 14:26:48.328297 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323544 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Apr 17 14:26:48.328297 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323547 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Apr 17 14:26:48.328297 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323550 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Apr 17 14:26:48.328297 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323553 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Apr 17 14:26:48.328851 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323558 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Apr 17 14:26:48.328851 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323561 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Apr 17 14:26:48.328851 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323564 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Apr 17 14:26:48.328851 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323567 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Apr 17 14:26:48.328851 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323569 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Apr 17 14:26:48.328851 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323572 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Apr 17 14:26:48.328851 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323575 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Apr 17 14:26:48.328851 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323578 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Apr 17 14:26:48.328851 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323580 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Apr 17 14:26:48.328851 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323584 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Apr 17 14:26:48.328851 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323587 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Apr 17 14:26:48.328851 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323589 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Apr 17 14:26:48.328851 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323592 2573 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Apr 17 14:26:48.328851 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323594 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Apr 17 14:26:48.328851 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323597 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Apr 17 14:26:48.328851 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323600 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Apr 17 14:26:48.328851 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323603 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Apr 17 14:26:48.328851 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323605 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Apr 17 14:26:48.328851 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323608 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Apr 17 14:26:48.329352 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323611 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Apr 17 14:26:48.329352 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323614 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Apr 17 14:26:48.329352 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323617 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Apr 17 14:26:48.329352 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323620 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Apr 17 14:26:48.329352 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323622 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Apr 17 14:26:48.329352 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323625 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Apr 17 14:26:48.329352 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323628 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Apr 17 14:26:48.329352 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323636 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Apr 17 14:26:48.329352 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323638 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Apr 17 14:26:48.329352 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323641 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Apr 17 14:26:48.329352 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323643 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Apr 17 14:26:48.329352 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323646 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Apr 17 14:26:48.329352 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323649 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Apr 17 14:26:48.329352 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323651 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Apr 17 14:26:48.329352 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323654 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Apr 17 14:26:48.329352 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323656 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Apr 17 14:26:48.329352 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323659 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Apr 17 14:26:48.329352 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323662 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Apr 17 14:26:48.329352 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323664 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Apr 17 14:26:48.329352 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323666 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Apr 17 14:26:48.329890 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323669 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Apr 17 14:26:48.329890 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323671 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Apr 17 14:26:48.329890 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323674 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Apr 17 14:26:48.329890 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323677 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Apr 17 14:26:48.329890 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323679 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Apr 17 14:26:48.329890 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323682 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Apr 17 14:26:48.329890 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323685 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Apr 17 14:26:48.329890 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323687 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Apr 17 14:26:48.329890 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323691 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Apr 17 14:26:48.329890 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323695 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Apr 17 14:26:48.329890 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323697 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Apr 17 14:26:48.329890 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323700 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Apr 17 14:26:48.329890 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323702 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Apr 17 14:26:48.329890 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323705 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Apr 17 14:26:48.329890 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323708 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Apr 17 14:26:48.329890 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323710 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Apr 17 14:26:48.329890 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323712 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Apr 17 14:26:48.329890 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323715 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Apr 17 14:26:48.329890 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323717 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Apr 17 14:26:48.330461 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323722 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Apr 17 14:26:48.330461 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323725 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Apr 17 14:26:48.330461 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323728 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Apr 17 14:26:48.330461 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323731 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Apr 17 14:26:48.330461 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323733 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Apr 17 14:26:48.330461 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323736 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Apr 17 14:26:48.330461 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323738 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Apr 17 14:26:48.330461 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323741 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Apr 17 14:26:48.330461 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323744 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Apr 17 14:26:48.330461 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323746 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Apr 17 14:26:48.330461 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323749 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Apr 17 14:26:48.330461 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323752 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Apr 17 14:26:48.330461 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323754 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Apr 17 14:26:48.330461 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323756 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Apr 17 14:26:48.330461 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323759 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Apr 17 14:26:48.330461 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323761 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Apr 17 14:26:48.330461 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323764 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Apr 17 14:26:48.330461 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323767 2573 feature_gate.go:328] unrecognized feature gate: Example Apr 17 14:26:48.330461 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323770 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Apr 17 14:26:48.330461 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323772 2573 feature_gate.go:328] unrecognized feature gate: Example2 Apr 17 14:26:48.331033 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.323775 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Apr 17 14:26:48.331033 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.324592 2573 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Apr 17 14:26:48.331033 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.331019 2573 server.go:530] "Kubelet version" kubeletVersion="v1.33.9" Apr 17 14:26:48.331033 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.331035 2573 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Apr 17 14:26:48.331161 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331082 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Apr 17 14:26:48.331161 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331088 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Apr 17 14:26:48.331161 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331092 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Apr 17 14:26:48.331161 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331095 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Apr 17 14:26:48.331161 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331098 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Apr 17 14:26:48.331161 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331101 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Apr 17 14:26:48.331161 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331104 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Apr 17 14:26:48.331161 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331107 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Apr 17 14:26:48.331161 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331109 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Apr 17 14:26:48.331161 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331112 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Apr 17 14:26:48.331161 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331115 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Apr 17 14:26:48.331161 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331117 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Apr 17 14:26:48.331161 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331120 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Apr 17 14:26:48.331161 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331123 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Apr 17 14:26:48.331161 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331126 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Apr 17 14:26:48.331161 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331129 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Apr 17 14:26:48.331161 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331131 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Apr 17 14:26:48.331161 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331134 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Apr 17 14:26:48.331161 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331136 2573 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Apr 17 14:26:48.331161 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331139 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Apr 17 14:26:48.331693 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331142 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Apr 17 14:26:48.331693 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331145 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Apr 17 14:26:48.331693 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331147 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Apr 17 14:26:48.331693 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331150 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Apr 17 14:26:48.331693 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331153 2573 feature_gate.go:328] unrecognized feature gate: Example2 Apr 17 14:26:48.331693 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331156 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Apr 17 14:26:48.331693 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331158 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Apr 17 14:26:48.331693 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331162 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Apr 17 14:26:48.331693 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331164 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Apr 17 14:26:48.331693 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331167 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Apr 17 14:26:48.331693 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331170 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Apr 17 14:26:48.331693 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331174 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Apr 17 14:26:48.331693 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331177 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Apr 17 14:26:48.331693 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331179 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Apr 17 14:26:48.331693 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331182 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Apr 17 14:26:48.331693 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331185 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Apr 17 14:26:48.331693 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331187 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Apr 17 14:26:48.331693 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331190 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Apr 17 14:26:48.331693 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331192 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Apr 17 14:26:48.331693 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331195 2573 feature_gate.go:328] unrecognized feature gate: Example Apr 17 14:26:48.332234 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331198 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Apr 17 14:26:48.332234 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331200 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Apr 17 14:26:48.332234 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331203 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Apr 17 14:26:48.332234 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331205 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Apr 17 14:26:48.332234 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331208 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Apr 17 14:26:48.332234 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331210 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Apr 17 14:26:48.332234 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331213 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Apr 17 14:26:48.332234 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331215 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Apr 17 14:26:48.332234 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331218 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Apr 17 14:26:48.332234 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331221 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Apr 17 14:26:48.332234 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331224 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Apr 17 14:26:48.332234 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331226 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Apr 17 14:26:48.332234 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331229 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Apr 17 14:26:48.332234 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331231 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Apr 17 14:26:48.332234 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331234 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Apr 17 14:26:48.332234 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331237 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Apr 17 14:26:48.332234 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331240 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Apr 17 14:26:48.332234 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331243 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Apr 17 14:26:48.332234 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331245 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Apr 17 14:26:48.332759 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331248 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Apr 17 14:26:48.332759 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331250 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Apr 17 14:26:48.332759 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331253 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Apr 17 14:26:48.332759 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331256 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Apr 17 14:26:48.332759 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331258 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Apr 17 14:26:48.332759 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331271 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Apr 17 14:26:48.332759 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331277 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Apr 17 14:26:48.332759 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331282 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Apr 17 14:26:48.332759 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331285 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Apr 17 14:26:48.332759 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331288 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Apr 17 14:26:48.332759 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331291 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Apr 17 14:26:48.332759 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331294 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Apr 17 14:26:48.332759 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331296 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Apr 17 14:26:48.332759 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331299 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Apr 17 14:26:48.332759 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331302 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Apr 17 14:26:48.332759 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331304 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Apr 17 14:26:48.332759 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331307 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Apr 17 14:26:48.332759 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331309 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Apr 17 14:26:48.332759 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331312 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Apr 17 14:26:48.333359 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331314 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Apr 17 14:26:48.333359 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331317 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Apr 17 14:26:48.333359 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331319 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Apr 17 14:26:48.333359 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331322 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Apr 17 14:26:48.333359 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331325 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Apr 17 14:26:48.333359 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331327 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Apr 17 14:26:48.333359 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331330 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Apr 17 14:26:48.333359 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331333 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Apr 17 14:26:48.333359 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.331338 2573 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Apr 17 14:26:48.333359 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331435 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Apr 17 14:26:48.333359 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331440 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Apr 17 14:26:48.333359 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331443 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Apr 17 14:26:48.333359 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331447 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Apr 17 14:26:48.333359 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331450 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Apr 17 14:26:48.333359 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331452 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Apr 17 14:26:48.333739 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331455 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Apr 17 14:26:48.333739 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331458 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Apr 17 14:26:48.333739 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331461 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Apr 17 14:26:48.333739 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331463 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Apr 17 14:26:48.333739 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331467 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Apr 17 14:26:48.333739 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331469 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Apr 17 14:26:48.333739 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331472 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Apr 17 14:26:48.333739 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331474 2573 feature_gate.go:328] unrecognized feature gate: Example Apr 17 14:26:48.333739 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331477 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Apr 17 14:26:48.333739 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331479 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Apr 17 14:26:48.333739 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331482 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Apr 17 14:26:48.333739 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331485 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Apr 17 14:26:48.333739 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331489 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Apr 17 14:26:48.333739 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331491 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Apr 17 14:26:48.333739 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331494 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Apr 17 14:26:48.333739 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331496 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Apr 17 14:26:48.333739 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331499 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Apr 17 14:26:48.333739 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331501 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Apr 17 14:26:48.333739 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331504 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Apr 17 14:26:48.333739 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331507 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Apr 17 14:26:48.334258 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331509 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Apr 17 14:26:48.334258 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331512 2573 feature_gate.go:328] unrecognized feature gate: Example2 Apr 17 14:26:48.334258 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331515 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Apr 17 14:26:48.334258 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331517 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Apr 17 14:26:48.334258 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331520 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Apr 17 14:26:48.334258 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331523 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Apr 17 14:26:48.334258 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331525 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Apr 17 14:26:48.334258 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331528 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Apr 17 14:26:48.334258 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331530 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Apr 17 14:26:48.334258 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331533 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Apr 17 14:26:48.334258 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331536 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Apr 17 14:26:48.334258 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331538 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Apr 17 14:26:48.334258 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331541 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Apr 17 14:26:48.334258 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331544 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Apr 17 14:26:48.334258 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331546 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Apr 17 14:26:48.334258 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331549 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Apr 17 14:26:48.334258 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331551 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Apr 17 14:26:48.334258 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331554 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Apr 17 14:26:48.334258 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331557 2573 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Apr 17 14:26:48.334258 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331559 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Apr 17 14:26:48.334754 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331562 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Apr 17 14:26:48.334754 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331564 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Apr 17 14:26:48.334754 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331566 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Apr 17 14:26:48.334754 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331569 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Apr 17 14:26:48.334754 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331572 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Apr 17 14:26:48.334754 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331575 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Apr 17 14:26:48.334754 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331578 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Apr 17 14:26:48.334754 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331580 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Apr 17 14:26:48.334754 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331583 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Apr 17 14:26:48.334754 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331585 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Apr 17 14:26:48.334754 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331588 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Apr 17 14:26:48.334754 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331590 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Apr 17 14:26:48.334754 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331593 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Apr 17 14:26:48.334754 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331595 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Apr 17 14:26:48.334754 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331598 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Apr 17 14:26:48.334754 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331601 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Apr 17 14:26:48.334754 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331603 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Apr 17 14:26:48.334754 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331607 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Apr 17 14:26:48.334754 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331610 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Apr 17 14:26:48.335234 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331614 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Apr 17 14:26:48.335234 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331617 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Apr 17 14:26:48.335234 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331620 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Apr 17 14:26:48.335234 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331622 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Apr 17 14:26:48.335234 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331625 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Apr 17 14:26:48.335234 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331628 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Apr 17 14:26:48.335234 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331631 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Apr 17 14:26:48.335234 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331633 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Apr 17 14:26:48.335234 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331636 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Apr 17 14:26:48.335234 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331638 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Apr 17 14:26:48.335234 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331641 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Apr 17 14:26:48.335234 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331644 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Apr 17 14:26:48.335234 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331647 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Apr 17 14:26:48.335234 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331650 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Apr 17 14:26:48.335234 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331652 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Apr 17 14:26:48.335234 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331655 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Apr 17 14:26:48.335234 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331657 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Apr 17 14:26:48.335234 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331660 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Apr 17 14:26:48.335234 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331663 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Apr 17 14:26:48.335234 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331666 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Apr 17 14:26:48.335709 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:48.331669 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Apr 17 14:26:48.335709 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.331674 2573 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Apr 17 14:26:48.335709 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.332413 2573 server.go:962] "Client rotation is on, will bootstrap in background" Apr 17 14:26:48.335709 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.335257 2573 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Apr 17 14:26:48.336307 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.336293 2573 server.go:1019] "Starting client certificate rotation" Apr 17 14:26:48.336421 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.336405 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Apr 17 14:26:48.336459 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.336451 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Apr 17 14:26:48.367145 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.367123 2573 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Apr 17 14:26:48.374738 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.374711 2573 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Apr 17 14:26:48.390376 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.390359 2573 log.go:25] "Validated CRI v1 runtime API" Apr 17 14:26:48.394484 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.394466 2573 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Apr 17 14:26:48.396132 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.396119 2573 log.go:25] "Validated CRI v1 image API" Apr 17 14:26:48.397334 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.397315 2573 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Apr 17 14:26:48.404741 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.404713 2573 fs.go:135] Filesystem UUIDs: map[028a7d3d-41db-4034-a0b9-622e7586a7a8:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 a3d21a03-250d-400f-9dd4-55ee7950440d:/dev/nvme0n1p3] Apr 17 14:26:48.404741 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.404733 2573 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Apr 17 14:26:48.411253 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.411142 2573 manager.go:217] Machine: {Timestamp:2026-04-17 14:26:48.409051933 +0000 UTC m=+0.453480731 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3109164 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2064127937a2e8c0a8b733f8d7e715 SystemUUID:ec206412-7937-a2e8-c0a8-b733f8d7e715 BootID:7d5f7e69-e09b-4684-8139-333a107177e6 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:68:4f:0c:95:97 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:68:4f:0c:95:97 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a2:2a:6b:91:58:c4 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Apr 17 14:26:48.411253 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.411248 2573 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Apr 17 14:26:48.411358 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.411327 2573 manager.go:233] Version: {KernelVersion:5.14.0-570.107.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260414-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Apr 17 14:26:48.412422 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.412403 2573 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Apr 17 14:26:48.412559 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.412425 2573 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-47.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Apr 17 14:26:48.412606 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.412570 2573 topology_manager.go:138] "Creating topology manager with none policy" Apr 17 14:26:48.412606 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.412579 2573 container_manager_linux.go:306] "Creating device plugin manager" Apr 17 14:26:48.412606 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.412592 2573 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Apr 17 14:26:48.413483 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.413470 2573 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Apr 17 14:26:48.414911 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.414901 2573 state_mem.go:36] "Initialized new in-memory state store" Apr 17 14:26:48.415223 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.415213 2573 server.go:1267] "Using root directory" path="/var/lib/kubelet" Apr 17 14:26:48.416838 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.416823 2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tf288" Apr 17 14:26:48.418357 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.418347 2573 kubelet.go:491] "Attempting to sync node with API server" Apr 17 14:26:48.418389 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.418361 2573 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Apr 17 14:26:48.418389 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.418374 2573 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Apr 17 14:26:48.418389 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.418383 2573 kubelet.go:397] "Adding apiserver pod source" Apr 17 14:26:48.418472 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.418391 2573 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Apr 17 14:26:48.419541 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.419530 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Apr 17 14:26:48.419589 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.419547 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Apr 17 14:26:48.422823 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.422807 2573 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.10-2.rhaos4.20.gita4d0894.el9" apiVersion="v1" Apr 17 14:26:48.424467 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.424454 2573 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Apr 17 14:26:48.425046 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.425033 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tf288" Apr 17 14:26:48.426239 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.426224 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Apr 17 14:26:48.426319 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.426265 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Apr 17 14:26:48.426319 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.426276 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Apr 17 14:26:48.426319 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.426284 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Apr 17 14:26:48.426319 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.426291 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Apr 17 14:26:48.426319 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.426297 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Apr 17 14:26:48.426319 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.426302 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Apr 17 14:26:48.426319 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.426308 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Apr 17 14:26:48.426319 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.426315 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Apr 17 14:26:48.426319 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.426321 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Apr 17 14:26:48.426547 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.426337 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Apr 17 14:26:48.426547 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.426346 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Apr 17 14:26:48.427263 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.427249 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Apr 17 14:26:48.427302 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.427267 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Apr 17 14:26:48.431240 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.431226 2573 watchdog_linux.go:99] "Systemd watchdog is not enabled" Apr 17 14:26:48.431327 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.431271 2573 server.go:1295] "Started kubelet" Apr 17 14:26:48.431385 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.431357 2573 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Apr 17 14:26:48.431443 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.431379 2573 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Apr 17 14:26:48.431485 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.431470 2573 server_v1.go:47] "podresources" method="list" useActivePods=true Apr 17 14:26:48.432085 ip-10-0-131-47 systemd[1]: Started Kubernetes Kubelet. Apr 17 14:26:48.433189 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.433166 2573 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Apr 17 14:26:48.436955 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.436903 2573 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Apr 17 14:26:48.439023 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.439003 2573 server.go:317] "Adding debug handlers to kubelet server" Apr 17 14:26:48.439193 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.439176 2573 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-131-47.ec2.internal" not found Apr 17 14:26:48.439290 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.439275 2573 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Apr 17 14:26:48.440894 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.440876 2573 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Apr 17 14:26:48.440894 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.440888 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Apr 17 14:26:48.441679 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.441661 2573 factory.go:55] Registering systemd factory Apr 17 14:26:48.441770 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.441692 2573 factory.go:223] Registration of the systemd container factory successfully Apr 17 14:26:48.441845 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.441828 2573 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Apr 17 14:26:48.441845 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.441840 2573 volume_manager.go:295] "The desired_state_of_world populator starts" Apr 17 14:26:48.441933 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.441868 2573 volume_manager.go:297] "Starting Kubelet Volume Manager" Apr 17 14:26:48.441933 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.441916 2573 factory.go:153] Registering CRI-O factory Apr 17 14:26:48.441933 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:26:48.441921 2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-47.ec2.internal\" not found" Apr 17 14:26:48.442087 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.441928 2573 factory.go:223] Registration of the crio container factory successfully Apr 17 14:26:48.442087 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.442008 2573 reconstruct.go:97] "Volume reconstruction finished" Apr 17 14:26:48.442087 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.442017 2573 reconciler.go:26] "Reconciler: start to sync state" Apr 17 14:26:48.442087 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.442022 2573 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Apr 17 14:26:48.442087 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.442046 2573 factory.go:103] Registering Raw factory Apr 17 14:26:48.442087 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.442058 2573 manager.go:1196] Started watching for new ooms in manager Apr 17 14:26:48.442358 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.442346 2573 manager.go:319] Starting recovery of all containers Apr 17 14:26:48.443034 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.443016 2573 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Apr 17 14:26:48.443199 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:26:48.443166 2573 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Apr 17 14:26:48.447290 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:26:48.447269 2573 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-131-47.ec2.internal\" not found" node="ip-10-0-131-47.ec2.internal" Apr 17 14:26:48.449265 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.449133 2573 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Apr 17 14:26:48.452444 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.452425 2573 manager.go:324] Recovery completed Apr 17 14:26:48.454445 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.454431 2573 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-131-47.ec2.internal" not found Apr 17 14:26:48.456429 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.456418 2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Apr 17 14:26:48.458592 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.458575 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-47.ec2.internal" event="NodeHasSufficientMemory" Apr 17 14:26:48.458673 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.458603 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-47.ec2.internal" event="NodeHasNoDiskPressure" Apr 17 14:26:48.458673 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.458614 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-47.ec2.internal" event="NodeHasSufficientPID" Apr 17 14:26:48.459526 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.459502 2573 cpu_manager.go:222] "Starting CPU manager" policy="none" Apr 17 14:26:48.459526 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.459525 2573 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Apr 17 14:26:48.459622 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.459553 2573 state_mem.go:36] "Initialized new in-memory state store" Apr 17 14:26:48.461956 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.461937 2573 policy_none.go:49] "None policy: Start" Apr 17 14:26:48.462044 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.461969 2573 memory_manager.go:186] "Starting memorymanager" policy="None" Apr 17 14:26:48.462044 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.461999 2573 state_mem.go:35] "Initializing new in-memory state store" Apr 17 14:26:48.494633 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.494613 2573 manager.go:341] "Starting Device Plugin manager" Apr 17 14:26:48.494708 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:26:48.494646 2573 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Apr 17 14:26:48.494708 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.494657 2573 server.go:85] "Starting device plugin registration server" Apr 17 14:26:48.494914 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.494902 2573 eviction_manager.go:189] "Eviction manager: starting control loop" Apr 17 14:26:48.494950 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.494915 2573 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Apr 17 14:26:48.495131 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.495025 2573 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Apr 17 14:26:48.495131 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.495107 2573 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Apr 17 14:26:48.495131 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.495116 2573 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Apr 17 14:26:48.495637 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:26:48.495622 2573 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Apr 17 14:26:48.495707 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:26:48.495658 2573 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-47.ec2.internal\" not found" Apr 17 14:26:48.511120 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.511100 2573 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-131-47.ec2.internal" not found Apr 17 14:26:48.595589 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.595528 2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Apr 17 14:26:48.596327 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.596311 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-47.ec2.internal" event="NodeHasSufficientMemory" Apr 17 14:26:48.596432 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.596339 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-47.ec2.internal" event="NodeHasNoDiskPressure" Apr 17 14:26:48.596432 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.596350 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-47.ec2.internal" event="NodeHasSufficientPID" Apr 17 14:26:48.596432 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.596373 2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-47.ec2.internal" Apr 17 14:26:48.605075 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.605061 2573 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-47.ec2.internal" Apr 17 14:26:48.605123 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:26:48.605085 2573 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-47.ec2.internal\": node \"ip-10-0-131-47.ec2.internal\" not found" Apr 17 14:26:48.619634 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.619614 2573 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Apr 17 14:26:48.619717 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.619640 2573 status_manager.go:230] "Starting to sync pod status with apiserver" Apr 17 14:26:48.619717 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.619657 2573 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Apr 17 14:26:48.619717 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.619666 2573 kubelet.go:2451] "Starting kubelet main sync loop" Apr 17 14:26:48.619717 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:26:48.619700 2573 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Apr 17 14:26:48.622499 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.622479 2573 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Apr 17 14:26:48.719931 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.719887 2573 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-47.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-47.ec2.internal"] Apr 17 14:26:48.722126 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.722111 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-47.ec2.internal" Apr 17 14:26:48.722126 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.722120 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-47.ec2.internal" Apr 17 14:26:48.744071 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.744054 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/438108d93a37ab59c6a0c9e57eee327c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-47.ec2.internal\" (UID: \"438108d93a37ab59c6a0c9e57eee327c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-47.ec2.internal" Apr 17 14:26:48.744147 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.744079 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/438108d93a37ab59c6a0c9e57eee327c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-47.ec2.internal\" (UID: \"438108d93a37ab59c6a0c9e57eee327c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-47.ec2.internal" Apr 17 14:26:48.744147 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.744096 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8b712f12e316b1a6ded9d349ca82d37a-config\") pod \"kube-apiserver-proxy-ip-10-0-131-47.ec2.internal\" (UID: \"8b712f12e316b1a6ded9d349ca82d37a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-47.ec2.internal" Apr 17 14:26:48.752451 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.752438 2573 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-47.ec2.internal" Apr 17 14:26:48.756592 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.756580 2573 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-47.ec2.internal" Apr 17 14:26:48.814057 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.814041 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Apr 17 14:26:48.817004 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.816989 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Apr 17 14:26:48.845020 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.844999 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8b712f12e316b1a6ded9d349ca82d37a-config\") pod \"kube-apiserver-proxy-ip-10-0-131-47.ec2.internal\" (UID: \"8b712f12e316b1a6ded9d349ca82d37a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-47.ec2.internal" Apr 17 14:26:48.845102 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.845025 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/438108d93a37ab59c6a0c9e57eee327c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-47.ec2.internal\" (UID: \"438108d93a37ab59c6a0c9e57eee327c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-47.ec2.internal" Apr 17 14:26:48.845102 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.845041 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/438108d93a37ab59c6a0c9e57eee327c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-47.ec2.internal\" (UID: \"438108d93a37ab59c6a0c9e57eee327c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-47.ec2.internal" Apr 17 14:26:48.845102 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.845083 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/438108d93a37ab59c6a0c9e57eee327c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-47.ec2.internal\" (UID: \"438108d93a37ab59c6a0c9e57eee327c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-47.ec2.internal" Apr 17 14:26:48.845226 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.845109 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/438108d93a37ab59c6a0c9e57eee327c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-47.ec2.internal\" (UID: \"438108d93a37ab59c6a0c9e57eee327c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-47.ec2.internal" Apr 17 14:26:48.845226 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:48.845114 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8b712f12e316b1a6ded9d349ca82d37a-config\") pod \"kube-apiserver-proxy-ip-10-0-131-47.ec2.internal\" (UID: \"8b712f12e316b1a6ded9d349ca82d37a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-47.ec2.internal" Apr 17 14:26:49.116676 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.116651 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-47.ec2.internal" Apr 17 14:26:49.120070 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.120054 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-47.ec2.internal" Apr 17 14:26:49.335986 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.335951 2573 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Apr 17 14:26:49.336693 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.336080 2573 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Apr 17 14:26:49.336693 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.336136 2573 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Apr 17 14:26:49.336693 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.336134 2573 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Apr 17 14:26:49.419309 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.419239 2573 apiserver.go:52] "Watching apiserver" Apr 17 14:26:49.426434 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.426406 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-04-16 14:21:48 +0000 UTC" deadline="2027-11-22 22:08:11.862041435 +0000 UTC" Apr 17 14:26:49.426434 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.426431 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14023h41m22.435613091s" Apr 17 14:26:49.427433 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.427415 2573 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Apr 17 14:26:49.428310 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.428284 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-47.ec2.internal","openshift-multus/multus-j95gf","openshift-multus/network-metrics-daemon-khctm","openshift-cluster-node-tuning-operator/tuned-sj9xp","openshift-multus/multus-additional-cni-plugins-dh4qj","openshift-network-diagnostics/network-check-target-n9zdz","openshift-network-operator/iptables-alerter-2jvxm","openshift-ovn-kubernetes/ovnkube-node-t4wf8","kube-system/konnectivity-agent-xjs2v","kube-system/kube-apiserver-proxy-ip-10-0-131-47.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss8x7","openshift-dns/node-resolver-pqwhd","openshift-image-registry/node-ca-wfhf5"] Apr 17 14:26:49.430318 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.430293 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-j95gf" Apr 17 14:26:49.432592 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.432574 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Apr 17 14:26:49.432697 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.432679 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Apr 17 14:26:49.432866 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.432846 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khctm" Apr 17 14:26:49.432935 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.432888 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Apr 17 14:26:49.432935 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:26:49.432919 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khctm" podUID="bedbded4-1a39-4b5a-b15a-2f9d05548508" Apr 17 14:26:49.433060 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.432943 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-sfssv\"" Apr 17 14:26:49.433060 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.432932 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sj9xp" Apr 17 14:26:49.433060 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.432957 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Apr 17 14:26:49.434167 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.434145 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dh4qj" Apr 17 14:26:49.435052 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.435034 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9zdz" Apr 17 14:26:49.435154 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.435062 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Apr 17 14:26:49.435154 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:26:49.435093 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9zdz" podUID="928be529-e62e-4b1a-8221-cf0def914796" Apr 17 14:26:49.435154 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.435120 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Apr 17 14:26:49.435289 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.435276 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8qdf9\"" Apr 17 14:26:49.436063 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.436049 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2jvxm" Apr 17 14:26:49.436227 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.436209 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Apr 17 14:26:49.436453 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.436436 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Apr 17 14:26:49.436453 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.436448 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-nzr4f\"" Apr 17 14:26:49.437241 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.437226 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" Apr 17 14:26:49.437869 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.437853 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Apr 17 14:26:49.437996 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.437983 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xfn8s\"" Apr 17 14:26:49.438166 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.438150 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Apr 17 14:26:49.438228 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.438168 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Apr 17 14:26:49.438355 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.438342 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xjs2v" Apr 17 14:26:49.439422 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.439404 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Apr 17 14:26:49.439515 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.439423 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Apr 17 14:26:49.439515 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.439433 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Apr 17 14:26:49.439515 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.439426 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Apr 17 14:26:49.439515 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.439426 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Apr 17 14:26:49.439657 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.439536 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss8x7" Apr 17 14:26:49.440139 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.440118 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-l6hmw\"" Apr 17 14:26:49.440246 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.440230 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Apr 17 14:26:49.440510 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.440496 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Apr 17 14:26:49.440575 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.440550 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Apr 17 14:26:49.440726 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.440711 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pqwhd" Apr 17 14:26:49.440806 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.440791 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-dw7qc\"" Apr 17 14:26:49.440966 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.440947 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Apr 17 14:26:49.441583 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.441564 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Apr 17 14:26:49.441695 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.441651 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-gkxh9\"" Apr 17 14:26:49.441845 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.441813 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Apr 17 14:26:49.442056 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.442036 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wfhf5" Apr 17 14:26:49.442150 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.442058 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Apr 17 14:26:49.443470 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.443446 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Apr 17 14:26:49.443631 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.443614 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Apr 17 14:26:49.443706 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.443640 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-s8hdz\"" Apr 17 14:26:49.444935 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.444915 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Apr 17 14:26:49.445058 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.444938 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-bj4fz\"" Apr 17 14:26:49.445166 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.445106 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Apr 17 14:26:49.445261 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.445224 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Apr 17 14:26:49.447327 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.447293 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1d47c42e-517c-405b-99a5-30609ea3d21d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dh4qj\" (UID: \"1d47c42e-517c-405b-99a5-30609ea3d21d\") " pod="openshift-multus/multus-additional-cni-plugins-dh4qj" Apr 17 14:26:49.447415 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.447337 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52-run-systemd\") pod \"ovnkube-node-t4wf8\" (UID: \"826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" Apr 17 14:26:49.447415 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.447369 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52-ovnkube-config\") pod \"ovnkube-node-t4wf8\" (UID: \"826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" Apr 17 14:26:49.447415 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.447398 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/733d18e1-1920-4e3c-83c4-b476253e1f4d-agent-certs\") pod \"konnectivity-agent-xjs2v\" (UID: \"733d18e1-1920-4e3c-83c4-b476253e1f4d\") " pod="kube-system/konnectivity-agent-xjs2v" Apr 17 14:26:49.447574 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.447421 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/733d18e1-1920-4e3c-83c4-b476253e1f4d-konnectivity-ca\") pod \"konnectivity-agent-xjs2v\" (UID: \"733d18e1-1920-4e3c-83c4-b476253e1f4d\") " pod="kube-system/konnectivity-agent-xjs2v" Apr 17 14:26:49.447574 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.447440 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e3b540b1-5c0c-463a-8b61-9e636cd837c1-socket-dir\") pod \"aws-ebs-csi-driver-node-ss8x7\" (UID: \"e3b540b1-5c0c-463a-8b61-9e636cd837c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss8x7" Apr 17 14:26:49.447574 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.447468 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e3b540b1-5c0c-463a-8b61-9e636cd837c1-sys-fs\") pod \"aws-ebs-csi-driver-node-ss8x7\" (UID: \"e3b540b1-5c0c-463a-8b61-9e636cd837c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss8x7" Apr 17 14:26:49.447574 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.447499 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7c85ebb8-909c-4ad2-affb-b7280f1cce30-lib-modules\") pod \"tuned-sj9xp\" (UID: \"7c85ebb8-909c-4ad2-affb-b7280f1cce30\") " pod="openshift-cluster-node-tuning-operator/tuned-sj9xp" Apr 17 14:26:49.447574 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.447530 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e3b540b1-5c0c-463a-8b61-9e636cd837c1-etc-selinux\") pod \"aws-ebs-csi-driver-node-ss8x7\" (UID: \"e3b540b1-5c0c-463a-8b61-9e636cd837c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss8x7" Apr 17 14:26:49.447574 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.447556 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/01db874f-c326-48bc-8c33-eeab64d1bf17-system-cni-dir\") pod \"multus-j95gf\" (UID: \"01db874f-c326-48bc-8c33-eeab64d1bf17\") " pod="openshift-multus/multus-j95gf" Apr 17 14:26:49.447856 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.447592 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/01db874f-c326-48bc-8c33-eeab64d1bf17-os-release\") pod \"multus-j95gf\" (UID: \"01db874f-c326-48bc-8c33-eeab64d1bf17\") " pod="openshift-multus/multus-j95gf" Apr 17 14:26:49.447856 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.447620 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdl74\" (UniqueName: \"kubernetes.io/projected/bedbded4-1a39-4b5a-b15a-2f9d05548508-kube-api-access-mdl74\") pod \"network-metrics-daemon-khctm\" (UID: \"bedbded4-1a39-4b5a-b15a-2f9d05548508\") " pod="openshift-multus/network-metrics-daemon-khctm" Apr 17 14:26:49.447856 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.447644 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5b7bd\" (UniqueName: \"kubernetes.io/projected/ab4fc13b-36d4-4f8b-9f8a-52c2424a807d-kube-api-access-5b7bd\") pod \"node-resolver-pqwhd\" (UID: \"ab4fc13b-36d4-4f8b-9f8a-52c2424a807d\") " pod="openshift-dns/node-resolver-pqwhd" Apr 17 14:26:49.447856 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.447675 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52-systemd-units\") pod \"ovnkube-node-t4wf8\" (UID: \"826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" Apr 17 14:26:49.447856 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.447700 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52-run-ovn\") pod \"ovnkube-node-t4wf8\" (UID: \"826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" Apr 17 14:26:49.447856 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.447716 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/01db874f-c326-48bc-8c33-eeab64d1bf17-cni-binary-copy\") pod \"multus-j95gf\" (UID: \"01db874f-c326-48bc-8c33-eeab64d1bf17\") " pod="openshift-multus/multus-j95gf" Apr 17 14:26:49.447856 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.447735 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cp8s\" (UniqueName: \"kubernetes.io/projected/01db874f-c326-48bc-8c33-eeab64d1bf17-kube-api-access-7cp8s\") pod \"multus-j95gf\" (UID: \"01db874f-c326-48bc-8c33-eeab64d1bf17\") " pod="openshift-multus/multus-j95gf" Apr 17 14:26:49.447856 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.447760 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7c85ebb8-909c-4ad2-affb-b7280f1cce30-etc-tuned\") pod \"tuned-sj9xp\" (UID: \"7c85ebb8-909c-4ad2-affb-b7280f1cce30\") " pod="openshift-cluster-node-tuning-operator/tuned-sj9xp" Apr 17 14:26:49.447856 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.447779 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/574ada25-3a36-4d49-be15-436687239f1a-host-slash\") pod \"iptables-alerter-2jvxm\" (UID: \"574ada25-3a36-4d49-be15-436687239f1a\") " pod="openshift-network-operator/iptables-alerter-2jvxm" Apr 17 14:26:49.447856 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.447798 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52-host-kubelet\") pod \"ovnkube-node-t4wf8\" (UID: \"826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" Apr 17 14:26:49.447856 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.447849 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52-run-openvswitch\") pod \"ovnkube-node-t4wf8\" (UID: \"826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" Apr 17 14:26:49.448269 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.447879 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52-env-overrides\") pod \"ovnkube-node-t4wf8\" (UID: \"826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" Apr 17 14:26:49.448269 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.447898 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj2jz\" (UniqueName: \"kubernetes.io/projected/826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52-kube-api-access-gj2jz\") pod \"ovnkube-node-t4wf8\" (UID: \"826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" Apr 17 14:26:49.448269 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.447922 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7c85ebb8-909c-4ad2-affb-b7280f1cce30-host\") pod \"tuned-sj9xp\" (UID: \"7c85ebb8-909c-4ad2-affb-b7280f1cce30\") " pod="openshift-cluster-node-tuning-operator/tuned-sj9xp" Apr 17 14:26:49.448269 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.447955 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ab4fc13b-36d4-4f8b-9f8a-52c2424a807d-hosts-file\") pod \"node-resolver-pqwhd\" (UID: \"ab4fc13b-36d4-4f8b-9f8a-52c2424a807d\") " pod="openshift-dns/node-resolver-pqwhd" Apr 17 14:26:49.448269 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.448003 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1d47c42e-517c-405b-99a5-30609ea3d21d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dh4qj\" (UID: \"1d47c42e-517c-405b-99a5-30609ea3d21d\") " pod="openshift-multus/multus-additional-cni-plugins-dh4qj" Apr 17 14:26:49.448269 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.448079 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52-host-cni-bin\") pod \"ovnkube-node-t4wf8\" (UID: \"826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" Apr 17 14:26:49.448269 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.448119 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52-ovn-node-metrics-cert\") pod \"ovnkube-node-t4wf8\" (UID: \"826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" Apr 17 14:26:49.448269 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.448167 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/01db874f-c326-48bc-8c33-eeab64d1bf17-multus-cni-dir\") pod \"multus-j95gf\" (UID: \"01db874f-c326-48bc-8c33-eeab64d1bf17\") " pod="openshift-multus/multus-j95gf" Apr 17 14:26:49.448269 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.448215 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/01db874f-c326-48bc-8c33-eeab64d1bf17-host-var-lib-kubelet\") pod \"multus-j95gf\" (UID: \"01db874f-c326-48bc-8c33-eeab64d1bf17\") " pod="openshift-multus/multus-j95gf" Apr 17 14:26:49.448269 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.448236 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7c85ebb8-909c-4ad2-affb-b7280f1cce30-etc-sysctl-conf\") pod \"tuned-sj9xp\" (UID: \"7c85ebb8-909c-4ad2-affb-b7280f1cce30\") " pod="openshift-cluster-node-tuning-operator/tuned-sj9xp" Apr 17 14:26:49.448269 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.448256 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6h55\" (UniqueName: \"kubernetes.io/projected/7c85ebb8-909c-4ad2-affb-b7280f1cce30-kube-api-access-z6h55\") pod \"tuned-sj9xp\" (UID: \"7c85ebb8-909c-4ad2-affb-b7280f1cce30\") " pod="openshift-cluster-node-tuning-operator/tuned-sj9xp" Apr 17 14:26:49.448729 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.448324 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52-log-socket\") pod \"ovnkube-node-t4wf8\" (UID: \"826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" Apr 17 14:26:49.448729 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.448360 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01db874f-c326-48bc-8c33-eeab64d1bf17-etc-kubernetes\") pod \"multus-j95gf\" (UID: \"01db874f-c326-48bc-8c33-eeab64d1bf17\") " pod="openshift-multus/multus-j95gf" Apr 17 14:26:49.448844 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.448463 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1d47c42e-517c-405b-99a5-30609ea3d21d-system-cni-dir\") pod \"multus-additional-cni-plugins-dh4qj\" (UID: \"1d47c42e-517c-405b-99a5-30609ea3d21d\") " pod="openshift-multus/multus-additional-cni-plugins-dh4qj" Apr 17 14:26:49.448892 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.448845 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/01db874f-c326-48bc-8c33-eeab64d1bf17-multus-conf-dir\") pod \"multus-j95gf\" (UID: \"01db874f-c326-48bc-8c33-eeab64d1bf17\") " pod="openshift-multus/multus-j95gf" Apr 17 14:26:49.448892 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.448865 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7c85ebb8-909c-4ad2-affb-b7280f1cce30-etc-systemd\") pod \"tuned-sj9xp\" (UID: \"7c85ebb8-909c-4ad2-affb-b7280f1cce30\") " pod="openshift-cluster-node-tuning-operator/tuned-sj9xp" Apr 17 14:26:49.448892 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.448881 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1d47c42e-517c-405b-99a5-30609ea3d21d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dh4qj\" (UID: \"1d47c42e-517c-405b-99a5-30609ea3d21d\") " pod="openshift-multus/multus-additional-cni-plugins-dh4qj" Apr 17 14:26:49.449047 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.448902 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52-ovnkube-script-lib\") pod \"ovnkube-node-t4wf8\" (UID: \"826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" Apr 17 14:26:49.449047 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.448926 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhvrv\" (UniqueName: \"kubernetes.io/projected/574ada25-3a36-4d49-be15-436687239f1a-kube-api-access-jhvrv\") pod \"iptables-alerter-2jvxm\" (UID: \"574ada25-3a36-4d49-be15-436687239f1a\") " pod="openshift-network-operator/iptables-alerter-2jvxm" Apr 17 14:26:49.449047 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.448945 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jd6sw\" (UniqueName: \"kubernetes.io/projected/1d47c42e-517c-405b-99a5-30609ea3d21d-kube-api-access-jd6sw\") pod \"multus-additional-cni-plugins-dh4qj\" (UID: \"1d47c42e-517c-405b-99a5-30609ea3d21d\") " pod="openshift-multus/multus-additional-cni-plugins-dh4qj" Apr 17 14:26:49.449047 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.449001 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76h8j\" (UniqueName: \"kubernetes.io/projected/928be529-e62e-4b1a-8221-cf0def914796-kube-api-access-76h8j\") pod \"network-check-target-n9zdz\" (UID: \"928be529-e62e-4b1a-8221-cf0def914796\") " pod="openshift-network-diagnostics/network-check-target-n9zdz" Apr 17 14:26:49.449047 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.449023 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52-var-lib-openvswitch\") pod \"ovnkube-node-t4wf8\" (UID: \"826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" Apr 17 14:26:49.449047 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.449037 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e3b540b1-5c0c-463a-8b61-9e636cd837c1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ss8x7\" (UID: \"e3b540b1-5c0c-463a-8b61-9e636cd837c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss8x7" Apr 17 14:26:49.449312 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.449055 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a44848f6-e8dc-4204-9db4-a4c4ca9cffdd-serviceca\") pod \"node-ca-wfhf5\" (UID: \"a44848f6-e8dc-4204-9db4-a4c4ca9cffdd\") " pod="openshift-image-registry/node-ca-wfhf5" Apr 17 14:26:49.449312 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.449077 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7c85ebb8-909c-4ad2-affb-b7280f1cce30-run\") pod \"tuned-sj9xp\" (UID: \"7c85ebb8-909c-4ad2-affb-b7280f1cce30\") " pod="openshift-cluster-node-tuning-operator/tuned-sj9xp" Apr 17 14:26:49.449312 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.449094 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab4fc13b-36d4-4f8b-9f8a-52c2424a807d-tmp-dir\") pod \"node-resolver-pqwhd\" (UID: \"ab4fc13b-36d4-4f8b-9f8a-52c2424a807d\") " pod="openshift-dns/node-resolver-pqwhd" Apr 17 14:26:49.449312 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.449115 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/01db874f-c326-48bc-8c33-eeab64d1bf17-host-run-netns\") pod \"multus-j95gf\" (UID: \"01db874f-c326-48bc-8c33-eeab64d1bf17\") " pod="openshift-multus/multus-j95gf" Apr 17 14:26:49.449312 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.449139 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/01db874f-c326-48bc-8c33-eeab64d1bf17-host-var-lib-cni-multus\") pod \"multus-j95gf\" (UID: \"01db874f-c326-48bc-8c33-eeab64d1bf17\") " pod="openshift-multus/multus-j95gf" Apr 17 14:26:49.449312 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.449165 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t4wf8\" (UID: \"826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" Apr 17 14:26:49.449312 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.449187 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e3b540b1-5c0c-463a-8b61-9e636cd837c1-registration-dir\") pod \"aws-ebs-csi-driver-node-ss8x7\" (UID: \"e3b540b1-5c0c-463a-8b61-9e636cd837c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss8x7" Apr 17 14:26:49.449312 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.449201 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/01db874f-c326-48bc-8c33-eeab64d1bf17-host-run-multus-certs\") pod \"multus-j95gf\" (UID: \"01db874f-c326-48bc-8c33-eeab64d1bf17\") " pod="openshift-multus/multus-j95gf" Apr 17 14:26:49.449312 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.449223 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7c85ebb8-909c-4ad2-affb-b7280f1cce30-etc-kubernetes\") pod \"tuned-sj9xp\" (UID: \"7c85ebb8-909c-4ad2-affb-b7280f1cce30\") " pod="openshift-cluster-node-tuning-operator/tuned-sj9xp" Apr 17 14:26:49.449312 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.449269 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7c85ebb8-909c-4ad2-affb-b7280f1cce30-sys\") pod \"tuned-sj9xp\" (UID: \"7c85ebb8-909c-4ad2-affb-b7280f1cce30\") " pod="openshift-cluster-node-tuning-operator/tuned-sj9xp" Apr 17 14:26:49.449312 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.449307 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52-host-slash\") pod \"ovnkube-node-t4wf8\" (UID: \"826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" Apr 17 14:26:49.449823 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.449358 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52-host-run-ovn-kubernetes\") pod \"ovnkube-node-t4wf8\" (UID: \"826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" Apr 17 14:26:49.449823 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.449391 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a44848f6-e8dc-4204-9db4-a4c4ca9cffdd-host\") pod \"node-ca-wfhf5\" (UID: \"a44848f6-e8dc-4204-9db4-a4c4ca9cffdd\") " pod="openshift-image-registry/node-ca-wfhf5" Apr 17 14:26:49.449823 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.449416 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/01db874f-c326-48bc-8c33-eeab64d1bf17-multus-socket-dir-parent\") pod \"multus-j95gf\" (UID: \"01db874f-c326-48bc-8c33-eeab64d1bf17\") " pod="openshift-multus/multus-j95gf" Apr 17 14:26:49.449823 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.449440 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1d47c42e-517c-405b-99a5-30609ea3d21d-cnibin\") pod \"multus-additional-cni-plugins-dh4qj\" (UID: \"1d47c42e-517c-405b-99a5-30609ea3d21d\") " pod="openshift-multus/multus-additional-cni-plugins-dh4qj" Apr 17 14:26:49.449823 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.449465 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1d47c42e-517c-405b-99a5-30609ea3d21d-os-release\") pod \"multus-additional-cni-plugins-dh4qj\" (UID: \"1d47c42e-517c-405b-99a5-30609ea3d21d\") " pod="openshift-multus/multus-additional-cni-plugins-dh4qj" Apr 17 14:26:49.449823 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.449488 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1d47c42e-517c-405b-99a5-30609ea3d21d-cni-binary-copy\") pod \"multus-additional-cni-plugins-dh4qj\" (UID: \"1d47c42e-517c-405b-99a5-30609ea3d21d\") " pod="openshift-multus/multus-additional-cni-plugins-dh4qj" Apr 17 14:26:49.449823 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.449513 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52-host-cni-netd\") pod \"ovnkube-node-t4wf8\" (UID: \"826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" Apr 17 14:26:49.449823 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.449551 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e3b540b1-5c0c-463a-8b61-9e636cd837c1-device-dir\") pod \"aws-ebs-csi-driver-node-ss8x7\" (UID: \"e3b540b1-5c0c-463a-8b61-9e636cd837c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss8x7" Apr 17 14:26:49.449823 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.449588 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7c85ebb8-909c-4ad2-affb-b7280f1cce30-etc-sysconfig\") pod \"tuned-sj9xp\" (UID: \"7c85ebb8-909c-4ad2-affb-b7280f1cce30\") " pod="openshift-cluster-node-tuning-operator/tuned-sj9xp" Apr 17 14:26:49.449823 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.449613 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7c85ebb8-909c-4ad2-affb-b7280f1cce30-var-lib-kubelet\") pod \"tuned-sj9xp\" (UID: \"7c85ebb8-909c-4ad2-affb-b7280f1cce30\") " pod="openshift-cluster-node-tuning-operator/tuned-sj9xp" Apr 17 14:26:49.449823 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.449638 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c85ebb8-909c-4ad2-affb-b7280f1cce30-tmp\") pod \"tuned-sj9xp\" (UID: \"7c85ebb8-909c-4ad2-affb-b7280f1cce30\") " pod="openshift-cluster-node-tuning-operator/tuned-sj9xp" Apr 17 14:26:49.449823 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.449668 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8d6qc\" (UniqueName: \"kubernetes.io/projected/a44848f6-e8dc-4204-9db4-a4c4ca9cffdd-kube-api-access-8d6qc\") pod \"node-ca-wfhf5\" (UID: \"a44848f6-e8dc-4204-9db4-a4c4ca9cffdd\") " pod="openshift-image-registry/node-ca-wfhf5" Apr 17 14:26:49.449823 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.449688 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/01db874f-c326-48bc-8c33-eeab64d1bf17-cnibin\") pod \"multus-j95gf\" (UID: \"01db874f-c326-48bc-8c33-eeab64d1bf17\") " pod="openshift-multus/multus-j95gf" Apr 17 14:26:49.449823 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.449703 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/01db874f-c326-48bc-8c33-eeab64d1bf17-host-run-k8s-cni-cncf-io\") pod \"multus-j95gf\" (UID: \"01db874f-c326-48bc-8c33-eeab64d1bf17\") " pod="openshift-multus/multus-j95gf" Apr 17 14:26:49.449823 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.449725 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/01db874f-c326-48bc-8c33-eeab64d1bf17-host-var-lib-cni-bin\") pod \"multus-j95gf\" (UID: \"01db874f-c326-48bc-8c33-eeab64d1bf17\") " pod="openshift-multus/multus-j95gf" Apr 17 14:26:49.449823 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.449739 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bedbded4-1a39-4b5a-b15a-2f9d05548508-metrics-certs\") pod \"network-metrics-daemon-khctm\" (UID: \"bedbded4-1a39-4b5a-b15a-2f9d05548508\") " pod="openshift-multus/network-metrics-daemon-khctm" Apr 17 14:26:49.450478 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.449752 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7c85ebb8-909c-4ad2-affb-b7280f1cce30-etc-modprobe-d\") pod \"tuned-sj9xp\" (UID: \"7c85ebb8-909c-4ad2-affb-b7280f1cce30\") " pod="openshift-cluster-node-tuning-operator/tuned-sj9xp" Apr 17 14:26:49.450478 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.449765 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52-node-log\") pod \"ovnkube-node-t4wf8\" (UID: \"826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" Apr 17 14:26:49.450478 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.449778 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7c85ebb8-909c-4ad2-affb-b7280f1cce30-etc-sysctl-d\") pod \"tuned-sj9xp\" (UID: \"7c85ebb8-909c-4ad2-affb-b7280f1cce30\") " pod="openshift-cluster-node-tuning-operator/tuned-sj9xp" Apr 17 14:26:49.450478 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.449792 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52-etc-openvswitch\") pod \"ovnkube-node-t4wf8\" (UID: \"826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" Apr 17 14:26:49.450478 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.449812 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/01db874f-c326-48bc-8c33-eeab64d1bf17-hostroot\") pod \"multus-j95gf\" (UID: \"01db874f-c326-48bc-8c33-eeab64d1bf17\") " pod="openshift-multus/multus-j95gf" Apr 17 14:26:49.450478 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.449838 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/574ada25-3a36-4d49-be15-436687239f1a-iptables-alerter-script\") pod \"iptables-alerter-2jvxm\" (UID: \"574ada25-3a36-4d49-be15-436687239f1a\") " pod="openshift-network-operator/iptables-alerter-2jvxm" Apr 17 14:26:49.450478 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.449861 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52-host-run-netns\") pod \"ovnkube-node-t4wf8\" (UID: \"826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" Apr 17 14:26:49.450478 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.449884 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8mp2\" (UniqueName: \"kubernetes.io/projected/e3b540b1-5c0c-463a-8b61-9e636cd837c1-kube-api-access-k8mp2\") pod \"aws-ebs-csi-driver-node-ss8x7\" (UID: \"e3b540b1-5c0c-463a-8b61-9e636cd837c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss8x7" Apr 17 14:26:49.450478 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.449905 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/01db874f-c326-48bc-8c33-eeab64d1bf17-multus-daemon-config\") pod \"multus-j95gf\" (UID: \"01db874f-c326-48bc-8c33-eeab64d1bf17\") " pod="openshift-multus/multus-j95gf" Apr 17 14:26:49.456201 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.456185 2573 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Apr 17 14:26:49.479710 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.479684 2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-b6wx7" Apr 17 14:26:49.490020 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.489999 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-b6wx7" Apr 17 14:26:49.542888 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.542871 2573 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Apr 17 14:26:49.548046 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:49.547999 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod438108d93a37ab59c6a0c9e57eee327c.slice/crio-d8ae82bf7aa5ed652cbc18a6f67d0b84583ff0fa5fdefd534c03ecd5ac058bb3 WatchSource:0}: Error finding container d8ae82bf7aa5ed652cbc18a6f67d0b84583ff0fa5fdefd534c03ecd5ac058bb3: Status 404 returned error can't find the container with id d8ae82bf7aa5ed652cbc18a6f67d0b84583ff0fa5fdefd534c03ecd5ac058bb3 Apr 17 14:26:49.550092 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.550075 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/01db874f-c326-48bc-8c33-eeab64d1bf17-host-var-lib-kubelet\") pod \"multus-j95gf\" (UID: \"01db874f-c326-48bc-8c33-eeab64d1bf17\") " pod="openshift-multus/multus-j95gf" Apr 17 14:26:49.550179 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.550106 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7c85ebb8-909c-4ad2-affb-b7280f1cce30-etc-sysctl-conf\") pod \"tuned-sj9xp\" (UID: \"7c85ebb8-909c-4ad2-affb-b7280f1cce30\") " pod="openshift-cluster-node-tuning-operator/tuned-sj9xp" Apr 17 14:26:49.550179 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.550129 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z6h55\" (UniqueName: \"kubernetes.io/projected/7c85ebb8-909c-4ad2-affb-b7280f1cce30-kube-api-access-z6h55\") pod \"tuned-sj9xp\" (UID: \"7c85ebb8-909c-4ad2-affb-b7280f1cce30\") " pod="openshift-cluster-node-tuning-operator/tuned-sj9xp" Apr 17 14:26:49.550275 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.550182 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/01db874f-c326-48bc-8c33-eeab64d1bf17-host-var-lib-kubelet\") pod \"multus-j95gf\" (UID: \"01db874f-c326-48bc-8c33-eeab64d1bf17\") " pod="openshift-multus/multus-j95gf" Apr 17 14:26:49.550275 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.550218 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52-log-socket\") pod \"ovnkube-node-t4wf8\" (UID: \"826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" Apr 17 14:26:49.550275 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.550250 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01db874f-c326-48bc-8c33-eeab64d1bf17-etc-kubernetes\") pod \"multus-j95gf\" (UID: \"01db874f-c326-48bc-8c33-eeab64d1bf17\") " pod="openshift-multus/multus-j95gf" Apr 17 14:26:49.550275 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.550265 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1d47c42e-517c-405b-99a5-30609ea3d21d-system-cni-dir\") pod \"multus-additional-cni-plugins-dh4qj\" (UID: \"1d47c42e-517c-405b-99a5-30609ea3d21d\") " pod="openshift-multus/multus-additional-cni-plugins-dh4qj" Apr 17 14:26:49.550459 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.550287 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/01db874f-c326-48bc-8c33-eeab64d1bf17-multus-conf-dir\") pod \"multus-j95gf\" (UID: \"01db874f-c326-48bc-8c33-eeab64d1bf17\") " pod="openshift-multus/multus-j95gf" Apr 17 14:26:49.550459 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.550314 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7c85ebb8-909c-4ad2-affb-b7280f1cce30-etc-sysctl-conf\") pod \"tuned-sj9xp\" (UID: \"7c85ebb8-909c-4ad2-affb-b7280f1cce30\") " pod="openshift-cluster-node-tuning-operator/tuned-sj9xp" Apr 17 14:26:49.550459 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.550327 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7c85ebb8-909c-4ad2-affb-b7280f1cce30-etc-systemd\") pod \"tuned-sj9xp\" (UID: \"7c85ebb8-909c-4ad2-affb-b7280f1cce30\") " pod="openshift-cluster-node-tuning-operator/tuned-sj9xp" Apr 17 14:26:49.550459 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.550318 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52-log-socket\") pod \"ovnkube-node-t4wf8\" (UID: \"826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" Apr 17 14:26:49.550459 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.550338 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1d47c42e-517c-405b-99a5-30609ea3d21d-system-cni-dir\") pod \"multus-additional-cni-plugins-dh4qj\" (UID: \"1d47c42e-517c-405b-99a5-30609ea3d21d\") " pod="openshift-multus/multus-additional-cni-plugins-dh4qj" Apr 17 14:26:49.550459 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.550352 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1d47c42e-517c-405b-99a5-30609ea3d21d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dh4qj\" (UID: \"1d47c42e-517c-405b-99a5-30609ea3d21d\") " pod="openshift-multus/multus-additional-cni-plugins-dh4qj" Apr 17 14:26:49.550459 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.550327 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01db874f-c326-48bc-8c33-eeab64d1bf17-etc-kubernetes\") pod \"multus-j95gf\" (UID: \"01db874f-c326-48bc-8c33-eeab64d1bf17\") " pod="openshift-multus/multus-j95gf" Apr 17 14:26:49.550459 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.550364 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/01db874f-c326-48bc-8c33-eeab64d1bf17-multus-conf-dir\") pod \"multus-j95gf\" (UID: \"01db874f-c326-48bc-8c33-eeab64d1bf17\") " pod="openshift-multus/multus-j95gf" Apr 17 14:26:49.550459 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.550379 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52-ovnkube-script-lib\") pod \"ovnkube-node-t4wf8\" (UID: \"826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" Apr 17 14:26:49.550459 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.550390 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7c85ebb8-909c-4ad2-affb-b7280f1cce30-etc-systemd\") pod \"tuned-sj9xp\" (UID: \"7c85ebb8-909c-4ad2-affb-b7280f1cce30\") " pod="openshift-cluster-node-tuning-operator/tuned-sj9xp" Apr 17 14:26:49.550459 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.550403 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jhvrv\" (UniqueName: \"kubernetes.io/projected/574ada25-3a36-4d49-be15-436687239f1a-kube-api-access-jhvrv\") pod \"iptables-alerter-2jvxm\" (UID: \"574ada25-3a36-4d49-be15-436687239f1a\") " pod="openshift-network-operator/iptables-alerter-2jvxm" Apr 17 14:26:49.550459 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.550427 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jd6sw\" (UniqueName: \"kubernetes.io/projected/1d47c42e-517c-405b-99a5-30609ea3d21d-kube-api-access-jd6sw\") pod \"multus-additional-cni-plugins-dh4qj\" (UID: \"1d47c42e-517c-405b-99a5-30609ea3d21d\") " pod="openshift-multus/multus-additional-cni-plugins-dh4qj" Apr 17 14:26:49.550459 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.550452 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-76h8j\" (UniqueName: \"kubernetes.io/projected/928be529-e62e-4b1a-8221-cf0def914796-kube-api-access-76h8j\") pod \"network-check-target-n9zdz\" (UID: \"928be529-e62e-4b1a-8221-cf0def914796\") " pod="openshift-network-diagnostics/network-check-target-n9zdz" Apr 17 14:26:49.551169 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.550476 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52-var-lib-openvswitch\") pod \"ovnkube-node-t4wf8\" (UID: \"826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" Apr 17 14:26:49.551169 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.550502 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e3b540b1-5c0c-463a-8b61-9e636cd837c1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ss8x7\" (UID: \"e3b540b1-5c0c-463a-8b61-9e636cd837c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss8x7" Apr 17 14:26:49.551169 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.550532 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a44848f6-e8dc-4204-9db4-a4c4ca9cffdd-serviceca\") pod \"node-ca-wfhf5\" (UID: \"a44848f6-e8dc-4204-9db4-a4c4ca9cffdd\") " pod="openshift-image-registry/node-ca-wfhf5" Apr 17 14:26:49.551169 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.550555 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7c85ebb8-909c-4ad2-affb-b7280f1cce30-run\") pod \"tuned-sj9xp\" (UID: \"7c85ebb8-909c-4ad2-affb-b7280f1cce30\") " pod="openshift-cluster-node-tuning-operator/tuned-sj9xp" Apr 17 14:26:49.551169 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.550579 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab4fc13b-36d4-4f8b-9f8a-52c2424a807d-tmp-dir\") pod \"node-resolver-pqwhd\" (UID: \"ab4fc13b-36d4-4f8b-9f8a-52c2424a807d\") " pod="openshift-dns/node-resolver-pqwhd" Apr 17 14:26:49.551169 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.550604 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/01db874f-c326-48bc-8c33-eeab64d1bf17-host-run-netns\") pod \"multus-j95gf\" (UID: \"01db874f-c326-48bc-8c33-eeab64d1bf17\") " pod="openshift-multus/multus-j95gf" Apr 17 14:26:49.551169 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.550628 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/01db874f-c326-48bc-8c33-eeab64d1bf17-host-var-lib-cni-multus\") pod \"multus-j95gf\" (UID: \"01db874f-c326-48bc-8c33-eeab64d1bf17\") " pod="openshift-multus/multus-j95gf" Apr 17 14:26:49.551169 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.550656 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t4wf8\" (UID: \"826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" Apr 17 14:26:49.551169 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.550681 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e3b540b1-5c0c-463a-8b61-9e636cd837c1-registration-dir\") pod \"aws-ebs-csi-driver-node-ss8x7\" (UID: \"e3b540b1-5c0c-463a-8b61-9e636cd837c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss8x7" Apr 17 14:26:49.551169 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.550688 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52-var-lib-openvswitch\") pod \"ovnkube-node-t4wf8\" (UID: \"826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" Apr 17 14:26:49.551169 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.550706 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/01db874f-c326-48bc-8c33-eeab64d1bf17-host-run-multus-certs\") pod \"multus-j95gf\" (UID: \"01db874f-c326-48bc-8c33-eeab64d1bf17\") " pod="openshift-multus/multus-j95gf" Apr 17 14:26:49.551169 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.550738 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/01db874f-c326-48bc-8c33-eeab64d1bf17-host-run-netns\") pod \"multus-j95gf\" (UID: \"01db874f-c326-48bc-8c33-eeab64d1bf17\") " pod="openshift-multus/multus-j95gf" Apr 17 14:26:49.551169 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.550757 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7c85ebb8-909c-4ad2-affb-b7280f1cce30-etc-kubernetes\") pod \"tuned-sj9xp\" (UID: \"7c85ebb8-909c-4ad2-affb-b7280f1cce30\") " pod="openshift-cluster-node-tuning-operator/tuned-sj9xp" Apr 17 14:26:49.551169 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.550780 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7c85ebb8-909c-4ad2-affb-b7280f1cce30-sys\") pod \"tuned-sj9xp\" (UID: \"7c85ebb8-909c-4ad2-affb-b7280f1cce30\") " pod="openshift-cluster-node-tuning-operator/tuned-sj9xp" Apr 17 14:26:49.551169 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.550806 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52-host-slash\") pod \"ovnkube-node-t4wf8\" (UID: \"826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" Apr 17 14:26:49.551169 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.550822 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7c85ebb8-909c-4ad2-affb-b7280f1cce30-run\") pod \"tuned-sj9xp\" (UID: \"7c85ebb8-909c-4ad2-affb-b7280f1cce30\") " pod="openshift-cluster-node-tuning-operator/tuned-sj9xp" Apr 17 14:26:49.551169 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.550834 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52-host-run-ovn-kubernetes\") pod \"ovnkube-node-t4wf8\" (UID: \"826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" Apr 17 14:26:49.551169 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.550860 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a44848f6-e8dc-4204-9db4-a4c4ca9cffdd-host\") pod \"node-ca-wfhf5\" (UID: \"a44848f6-e8dc-4204-9db4-a4c4ca9cffdd\") " pod="openshift-image-registry/node-ca-wfhf5" Apr 17 14:26:49.552060 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.550879 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e3b540b1-5c0c-463a-8b61-9e636cd837c1-registration-dir\") pod \"aws-ebs-csi-driver-node-ss8x7\" (UID: \"e3b540b1-5c0c-463a-8b61-9e636cd837c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss8x7" Apr 17 14:26:49.552060 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.550883 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/01db874f-c326-48bc-8c33-eeab64d1bf17-multus-socket-dir-parent\") pod \"multus-j95gf\" (UID: \"01db874f-c326-48bc-8c33-eeab64d1bf17\") " pod="openshift-multus/multus-j95gf" Apr 17 14:26:49.552060 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.550915 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1d47c42e-517c-405b-99a5-30609ea3d21d-cnibin\") pod \"multus-additional-cni-plugins-dh4qj\" (UID: \"1d47c42e-517c-405b-99a5-30609ea3d21d\") " pod="openshift-multus/multus-additional-cni-plugins-dh4qj" Apr 17 14:26:49.552060 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.550935 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/01db874f-c326-48bc-8c33-eeab64d1bf17-multus-socket-dir-parent\") pod \"multus-j95gf\" (UID: \"01db874f-c326-48bc-8c33-eeab64d1bf17\") " pod="openshift-multus/multus-j95gf" Apr 17 14:26:49.552060 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.550942 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1d47c42e-517c-405b-99a5-30609ea3d21d-os-release\") pod \"multus-additional-cni-plugins-dh4qj\" (UID: \"1d47c42e-517c-405b-99a5-30609ea3d21d\") " pod="openshift-multus/multus-additional-cni-plugins-dh4qj" Apr 17 14:26:49.552060 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.550935 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1d47c42e-517c-405b-99a5-30609ea3d21d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dh4qj\" (UID: \"1d47c42e-517c-405b-99a5-30609ea3d21d\") " pod="openshift-multus/multus-additional-cni-plugins-dh4qj" Apr 17 14:26:49.552060 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.550992 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1d47c42e-517c-405b-99a5-30609ea3d21d-cni-binary-copy\") pod \"multus-additional-cni-plugins-dh4qj\" (UID: \"1d47c42e-517c-405b-99a5-30609ea3d21d\") " pod="openshift-multus/multus-additional-cni-plugins-dh4qj" Apr 17 14:26:49.552060 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.550999 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7c85ebb8-909c-4ad2-affb-b7280f1cce30-sys\") pod \"tuned-sj9xp\" (UID: \"7c85ebb8-909c-4ad2-affb-b7280f1cce30\") " pod="openshift-cluster-node-tuning-operator/tuned-sj9xp" Apr 17 14:26:49.552060 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.551032 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52-host-cni-netd\") pod \"ovnkube-node-t4wf8\" (UID: \"826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" Apr 17 14:26:49.552060 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.551058 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7c85ebb8-909c-4ad2-affb-b7280f1cce30-etc-kubernetes\") pod \"tuned-sj9xp\" (UID: \"7c85ebb8-909c-4ad2-affb-b7280f1cce30\") " pod="openshift-cluster-node-tuning-operator/tuned-sj9xp" Apr 17 14:26:49.552060 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.551095 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52-host-cni-netd\") pod \"ovnkube-node-t4wf8\" (UID: \"826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" Apr 17 14:26:49.552060 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.551115 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52-host-slash\") pod \"ovnkube-node-t4wf8\" (UID: \"826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" Apr 17 14:26:49.552060 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.551122 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e3b540b1-5c0c-463a-8b61-9e636cd837c1-device-dir\") pod \"aws-ebs-csi-driver-node-ss8x7\" (UID: \"e3b540b1-5c0c-463a-8b61-9e636cd837c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss8x7" Apr 17 14:26:49.552060 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.551148 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7c85ebb8-909c-4ad2-affb-b7280f1cce30-etc-sysconfig\") pod \"tuned-sj9xp\" (UID: \"7c85ebb8-909c-4ad2-affb-b7280f1cce30\") " pod="openshift-cluster-node-tuning-operator/tuned-sj9xp" Apr 17 14:26:49.552060 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.551165 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a44848f6-e8dc-4204-9db4-a4c4ca9cffdd-host\") pod \"node-ca-wfhf5\" (UID: \"a44848f6-e8dc-4204-9db4-a4c4ca9cffdd\") " pod="openshift-image-registry/node-ca-wfhf5" Apr 17 14:26:49.552060 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.551175 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7c85ebb8-909c-4ad2-affb-b7280f1cce30-var-lib-kubelet\") pod \"tuned-sj9xp\" (UID: \"7c85ebb8-909c-4ad2-affb-b7280f1cce30\") " pod="openshift-cluster-node-tuning-operator/tuned-sj9xp" Apr 17 14:26:49.552060 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.551198 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c85ebb8-909c-4ad2-affb-b7280f1cce30-tmp\") pod \"tuned-sj9xp\" (UID: \"7c85ebb8-909c-4ad2-affb-b7280f1cce30\") " pod="openshift-cluster-node-tuning-operator/tuned-sj9xp" Apr 17 14:26:49.552904 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.551224 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8d6qc\" (UniqueName: \"kubernetes.io/projected/a44848f6-e8dc-4204-9db4-a4c4ca9cffdd-kube-api-access-8d6qc\") pod \"node-ca-wfhf5\" (UID: \"a44848f6-e8dc-4204-9db4-a4c4ca9cffdd\") " pod="openshift-image-registry/node-ca-wfhf5" Apr 17 14:26:49.552904 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.551249 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/01db874f-c326-48bc-8c33-eeab64d1bf17-cnibin\") pod \"multus-j95gf\" (UID: \"01db874f-c326-48bc-8c33-eeab64d1bf17\") " pod="openshift-multus/multus-j95gf" Apr 17 14:26:49.552904 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.551262 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e3b540b1-5c0c-463a-8b61-9e636cd837c1-device-dir\") pod \"aws-ebs-csi-driver-node-ss8x7\" (UID: \"e3b540b1-5c0c-463a-8b61-9e636cd837c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss8x7" Apr 17 14:26:49.552904 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.551274 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/01db874f-c326-48bc-8c33-eeab64d1bf17-host-run-k8s-cni-cncf-io\") pod \"multus-j95gf\" (UID: \"01db874f-c326-48bc-8c33-eeab64d1bf17\") " pod="openshift-multus/multus-j95gf" Apr 17 14:26:49.552904 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.551299 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/01db874f-c326-48bc-8c33-eeab64d1bf17-host-var-lib-cni-bin\") pod \"multus-j95gf\" (UID: \"01db874f-c326-48bc-8c33-eeab64d1bf17\") " pod="openshift-multus/multus-j95gf" Apr 17 14:26:49.552904 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.551305 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t4wf8\" (UID: \"826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" Apr 17 14:26:49.552904 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.551332 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bedbded4-1a39-4b5a-b15a-2f9d05548508-metrics-certs\") pod \"network-metrics-daemon-khctm\" (UID: \"bedbded4-1a39-4b5a-b15a-2f9d05548508\") " pod="openshift-multus/network-metrics-daemon-khctm" Apr 17 14:26:49.552904 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.551338 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/01db874f-c326-48bc-8c33-eeab64d1bf17-host-var-lib-cni-bin\") pod \"multus-j95gf\" (UID: \"01db874f-c326-48bc-8c33-eeab64d1bf17\") " pod="openshift-multus/multus-j95gf" Apr 17 14:26:49.552904 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.551199 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/01db874f-c326-48bc-8c33-eeab64d1bf17-host-run-multus-certs\") pod \"multus-j95gf\" (UID: \"01db874f-c326-48bc-8c33-eeab64d1bf17\") " pod="openshift-multus/multus-j95gf" Apr 17 14:26:49.552904 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.551336 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab4fc13b-36d4-4f8b-9f8a-52c2424a807d-tmp-dir\") pod \"node-resolver-pqwhd\" (UID: \"ab4fc13b-36d4-4f8b-9f8a-52c2424a807d\") " pod="openshift-dns/node-resolver-pqwhd" Apr 17 14:26:49.552904 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.551225 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52-host-run-ovn-kubernetes\") pod \"ovnkube-node-t4wf8\" (UID: \"826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" Apr 17 14:26:49.552904 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.551358 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7c85ebb8-909c-4ad2-affb-b7280f1cce30-etc-modprobe-d\") pod \"tuned-sj9xp\" (UID: \"7c85ebb8-909c-4ad2-affb-b7280f1cce30\") " pod="openshift-cluster-node-tuning-operator/tuned-sj9xp" Apr 17 14:26:49.552904 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.551393 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/01db874f-c326-48bc-8c33-eeab64d1bf17-host-var-lib-cni-multus\") pod \"multus-j95gf\" (UID: \"01db874f-c326-48bc-8c33-eeab64d1bf17\") " pod="openshift-multus/multus-j95gf" Apr 17 14:26:49.552904 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.551400 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52-node-log\") pod \"ovnkube-node-t4wf8\" (UID: \"826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" Apr 17 14:26:49.552904 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.551429 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7c85ebb8-909c-4ad2-affb-b7280f1cce30-etc-sysctl-d\") pod \"tuned-sj9xp\" (UID: \"7c85ebb8-909c-4ad2-affb-b7280f1cce30\") " pod="openshift-cluster-node-tuning-operator/tuned-sj9xp" Apr 17 14:26:49.552904 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.551436 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/01db874f-c326-48bc-8c33-eeab64d1bf17-host-run-k8s-cni-cncf-io\") pod \"multus-j95gf\" (UID: \"01db874f-c326-48bc-8c33-eeab64d1bf17\") " pod="openshift-multus/multus-j95gf" Apr 17 14:26:49.552904 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.550625 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e3b540b1-5c0c-463a-8b61-9e636cd837c1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ss8x7\" (UID: \"e3b540b1-5c0c-463a-8b61-9e636cd837c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss8x7" Apr 17 14:26:49.553731 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.551430 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7c85ebb8-909c-4ad2-affb-b7280f1cce30-etc-modprobe-d\") pod \"tuned-sj9xp\" (UID: \"7c85ebb8-909c-4ad2-affb-b7280f1cce30\") " pod="openshift-cluster-node-tuning-operator/tuned-sj9xp" Apr 17 14:26:49.553731 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.551343 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a44848f6-e8dc-4204-9db4-a4c4ca9cffdd-serviceca\") pod \"node-ca-wfhf5\" (UID: \"a44848f6-e8dc-4204-9db4-a4c4ca9cffdd\") " pod="openshift-image-registry/node-ca-wfhf5" Apr 17 14:26:49.553731 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.551456 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52-etc-openvswitch\") pod \"ovnkube-node-t4wf8\" (UID: \"826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" Apr 17 14:26:49.553731 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.551474 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52-ovnkube-script-lib\") pod \"ovnkube-node-t4wf8\" (UID: \"826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" Apr 17 14:26:49.553731 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.551489 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52-etc-openvswitch\") pod \"ovnkube-node-t4wf8\" (UID: \"826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" Apr 17 14:26:49.553731 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.551504 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/01db874f-c326-48bc-8c33-eeab64d1bf17-hostroot\") pod \"multus-j95gf\" (UID: \"01db874f-c326-48bc-8c33-eeab64d1bf17\") " pod="openshift-multus/multus-j95gf" Apr 17 14:26:49.553731 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.551454 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7c85ebb8-909c-4ad2-affb-b7280f1cce30-var-lib-kubelet\") pod \"tuned-sj9xp\" (UID: \"7c85ebb8-909c-4ad2-affb-b7280f1cce30\") " pod="openshift-cluster-node-tuning-operator/tuned-sj9xp" Apr 17 14:26:49.553731 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.551534 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/574ada25-3a36-4d49-be15-436687239f1a-iptables-alerter-script\") pod \"iptables-alerter-2jvxm\" (UID: \"574ada25-3a36-4d49-be15-436687239f1a\") " pod="openshift-network-operator/iptables-alerter-2jvxm" Apr 17 14:26:49.553731 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.551556 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/01db874f-c326-48bc-8c33-eeab64d1bf17-cnibin\") pod \"multus-j95gf\" (UID: \"01db874f-c326-48bc-8c33-eeab64d1bf17\") " pod="openshift-multus/multus-j95gf" Apr 17 14:26:49.553731 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.551578 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52-host-run-netns\") pod \"ovnkube-node-t4wf8\" (UID: \"826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" Apr 17 14:26:49.553731 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:26:49.551548 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Apr 17 14:26:49.553731 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.551580 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/01db874f-c326-48bc-8c33-eeab64d1bf17-hostroot\") pod \"multus-j95gf\" (UID: \"01db874f-c326-48bc-8c33-eeab64d1bf17\") " pod="openshift-multus/multus-j95gf" Apr 17 14:26:49.553731 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.551630 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52-host-run-netns\") pod \"ovnkube-node-t4wf8\" (UID: \"826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" Apr 17 14:26:49.553731 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.551670 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52-node-log\") pod \"ovnkube-node-t4wf8\" (UID: \"826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" Apr 17 14:26:49.553731 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.551674 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7c85ebb8-909c-4ad2-affb-b7280f1cce30-etc-sysctl-d\") pod \"tuned-sj9xp\" (UID: \"7c85ebb8-909c-4ad2-affb-b7280f1cce30\") " pod="openshift-cluster-node-tuning-operator/tuned-sj9xp" Apr 17 14:26:49.553731 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:26:49.551682 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bedbded4-1a39-4b5a-b15a-2f9d05548508-metrics-certs podName:bedbded4-1a39-4b5a-b15a-2f9d05548508 nodeName:}" failed. No retries permitted until 2026-04-17 14:26:50.051632645 +0000 UTC m=+2.096061449 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bedbded4-1a39-4b5a-b15a-2f9d05548508-metrics-certs") pod "network-metrics-daemon-khctm" (UID: "bedbded4-1a39-4b5a-b15a-2f9d05548508") : object "openshift-multus"/"metrics-daemon-secret" not registered Apr 17 14:26:49.553731 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.551715 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1d47c42e-517c-405b-99a5-30609ea3d21d-cnibin\") pod \"multus-additional-cni-plugins-dh4qj\" (UID: \"1d47c42e-517c-405b-99a5-30609ea3d21d\") " pod="openshift-multus/multus-additional-cni-plugins-dh4qj" Apr 17 14:26:49.554525 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.551744 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1d47c42e-517c-405b-99a5-30609ea3d21d-os-release\") pod \"multus-additional-cni-plugins-dh4qj\" (UID: \"1d47c42e-517c-405b-99a5-30609ea3d21d\") " pod="openshift-multus/multus-additional-cni-plugins-dh4qj" Apr 17 14:26:49.554525 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.551770 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7c85ebb8-909c-4ad2-affb-b7280f1cce30-etc-sysconfig\") pod \"tuned-sj9xp\" (UID: \"7c85ebb8-909c-4ad2-affb-b7280f1cce30\") " pod="openshift-cluster-node-tuning-operator/tuned-sj9xp" Apr 17 14:26:49.554525 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.551775 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k8mp2\" (UniqueName: \"kubernetes.io/projected/e3b540b1-5c0c-463a-8b61-9e636cd837c1-kube-api-access-k8mp2\") pod \"aws-ebs-csi-driver-node-ss8x7\" (UID: \"e3b540b1-5c0c-463a-8b61-9e636cd837c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss8x7" Apr 17 14:26:49.554525 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.551801 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/01db874f-c326-48bc-8c33-eeab64d1bf17-multus-daemon-config\") pod \"multus-j95gf\" (UID: \"01db874f-c326-48bc-8c33-eeab64d1bf17\") " pod="openshift-multus/multus-j95gf" Apr 17 14:26:49.554525 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.551839 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1d47c42e-517c-405b-99a5-30609ea3d21d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dh4qj\" (UID: \"1d47c42e-517c-405b-99a5-30609ea3d21d\") " pod="openshift-multus/multus-additional-cni-plugins-dh4qj" Apr 17 14:26:49.554525 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.551865 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52-run-systemd\") pod \"ovnkube-node-t4wf8\" (UID: \"826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" Apr 17 14:26:49.554525 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.551886 2573 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Apr 17 14:26:49.554525 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.552010 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1d47c42e-517c-405b-99a5-30609ea3d21d-cni-binary-copy\") pod \"multus-additional-cni-plugins-dh4qj\" (UID: \"1d47c42e-517c-405b-99a5-30609ea3d21d\") " pod="openshift-multus/multus-additional-cni-plugins-dh4qj" Apr 17 14:26:49.554525 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.552047 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/574ada25-3a36-4d49-be15-436687239f1a-iptables-alerter-script\") pod \"iptables-alerter-2jvxm\" (UID: \"574ada25-3a36-4d49-be15-436687239f1a\") " pod="openshift-network-operator/iptables-alerter-2jvxm" Apr 17 14:26:49.554525 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.552074 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52-run-systemd\") pod \"ovnkube-node-t4wf8\" (UID: \"826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" Apr 17 14:26:49.554525 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.551890 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52-ovnkube-config\") pod \"ovnkube-node-t4wf8\" (UID: \"826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" Apr 17 14:26:49.554525 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.552207 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/733d18e1-1920-4e3c-83c4-b476253e1f4d-agent-certs\") pod \"konnectivity-agent-xjs2v\" (UID: \"733d18e1-1920-4e3c-83c4-b476253e1f4d\") " pod="kube-system/konnectivity-agent-xjs2v" Apr 17 14:26:49.554525 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.552228 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/733d18e1-1920-4e3c-83c4-b476253e1f4d-konnectivity-ca\") pod \"konnectivity-agent-xjs2v\" (UID: \"733d18e1-1920-4e3c-83c4-b476253e1f4d\") " pod="kube-system/konnectivity-agent-xjs2v" Apr 17 14:26:49.554525 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.552252 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e3b540b1-5c0c-463a-8b61-9e636cd837c1-socket-dir\") pod \"aws-ebs-csi-driver-node-ss8x7\" (UID: \"e3b540b1-5c0c-463a-8b61-9e636cd837c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss8x7" Apr 17 14:26:49.554525 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.552277 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e3b540b1-5c0c-463a-8b61-9e636cd837c1-sys-fs\") pod \"aws-ebs-csi-driver-node-ss8x7\" (UID: \"e3b540b1-5c0c-463a-8b61-9e636cd837c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss8x7" Apr 17 14:26:49.554525 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.552301 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7c85ebb8-909c-4ad2-affb-b7280f1cce30-lib-modules\") pod \"tuned-sj9xp\" (UID: \"7c85ebb8-909c-4ad2-affb-b7280f1cce30\") " pod="openshift-cluster-node-tuning-operator/tuned-sj9xp" Apr 17 14:26:49.554525 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.552323 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e3b540b1-5c0c-463a-8b61-9e636cd837c1-etc-selinux\") pod \"aws-ebs-csi-driver-node-ss8x7\" (UID: \"e3b540b1-5c0c-463a-8b61-9e636cd837c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss8x7" Apr 17 14:26:49.555242 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.552348 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/01db874f-c326-48bc-8c33-eeab64d1bf17-system-cni-dir\") pod \"multus-j95gf\" (UID: \"01db874f-c326-48bc-8c33-eeab64d1bf17\") " pod="openshift-multus/multus-j95gf" Apr 17 14:26:49.555242 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.552370 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/01db874f-c326-48bc-8c33-eeab64d1bf17-os-release\") pod \"multus-j95gf\" (UID: \"01db874f-c326-48bc-8c33-eeab64d1bf17\") " pod="openshift-multus/multus-j95gf" Apr 17 14:26:49.555242 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.552374 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e3b540b1-5c0c-463a-8b61-9e636cd837c1-socket-dir\") pod \"aws-ebs-csi-driver-node-ss8x7\" (UID: \"e3b540b1-5c0c-463a-8b61-9e636cd837c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss8x7" Apr 17 14:26:49.555242 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.552396 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mdl74\" (UniqueName: \"kubernetes.io/projected/bedbded4-1a39-4b5a-b15a-2f9d05548508-kube-api-access-mdl74\") pod \"network-metrics-daemon-khctm\" (UID: \"bedbded4-1a39-4b5a-b15a-2f9d05548508\") " pod="openshift-multus/network-metrics-daemon-khctm" Apr 17 14:26:49.555242 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.552422 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5b7bd\" (UniqueName: \"kubernetes.io/projected/ab4fc13b-36d4-4f8b-9f8a-52c2424a807d-kube-api-access-5b7bd\") pod \"node-resolver-pqwhd\" (UID: \"ab4fc13b-36d4-4f8b-9f8a-52c2424a807d\") " pod="openshift-dns/node-resolver-pqwhd" Apr 17 14:26:49.555242 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.552161 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1d47c42e-517c-405b-99a5-30609ea3d21d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dh4qj\" (UID: \"1d47c42e-517c-405b-99a5-30609ea3d21d\") " pod="openshift-multus/multus-additional-cni-plugins-dh4qj" Apr 17 14:26:49.555242 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.552447 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52-systemd-units\") pod \"ovnkube-node-t4wf8\" (UID: \"826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" Apr 17 14:26:49.555242 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.552470 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52-run-ovn\") pod \"ovnkube-node-t4wf8\" (UID: \"826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" Apr 17 14:26:49.555242 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.552495 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/01db874f-c326-48bc-8c33-eeab64d1bf17-cni-binary-copy\") pod \"multus-j95gf\" (UID: \"01db874f-c326-48bc-8c33-eeab64d1bf17\") " pod="openshift-multus/multus-j95gf" Apr 17 14:26:49.555242 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.552521 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7cp8s\" (UniqueName: \"kubernetes.io/projected/01db874f-c326-48bc-8c33-eeab64d1bf17-kube-api-access-7cp8s\") pod \"multus-j95gf\" (UID: \"01db874f-c326-48bc-8c33-eeab64d1bf17\") " pod="openshift-multus/multus-j95gf" Apr 17 14:26:49.555242 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.552527 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/01db874f-c326-48bc-8c33-eeab64d1bf17-multus-daemon-config\") pod \"multus-j95gf\" (UID: \"01db874f-c326-48bc-8c33-eeab64d1bf17\") " pod="openshift-multus/multus-j95gf" Apr 17 14:26:49.555242 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.552544 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7c85ebb8-909c-4ad2-affb-b7280f1cce30-etc-tuned\") pod \"tuned-sj9xp\" (UID: \"7c85ebb8-909c-4ad2-affb-b7280f1cce30\") " pod="openshift-cluster-node-tuning-operator/tuned-sj9xp" Apr 17 14:26:49.555242 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.552533 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e3b540b1-5c0c-463a-8b61-9e636cd837c1-sys-fs\") pod \"aws-ebs-csi-driver-node-ss8x7\" (UID: \"e3b540b1-5c0c-463a-8b61-9e636cd837c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss8x7" Apr 17 14:26:49.555242 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.552570 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/574ada25-3a36-4d49-be15-436687239f1a-host-slash\") pod \"iptables-alerter-2jvxm\" (UID: \"574ada25-3a36-4d49-be15-436687239f1a\") " pod="openshift-network-operator/iptables-alerter-2jvxm" Apr 17 14:26:49.555242 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.552600 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52-host-kubelet\") pod \"ovnkube-node-t4wf8\" (UID: \"826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" Apr 17 14:26:49.555242 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.552602 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52-systemd-units\") pod \"ovnkube-node-t4wf8\" (UID: \"826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" Apr 17 14:26:49.555242 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.552638 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52-run-openvswitch\") pod \"ovnkube-node-t4wf8\" (UID: \"826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" Apr 17 14:26:49.555242 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.552644 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7c85ebb8-909c-4ad2-affb-b7280f1cce30-lib-modules\") pod \"tuned-sj9xp\" (UID: \"7c85ebb8-909c-4ad2-affb-b7280f1cce30\") " pod="openshift-cluster-node-tuning-operator/tuned-sj9xp" Apr 17 14:26:49.555835 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.552672 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52-env-overrides\") pod \"ovnkube-node-t4wf8\" (UID: \"826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" Apr 17 14:26:49.555835 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.552672 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/01db874f-c326-48bc-8c33-eeab64d1bf17-os-release\") pod \"multus-j95gf\" (UID: \"01db874f-c326-48bc-8c33-eeab64d1bf17\") " pod="openshift-multus/multus-j95gf" Apr 17 14:26:49.555835 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.552696 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gj2jz\" (UniqueName: \"kubernetes.io/projected/826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52-kube-api-access-gj2jz\") pod \"ovnkube-node-t4wf8\" (UID: \"826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" Apr 17 14:26:49.555835 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.552719 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7c85ebb8-909c-4ad2-affb-b7280f1cce30-host\") pod \"tuned-sj9xp\" (UID: \"7c85ebb8-909c-4ad2-affb-b7280f1cce30\") " pod="openshift-cluster-node-tuning-operator/tuned-sj9xp" Apr 17 14:26:49.555835 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.552721 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e3b540b1-5c0c-463a-8b61-9e636cd837c1-etc-selinux\") pod \"aws-ebs-csi-driver-node-ss8x7\" (UID: \"e3b540b1-5c0c-463a-8b61-9e636cd837c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss8x7" Apr 17 14:26:49.555835 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.552742 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ab4fc13b-36d4-4f8b-9f8a-52c2424a807d-hosts-file\") pod \"node-resolver-pqwhd\" (UID: \"ab4fc13b-36d4-4f8b-9f8a-52c2424a807d\") " pod="openshift-dns/node-resolver-pqwhd" Apr 17 14:26:49.555835 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.552421 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52-ovnkube-config\") pod \"ovnkube-node-t4wf8\" (UID: \"826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" Apr 17 14:26:49.555835 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.552871 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1d47c42e-517c-405b-99a5-30609ea3d21d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dh4qj\" (UID: \"1d47c42e-517c-405b-99a5-30609ea3d21d\") " pod="openshift-multus/multus-additional-cni-plugins-dh4qj" Apr 17 14:26:49.555835 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.552921 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52-host-kubelet\") pod \"ovnkube-node-t4wf8\" (UID: \"826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" Apr 17 14:26:49.555835 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.552990 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52-host-cni-bin\") pod \"ovnkube-node-t4wf8\" (UID: \"826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" Apr 17 14:26:49.555835 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.552993 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52-run-openvswitch\") pod \"ovnkube-node-t4wf8\" (UID: \"826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" Apr 17 14:26:49.555835 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.553019 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52-ovn-node-metrics-cert\") pod \"ovnkube-node-t4wf8\" (UID: \"826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" Apr 17 14:26:49.555835 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.553048 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/01db874f-c326-48bc-8c33-eeab64d1bf17-multus-cni-dir\") pod \"multus-j95gf\" (UID: \"01db874f-c326-48bc-8c33-eeab64d1bf17\") " pod="openshift-multus/multus-j95gf" Apr 17 14:26:49.555835 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.553126 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/01db874f-c326-48bc-8c33-eeab64d1bf17-multus-cni-dir\") pod \"multus-j95gf\" (UID: \"01db874f-c326-48bc-8c33-eeab64d1bf17\") " pod="openshift-multus/multus-j95gf" Apr 17 14:26:49.555835 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.553174 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52-run-ovn\") pod \"ovnkube-node-t4wf8\" (UID: \"826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" Apr 17 14:26:49.555835 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.553289 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7c85ebb8-909c-4ad2-affb-b7280f1cce30-host\") pod \"tuned-sj9xp\" (UID: \"7c85ebb8-909c-4ad2-affb-b7280f1cce30\") " pod="openshift-cluster-node-tuning-operator/tuned-sj9xp" Apr 17 14:26:49.555835 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.553423 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52-env-overrides\") pod \"ovnkube-node-t4wf8\" (UID: \"826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" Apr 17 14:26:49.555835 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.553554 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/574ada25-3a36-4d49-be15-436687239f1a-host-slash\") pod \"iptables-alerter-2jvxm\" (UID: \"574ada25-3a36-4d49-be15-436687239f1a\") " pod="openshift-network-operator/iptables-alerter-2jvxm" Apr 17 14:26:49.556474 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.552496 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/01db874f-c326-48bc-8c33-eeab64d1bf17-system-cni-dir\") pod \"multus-j95gf\" (UID: \"01db874f-c326-48bc-8c33-eeab64d1bf17\") " pod="openshift-multus/multus-j95gf" Apr 17 14:26:49.556474 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.554248 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/733d18e1-1920-4e3c-83c4-b476253e1f4d-konnectivity-ca\") pod \"konnectivity-agent-xjs2v\" (UID: \"733d18e1-1920-4e3c-83c4-b476253e1f4d\") " pod="kube-system/konnectivity-agent-xjs2v" Apr 17 14:26:49.556474 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.554280 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1d47c42e-517c-405b-99a5-30609ea3d21d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dh4qj\" (UID: \"1d47c42e-517c-405b-99a5-30609ea3d21d\") " pod="openshift-multus/multus-additional-cni-plugins-dh4qj" Apr 17 14:26:49.556474 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.554338 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ab4fc13b-36d4-4f8b-9f8a-52c2424a807d-hosts-file\") pod \"node-resolver-pqwhd\" (UID: \"ab4fc13b-36d4-4f8b-9f8a-52c2424a807d\") " pod="openshift-dns/node-resolver-pqwhd" Apr 17 14:26:49.556474 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.554363 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52-host-cni-bin\") pod \"ovnkube-node-t4wf8\" (UID: \"826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" Apr 17 14:26:49.556474 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.554896 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/01db874f-c326-48bc-8c33-eeab64d1bf17-cni-binary-copy\") pod \"multus-j95gf\" (UID: \"01db874f-c326-48bc-8c33-eeab64d1bf17\") " pod="openshift-multus/multus-j95gf" Apr 17 14:26:49.556474 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.555443 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/733d18e1-1920-4e3c-83c4-b476253e1f4d-agent-certs\") pod \"konnectivity-agent-xjs2v\" (UID: \"733d18e1-1920-4e3c-83c4-b476253e1f4d\") " pod="kube-system/konnectivity-agent-xjs2v" Apr 17 14:26:49.556474 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.555681 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xjs2v" Apr 17 14:26:49.556474 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.555951 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c85ebb8-909c-4ad2-affb-b7280f1cce30-tmp\") pod \"tuned-sj9xp\" (UID: \"7c85ebb8-909c-4ad2-affb-b7280f1cce30\") " pod="openshift-cluster-node-tuning-operator/tuned-sj9xp" Apr 17 14:26:49.557037 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:26:49.556622 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Apr 17 14:26:49.557037 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:26:49.556643 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Apr 17 14:26:49.557037 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:26:49.556659 2573 projected.go:194] Error preparing data for projected volume kube-api-access-76h8j for pod openshift-network-diagnostics/network-check-target-n9zdz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 17 14:26:49.557037 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:26:49.556733 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/928be529-e62e-4b1a-8221-cf0def914796-kube-api-access-76h8j podName:928be529-e62e-4b1a-8221-cf0def914796 nodeName:}" failed. No retries permitted until 2026-04-17 14:26:50.056713462 +0000 UTC m=+2.101142267 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-76h8j" (UniqueName: "kubernetes.io/projected/928be529-e62e-4b1a-8221-cf0def914796-kube-api-access-76h8j") pod "network-check-target-n9zdz" (UID: "928be529-e62e-4b1a-8221-cf0def914796") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 17 14:26:49.560146 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.558901 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6h55\" (UniqueName: \"kubernetes.io/projected/7c85ebb8-909c-4ad2-affb-b7280f1cce30-kube-api-access-z6h55\") pod \"tuned-sj9xp\" (UID: \"7c85ebb8-909c-4ad2-affb-b7280f1cce30\") " pod="openshift-cluster-node-tuning-operator/tuned-sj9xp" Apr 17 14:26:49.560146 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.558956 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jd6sw\" (UniqueName: \"kubernetes.io/projected/1d47c42e-517c-405b-99a5-30609ea3d21d-kube-api-access-jd6sw\") pod \"multus-additional-cni-plugins-dh4qj\" (UID: \"1d47c42e-517c-405b-99a5-30609ea3d21d\") " pod="openshift-multus/multus-additional-cni-plugins-dh4qj" Apr 17 14:26:49.560903 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.560878 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52-ovn-node-metrics-cert\") pod \"ovnkube-node-t4wf8\" (UID: \"826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" Apr 17 14:26:49.562015 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.561593 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8d6qc\" (UniqueName: \"kubernetes.io/projected/a44848f6-e8dc-4204-9db4-a4c4ca9cffdd-kube-api-access-8d6qc\") pod \"node-ca-wfhf5\" (UID: \"a44848f6-e8dc-4204-9db4-a4c4ca9cffdd\") " pod="openshift-image-registry/node-ca-wfhf5" Apr 17 14:26:49.562015 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.561873 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8mp2\" (UniqueName: \"kubernetes.io/projected/e3b540b1-5c0c-463a-8b61-9e636cd837c1-kube-api-access-k8mp2\") pod \"aws-ebs-csi-driver-node-ss8x7\" (UID: \"e3b540b1-5c0c-463a-8b61-9e636cd837c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss8x7" Apr 17 14:26:49.563118 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.563078 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7c85ebb8-909c-4ad2-affb-b7280f1cce30-etc-tuned\") pod \"tuned-sj9xp\" (UID: \"7c85ebb8-909c-4ad2-affb-b7280f1cce30\") " pod="openshift-cluster-node-tuning-operator/tuned-sj9xp" Apr 17 14:26:49.563411 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.563367 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhvrv\" (UniqueName: \"kubernetes.io/projected/574ada25-3a36-4d49-be15-436687239f1a-kube-api-access-jhvrv\") pod \"iptables-alerter-2jvxm\" (UID: \"574ada25-3a36-4d49-be15-436687239f1a\") " pod="openshift-network-operator/iptables-alerter-2jvxm" Apr 17 14:26:49.564300 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.563868 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cp8s\" (UniqueName: \"kubernetes.io/projected/01db874f-c326-48bc-8c33-eeab64d1bf17-kube-api-access-7cp8s\") pod \"multus-j95gf\" (UID: \"01db874f-c326-48bc-8c33-eeab64d1bf17\") " pod="openshift-multus/multus-j95gf" Apr 17 14:26:49.564300 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.564112 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdl74\" (UniqueName: \"kubernetes.io/projected/bedbded4-1a39-4b5a-b15a-2f9d05548508-kube-api-access-mdl74\") pod \"network-metrics-daemon-khctm\" (UID: \"bedbded4-1a39-4b5a-b15a-2f9d05548508\") " pod="openshift-multus/network-metrics-daemon-khctm" Apr 17 14:26:49.564300 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.564265 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5b7bd\" (UniqueName: \"kubernetes.io/projected/ab4fc13b-36d4-4f8b-9f8a-52c2424a807d-kube-api-access-5b7bd\") pod \"node-resolver-pqwhd\" (UID: \"ab4fc13b-36d4-4f8b-9f8a-52c2424a807d\") " pod="openshift-dns/node-resolver-pqwhd" Apr 17 14:26:49.564682 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.564665 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj2jz\" (UniqueName: \"kubernetes.io/projected/826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52-kube-api-access-gj2jz\") pod \"ovnkube-node-t4wf8\" (UID: \"826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" Apr 17 14:26:49.565790 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:49.565772 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod733d18e1_1920_4e3c_83c4_b476253e1f4d.slice/crio-b2d14079c1ebcf9d0058082b7990fb872a95f1e7f6391668b978349b65dda0cc WatchSource:0}: Error finding container b2d14079c1ebcf9d0058082b7990fb872a95f1e7f6391668b978349b65dda0cc: Status 404 returned error can't find the container with id b2d14079c1ebcf9d0058082b7990fb872a95f1e7f6391668b978349b65dda0cc Apr 17 14:26:49.568562 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.568526 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Apr 17 14:26:49.570770 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.570754 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss8x7" Apr 17 14:26:49.575496 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:49.575473 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b712f12e316b1a6ded9d349ca82d37a.slice/crio-356acad5b5b3233e96e96f457d7e4ceb9060fc336f470c4964962cfd9f094164 WatchSource:0}: Error finding container 356acad5b5b3233e96e96f457d7e4ceb9060fc336f470c4964962cfd9f094164: Status 404 returned error can't find the container with id 356acad5b5b3233e96e96f457d7e4ceb9060fc336f470c4964962cfd9f094164 Apr 17 14:26:49.577814 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.577799 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pqwhd" Apr 17 14:26:49.579041 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:49.579019 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3b540b1_5c0c_463a_8b61_9e636cd837c1.slice/crio-5f00fde177b9492b38cd6cc95e3a390e27100086959d8928fd84f826ef6f84f8 WatchSource:0}: Error finding container 5f00fde177b9492b38cd6cc95e3a390e27100086959d8928fd84f826ef6f84f8: Status 404 returned error can't find the container with id 5f00fde177b9492b38cd6cc95e3a390e27100086959d8928fd84f826ef6f84f8 Apr 17 14:26:49.583060 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.583045 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wfhf5" Apr 17 14:26:49.584312 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:49.584295 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab4fc13b_36d4_4f8b_9f8a_52c2424a807d.slice/crio-90334d7b04253e1321c353a3c0d6cbbd33a77389410007c3015d6385ec40efae WatchSource:0}: Error finding container 90334d7b04253e1321c353a3c0d6cbbd33a77389410007c3015d6385ec40efae: Status 404 returned error can't find the container with id 90334d7b04253e1321c353a3c0d6cbbd33a77389410007c3015d6385ec40efae Apr 17 14:26:49.589121 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:49.589103 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda44848f6_e8dc_4204_9db4_a4c4ca9cffdd.slice/crio-5e8efc609b0e040b6496fa80f4b71569e9ba900031240988d3f81f3ae65a7c07 WatchSource:0}: Error finding container 5e8efc609b0e040b6496fa80f4b71569e9ba900031240988d3f81f3ae65a7c07: Status 404 returned error can't find the container with id 5e8efc609b0e040b6496fa80f4b71569e9ba900031240988d3f81f3ae65a7c07 Apr 17 14:26:49.622277 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.622239 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xjs2v" event={"ID":"733d18e1-1920-4e3c-83c4-b476253e1f4d","Type":"ContainerStarted","Data":"b2d14079c1ebcf9d0058082b7990fb872a95f1e7f6391668b978349b65dda0cc"} Apr 17 14:26:49.623066 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.623050 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-47.ec2.internal" event={"ID":"438108d93a37ab59c6a0c9e57eee327c","Type":"ContainerStarted","Data":"d8ae82bf7aa5ed652cbc18a6f67d0b84583ff0fa5fdefd534c03ecd5ac058bb3"} Apr 17 14:26:49.623871 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.623853 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wfhf5" event={"ID":"a44848f6-e8dc-4204-9db4-a4c4ca9cffdd","Type":"ContainerStarted","Data":"5e8efc609b0e040b6496fa80f4b71569e9ba900031240988d3f81f3ae65a7c07"} Apr 17 14:26:49.624641 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.624625 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pqwhd" event={"ID":"ab4fc13b-36d4-4f8b-9f8a-52c2424a807d","Type":"ContainerStarted","Data":"90334d7b04253e1321c353a3c0d6cbbd33a77389410007c3015d6385ec40efae"} Apr 17 14:26:49.625491 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.625440 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss8x7" event={"ID":"e3b540b1-5c0c-463a-8b61-9e636cd837c1","Type":"ContainerStarted","Data":"5f00fde177b9492b38cd6cc95e3a390e27100086959d8928fd84f826ef6f84f8"} Apr 17 14:26:49.626350 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.626334 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-47.ec2.internal" event={"ID":"8b712f12e316b1a6ded9d349ca82d37a","Type":"ContainerStarted","Data":"356acad5b5b3233e96e96f457d7e4ceb9060fc336f470c4964962cfd9f094164"} Apr 17 14:26:49.769814 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.769760 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-j95gf" Apr 17 14:26:49.774941 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:49.774920 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01db874f_c326_48bc_8c33_eeab64d1bf17.slice/crio-08e0fa833223aaf3cdc14b85f75323fc10a327e1a15efc00de75f109732852be WatchSource:0}: Error finding container 08e0fa833223aaf3cdc14b85f75323fc10a327e1a15efc00de75f109732852be: Status 404 returned error can't find the container with id 08e0fa833223aaf3cdc14b85f75323fc10a327e1a15efc00de75f109732852be Apr 17 14:26:49.785009 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.784992 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sj9xp" Apr 17 14:26:49.790386 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:49.790366 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c85ebb8_909c_4ad2_affb_b7280f1cce30.slice/crio-82a4121191a8aa006d200bafe52697e1d0b89de8072c648ac21cf93a0a82bf98 WatchSource:0}: Error finding container 82a4121191a8aa006d200bafe52697e1d0b89de8072c648ac21cf93a0a82bf98: Status 404 returned error can't find the container with id 82a4121191a8aa006d200bafe52697e1d0b89de8072c648ac21cf93a0a82bf98 Apr 17 14:26:49.800039 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.800022 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dh4qj" Apr 17 14:26:49.805344 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:49.805325 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d47c42e_517c_405b_99a5_30609ea3d21d.slice/crio-d0049121ad2f0442b7baf3a3c7644759393a74770b42c5c5f6db93fdd203f97a WatchSource:0}: Error finding container d0049121ad2f0442b7baf3a3c7644759393a74770b42c5c5f6db93fdd203f97a: Status 404 returned error can't find the container with id d0049121ad2f0442b7baf3a3c7644759393a74770b42c5c5f6db93fdd203f97a Apr 17 14:26:49.812931 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.812916 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2jvxm" Apr 17 14:26:49.817928 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:49.817910 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" Apr 17 14:26:49.818023 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:49.817947 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod574ada25_3a36_4d49_be15_436687239f1a.slice/crio-1e33374177e6fcd39c20ff5b5427b2ae3f557e7a4ae19b5ebcff6cc368af331f WatchSource:0}: Error finding container 1e33374177e6fcd39c20ff5b5427b2ae3f557e7a4ae19b5ebcff6cc368af331f: Status 404 returned error can't find the container with id 1e33374177e6fcd39c20ff5b5427b2ae3f557e7a4ae19b5ebcff6cc368af331f Apr 17 14:26:49.823593 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:26:49.823570 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod826a8fd1_f10a_48b9_b0a8_6a22a6fb1a52.slice/crio-33b191cc9a1e38b01d77c52cab4130f26e98cd5b206fa11e92f616f1bdf3b1fc WatchSource:0}: Error finding container 33b191cc9a1e38b01d77c52cab4130f26e98cd5b206fa11e92f616f1bdf3b1fc: Status 404 returned error can't find the container with id 33b191cc9a1e38b01d77c52cab4130f26e98cd5b206fa11e92f616f1bdf3b1fc Apr 17 14:26:50.057166 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:50.057087 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-76h8j\" (UniqueName: \"kubernetes.io/projected/928be529-e62e-4b1a-8221-cf0def914796-kube-api-access-76h8j\") pod \"network-check-target-n9zdz\" (UID: \"928be529-e62e-4b1a-8221-cf0def914796\") " pod="openshift-network-diagnostics/network-check-target-n9zdz" Apr 17 14:26:50.057166 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:50.057156 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bedbded4-1a39-4b5a-b15a-2f9d05548508-metrics-certs\") pod \"network-metrics-daemon-khctm\" (UID: \"bedbded4-1a39-4b5a-b15a-2f9d05548508\") " pod="openshift-multus/network-metrics-daemon-khctm" Apr 17 14:26:50.057388 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:26:50.057258 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Apr 17 14:26:50.057388 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:26:50.057261 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Apr 17 14:26:50.057388 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:26:50.057286 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Apr 17 14:26:50.057388 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:26:50.057299 2573 projected.go:194] Error preparing data for projected volume kube-api-access-76h8j for pod openshift-network-diagnostics/network-check-target-n9zdz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 17 14:26:50.057388 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:26:50.057318 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bedbded4-1a39-4b5a-b15a-2f9d05548508-metrics-certs podName:bedbded4-1a39-4b5a-b15a-2f9d05548508 nodeName:}" failed. No retries permitted until 2026-04-17 14:26:51.057299294 +0000 UTC m=+3.101728094 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bedbded4-1a39-4b5a-b15a-2f9d05548508-metrics-certs") pod "network-metrics-daemon-khctm" (UID: "bedbded4-1a39-4b5a-b15a-2f9d05548508") : object "openshift-multus"/"metrics-daemon-secret" not registered Apr 17 14:26:50.057388 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:26:50.057351 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/928be529-e62e-4b1a-8221-cf0def914796-kube-api-access-76h8j podName:928be529-e62e-4b1a-8221-cf0def914796 nodeName:}" failed. No retries permitted until 2026-04-17 14:26:51.0573339 +0000 UTC m=+3.101762708 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-76h8j" (UniqueName: "kubernetes.io/projected/928be529-e62e-4b1a-8221-cf0def914796-kube-api-access-76h8j") pod "network-check-target-n9zdz" (UID: "928be529-e62e-4b1a-8221-cf0def914796") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 17 14:26:50.321961 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:50.321726 2573 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Apr 17 14:26:50.455400 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:50.455181 2573 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Apr 17 14:26:50.491347 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:50.491306 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-04-16 14:21:49 +0000 UTC" deadline="2028-01-09 22:37:04.770847278 +0000 UTC" Apr 17 14:26:50.491347 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:50.491345 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15176h10m14.279505914s" Apr 17 14:26:50.592091 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:50.592017 2573 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Apr 17 14:26:50.623335 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:50.623306 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khctm" Apr 17 14:26:50.623508 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:26:50.623444 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khctm" podUID="bedbded4-1a39-4b5a-b15a-2f9d05548508" Apr 17 14:26:50.623904 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:50.623884 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9zdz" Apr 17 14:26:50.624009 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:26:50.623993 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9zdz" podUID="928be529-e62e-4b1a-8221-cf0def914796" Apr 17 14:26:50.661782 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:50.661748 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-j95gf" event={"ID":"01db874f-c326-48bc-8c33-eeab64d1bf17","Type":"ContainerStarted","Data":"08e0fa833223aaf3cdc14b85f75323fc10a327e1a15efc00de75f109732852be"} Apr 17 14:26:50.671255 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:50.671223 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" event={"ID":"826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52","Type":"ContainerStarted","Data":"33b191cc9a1e38b01d77c52cab4130f26e98cd5b206fa11e92f616f1bdf3b1fc"} Apr 17 14:26:50.685379 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:50.685347 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2jvxm" event={"ID":"574ada25-3a36-4d49-be15-436687239f1a","Type":"ContainerStarted","Data":"1e33374177e6fcd39c20ff5b5427b2ae3f557e7a4ae19b5ebcff6cc368af331f"} Apr 17 14:26:50.695596 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:50.695568 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dh4qj" event={"ID":"1d47c42e-517c-405b-99a5-30609ea3d21d","Type":"ContainerStarted","Data":"d0049121ad2f0442b7baf3a3c7644759393a74770b42c5c5f6db93fdd203f97a"} Apr 17 14:26:50.704452 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:50.704420 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sj9xp" event={"ID":"7c85ebb8-909c-4ad2-affb-b7280f1cce30","Type":"ContainerStarted","Data":"82a4121191a8aa006d200bafe52697e1d0b89de8072c648ac21cf93a0a82bf98"} Apr 17 14:26:51.065221 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:51.065122 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-76h8j\" (UniqueName: \"kubernetes.io/projected/928be529-e62e-4b1a-8221-cf0def914796-kube-api-access-76h8j\") pod \"network-check-target-n9zdz\" (UID: \"928be529-e62e-4b1a-8221-cf0def914796\") " pod="openshift-network-diagnostics/network-check-target-n9zdz" Apr 17 14:26:51.065221 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:51.065182 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bedbded4-1a39-4b5a-b15a-2f9d05548508-metrics-certs\") pod \"network-metrics-daemon-khctm\" (UID: \"bedbded4-1a39-4b5a-b15a-2f9d05548508\") " pod="openshift-multus/network-metrics-daemon-khctm" Apr 17 14:26:51.065440 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:26:51.065318 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Apr 17 14:26:51.065440 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:26:51.065375 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bedbded4-1a39-4b5a-b15a-2f9d05548508-metrics-certs podName:bedbded4-1a39-4b5a-b15a-2f9d05548508 nodeName:}" failed. No retries permitted until 2026-04-17 14:26:53.065355355 +0000 UTC m=+5.109784154 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bedbded4-1a39-4b5a-b15a-2f9d05548508-metrics-certs") pod "network-metrics-daemon-khctm" (UID: "bedbded4-1a39-4b5a-b15a-2f9d05548508") : object "openshift-multus"/"metrics-daemon-secret" not registered Apr 17 14:26:51.065999 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:26:51.065759 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Apr 17 14:26:51.065999 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:26:51.065787 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Apr 17 14:26:51.065999 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:26:51.065800 2573 projected.go:194] Error preparing data for projected volume kube-api-access-76h8j for pod openshift-network-diagnostics/network-check-target-n9zdz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 17 14:26:51.065999 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:26:51.065846 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/928be529-e62e-4b1a-8221-cf0def914796-kube-api-access-76h8j podName:928be529-e62e-4b1a-8221-cf0def914796 nodeName:}" failed. No retries permitted until 2026-04-17 14:26:53.065831297 +0000 UTC m=+5.110260087 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-76h8j" (UniqueName: "kubernetes.io/projected/928be529-e62e-4b1a-8221-cf0def914796-kube-api-access-76h8j") pod "network-check-target-n9zdz" (UID: "928be529-e62e-4b1a-8221-cf0def914796") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 17 14:26:51.492098 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:51.492000 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-04-16 14:21:49 +0000 UTC" deadline="2028-01-02 16:10:24.833131882 +0000 UTC" Apr 17 14:26:51.492098 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:51.492030 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15001h43m33.341105013s" Apr 17 14:26:52.620555 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:52.620494 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khctm" Apr 17 14:26:52.621015 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:26:52.620660 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khctm" podUID="bedbded4-1a39-4b5a-b15a-2f9d05548508" Apr 17 14:26:52.621192 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:52.621170 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9zdz" Apr 17 14:26:52.621286 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:26:52.621253 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9zdz" podUID="928be529-e62e-4b1a-8221-cf0def914796" Apr 17 14:26:53.084091 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:53.084053 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-76h8j\" (UniqueName: \"kubernetes.io/projected/928be529-e62e-4b1a-8221-cf0def914796-kube-api-access-76h8j\") pod \"network-check-target-n9zdz\" (UID: \"928be529-e62e-4b1a-8221-cf0def914796\") " pod="openshift-network-diagnostics/network-check-target-n9zdz" Apr 17 14:26:53.084285 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:53.084128 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bedbded4-1a39-4b5a-b15a-2f9d05548508-metrics-certs\") pod \"network-metrics-daemon-khctm\" (UID: \"bedbded4-1a39-4b5a-b15a-2f9d05548508\") " pod="openshift-multus/network-metrics-daemon-khctm" Apr 17 14:26:53.084285 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:26:53.084233 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Apr 17 14:26:53.084402 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:26:53.084293 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Apr 17 14:26:53.084402 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:26:53.084309 2573 projected.go:194] Error preparing data for projected volume kube-api-access-76h8j for pod openshift-network-diagnostics/network-check-target-n9zdz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 17 14:26:53.084402 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:26:53.084311 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Apr 17 14:26:53.084402 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:26:53.084376 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/928be529-e62e-4b1a-8221-cf0def914796-kube-api-access-76h8j podName:928be529-e62e-4b1a-8221-cf0def914796 nodeName:}" failed. No retries permitted until 2026-04-17 14:26:57.084357271 +0000 UTC m=+9.128786057 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-76h8j" (UniqueName: "kubernetes.io/projected/928be529-e62e-4b1a-8221-cf0def914796-kube-api-access-76h8j") pod "network-check-target-n9zdz" (UID: "928be529-e62e-4b1a-8221-cf0def914796") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 17 14:26:53.084402 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:26:53.084401 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bedbded4-1a39-4b5a-b15a-2f9d05548508-metrics-certs podName:bedbded4-1a39-4b5a-b15a-2f9d05548508 nodeName:}" failed. No retries permitted until 2026-04-17 14:26:57.084389817 +0000 UTC m=+9.128818605 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bedbded4-1a39-4b5a-b15a-2f9d05548508-metrics-certs") pod "network-metrics-daemon-khctm" (UID: "bedbded4-1a39-4b5a-b15a-2f9d05548508") : object "openshift-multus"/"metrics-daemon-secret" not registered Apr 17 14:26:54.619891 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:54.619859 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khctm" Apr 17 14:26:54.620558 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:54.619859 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9zdz" Apr 17 14:26:54.620558 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:26:54.620053 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9zdz" podUID="928be529-e62e-4b1a-8221-cf0def914796" Apr 17 14:26:54.620558 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:26:54.620319 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khctm" podUID="bedbded4-1a39-4b5a-b15a-2f9d05548508" Apr 17 14:26:56.620290 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:56.620250 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9zdz" Apr 17 14:26:56.620748 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:26:56.620376 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9zdz" podUID="928be529-e62e-4b1a-8221-cf0def914796" Apr 17 14:26:56.620748 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:56.620444 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khctm" Apr 17 14:26:56.620748 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:26:56.620558 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khctm" podUID="bedbded4-1a39-4b5a-b15a-2f9d05548508" Apr 17 14:26:57.114422 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:57.113631 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-76h8j\" (UniqueName: \"kubernetes.io/projected/928be529-e62e-4b1a-8221-cf0def914796-kube-api-access-76h8j\") pod \"network-check-target-n9zdz\" (UID: \"928be529-e62e-4b1a-8221-cf0def914796\") " pod="openshift-network-diagnostics/network-check-target-n9zdz" Apr 17 14:26:57.114422 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:57.113698 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bedbded4-1a39-4b5a-b15a-2f9d05548508-metrics-certs\") pod \"network-metrics-daemon-khctm\" (UID: \"bedbded4-1a39-4b5a-b15a-2f9d05548508\") " pod="openshift-multus/network-metrics-daemon-khctm" Apr 17 14:26:57.114422 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:26:57.113837 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Apr 17 14:26:57.114422 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:26:57.113897 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bedbded4-1a39-4b5a-b15a-2f9d05548508-metrics-certs podName:bedbded4-1a39-4b5a-b15a-2f9d05548508 nodeName:}" failed. No retries permitted until 2026-04-17 14:27:05.113878913 +0000 UTC m=+17.158307700 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bedbded4-1a39-4b5a-b15a-2f9d05548508-metrics-certs") pod "network-metrics-daemon-khctm" (UID: "bedbded4-1a39-4b5a-b15a-2f9d05548508") : object "openshift-multus"/"metrics-daemon-secret" not registered Apr 17 14:26:57.114422 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:26:57.114320 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Apr 17 14:26:57.114422 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:26:57.114340 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Apr 17 14:26:57.114422 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:26:57.114352 2573 projected.go:194] Error preparing data for projected volume kube-api-access-76h8j for pod openshift-network-diagnostics/network-check-target-n9zdz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 17 14:26:57.114422 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:26:57.114397 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/928be529-e62e-4b1a-8221-cf0def914796-kube-api-access-76h8j podName:928be529-e62e-4b1a-8221-cf0def914796 nodeName:}" failed. No retries permitted until 2026-04-17 14:27:05.114382635 +0000 UTC m=+17.158811426 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-76h8j" (UniqueName: "kubernetes.io/projected/928be529-e62e-4b1a-8221-cf0def914796-kube-api-access-76h8j") pod "network-check-target-n9zdz" (UID: "928be529-e62e-4b1a-8221-cf0def914796") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 17 14:26:58.620907 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:58.620866 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9zdz" Apr 17 14:26:58.621387 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:26:58.620989 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9zdz" podUID="928be529-e62e-4b1a-8221-cf0def914796" Apr 17 14:26:58.621387 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:26:58.621158 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khctm" Apr 17 14:26:58.621387 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:26:58.621281 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khctm" podUID="bedbded4-1a39-4b5a-b15a-2f9d05548508" Apr 17 14:27:00.620284 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:00.620242 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khctm" Apr 17 14:27:00.620733 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:27:00.620365 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khctm" podUID="bedbded4-1a39-4b5a-b15a-2f9d05548508" Apr 17 14:27:00.620733 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:00.620415 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9zdz" Apr 17 14:27:00.620733 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:27:00.620535 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9zdz" podUID="928be529-e62e-4b1a-8221-cf0def914796" Apr 17 14:27:02.620686 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:02.620650 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khctm" Apr 17 14:27:02.621146 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:02.620695 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9zdz" Apr 17 14:27:02.621146 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:27:02.620793 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khctm" podUID="bedbded4-1a39-4b5a-b15a-2f9d05548508" Apr 17 14:27:02.621146 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:27:02.620899 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9zdz" podUID="928be529-e62e-4b1a-8221-cf0def914796" Apr 17 14:27:04.620352 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:04.620138 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9zdz" Apr 17 14:27:04.620867 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:04.620169 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khctm" Apr 17 14:27:04.620867 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:27:04.620443 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9zdz" podUID="928be529-e62e-4b1a-8221-cf0def914796" Apr 17 14:27:04.620867 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:27:04.620557 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khctm" podUID="bedbded4-1a39-4b5a-b15a-2f9d05548508" Apr 17 14:27:05.168618 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:05.168574 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-76h8j\" (UniqueName: \"kubernetes.io/projected/928be529-e62e-4b1a-8221-cf0def914796-kube-api-access-76h8j\") pod \"network-check-target-n9zdz\" (UID: \"928be529-e62e-4b1a-8221-cf0def914796\") " pod="openshift-network-diagnostics/network-check-target-n9zdz" Apr 17 14:27:05.168829 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:05.168644 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bedbded4-1a39-4b5a-b15a-2f9d05548508-metrics-certs\") pod \"network-metrics-daemon-khctm\" (UID: \"bedbded4-1a39-4b5a-b15a-2f9d05548508\") " pod="openshift-multus/network-metrics-daemon-khctm" Apr 17 14:27:05.168829 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:27:05.168743 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Apr 17 14:27:05.168829 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:27:05.168768 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Apr 17 14:27:05.168829 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:27:05.168781 2573 projected.go:194] Error preparing data for projected volume kube-api-access-76h8j for pod openshift-network-diagnostics/network-check-target-n9zdz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 17 14:27:05.169026 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:27:05.168747 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Apr 17 14:27:05.169026 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:27:05.168840 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/928be529-e62e-4b1a-8221-cf0def914796-kube-api-access-76h8j podName:928be529-e62e-4b1a-8221-cf0def914796 nodeName:}" failed. No retries permitted until 2026-04-17 14:27:21.16882152 +0000 UTC m=+33.213250331 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-76h8j" (UniqueName: "kubernetes.io/projected/928be529-e62e-4b1a-8221-cf0def914796-kube-api-access-76h8j") pod "network-check-target-n9zdz" (UID: "928be529-e62e-4b1a-8221-cf0def914796") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 17 14:27:05.169026 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:27:05.168904 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bedbded4-1a39-4b5a-b15a-2f9d05548508-metrics-certs podName:bedbded4-1a39-4b5a-b15a-2f9d05548508 nodeName:}" failed. No retries permitted until 2026-04-17 14:27:21.168886984 +0000 UTC m=+33.213315771 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bedbded4-1a39-4b5a-b15a-2f9d05548508-metrics-certs") pod "network-metrics-daemon-khctm" (UID: "bedbded4-1a39-4b5a-b15a-2f9d05548508") : object "openshift-multus"/"metrics-daemon-secret" not registered Apr 17 14:27:06.620702 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:06.620648 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9zdz" Apr 17 14:27:06.621177 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:27:06.620782 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9zdz" podUID="928be529-e62e-4b1a-8221-cf0def914796" Apr 17 14:27:06.621177 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:06.620835 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khctm" Apr 17 14:27:06.621177 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:27:06.620947 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khctm" podUID="bedbded4-1a39-4b5a-b15a-2f9d05548508" Apr 17 14:27:08.620905 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:08.620554 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9zdz" Apr 17 14:27:08.621550 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:08.620627 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khctm" Apr 17 14:27:08.621550 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:27:08.620994 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9zdz" podUID="928be529-e62e-4b1a-8221-cf0def914796" Apr 17 14:27:08.621550 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:27:08.621047 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khctm" podUID="bedbded4-1a39-4b5a-b15a-2f9d05548508" Apr 17 14:27:08.737127 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:08.737100 2573 generic.go:358] "Generic (PLEG): container finished" podID="1d47c42e-517c-405b-99a5-30609ea3d21d" containerID="850675daedf307e0237f953623c67d4b8a37a6ca2767088278035275d9993e6d" exitCode=0 Apr 17 14:27:08.737237 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:08.737161 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dh4qj" event={"ID":"1d47c42e-517c-405b-99a5-30609ea3d21d","Type":"ContainerDied","Data":"850675daedf307e0237f953623c67d4b8a37a6ca2767088278035275d9993e6d"} Apr 17 14:27:08.738417 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:08.738390 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sj9xp" event={"ID":"7c85ebb8-909c-4ad2-affb-b7280f1cce30","Type":"ContainerStarted","Data":"dc3513a794fa62ec44dc67a5cd803441e1c66f83050bed56bb23b9bfb25d1506"} Apr 17 14:27:08.739716 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:08.739687 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-47.ec2.internal" event={"ID":"8b712f12e316b1a6ded9d349ca82d37a","Type":"ContainerStarted","Data":"d1ad1d3f81f7b8ae0f3505d45aae42e68ef4821b18d7c1846cf8663fee7f1378"} Apr 17 14:27:08.740932 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:08.740914 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xjs2v" event={"ID":"733d18e1-1920-4e3c-83c4-b476253e1f4d","Type":"ContainerStarted","Data":"581c0b9ba4be88480db78e45bb6893edc34729c74b8eef9dd4f058faf1ba5f32"} Apr 17 14:27:08.742172 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:08.742149 2573 generic.go:358] "Generic (PLEG): container finished" podID="438108d93a37ab59c6a0c9e57eee327c" containerID="e5a19e16e8ec1693382b2305dda1fba4fdb53f63dbc02fcc75959cd2db90cfd8" exitCode=0 Apr 17 14:27:08.742265 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:08.742220 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-47.ec2.internal" event={"ID":"438108d93a37ab59c6a0c9e57eee327c","Type":"ContainerDied","Data":"e5a19e16e8ec1693382b2305dda1fba4fdb53f63dbc02fcc75959cd2db90cfd8"} Apr 17 14:27:08.743857 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:08.743836 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-j95gf" event={"ID":"01db874f-c326-48bc-8c33-eeab64d1bf17","Type":"ContainerStarted","Data":"44bbdde9f968bb5e7502f60522e7bd827ae3c2b0169a11a684604d5f9cd992bd"} Apr 17 14:27:08.745001 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:08.744967 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wfhf5" event={"ID":"a44848f6-e8dc-4204-9db4-a4c4ca9cffdd","Type":"ContainerStarted","Data":"b635ee08f32eadde2c7841c4bf1cb6d01ffa1f88fbac94367ca43fd10bfbb977"} Apr 17 14:27:08.746013 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:08.745997 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pqwhd" event={"ID":"ab4fc13b-36d4-4f8b-9f8a-52c2424a807d","Type":"ContainerStarted","Data":"0040e49fe5a9e84aee1809b7825484db65775e8b4719b536d1e347cc16f03e74"} Apr 17 14:27:08.747176 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:08.747157 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss8x7" event={"ID":"e3b540b1-5c0c-463a-8b61-9e636cd837c1","Type":"ContainerStarted","Data":"b76ee963acface2adc52ade4987abcdf25b75d32643ae4e09ea7a76531ed8fd4"} Apr 17 14:27:08.749257 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:08.749242 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t4wf8_826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52/ovn-acl-logging/0.log" Apr 17 14:27:08.749523 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:08.749505 2573 generic.go:358] "Generic (PLEG): container finished" podID="826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52" containerID="78912284312aea344512c4c64c209a6e9df26d528c2e18793647165bf45c080b" exitCode=1 Apr 17 14:27:08.749573 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:08.749532 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" event={"ID":"826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52","Type":"ContainerStarted","Data":"b45002efef478c853372067f399667027d9bc1e893ff0175741a822f50d44cd9"} Apr 17 14:27:08.749573 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:08.749545 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" event={"ID":"826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52","Type":"ContainerStarted","Data":"7a973c708f1c8bbae45c4fe268da7c27aaad2129164fd42b7af106d85fa13438"} Apr 17 14:27:08.749573 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:08.749553 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" event={"ID":"826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52","Type":"ContainerStarted","Data":"e0b33e0b6c3598a5d52c2dcd317a8c9a7ea88639033db0dff864b274e49ca3ca"} Apr 17 14:27:08.749573 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:08.749561 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" event={"ID":"826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52","Type":"ContainerStarted","Data":"0006035f1564f374a84ff2a87fc9054a40fd58835338fcb7fc00ef2c93022032"} Apr 17 14:27:08.749573 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:08.749571 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" event={"ID":"826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52","Type":"ContainerDied","Data":"78912284312aea344512c4c64c209a6e9df26d528c2e18793647165bf45c080b"} Apr 17 14:27:08.749732 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:08.749579 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" event={"ID":"826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52","Type":"ContainerStarted","Data":"9b0058c1af23aeed75e00cc85e687534150991c01ba2aa970e25afbe0dca8edd"} Apr 17 14:27:08.782547 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:08.782503 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-pqwhd" podStartSLOduration=2.835918729 podStartE2EDuration="20.782490063s" podCreationTimestamp="2026-04-17 14:26:48 +0000 UTC" firstStartedPulling="2026-04-17 14:26:49.585854189 +0000 UTC m=+1.630282975" lastFinishedPulling="2026-04-17 14:27:07.53242551 +0000 UTC m=+19.576854309" observedRunningTime="2026-04-17 14:27:08.770288366 +0000 UTC m=+20.814717196" watchObservedRunningTime="2026-04-17 14:27:08.782490063 +0000 UTC m=+20.826918871" Apr 17 14:27:08.796760 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:08.796717 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-47.ec2.internal" podStartSLOduration=20.796702721 podStartE2EDuration="20.796702721s" podCreationTimestamp="2026-04-17 14:26:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-17 14:27:08.782631816 +0000 UTC m=+20.827060605" watchObservedRunningTime="2026-04-17 14:27:08.796702721 +0000 UTC m=+20.841131529" Apr 17 14:27:08.810113 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:08.810070 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xjs2v" podStartSLOduration=2.794900007 podStartE2EDuration="20.810060637s" podCreationTimestamp="2026-04-17 14:26:48 +0000 UTC" firstStartedPulling="2026-04-17 14:26:49.568784025 +0000 UTC m=+1.613212816" lastFinishedPulling="2026-04-17 14:27:07.583944647 +0000 UTC m=+19.628373446" observedRunningTime="2026-04-17 14:27:08.809329784 +0000 UTC m=+20.853758592" watchObservedRunningTime="2026-04-17 14:27:08.810060637 +0000 UTC m=+20.854489444" Apr 17 14:27:08.822488 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:08.822454 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wfhf5" podStartSLOduration=2.8299804440000003 podStartE2EDuration="20.822442418s" podCreationTimestamp="2026-04-17 14:26:48 +0000 UTC" firstStartedPulling="2026-04-17 14:26:49.591862914 +0000 UTC m=+1.636291713" lastFinishedPulling="2026-04-17 14:27:07.584324889 +0000 UTC m=+19.628753687" observedRunningTime="2026-04-17 14:27:08.822149165 +0000 UTC m=+20.866577974" watchObservedRunningTime="2026-04-17 14:27:08.822442418 +0000 UTC m=+20.866871228" Apr 17 14:27:08.837730 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:08.837693 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-j95gf" podStartSLOduration=2.994777465 podStartE2EDuration="20.837680308s" podCreationTimestamp="2026-04-17 14:26:48 +0000 UTC" firstStartedPulling="2026-04-17 14:26:49.776382694 +0000 UTC m=+1.820811480" lastFinishedPulling="2026-04-17 14:27:07.619285535 +0000 UTC m=+19.663714323" observedRunningTime="2026-04-17 14:27:08.837641222 +0000 UTC m=+20.882070030" watchObservedRunningTime="2026-04-17 14:27:08.837680308 +0000 UTC m=+20.882109116" Apr 17 14:27:08.854476 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:08.854442 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-sj9xp" podStartSLOduration=3.060179696 podStartE2EDuration="20.854428686s" podCreationTimestamp="2026-04-17 14:26:48 +0000 UTC" firstStartedPulling="2026-04-17 14:26:49.791677577 +0000 UTC m=+1.836106362" lastFinishedPulling="2026-04-17 14:27:07.585926553 +0000 UTC m=+19.630355352" observedRunningTime="2026-04-17 14:27:08.853970442 +0000 UTC m=+20.898416641" watchObservedRunningTime="2026-04-17 14:27:08.854428686 +0000 UTC m=+20.898857497" Apr 17 14:27:09.333012 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:09.332952 2573 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Apr 17 14:27:09.506802 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:09.506711 2573 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-04-17T14:27:09.332969891Z","UUID":"aad5393d-656e-491b-bb75-0b547fc7ab57","Handler":null,"Name":"","Endpoint":""} Apr 17 14:27:09.509417 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:09.509394 2573 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Apr 17 14:27:09.509529 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:09.509426 2573 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Apr 17 14:27:09.753371 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:09.753337 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-47.ec2.internal" event={"ID":"438108d93a37ab59c6a0c9e57eee327c","Type":"ContainerStarted","Data":"908d4ff8daf112155bfbd6fde0f7f5d2137c9912e6202b7b03257f22e85021e2"} Apr 17 14:27:09.755159 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:09.755128 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss8x7" event={"ID":"e3b540b1-5c0c-463a-8b61-9e636cd837c1","Type":"ContainerStarted","Data":"cbe06f6d94f76b812fb20c342b1e589f35eebff9fc683b88316f16ee692b7328"} Apr 17 14:27:09.756489 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:09.756458 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2jvxm" event={"ID":"574ada25-3a36-4d49-be15-436687239f1a","Type":"ContainerStarted","Data":"7d33fe888748691b26009eba5d82ac803fbb7940ebb82916953126b8e851f327"} Apr 17 14:27:09.767736 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:09.767687 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-47.ec2.internal" podStartSLOduration=21.767671553 podStartE2EDuration="21.767671553s" podCreationTimestamp="2026-04-17 14:26:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-17 14:27:09.767593929 +0000 UTC m=+21.812022736" watchObservedRunningTime="2026-04-17 14:27:09.767671553 +0000 UTC m=+21.812100361" Apr 17 14:27:09.780339 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:09.780304 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-2jvxm" podStartSLOduration=4.01585883 podStartE2EDuration="21.780296061s" podCreationTimestamp="2026-04-17 14:26:48 +0000 UTC" firstStartedPulling="2026-04-17 14:26:49.819509799 +0000 UTC m=+1.863938587" lastFinishedPulling="2026-04-17 14:27:07.583947031 +0000 UTC m=+19.628375818" observedRunningTime="2026-04-17 14:27:09.78004473 +0000 UTC m=+21.824473537" watchObservedRunningTime="2026-04-17 14:27:09.780296061 +0000 UTC m=+21.824724868" Apr 17 14:27:10.620767 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:10.620731 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khctm" Apr 17 14:27:10.620767 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:10.620749 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9zdz" Apr 17 14:27:10.621051 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:27:10.620865 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khctm" podUID="bedbded4-1a39-4b5a-b15a-2f9d05548508" Apr 17 14:27:10.621051 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:27:10.620991 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9zdz" podUID="928be529-e62e-4b1a-8221-cf0def914796" Apr 17 14:27:10.760409 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:10.760374 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss8x7" event={"ID":"e3b540b1-5c0c-463a-8b61-9e636cd837c1","Type":"ContainerStarted","Data":"6e29c13f7cda4ee1e78743756a68e4b3c777c2f86aeb1621c2746f45cafadb6b"} Apr 17 14:27:10.763410 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:10.763389 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t4wf8_826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52/ovn-acl-logging/0.log" Apr 17 14:27:10.763817 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:10.763770 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" event={"ID":"826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52","Type":"ContainerStarted","Data":"a8ab69caf08c38cb9bfeae8b62ef3b1d39a09c10c436e5b5d8f6dcac2154a4d5"} Apr 17 14:27:12.457057 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:12.457022 2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xjs2v" Apr 17 14:27:12.457693 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:12.457673 2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xjs2v" Apr 17 14:27:12.471830 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:12.471786 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss8x7" podStartSLOduration=3.864691081 podStartE2EDuration="24.471772919s" podCreationTimestamp="2026-04-17 14:26:48 +0000 UTC" firstStartedPulling="2026-04-17 14:26:49.581254981 +0000 UTC m=+1.625683765" lastFinishedPulling="2026-04-17 14:27:10.188336815 +0000 UTC m=+22.232765603" observedRunningTime="2026-04-17 14:27:10.776235879 +0000 UTC m=+22.820664685" watchObservedRunningTime="2026-04-17 14:27:12.471772919 +0000 UTC m=+24.516201727" Apr 17 14:27:12.620823 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:12.620754 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khctm" Apr 17 14:27:12.620999 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:12.620755 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9zdz" Apr 17 14:27:12.620999 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:27:12.620894 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khctm" podUID="bedbded4-1a39-4b5a-b15a-2f9d05548508" Apr 17 14:27:12.621116 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:27:12.621009 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9zdz" podUID="928be529-e62e-4b1a-8221-cf0def914796" Apr 17 14:27:12.768254 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:12.768220 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xjs2v" Apr 17 14:27:12.768877 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:12.768857 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xjs2v" Apr 17 14:27:13.771870 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:13.771709 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t4wf8_826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52/ovn-acl-logging/0.log" Apr 17 14:27:13.772688 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:13.772213 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" event={"ID":"826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52","Type":"ContainerStarted","Data":"0ecac3b8dd6f99b50f2c64a4419cac304fc287df092ca4c6b07200c06e0bee40"} Apr 17 14:27:13.772688 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:13.772486 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" Apr 17 14:27:13.772688 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:13.772509 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" Apr 17 14:27:13.772688 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:13.772662 2573 scope.go:117] "RemoveContainer" containerID="78912284312aea344512c4c64c209a6e9df26d528c2e18793647165bf45c080b" Apr 17 14:27:13.774069 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:13.774046 2573 generic.go:358] "Generic (PLEG): container finished" podID="1d47c42e-517c-405b-99a5-30609ea3d21d" containerID="079974a5909c90abf844bd1b48544e1aec2e27be4a405fd33159691543c4a5d5" exitCode=0 Apr 17 14:27:13.774177 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:13.774124 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dh4qj" event={"ID":"1d47c42e-517c-405b-99a5-30609ea3d21d","Type":"ContainerDied","Data":"079974a5909c90abf844bd1b48544e1aec2e27be4a405fd33159691543c4a5d5"} Apr 17 14:27:13.787650 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:13.787631 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" Apr 17 14:27:14.620880 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:14.620676 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9zdz" Apr 17 14:27:14.621049 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:14.620691 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khctm" Apr 17 14:27:14.621049 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:27:14.620970 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9zdz" podUID="928be529-e62e-4b1a-8221-cf0def914796" Apr 17 14:27:14.621151 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:27:14.621047 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khctm" podUID="bedbded4-1a39-4b5a-b15a-2f9d05548508" Apr 17 14:27:14.779555 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:14.779531 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t4wf8_826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52/ovn-acl-logging/0.log" Apr 17 14:27:14.779925 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:14.779902 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" event={"ID":"826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52","Type":"ContainerStarted","Data":"9703e6b3907955eb7d4349009de31d66253ee7f1e9613715727442981a2bd6e7"} Apr 17 14:27:14.780465 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:14.780380 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" Apr 17 14:27:14.782033 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:14.782008 2573 generic.go:358] "Generic (PLEG): container finished" podID="1d47c42e-517c-405b-99a5-30609ea3d21d" containerID="71ff0a592466d0b8d1687ae6d64b8e9d46c3706af5e3e26d99fabb5957dfde07" exitCode=0 Apr 17 14:27:14.782139 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:14.782108 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dh4qj" event={"ID":"1d47c42e-517c-405b-99a5-30609ea3d21d","Type":"ContainerDied","Data":"71ff0a592466d0b8d1687ae6d64b8e9d46c3706af5e3e26d99fabb5957dfde07"} Apr 17 14:27:14.794376 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:14.794355 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" Apr 17 14:27:14.804808 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:14.804773 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" podStartSLOduration=8.905065667 podStartE2EDuration="26.804762383s" podCreationTimestamp="2026-04-17 14:26:48 +0000 UTC" firstStartedPulling="2026-04-17 14:26:49.825489152 +0000 UTC m=+1.869917941" lastFinishedPulling="2026-04-17 14:27:07.725185858 +0000 UTC m=+19.769614657" observedRunningTime="2026-04-17 14:27:14.803351912 +0000 UTC m=+26.847780718" watchObservedRunningTime="2026-04-17 14:27:14.804762383 +0000 UTC m=+26.849191189" Apr 17 14:27:14.976672 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:14.976638 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-n9zdz"] Apr 17 14:27:14.976804 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:14.976733 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9zdz" Apr 17 14:27:14.976838 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:27:14.976808 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9zdz" podUID="928be529-e62e-4b1a-8221-cf0def914796" Apr 17 14:27:14.979593 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:14.979573 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-khctm"] Apr 17 14:27:14.979687 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:14.979636 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khctm" Apr 17 14:27:14.979726 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:27:14.979702 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khctm" podUID="bedbded4-1a39-4b5a-b15a-2f9d05548508" Apr 17 14:27:15.786029 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:15.786000 2573 generic.go:358] "Generic (PLEG): container finished" podID="1d47c42e-517c-405b-99a5-30609ea3d21d" containerID="4e2d1740504696f2dc89830914c1e38d6706f0c309ed5e3ebe296283330198e6" exitCode=0 Apr 17 14:27:15.786441 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:15.786070 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dh4qj" event={"ID":"1d47c42e-517c-405b-99a5-30609ea3d21d","Type":"ContainerDied","Data":"4e2d1740504696f2dc89830914c1e38d6706f0c309ed5e3ebe296283330198e6"} Apr 17 14:27:16.620250 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:16.620220 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khctm" Apr 17 14:27:16.620412 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:16.620221 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9zdz" Apr 17 14:27:16.620412 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:27:16.620363 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khctm" podUID="bedbded4-1a39-4b5a-b15a-2f9d05548508" Apr 17 14:27:16.620532 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:27:16.620444 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9zdz" podUID="928be529-e62e-4b1a-8221-cf0def914796" Apr 17 14:27:18.621387 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:18.621353 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9zdz" Apr 17 14:27:18.621844 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:27:18.621460 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9zdz" podUID="928be529-e62e-4b1a-8221-cf0def914796" Apr 17 14:27:18.621844 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:18.621518 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khctm" Apr 17 14:27:18.621844 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:27:18.621625 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khctm" podUID="bedbded4-1a39-4b5a-b15a-2f9d05548508" Apr 17 14:27:20.620240 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:20.620000 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9zdz" Apr 17 14:27:20.620664 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:20.620055 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khctm" Apr 17 14:27:20.620664 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:27:20.620276 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9zdz" podUID="928be529-e62e-4b1a-8221-cf0def914796" Apr 17 14:27:20.620664 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:27:20.620404 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khctm" podUID="bedbded4-1a39-4b5a-b15a-2f9d05548508" Apr 17 14:27:20.819881 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:20.819847 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-47.ec2.internal" event="NodeReady" Apr 17 14:27:20.820068 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:20.820015 2573 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Apr 17 14:27:20.864127 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:20.864097 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-zrllc"] Apr 17 14:27:20.893728 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:20.893661 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-fwpd5"] Apr 17 14:27:20.893847 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:20.893769 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zrllc" Apr 17 14:27:20.895830 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:20.895806 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Apr 17 14:27:20.895949 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:20.895922 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Apr 17 14:27:20.896080 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:20.896061 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-p2qzh\"" Apr 17 14:27:20.914453 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:20.914434 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fwpd5"] Apr 17 14:27:20.914453 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:20.914454 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zrllc"] Apr 17 14:27:20.914605 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:20.914542 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fwpd5" Apr 17 14:27:20.916806 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:20.916781 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Apr 17 14:27:20.916925 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:20.916828 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Apr 17 14:27:20.916925 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:20.916845 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-qz9tk\"" Apr 17 14:27:20.917049 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:20.916937 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Apr 17 14:27:20.985013 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:20.984967 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/75b3dec2-6f28-4d4d-ae26-d694cb6e25de-metrics-tls\") pod \"dns-default-zrllc\" (UID: \"75b3dec2-6f28-4d4d-ae26-d694cb6e25de\") " pod="openshift-dns/dns-default-zrllc" Apr 17 14:27:20.985196 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:20.985043 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7vvf\" (UniqueName: \"kubernetes.io/projected/75b3dec2-6f28-4d4d-ae26-d694cb6e25de-kube-api-access-h7vvf\") pod \"dns-default-zrllc\" (UID: \"75b3dec2-6f28-4d4d-ae26-d694cb6e25de\") " pod="openshift-dns/dns-default-zrllc" Apr 17 14:27:20.985196 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:20.985069 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3c4b5228-3ecd-4956-b222-fa218091ebaf-cert\") pod \"ingress-canary-fwpd5\" (UID: \"3c4b5228-3ecd-4956-b222-fa218091ebaf\") " pod="openshift-ingress-canary/ingress-canary-fwpd5" Apr 17 14:27:20.985196 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:20.985114 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/75b3dec2-6f28-4d4d-ae26-d694cb6e25de-config-volume\") pod \"dns-default-zrllc\" (UID: \"75b3dec2-6f28-4d4d-ae26-d694cb6e25de\") " pod="openshift-dns/dns-default-zrllc" Apr 17 14:27:20.985335 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:20.985205 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75b3dec2-6f28-4d4d-ae26-d694cb6e25de-tmp-dir\") pod \"dns-default-zrllc\" (UID: \"75b3dec2-6f28-4d4d-ae26-d694cb6e25de\") " pod="openshift-dns/dns-default-zrllc" Apr 17 14:27:20.985335 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:20.985231 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdxr7\" (UniqueName: \"kubernetes.io/projected/3c4b5228-3ecd-4956-b222-fa218091ebaf-kube-api-access-tdxr7\") pod \"ingress-canary-fwpd5\" (UID: \"3c4b5228-3ecd-4956-b222-fa218091ebaf\") " pod="openshift-ingress-canary/ingress-canary-fwpd5" Apr 17 14:27:21.086528 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:21.086493 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/75b3dec2-6f28-4d4d-ae26-d694cb6e25de-config-volume\") pod \"dns-default-zrllc\" (UID: \"75b3dec2-6f28-4d4d-ae26-d694cb6e25de\") " pod="openshift-dns/dns-default-zrllc" Apr 17 14:27:21.086677 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:21.086553 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75b3dec2-6f28-4d4d-ae26-d694cb6e25de-tmp-dir\") pod \"dns-default-zrllc\" (UID: \"75b3dec2-6f28-4d4d-ae26-d694cb6e25de\") " pod="openshift-dns/dns-default-zrllc" Apr 17 14:27:21.086741 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:21.086670 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tdxr7\" (UniqueName: \"kubernetes.io/projected/3c4b5228-3ecd-4956-b222-fa218091ebaf-kube-api-access-tdxr7\") pod \"ingress-canary-fwpd5\" (UID: \"3c4b5228-3ecd-4956-b222-fa218091ebaf\") " pod="openshift-ingress-canary/ingress-canary-fwpd5" Apr 17 14:27:21.086741 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:21.086721 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/75b3dec2-6f28-4d4d-ae26-d694cb6e25de-metrics-tls\") pod \"dns-default-zrllc\" (UID: \"75b3dec2-6f28-4d4d-ae26-d694cb6e25de\") " pod="openshift-dns/dns-default-zrllc" Apr 17 14:27:21.086844 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:21.086767 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h7vvf\" (UniqueName: \"kubernetes.io/projected/75b3dec2-6f28-4d4d-ae26-d694cb6e25de-kube-api-access-h7vvf\") pod \"dns-default-zrllc\" (UID: \"75b3dec2-6f28-4d4d-ae26-d694cb6e25de\") " pod="openshift-dns/dns-default-zrllc" Apr 17 14:27:21.086844 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:21.086794 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3c4b5228-3ecd-4956-b222-fa218091ebaf-cert\") pod \"ingress-canary-fwpd5\" (UID: \"3c4b5228-3ecd-4956-b222-fa218091ebaf\") " pod="openshift-ingress-canary/ingress-canary-fwpd5" Apr 17 14:27:21.086937 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:27:21.086897 2573 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Apr 17 14:27:21.086937 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:27:21.086902 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Apr 17 14:27:21.087062 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:27:21.086957 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c4b5228-3ecd-4956-b222-fa218091ebaf-cert podName:3c4b5228-3ecd-4956-b222-fa218091ebaf nodeName:}" failed. No retries permitted until 2026-04-17 14:27:21.586936981 +0000 UTC m=+33.631365787 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3c4b5228-3ecd-4956-b222-fa218091ebaf-cert") pod "ingress-canary-fwpd5" (UID: "3c4b5228-3ecd-4956-b222-fa218091ebaf") : secret "canary-serving-cert" not found Apr 17 14:27:21.087062 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:27:21.087001 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75b3dec2-6f28-4d4d-ae26-d694cb6e25de-metrics-tls podName:75b3dec2-6f28-4d4d-ae26-d694cb6e25de nodeName:}" failed. No retries permitted until 2026-04-17 14:27:21.58696545 +0000 UTC m=+33.631394241 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/75b3dec2-6f28-4d4d-ae26-d694cb6e25de-metrics-tls") pod "dns-default-zrllc" (UID: "75b3dec2-6f28-4d4d-ae26-d694cb6e25de") : secret "dns-default-metrics-tls" not found Apr 17 14:27:21.087176 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:21.087158 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75b3dec2-6f28-4d4d-ae26-d694cb6e25de-tmp-dir\") pod \"dns-default-zrllc\" (UID: \"75b3dec2-6f28-4d4d-ae26-d694cb6e25de\") " pod="openshift-dns/dns-default-zrllc" Apr 17 14:27:21.087365 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:21.087345 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/75b3dec2-6f28-4d4d-ae26-d694cb6e25de-config-volume\") pod \"dns-default-zrllc\" (UID: \"75b3dec2-6f28-4d4d-ae26-d694cb6e25de\") " pod="openshift-dns/dns-default-zrllc" Apr 17 14:27:21.097173 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:21.097147 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7vvf\" (UniqueName: \"kubernetes.io/projected/75b3dec2-6f28-4d4d-ae26-d694cb6e25de-kube-api-access-h7vvf\") pod \"dns-default-zrllc\" (UID: \"75b3dec2-6f28-4d4d-ae26-d694cb6e25de\") " pod="openshift-dns/dns-default-zrllc" Apr 17 14:27:21.097318 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:21.097298 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdxr7\" (UniqueName: \"kubernetes.io/projected/3c4b5228-3ecd-4956-b222-fa218091ebaf-kube-api-access-tdxr7\") pod \"ingress-canary-fwpd5\" (UID: \"3c4b5228-3ecd-4956-b222-fa218091ebaf\") " pod="openshift-ingress-canary/ingress-canary-fwpd5" Apr 17 14:27:21.187321 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:21.187238 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-76h8j\" (UniqueName: \"kubernetes.io/projected/928be529-e62e-4b1a-8221-cf0def914796-kube-api-access-76h8j\") pod \"network-check-target-n9zdz\" (UID: \"928be529-e62e-4b1a-8221-cf0def914796\") " pod="openshift-network-diagnostics/network-check-target-n9zdz" Apr 17 14:27:21.187321 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:21.187311 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bedbded4-1a39-4b5a-b15a-2f9d05548508-metrics-certs\") pod \"network-metrics-daemon-khctm\" (UID: \"bedbded4-1a39-4b5a-b15a-2f9d05548508\") " pod="openshift-multus/network-metrics-daemon-khctm" Apr 17 14:27:21.187535 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:27:21.187420 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Apr 17 14:27:21.187535 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:27:21.187445 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Apr 17 14:27:21.187535 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:27:21.187450 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Apr 17 14:27:21.187535 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:27:21.187460 2573 projected.go:194] Error preparing data for projected volume kube-api-access-76h8j for pod openshift-network-diagnostics/network-check-target-n9zdz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 17 14:27:21.187535 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:27:21.187522 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bedbded4-1a39-4b5a-b15a-2f9d05548508-metrics-certs podName:bedbded4-1a39-4b5a-b15a-2f9d05548508 nodeName:}" failed. No retries permitted until 2026-04-17 14:27:53.187502337 +0000 UTC m=+65.231931141 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bedbded4-1a39-4b5a-b15a-2f9d05548508-metrics-certs") pod "network-metrics-daemon-khctm" (UID: "bedbded4-1a39-4b5a-b15a-2f9d05548508") : object "openshift-multus"/"metrics-daemon-secret" not registered Apr 17 14:27:21.187742 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:27:21.187547 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/928be529-e62e-4b1a-8221-cf0def914796-kube-api-access-76h8j podName:928be529-e62e-4b1a-8221-cf0def914796 nodeName:}" failed. No retries permitted until 2026-04-17 14:27:53.187534138 +0000 UTC m=+65.231962944 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-76h8j" (UniqueName: "kubernetes.io/projected/928be529-e62e-4b1a-8221-cf0def914796-kube-api-access-76h8j") pod "network-check-target-n9zdz" (UID: "928be529-e62e-4b1a-8221-cf0def914796") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 17 14:27:21.590307 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:21.590273 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/75b3dec2-6f28-4d4d-ae26-d694cb6e25de-metrics-tls\") pod \"dns-default-zrllc\" (UID: \"75b3dec2-6f28-4d4d-ae26-d694cb6e25de\") " pod="openshift-dns/dns-default-zrllc" Apr 17 14:27:21.590572 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:21.590326 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3c4b5228-3ecd-4956-b222-fa218091ebaf-cert\") pod \"ingress-canary-fwpd5\" (UID: \"3c4b5228-3ecd-4956-b222-fa218091ebaf\") " pod="openshift-ingress-canary/ingress-canary-fwpd5" Apr 17 14:27:21.590572 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:27:21.590435 2573 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Apr 17 14:27:21.590572 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:27:21.590436 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Apr 17 14:27:21.590572 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:27:21.590545 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c4b5228-3ecd-4956-b222-fa218091ebaf-cert podName:3c4b5228-3ecd-4956-b222-fa218091ebaf nodeName:}" failed. No retries permitted until 2026-04-17 14:27:22.590525706 +0000 UTC m=+34.634954491 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3c4b5228-3ecd-4956-b222-fa218091ebaf-cert") pod "ingress-canary-fwpd5" (UID: "3c4b5228-3ecd-4956-b222-fa218091ebaf") : secret "canary-serving-cert" not found Apr 17 14:27:21.590572 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:27:21.590566 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75b3dec2-6f28-4d4d-ae26-d694cb6e25de-metrics-tls podName:75b3dec2-6f28-4d4d-ae26-d694cb6e25de nodeName:}" failed. No retries permitted until 2026-04-17 14:27:22.590552153 +0000 UTC m=+34.634980938 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/75b3dec2-6f28-4d4d-ae26-d694cb6e25de-metrics-tls") pod "dns-default-zrllc" (UID: "75b3dec2-6f28-4d4d-ae26-d694cb6e25de") : secret "dns-default-metrics-tls" not found Apr 17 14:27:22.596847 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:22.596770 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/75b3dec2-6f28-4d4d-ae26-d694cb6e25de-metrics-tls\") pod \"dns-default-zrllc\" (UID: \"75b3dec2-6f28-4d4d-ae26-d694cb6e25de\") " pod="openshift-dns/dns-default-zrllc" Apr 17 14:27:22.596847 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:22.596812 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3c4b5228-3ecd-4956-b222-fa218091ebaf-cert\") pod \"ingress-canary-fwpd5\" (UID: \"3c4b5228-3ecd-4956-b222-fa218091ebaf\") " pod="openshift-ingress-canary/ingress-canary-fwpd5" Apr 17 14:27:22.597394 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:27:22.596918 2573 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Apr 17 14:27:22.597394 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:27:22.596986 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c4b5228-3ecd-4956-b222-fa218091ebaf-cert podName:3c4b5228-3ecd-4956-b222-fa218091ebaf nodeName:}" failed. No retries permitted until 2026-04-17 14:27:24.596958098 +0000 UTC m=+36.641386883 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3c4b5228-3ecd-4956-b222-fa218091ebaf-cert") pod "ingress-canary-fwpd5" (UID: "3c4b5228-3ecd-4956-b222-fa218091ebaf") : secret "canary-serving-cert" not found Apr 17 14:27:22.597394 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:27:22.596918 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Apr 17 14:27:22.597394 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:27:22.597051 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75b3dec2-6f28-4d4d-ae26-d694cb6e25de-metrics-tls podName:75b3dec2-6f28-4d4d-ae26-d694cb6e25de nodeName:}" failed. No retries permitted until 2026-04-17 14:27:24.597038981 +0000 UTC m=+36.641467770 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/75b3dec2-6f28-4d4d-ae26-d694cb6e25de-metrics-tls") pod "dns-default-zrllc" (UID: "75b3dec2-6f28-4d4d-ae26-d694cb6e25de") : secret "dns-default-metrics-tls" not found Apr 17 14:27:22.623380 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:22.623351 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khctm" Apr 17 14:27:22.623516 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:22.623351 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9zdz" Apr 17 14:27:22.625962 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:22.625925 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Apr 17 14:27:22.626085 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:22.625967 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Apr 17 14:27:22.626892 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:22.626871 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lqr8w\"" Apr 17 14:27:22.626892 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:22.626875 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-w222h\"" Apr 17 14:27:22.627057 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:22.626923 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Apr 17 14:27:22.799104 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:22.799077 2573 generic.go:358] "Generic (PLEG): container finished" podID="1d47c42e-517c-405b-99a5-30609ea3d21d" containerID="1f9d6b550093870fba02a6f41d1e0ca75dc0489af2db148069fd51d97a5dc836" exitCode=0 Apr 17 14:27:22.799214 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:22.799121 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dh4qj" event={"ID":"1d47c42e-517c-405b-99a5-30609ea3d21d","Type":"ContainerDied","Data":"1f9d6b550093870fba02a6f41d1e0ca75dc0489af2db148069fd51d97a5dc836"} Apr 17 14:27:23.803480 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:23.803446 2573 generic.go:358] "Generic (PLEG): container finished" podID="1d47c42e-517c-405b-99a5-30609ea3d21d" containerID="15d4268f3ec1e37450e1bc2d4abe70a381cbd9be8992ae19fe42633781d041fb" exitCode=0 Apr 17 14:27:23.803874 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:23.803496 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dh4qj" event={"ID":"1d47c42e-517c-405b-99a5-30609ea3d21d","Type":"ContainerDied","Data":"15d4268f3ec1e37450e1bc2d4abe70a381cbd9be8992ae19fe42633781d041fb"} Apr 17 14:27:24.610048 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:24.610018 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3c4b5228-3ecd-4956-b222-fa218091ebaf-cert\") pod \"ingress-canary-fwpd5\" (UID: \"3c4b5228-3ecd-4956-b222-fa218091ebaf\") " pod="openshift-ingress-canary/ingress-canary-fwpd5" Apr 17 14:27:24.610201 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:24.610098 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/75b3dec2-6f28-4d4d-ae26-d694cb6e25de-metrics-tls\") pod \"dns-default-zrllc\" (UID: \"75b3dec2-6f28-4d4d-ae26-d694cb6e25de\") " pod="openshift-dns/dns-default-zrllc" Apr 17 14:27:24.610201 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:27:24.610183 2573 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Apr 17 14:27:24.610270 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:27:24.610245 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c4b5228-3ecd-4956-b222-fa218091ebaf-cert podName:3c4b5228-3ecd-4956-b222-fa218091ebaf nodeName:}" failed. No retries permitted until 2026-04-17 14:27:28.610230808 +0000 UTC m=+40.654659607 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3c4b5228-3ecd-4956-b222-fa218091ebaf-cert") pod "ingress-canary-fwpd5" (UID: "3c4b5228-3ecd-4956-b222-fa218091ebaf") : secret "canary-serving-cert" not found Apr 17 14:27:24.610316 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:27:24.610183 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Apr 17 14:27:24.610316 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:27:24.610310 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75b3dec2-6f28-4d4d-ae26-d694cb6e25de-metrics-tls podName:75b3dec2-6f28-4d4d-ae26-d694cb6e25de nodeName:}" failed. No retries permitted until 2026-04-17 14:27:28.610298623 +0000 UTC m=+40.654727408 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/75b3dec2-6f28-4d4d-ae26-d694cb6e25de-metrics-tls") pod "dns-default-zrllc" (UID: "75b3dec2-6f28-4d4d-ae26-d694cb6e25de") : secret "dns-default-metrics-tls" not found Apr 17 14:27:24.808025 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:24.807935 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dh4qj" event={"ID":"1d47c42e-517c-405b-99a5-30609ea3d21d","Type":"ContainerStarted","Data":"70039f0c05fd328c4124dd6b2cd2b361ba606a829fd645a728b002758d1468af"} Apr 17 14:27:24.829896 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:24.829823 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-dh4qj" podStartSLOduration=4.590833859 podStartE2EDuration="36.829807935s" podCreationTimestamp="2026-04-17 14:26:48 +0000 UTC" firstStartedPulling="2026-04-17 14:26:49.806863174 +0000 UTC m=+1.851291962" lastFinishedPulling="2026-04-17 14:27:22.045837251 +0000 UTC m=+34.090266038" observedRunningTime="2026-04-17 14:27:24.828680301 +0000 UTC m=+36.873109108" watchObservedRunningTime="2026-04-17 14:27:24.829807935 +0000 UTC m=+36.874236741" Apr 17 14:27:28.636858 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:28.636825 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3c4b5228-3ecd-4956-b222-fa218091ebaf-cert\") pod \"ingress-canary-fwpd5\" (UID: \"3c4b5228-3ecd-4956-b222-fa218091ebaf\") " pod="openshift-ingress-canary/ingress-canary-fwpd5" Apr 17 14:27:28.637246 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:28.636893 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/75b3dec2-6f28-4d4d-ae26-d694cb6e25de-metrics-tls\") pod \"dns-default-zrllc\" (UID: \"75b3dec2-6f28-4d4d-ae26-d694cb6e25de\") " pod="openshift-dns/dns-default-zrllc" Apr 17 14:27:28.637246 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:27:28.636956 2573 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Apr 17 14:27:28.637246 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:27:28.636989 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Apr 17 14:27:28.637246 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:27:28.637022 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c4b5228-3ecd-4956-b222-fa218091ebaf-cert podName:3c4b5228-3ecd-4956-b222-fa218091ebaf nodeName:}" failed. No retries permitted until 2026-04-17 14:27:36.637007611 +0000 UTC m=+48.681436397 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3c4b5228-3ecd-4956-b222-fa218091ebaf-cert") pod "ingress-canary-fwpd5" (UID: "3c4b5228-3ecd-4956-b222-fa218091ebaf") : secret "canary-serving-cert" not found Apr 17 14:27:28.637246 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:27:28.637036 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75b3dec2-6f28-4d4d-ae26-d694cb6e25de-metrics-tls podName:75b3dec2-6f28-4d4d-ae26-d694cb6e25de nodeName:}" failed. No retries permitted until 2026-04-17 14:27:36.637029728 +0000 UTC m=+48.681458513 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/75b3dec2-6f28-4d4d-ae26-d694cb6e25de-metrics-tls") pod "dns-default-zrllc" (UID: "75b3dec2-6f28-4d4d-ae26-d694cb6e25de") : secret "dns-default-metrics-tls" not found Apr 17 14:27:36.690530 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:36.690496 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/75b3dec2-6f28-4d4d-ae26-d694cb6e25de-metrics-tls\") pod \"dns-default-zrllc\" (UID: \"75b3dec2-6f28-4d4d-ae26-d694cb6e25de\") " pod="openshift-dns/dns-default-zrllc" Apr 17 14:27:36.690530 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:36.690537 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3c4b5228-3ecd-4956-b222-fa218091ebaf-cert\") pod \"ingress-canary-fwpd5\" (UID: \"3c4b5228-3ecd-4956-b222-fa218091ebaf\") " pod="openshift-ingress-canary/ingress-canary-fwpd5" Apr 17 14:27:36.691131 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:27:36.690668 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Apr 17 14:27:36.691131 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:27:36.690704 2573 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Apr 17 14:27:36.691131 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:27:36.690745 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75b3dec2-6f28-4d4d-ae26-d694cb6e25de-metrics-tls podName:75b3dec2-6f28-4d4d-ae26-d694cb6e25de nodeName:}" failed. No retries permitted until 2026-04-17 14:27:52.690723672 +0000 UTC m=+64.735152470 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/75b3dec2-6f28-4d4d-ae26-d694cb6e25de-metrics-tls") pod "dns-default-zrllc" (UID: "75b3dec2-6f28-4d4d-ae26-d694cb6e25de") : secret "dns-default-metrics-tls" not found Apr 17 14:27:36.691131 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:27:36.690764 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c4b5228-3ecd-4956-b222-fa218091ebaf-cert podName:3c4b5228-3ecd-4956-b222-fa218091ebaf nodeName:}" failed. No retries permitted until 2026-04-17 14:27:52.690753519 +0000 UTC m=+64.735182304 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3c4b5228-3ecd-4956-b222-fa218091ebaf-cert") pod "ingress-canary-fwpd5" (UID: "3c4b5228-3ecd-4956-b222-fa218091ebaf") : secret "canary-serving-cert" not found Apr 17 14:27:46.798235 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:46.798205 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t4wf8" Apr 17 14:27:52.698813 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:52.698779 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/75b3dec2-6f28-4d4d-ae26-d694cb6e25de-metrics-tls\") pod \"dns-default-zrllc\" (UID: \"75b3dec2-6f28-4d4d-ae26-d694cb6e25de\") " pod="openshift-dns/dns-default-zrllc" Apr 17 14:27:52.699208 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:52.698822 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3c4b5228-3ecd-4956-b222-fa218091ebaf-cert\") pod \"ingress-canary-fwpd5\" (UID: \"3c4b5228-3ecd-4956-b222-fa218091ebaf\") " pod="openshift-ingress-canary/ingress-canary-fwpd5" Apr 17 14:27:52.699208 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:27:52.698920 2573 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Apr 17 14:27:52.699208 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:27:52.698925 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Apr 17 14:27:52.699208 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:27:52.698993 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c4b5228-3ecd-4956-b222-fa218091ebaf-cert podName:3c4b5228-3ecd-4956-b222-fa218091ebaf nodeName:}" failed. No retries permitted until 2026-04-17 14:28:24.698963607 +0000 UTC m=+96.743392392 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3c4b5228-3ecd-4956-b222-fa218091ebaf-cert") pod "ingress-canary-fwpd5" (UID: "3c4b5228-3ecd-4956-b222-fa218091ebaf") : secret "canary-serving-cert" not found Apr 17 14:27:52.699208 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:27:52.699006 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75b3dec2-6f28-4d4d-ae26-d694cb6e25de-metrics-tls podName:75b3dec2-6f28-4d4d-ae26-d694cb6e25de nodeName:}" failed. No retries permitted until 2026-04-17 14:28:24.699000468 +0000 UTC m=+96.743429253 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/75b3dec2-6f28-4d4d-ae26-d694cb6e25de-metrics-tls") pod "dns-default-zrllc" (UID: "75b3dec2-6f28-4d4d-ae26-d694cb6e25de") : secret "dns-default-metrics-tls" not found Apr 17 14:27:53.202864 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:53.202828 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-76h8j\" (UniqueName: \"kubernetes.io/projected/928be529-e62e-4b1a-8221-cf0def914796-kube-api-access-76h8j\") pod \"network-check-target-n9zdz\" (UID: \"928be529-e62e-4b1a-8221-cf0def914796\") " pod="openshift-network-diagnostics/network-check-target-n9zdz" Apr 17 14:27:53.203060 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:53.202879 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bedbded4-1a39-4b5a-b15a-2f9d05548508-metrics-certs\") pod \"network-metrics-daemon-khctm\" (UID: \"bedbded4-1a39-4b5a-b15a-2f9d05548508\") " pod="openshift-multus/network-metrics-daemon-khctm" Apr 17 14:27:53.205430 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:53.205409 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Apr 17 14:27:53.205537 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:53.205437 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Apr 17 14:27:53.213241 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:27:53.213225 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Apr 17 14:27:53.213322 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:27:53.213299 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bedbded4-1a39-4b5a-b15a-2f9d05548508-metrics-certs podName:bedbded4-1a39-4b5a-b15a-2f9d05548508 nodeName:}" failed. No retries permitted until 2026-04-17 14:28:57.213279261 +0000 UTC m=+129.257708046 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bedbded4-1a39-4b5a-b15a-2f9d05548508-metrics-certs") pod "network-metrics-daemon-khctm" (UID: "bedbded4-1a39-4b5a-b15a-2f9d05548508") : secret "metrics-daemon-secret" not found Apr 17 14:27:53.215012 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:53.214996 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Apr 17 14:27:53.226095 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:53.226069 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-76h8j\" (UniqueName: \"kubernetes.io/projected/928be529-e62e-4b1a-8221-cf0def914796-kube-api-access-76h8j\") pod \"network-check-target-n9zdz\" (UID: \"928be529-e62e-4b1a-8221-cf0def914796\") " pod="openshift-network-diagnostics/network-check-target-n9zdz" Apr 17 14:27:53.238848 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:53.238830 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lqr8w\"" Apr 17 14:27:53.247597 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:53.247583 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9zdz" Apr 17 14:27:53.437877 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:53.437843 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-n9zdz"] Apr 17 14:27:53.860470 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:53.860436 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-n9zdz" event={"ID":"928be529-e62e-4b1a-8221-cf0def914796","Type":"ContainerStarted","Data":"ed65cae4c06f4766b9707975f4deb2869b0d00aa78bb4dd0a342f7b792315465"} Apr 17 14:27:56.867730 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:56.867689 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-n9zdz" event={"ID":"928be529-e62e-4b1a-8221-cf0def914796","Type":"ContainerStarted","Data":"c664c926ede2073df3bd619045204c680ccc81fa4f4615695cc06e1e7386ac8f"} Apr 17 14:27:56.868116 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:56.867895 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-n9zdz" Apr 17 14:27:56.881500 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:56.881459 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-n9zdz" podStartSLOduration=66.242753283 podStartE2EDuration="1m8.881448342s" podCreationTimestamp="2026-04-17 14:26:48 +0000 UTC" firstStartedPulling="2026-04-17 14:27:53.445442241 +0000 UTC m=+65.489871029" lastFinishedPulling="2026-04-17 14:27:56.084137304 +0000 UTC m=+68.128566088" observedRunningTime="2026-04-17 14:27:56.88115263 +0000 UTC m=+68.925581437" watchObservedRunningTime="2026-04-17 14:27:56.881448342 +0000 UTC m=+68.925877148" Apr 17 14:27:58.736016 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:58.735963 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-75587bd455-jsfqq"] Apr 17 14:27:58.739580 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:58.739307 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-75587bd455-jsfqq" Apr 17 14:27:58.740167 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:58.740144 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-585dfdc468-vmfdz"] Apr 17 14:27:58.742130 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:58.742109 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Apr 17 14:27:58.742245 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:58.742109 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Apr 17 14:27:58.742369 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:58.742358 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Apr 17 14:27:58.742734 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:58.742716 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-585dfdc468-vmfdz" Apr 17 14:27:58.743699 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:58.743679 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Apr 17 14:27:58.743699 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:58.743685 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-cqvqs\"" Apr 17 14:27:58.745443 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:58.745426 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Apr 17 14:27:58.745728 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:58.745705 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Apr 17 14:27:58.745834 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:58.745775 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-99r8n\"" Apr 17 14:27:58.745834 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:58.745822 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Apr 17 14:27:58.745957 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:58.745863 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Apr 17 14:27:58.750114 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:58.750096 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Apr 17 14:27:58.751874 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:58.751851 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-585dfdc468-vmfdz"] Apr 17 14:27:58.752918 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:58.752668 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-75587bd455-jsfqq"] Apr 17 14:27:58.840848 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:58.840822 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/937afaa8-5b13-4dd9-9bba-cbe6d6606c4f-serving-cert\") pod \"insights-operator-585dfdc468-vmfdz\" (UID: \"937afaa8-5b13-4dd9-9bba-cbe6d6606c4f\") " pod="openshift-insights/insights-operator-585dfdc468-vmfdz" Apr 17 14:27:58.840848 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:58.840849 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4dfj\" (UniqueName: \"kubernetes.io/projected/0d16f0ef-1c78-4702-8694-f5c03fdb065b-kube-api-access-w4dfj\") pod \"cluster-monitoring-operator-75587bd455-jsfqq\" (UID: \"0d16f0ef-1c78-4702-8694-f5c03fdb065b\") " pod="openshift-monitoring/cluster-monitoring-operator-75587bd455-jsfqq" Apr 17 14:27:58.841034 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:58.840868 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/937afaa8-5b13-4dd9-9bba-cbe6d6606c4f-service-ca-bundle\") pod \"insights-operator-585dfdc468-vmfdz\" (UID: \"937afaa8-5b13-4dd9-9bba-cbe6d6606c4f\") " pod="openshift-insights/insights-operator-585dfdc468-vmfdz" Apr 17 14:27:58.841034 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:58.840891 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/937afaa8-5b13-4dd9-9bba-cbe6d6606c4f-tmp\") pod \"insights-operator-585dfdc468-vmfdz\" (UID: \"937afaa8-5b13-4dd9-9bba-cbe6d6606c4f\") " pod="openshift-insights/insights-operator-585dfdc468-vmfdz" Apr 17 14:27:58.841034 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:58.840964 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/937afaa8-5b13-4dd9-9bba-cbe6d6606c4f-snapshots\") pod \"insights-operator-585dfdc468-vmfdz\" (UID: \"937afaa8-5b13-4dd9-9bba-cbe6d6606c4f\") " pod="openshift-insights/insights-operator-585dfdc468-vmfdz" Apr 17 14:27:58.841034 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:58.841009 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/0d16f0ef-1c78-4702-8694-f5c03fdb065b-telemetry-config\") pod \"cluster-monitoring-operator-75587bd455-jsfqq\" (UID: \"0d16f0ef-1c78-4702-8694-f5c03fdb065b\") " pod="openshift-monitoring/cluster-monitoring-operator-75587bd455-jsfqq" Apr 17 14:27:58.841291 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:58.841039 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/937afaa8-5b13-4dd9-9bba-cbe6d6606c4f-trusted-ca-bundle\") pod \"insights-operator-585dfdc468-vmfdz\" (UID: \"937afaa8-5b13-4dd9-9bba-cbe6d6606c4f\") " pod="openshift-insights/insights-operator-585dfdc468-vmfdz" Apr 17 14:27:58.841291 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:58.841061 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4r8vp\" (UniqueName: \"kubernetes.io/projected/937afaa8-5b13-4dd9-9bba-cbe6d6606c4f-kube-api-access-4r8vp\") pod \"insights-operator-585dfdc468-vmfdz\" (UID: \"937afaa8-5b13-4dd9-9bba-cbe6d6606c4f\") " pod="openshift-insights/insights-operator-585dfdc468-vmfdz" Apr 17 14:27:58.841291 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:58.841138 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d16f0ef-1c78-4702-8694-f5c03fdb065b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-75587bd455-jsfqq\" (UID: \"0d16f0ef-1c78-4702-8694-f5c03fdb065b\") " pod="openshift-monitoring/cluster-monitoring-operator-75587bd455-jsfqq" Apr 17 14:27:58.842294 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:58.842264 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-d6fc45fc5-lxq9m"] Apr 17 14:27:58.845162 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:58.845145 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-9d4b6777b-mslwt"] Apr 17 14:27:58.845251 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:58.845232 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-d6fc45fc5-lxq9m" Apr 17 14:27:58.847403 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:58.847384 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-5cp2j\"" Apr 17 14:27:58.847694 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:58.847656 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Apr 17 14:27:58.847787 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:58.847774 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Apr 17 14:27:58.847840 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:58.847807 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Apr 17 14:27:58.847906 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:58.847894 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Apr 17 14:27:58.848140 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:58.848124 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-9d4b6777b-mslwt" Apr 17 14:27:58.851027 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:58.851008 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Apr 17 14:27:58.851230 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:58.851127 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Apr 17 14:27:58.851589 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:58.851573 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Apr 17 14:27:58.852152 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:58.852135 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-qdl6v\"" Apr 17 14:27:58.852239 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:58.852193 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Apr 17 14:27:58.855938 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:58.855918 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-d6fc45fc5-lxq9m"] Apr 17 14:27:58.856811 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:58.856777 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-9d4b6777b-mslwt"] Apr 17 14:27:58.860505 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:58.860489 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Apr 17 14:27:58.942128 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:58.942101 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/937afaa8-5b13-4dd9-9bba-cbe6d6606c4f-tmp\") pod \"insights-operator-585dfdc468-vmfdz\" (UID: \"937afaa8-5b13-4dd9-9bba-cbe6d6606c4f\") " pod="openshift-insights/insights-operator-585dfdc468-vmfdz" Apr 17 14:27:58.942290 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:58.942143 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/937afaa8-5b13-4dd9-9bba-cbe6d6606c4f-snapshots\") pod \"insights-operator-585dfdc468-vmfdz\" (UID: \"937afaa8-5b13-4dd9-9bba-cbe6d6606c4f\") " pod="openshift-insights/insights-operator-585dfdc468-vmfdz" Apr 17 14:27:58.942290 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:58.942160 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/0d16f0ef-1c78-4702-8694-f5c03fdb065b-telemetry-config\") pod \"cluster-monitoring-operator-75587bd455-jsfqq\" (UID: \"0d16f0ef-1c78-4702-8694-f5c03fdb065b\") " pod="openshift-monitoring/cluster-monitoring-operator-75587bd455-jsfqq" Apr 17 14:27:58.942290 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:58.942187 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/937afaa8-5b13-4dd9-9bba-cbe6d6606c4f-trusted-ca-bundle\") pod \"insights-operator-585dfdc468-vmfdz\" (UID: \"937afaa8-5b13-4dd9-9bba-cbe6d6606c4f\") " pod="openshift-insights/insights-operator-585dfdc468-vmfdz" Apr 17 14:27:58.942290 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:58.942211 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4r8vp\" (UniqueName: \"kubernetes.io/projected/937afaa8-5b13-4dd9-9bba-cbe6d6606c4f-kube-api-access-4r8vp\") pod \"insights-operator-585dfdc468-vmfdz\" (UID: \"937afaa8-5b13-4dd9-9bba-cbe6d6606c4f\") " pod="openshift-insights/insights-operator-585dfdc468-vmfdz" Apr 17 14:27:58.942290 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:58.942254 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d16f0ef-1c78-4702-8694-f5c03fdb065b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-75587bd455-jsfqq\" (UID: \"0d16f0ef-1c78-4702-8694-f5c03fdb065b\") " pod="openshift-monitoring/cluster-monitoring-operator-75587bd455-jsfqq" Apr 17 14:27:58.942961 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:58.942663 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/937afaa8-5b13-4dd9-9bba-cbe6d6606c4f-serving-cert\") pod \"insights-operator-585dfdc468-vmfdz\" (UID: \"937afaa8-5b13-4dd9-9bba-cbe6d6606c4f\") " pod="openshift-insights/insights-operator-585dfdc468-vmfdz" Apr 17 14:27:58.942961 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:58.942733 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w4dfj\" (UniqueName: \"kubernetes.io/projected/0d16f0ef-1c78-4702-8694-f5c03fdb065b-kube-api-access-w4dfj\") pod \"cluster-monitoring-operator-75587bd455-jsfqq\" (UID: \"0d16f0ef-1c78-4702-8694-f5c03fdb065b\") " pod="openshift-monitoring/cluster-monitoring-operator-75587bd455-jsfqq" Apr 17 14:27:58.942961 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:27:58.942741 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Apr 17 14:27:58.942961 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:58.942768 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/937afaa8-5b13-4dd9-9bba-cbe6d6606c4f-service-ca-bundle\") pod \"insights-operator-585dfdc468-vmfdz\" (UID: \"937afaa8-5b13-4dd9-9bba-cbe6d6606c4f\") " pod="openshift-insights/insights-operator-585dfdc468-vmfdz" Apr 17 14:27:58.942961 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:58.942892 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/937afaa8-5b13-4dd9-9bba-cbe6d6606c4f-tmp\") pod \"insights-operator-585dfdc468-vmfdz\" (UID: \"937afaa8-5b13-4dd9-9bba-cbe6d6606c4f\") " pod="openshift-insights/insights-operator-585dfdc468-vmfdz" Apr 17 14:27:58.943295 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:58.943155 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/937afaa8-5b13-4dd9-9bba-cbe6d6606c4f-snapshots\") pod \"insights-operator-585dfdc468-vmfdz\" (UID: \"937afaa8-5b13-4dd9-9bba-cbe6d6606c4f\") " pod="openshift-insights/insights-operator-585dfdc468-vmfdz" Apr 17 14:27:58.943352 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:27:58.943319 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d16f0ef-1c78-4702-8694-f5c03fdb065b-cluster-monitoring-operator-tls podName:0d16f0ef-1c78-4702-8694-f5c03fdb065b nodeName:}" failed. No retries permitted until 2026-04-17 14:27:59.442873853 +0000 UTC m=+71.487302650 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0d16f0ef-1c78-4702-8694-f5c03fdb065b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-75587bd455-jsfqq" (UID: "0d16f0ef-1c78-4702-8694-f5c03fdb065b") : secret "cluster-monitoring-operator-tls" not found Apr 17 14:27:58.943440 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:58.943411 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/937afaa8-5b13-4dd9-9bba-cbe6d6606c4f-service-ca-bundle\") pod \"insights-operator-585dfdc468-vmfdz\" (UID: \"937afaa8-5b13-4dd9-9bba-cbe6d6606c4f\") " pod="openshift-insights/insights-operator-585dfdc468-vmfdz" Apr 17 14:27:58.943529 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:58.943504 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/0d16f0ef-1c78-4702-8694-f5c03fdb065b-telemetry-config\") pod \"cluster-monitoring-operator-75587bd455-jsfqq\" (UID: \"0d16f0ef-1c78-4702-8694-f5c03fdb065b\") " pod="openshift-monitoring/cluster-monitoring-operator-75587bd455-jsfqq" Apr 17 14:27:58.946508 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:58.944355 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/937afaa8-5b13-4dd9-9bba-cbe6d6606c4f-trusted-ca-bundle\") pod \"insights-operator-585dfdc468-vmfdz\" (UID: \"937afaa8-5b13-4dd9-9bba-cbe6d6606c4f\") " pod="openshift-insights/insights-operator-585dfdc468-vmfdz" Apr 17 14:27:58.946508 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:58.945772 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/937afaa8-5b13-4dd9-9bba-cbe6d6606c4f-serving-cert\") pod \"insights-operator-585dfdc468-vmfdz\" (UID: \"937afaa8-5b13-4dd9-9bba-cbe6d6606c4f\") " pod="openshift-insights/insights-operator-585dfdc468-vmfdz" Apr 17 14:27:58.954575 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:58.954556 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4r8vp\" (UniqueName: \"kubernetes.io/projected/937afaa8-5b13-4dd9-9bba-cbe6d6606c4f-kube-api-access-4r8vp\") pod \"insights-operator-585dfdc468-vmfdz\" (UID: \"937afaa8-5b13-4dd9-9bba-cbe6d6606c4f\") " pod="openshift-insights/insights-operator-585dfdc468-vmfdz" Apr 17 14:27:58.954670 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:58.954575 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4dfj\" (UniqueName: \"kubernetes.io/projected/0d16f0ef-1c78-4702-8694-f5c03fdb065b-kube-api-access-w4dfj\") pod \"cluster-monitoring-operator-75587bd455-jsfqq\" (UID: \"0d16f0ef-1c78-4702-8694-f5c03fdb065b\") " pod="openshift-monitoring/cluster-monitoring-operator-75587bd455-jsfqq" Apr 17 14:27:59.043992 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:59.043881 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bcfc0e78-bf12-499f-874d-3b0c3b9f6e21-config\") pod \"service-ca-operator-d6fc45fc5-lxq9m\" (UID: \"bcfc0e78-bf12-499f-874d-3b0c3b9f6e21\") " pod="openshift-service-ca-operator/service-ca-operator-d6fc45fc5-lxq9m" Apr 17 14:27:59.043992 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:59.043917 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6j7nt\" (UniqueName: \"kubernetes.io/projected/bcfc0e78-bf12-499f-874d-3b0c3b9f6e21-kube-api-access-6j7nt\") pod \"service-ca-operator-d6fc45fc5-lxq9m\" (UID: \"bcfc0e78-bf12-499f-874d-3b0c3b9f6e21\") " pod="openshift-service-ca-operator/service-ca-operator-d6fc45fc5-lxq9m" Apr 17 14:27:59.044226 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:59.044027 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fba84e6b-7f61-427c-94d1-489ee9dadc9e-config\") pod \"console-operator-9d4b6777b-mslwt\" (UID: \"fba84e6b-7f61-427c-94d1-489ee9dadc9e\") " pod="openshift-console-operator/console-operator-9d4b6777b-mslwt" Apr 17 14:27:59.044226 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:59.044075 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tlxk\" (UniqueName: \"kubernetes.io/projected/fba84e6b-7f61-427c-94d1-489ee9dadc9e-kube-api-access-8tlxk\") pod \"console-operator-9d4b6777b-mslwt\" (UID: \"fba84e6b-7f61-427c-94d1-489ee9dadc9e\") " pod="openshift-console-operator/console-operator-9d4b6777b-mslwt" Apr 17 14:27:59.044226 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:59.044135 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fba84e6b-7f61-427c-94d1-489ee9dadc9e-trusted-ca\") pod \"console-operator-9d4b6777b-mslwt\" (UID: \"fba84e6b-7f61-427c-94d1-489ee9dadc9e\") " pod="openshift-console-operator/console-operator-9d4b6777b-mslwt" Apr 17 14:27:59.044226 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:59.044161 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bcfc0e78-bf12-499f-874d-3b0c3b9f6e21-serving-cert\") pod \"service-ca-operator-d6fc45fc5-lxq9m\" (UID: \"bcfc0e78-bf12-499f-874d-3b0c3b9f6e21\") " pod="openshift-service-ca-operator/service-ca-operator-d6fc45fc5-lxq9m" Apr 17 14:27:59.044226 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:59.044200 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fba84e6b-7f61-427c-94d1-489ee9dadc9e-serving-cert\") pod \"console-operator-9d4b6777b-mslwt\" (UID: \"fba84e6b-7f61-427c-94d1-489ee9dadc9e\") " pod="openshift-console-operator/console-operator-9d4b6777b-mslwt" Apr 17 14:27:59.056119 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:59.056096 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-585dfdc468-vmfdz" Apr 17 14:27:59.151365 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:59.146320 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bcfc0e78-bf12-499f-874d-3b0c3b9f6e21-config\") pod \"service-ca-operator-d6fc45fc5-lxq9m\" (UID: \"bcfc0e78-bf12-499f-874d-3b0c3b9f6e21\") " pod="openshift-service-ca-operator/service-ca-operator-d6fc45fc5-lxq9m" Apr 17 14:27:59.151365 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:59.146374 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6j7nt\" (UniqueName: \"kubernetes.io/projected/bcfc0e78-bf12-499f-874d-3b0c3b9f6e21-kube-api-access-6j7nt\") pod \"service-ca-operator-d6fc45fc5-lxq9m\" (UID: \"bcfc0e78-bf12-499f-874d-3b0c3b9f6e21\") " pod="openshift-service-ca-operator/service-ca-operator-d6fc45fc5-lxq9m" Apr 17 14:27:59.151365 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:59.146436 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fba84e6b-7f61-427c-94d1-489ee9dadc9e-config\") pod \"console-operator-9d4b6777b-mslwt\" (UID: \"fba84e6b-7f61-427c-94d1-489ee9dadc9e\") " pod="openshift-console-operator/console-operator-9d4b6777b-mslwt" Apr 17 14:27:59.151365 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:59.146468 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8tlxk\" (UniqueName: \"kubernetes.io/projected/fba84e6b-7f61-427c-94d1-489ee9dadc9e-kube-api-access-8tlxk\") pod \"console-operator-9d4b6777b-mslwt\" (UID: \"fba84e6b-7f61-427c-94d1-489ee9dadc9e\") " pod="openshift-console-operator/console-operator-9d4b6777b-mslwt" Apr 17 14:27:59.151365 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:59.146518 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fba84e6b-7f61-427c-94d1-489ee9dadc9e-trusted-ca\") pod \"console-operator-9d4b6777b-mslwt\" (UID: \"fba84e6b-7f61-427c-94d1-489ee9dadc9e\") " pod="openshift-console-operator/console-operator-9d4b6777b-mslwt" Apr 17 14:27:59.151365 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:59.146548 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bcfc0e78-bf12-499f-874d-3b0c3b9f6e21-serving-cert\") pod \"service-ca-operator-d6fc45fc5-lxq9m\" (UID: \"bcfc0e78-bf12-499f-874d-3b0c3b9f6e21\") " pod="openshift-service-ca-operator/service-ca-operator-d6fc45fc5-lxq9m" Apr 17 14:27:59.151365 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:59.146588 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fba84e6b-7f61-427c-94d1-489ee9dadc9e-serving-cert\") pod \"console-operator-9d4b6777b-mslwt\" (UID: \"fba84e6b-7f61-427c-94d1-489ee9dadc9e\") " pod="openshift-console-operator/console-operator-9d4b6777b-mslwt" Apr 17 14:27:59.151365 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:59.148408 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fba84e6b-7f61-427c-94d1-489ee9dadc9e-trusted-ca\") pod \"console-operator-9d4b6777b-mslwt\" (UID: \"fba84e6b-7f61-427c-94d1-489ee9dadc9e\") " pod="openshift-console-operator/console-operator-9d4b6777b-mslwt" Apr 17 14:27:59.151365 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:59.148995 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fba84e6b-7f61-427c-94d1-489ee9dadc9e-config\") pod \"console-operator-9d4b6777b-mslwt\" (UID: \"fba84e6b-7f61-427c-94d1-489ee9dadc9e\") " pod="openshift-console-operator/console-operator-9d4b6777b-mslwt" Apr 17 14:27:59.151365 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:59.149311 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bcfc0e78-bf12-499f-874d-3b0c3b9f6e21-config\") pod \"service-ca-operator-d6fc45fc5-lxq9m\" (UID: \"bcfc0e78-bf12-499f-874d-3b0c3b9f6e21\") " pod="openshift-service-ca-operator/service-ca-operator-d6fc45fc5-lxq9m" Apr 17 14:27:59.152418 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:59.152392 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fba84e6b-7f61-427c-94d1-489ee9dadc9e-serving-cert\") pod \"console-operator-9d4b6777b-mslwt\" (UID: \"fba84e6b-7f61-427c-94d1-489ee9dadc9e\") " pod="openshift-console-operator/console-operator-9d4b6777b-mslwt" Apr 17 14:27:59.153333 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:59.153314 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bcfc0e78-bf12-499f-874d-3b0c3b9f6e21-serving-cert\") pod \"service-ca-operator-d6fc45fc5-lxq9m\" (UID: \"bcfc0e78-bf12-499f-874d-3b0c3b9f6e21\") " pod="openshift-service-ca-operator/service-ca-operator-d6fc45fc5-lxq9m" Apr 17 14:27:59.164576 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:59.164549 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6j7nt\" (UniqueName: \"kubernetes.io/projected/bcfc0e78-bf12-499f-874d-3b0c3b9f6e21-kube-api-access-6j7nt\") pod \"service-ca-operator-d6fc45fc5-lxq9m\" (UID: \"bcfc0e78-bf12-499f-874d-3b0c3b9f6e21\") " pod="openshift-service-ca-operator/service-ca-operator-d6fc45fc5-lxq9m" Apr 17 14:27:59.164837 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:59.164817 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tlxk\" (UniqueName: \"kubernetes.io/projected/fba84e6b-7f61-427c-94d1-489ee9dadc9e-kube-api-access-8tlxk\") pod \"console-operator-9d4b6777b-mslwt\" (UID: \"fba84e6b-7f61-427c-94d1-489ee9dadc9e\") " pod="openshift-console-operator/console-operator-9d4b6777b-mslwt" Apr 17 14:27:59.188715 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:59.188691 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-585dfdc468-vmfdz"] Apr 17 14:27:59.191467 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:27:59.191445 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod937afaa8_5b13_4dd9_9bba_cbe6d6606c4f.slice/crio-4baca112aadcfb91e7992c1e94463c702ef54fce4549e0c6daddfa7dfe8c5f0a WatchSource:0}: Error finding container 4baca112aadcfb91e7992c1e94463c702ef54fce4549e0c6daddfa7dfe8c5f0a: Status 404 returned error can't find the container with id 4baca112aadcfb91e7992c1e94463c702ef54fce4549e0c6daddfa7dfe8c5f0a Apr 17 14:27:59.448750 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:59.448673 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d16f0ef-1c78-4702-8694-f5c03fdb065b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-75587bd455-jsfqq\" (UID: \"0d16f0ef-1c78-4702-8694-f5c03fdb065b\") " pod="openshift-monitoring/cluster-monitoring-operator-75587bd455-jsfqq" Apr 17 14:27:59.448869 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:27:59.448815 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Apr 17 14:27:59.448906 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:27:59.448873 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d16f0ef-1c78-4702-8694-f5c03fdb065b-cluster-monitoring-operator-tls podName:0d16f0ef-1c78-4702-8694-f5c03fdb065b nodeName:}" failed. No retries permitted until 2026-04-17 14:28:00.448859393 +0000 UTC m=+72.493288182 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0d16f0ef-1c78-4702-8694-f5c03fdb065b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-75587bd455-jsfqq" (UID: "0d16f0ef-1c78-4702-8694-f5c03fdb065b") : secret "cluster-monitoring-operator-tls" not found Apr 17 14:27:59.454719 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:59.454695 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-d6fc45fc5-lxq9m" Apr 17 14:27:59.461708 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:59.461689 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-9d4b6777b-mslwt" Apr 17 14:27:59.569664 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:59.569632 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-d6fc45fc5-lxq9m"] Apr 17 14:27:59.573430 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:27:59.573402 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcfc0e78_bf12_499f_874d_3b0c3b9f6e21.slice/crio-966c75e859d7197b3f47c85b22ddd1ab1e6d5305918439c4decdef0c620a167f WatchSource:0}: Error finding container 966c75e859d7197b3f47c85b22ddd1ab1e6d5305918439c4decdef0c620a167f: Status 404 returned error can't find the container with id 966c75e859d7197b3f47c85b22ddd1ab1e6d5305918439c4decdef0c620a167f Apr 17 14:27:59.586045 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:59.586023 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-9d4b6777b-mslwt"] Apr 17 14:27:59.588924 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:27:59.588901 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfba84e6b_7f61_427c_94d1_489ee9dadc9e.slice/crio-f6deb029f9eb1ae9318b02e184f92584f831173c9800c3e281322887392f3b4b WatchSource:0}: Error finding container f6deb029f9eb1ae9318b02e184f92584f831173c9800c3e281322887392f3b4b: Status 404 returned error can't find the container with id f6deb029f9eb1ae9318b02e184f92584f831173c9800c3e281322887392f3b4b Apr 17 14:27:59.876477 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:59.876411 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-9d4b6777b-mslwt" event={"ID":"fba84e6b-7f61-427c-94d1-489ee9dadc9e","Type":"ContainerStarted","Data":"f6deb029f9eb1ae9318b02e184f92584f831173c9800c3e281322887392f3b4b"} Apr 17 14:27:59.877620 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:59.877587 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-d6fc45fc5-lxq9m" event={"ID":"bcfc0e78-bf12-499f-874d-3b0c3b9f6e21","Type":"ContainerStarted","Data":"966c75e859d7197b3f47c85b22ddd1ab1e6d5305918439c4decdef0c620a167f"} Apr 17 14:27:59.878646 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:27:59.878622 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-585dfdc468-vmfdz" event={"ID":"937afaa8-5b13-4dd9-9bba-cbe6d6606c4f","Type":"ContainerStarted","Data":"4baca112aadcfb91e7992c1e94463c702ef54fce4549e0c6daddfa7dfe8c5f0a"} Apr 17 14:28:00.457405 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:00.457310 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d16f0ef-1c78-4702-8694-f5c03fdb065b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-75587bd455-jsfqq\" (UID: \"0d16f0ef-1c78-4702-8694-f5c03fdb065b\") " pod="openshift-monitoring/cluster-monitoring-operator-75587bd455-jsfqq" Apr 17 14:28:00.457593 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:28:00.457479 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Apr 17 14:28:00.457593 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:28:00.457562 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d16f0ef-1c78-4702-8694-f5c03fdb065b-cluster-monitoring-operator-tls podName:0d16f0ef-1c78-4702-8694-f5c03fdb065b nodeName:}" failed. No retries permitted until 2026-04-17 14:28:02.457540023 +0000 UTC m=+74.501968812 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0d16f0ef-1c78-4702-8694-f5c03fdb065b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-75587bd455-jsfqq" (UID: "0d16f0ef-1c78-4702-8694-f5c03fdb065b") : secret "cluster-monitoring-operator-tls" not found Apr 17 14:28:02.472767 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:02.472743 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d16f0ef-1c78-4702-8694-f5c03fdb065b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-75587bd455-jsfqq\" (UID: \"0d16f0ef-1c78-4702-8694-f5c03fdb065b\") " pod="openshift-monitoring/cluster-monitoring-operator-75587bd455-jsfqq" Apr 17 14:28:02.473098 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:28:02.472852 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Apr 17 14:28:02.473098 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:28:02.472897 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d16f0ef-1c78-4702-8694-f5c03fdb065b-cluster-monitoring-operator-tls podName:0d16f0ef-1c78-4702-8694-f5c03fdb065b nodeName:}" failed. No retries permitted until 2026-04-17 14:28:06.472884718 +0000 UTC m=+78.517313503 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0d16f0ef-1c78-4702-8694-f5c03fdb065b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-75587bd455-jsfqq" (UID: "0d16f0ef-1c78-4702-8694-f5c03fdb065b") : secret "cluster-monitoring-operator-tls" not found Apr 17 14:28:02.886041 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:02.886002 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-d6fc45fc5-lxq9m" event={"ID":"bcfc0e78-bf12-499f-874d-3b0c3b9f6e21","Type":"ContainerStarted","Data":"f2a7d7007b3b83dcabe9d080e4700dd07325c6cd572563dc83e8ac5e5be3e6c4"} Apr 17 14:28:02.887390 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:02.887360 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-585dfdc468-vmfdz" event={"ID":"937afaa8-5b13-4dd9-9bba-cbe6d6606c4f","Type":"ContainerStarted","Data":"9a6a605979cd4580f68bed4d3eb1503e44f97678d05e520c7ca9ea2433defde7"} Apr 17 14:28:02.888662 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:02.888644 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-9d4b6777b-mslwt_fba84e6b-7f61-427c-94d1-489ee9dadc9e/console-operator/0.log" Apr 17 14:28:02.888747 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:02.888677 2573 generic.go:358] "Generic (PLEG): container finished" podID="fba84e6b-7f61-427c-94d1-489ee9dadc9e" containerID="dd0fa520e4cfc2bda0689bb9a26de5dcf7e95a1a707d2e9b5272905d867b73ed" exitCode=255 Apr 17 14:28:02.888747 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:02.888715 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-9d4b6777b-mslwt" event={"ID":"fba84e6b-7f61-427c-94d1-489ee9dadc9e","Type":"ContainerDied","Data":"dd0fa520e4cfc2bda0689bb9a26de5dcf7e95a1a707d2e9b5272905d867b73ed"} Apr 17 14:28:02.888941 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:02.888923 2573 scope.go:117] "RemoveContainer" containerID="dd0fa520e4cfc2bda0689bb9a26de5dcf7e95a1a707d2e9b5272905d867b73ed" Apr 17 14:28:02.902229 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:02.902178 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-d6fc45fc5-lxq9m" podStartSLOduration=2.034074558 podStartE2EDuration="4.902162655s" podCreationTimestamp="2026-04-17 14:27:58 +0000 UTC" firstStartedPulling="2026-04-17 14:27:59.575074273 +0000 UTC m=+71.619503066" lastFinishedPulling="2026-04-17 14:28:02.443162365 +0000 UTC m=+74.487591163" observedRunningTime="2026-04-17 14:28:02.901952241 +0000 UTC m=+74.946381049" watchObservedRunningTime="2026-04-17 14:28:02.902162655 +0000 UTC m=+74.946591463" Apr 17 14:28:02.915595 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:02.915547 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-585dfdc468-vmfdz" podStartSLOduration=1.672356323 podStartE2EDuration="4.915534895s" podCreationTimestamp="2026-04-17 14:27:58 +0000 UTC" firstStartedPulling="2026-04-17 14:27:59.193343705 +0000 UTC m=+71.237772491" lastFinishedPulling="2026-04-17 14:28:02.43652227 +0000 UTC m=+74.480951063" observedRunningTime="2026-04-17 14:28:02.915422584 +0000 UTC m=+74.959851393" watchObservedRunningTime="2026-04-17 14:28:02.915534895 +0000 UTC m=+74.959963703" Apr 17 14:28:03.263050 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:03.263014 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-74bb7799d9-qhps7"] Apr 17 14:28:03.266037 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:03.266023 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-74bb7799d9-qhps7" Apr 17 14:28:03.268387 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:03.268358 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Apr 17 14:28:03.268387 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:03.268377 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-zwrz9\"" Apr 17 14:28:03.268591 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:03.268419 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Apr 17 14:28:03.275687 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:03.275665 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-74bb7799d9-qhps7"] Apr 17 14:28:03.280075 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:03.280050 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtjzr\" (UniqueName: \"kubernetes.io/projected/3492345b-fc9e-4e01-b9b3-5dfa31a8de37-kube-api-access-gtjzr\") pod \"migrator-74bb7799d9-qhps7\" (UID: \"3492345b-fc9e-4e01-b9b3-5dfa31a8de37\") " pod="openshift-kube-storage-version-migrator/migrator-74bb7799d9-qhps7" Apr 17 14:28:03.380507 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:03.380467 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gtjzr\" (UniqueName: \"kubernetes.io/projected/3492345b-fc9e-4e01-b9b3-5dfa31a8de37-kube-api-access-gtjzr\") pod \"migrator-74bb7799d9-qhps7\" (UID: \"3492345b-fc9e-4e01-b9b3-5dfa31a8de37\") " pod="openshift-kube-storage-version-migrator/migrator-74bb7799d9-qhps7" Apr 17 14:28:03.388891 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:03.388866 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtjzr\" (UniqueName: \"kubernetes.io/projected/3492345b-fc9e-4e01-b9b3-5dfa31a8de37-kube-api-access-gtjzr\") pod \"migrator-74bb7799d9-qhps7\" (UID: \"3492345b-fc9e-4e01-b9b3-5dfa31a8de37\") " pod="openshift-kube-storage-version-migrator/migrator-74bb7799d9-qhps7" Apr 17 14:28:03.576015 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:03.575904 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-74bb7799d9-qhps7" Apr 17 14:28:03.696678 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:03.696631 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-74bb7799d9-qhps7"] Apr 17 14:28:03.702032 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:28:03.701890 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3492345b_fc9e_4e01_b9b3_5dfa31a8de37.slice/crio-570cde5ac98b7abbf79b7382c5cb5a838688f9cf166a674423bc0e120c3322d1 WatchSource:0}: Error finding container 570cde5ac98b7abbf79b7382c5cb5a838688f9cf166a674423bc0e120c3322d1: Status 404 returned error can't find the container with id 570cde5ac98b7abbf79b7382c5cb5a838688f9cf166a674423bc0e120c3322d1 Apr 17 14:28:03.895114 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:03.895042 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-9d4b6777b-mslwt_fba84e6b-7f61-427c-94d1-489ee9dadc9e/console-operator/1.log" Apr 17 14:28:03.895405 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:03.895392 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-9d4b6777b-mslwt_fba84e6b-7f61-427c-94d1-489ee9dadc9e/console-operator/0.log" Apr 17 14:28:03.895465 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:03.895424 2573 generic.go:358] "Generic (PLEG): container finished" podID="fba84e6b-7f61-427c-94d1-489ee9dadc9e" containerID="a9aa05cc8857957458dcfed6c8a6d2f40ad93ffed712ea3fdc190b9f6e7a49b5" exitCode=255 Apr 17 14:28:03.895517 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:03.895459 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-9d4b6777b-mslwt" event={"ID":"fba84e6b-7f61-427c-94d1-489ee9dadc9e","Type":"ContainerDied","Data":"a9aa05cc8857957458dcfed6c8a6d2f40ad93ffed712ea3fdc190b9f6e7a49b5"} Apr 17 14:28:03.895570 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:03.895518 2573 scope.go:117] "RemoveContainer" containerID="dd0fa520e4cfc2bda0689bb9a26de5dcf7e95a1a707d2e9b5272905d867b73ed" Apr 17 14:28:03.895782 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:03.895766 2573 scope.go:117] "RemoveContainer" containerID="a9aa05cc8857957458dcfed6c8a6d2f40ad93ffed712ea3fdc190b9f6e7a49b5" Apr 17 14:28:03.896041 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:28:03.896014 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-9d4b6777b-mslwt_openshift-console-operator(fba84e6b-7f61-427c-94d1-489ee9dadc9e)\"" pod="openshift-console-operator/console-operator-9d4b6777b-mslwt" podUID="fba84e6b-7f61-427c-94d1-489ee9dadc9e" Apr 17 14:28:03.896808 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:03.896788 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-74bb7799d9-qhps7" event={"ID":"3492345b-fc9e-4e01-b9b3-5dfa31a8de37","Type":"ContainerStarted","Data":"570cde5ac98b7abbf79b7382c5cb5a838688f9cf166a674423bc0e120c3322d1"} Apr 17 14:28:04.900934 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:04.900900 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-74bb7799d9-qhps7" event={"ID":"3492345b-fc9e-4e01-b9b3-5dfa31a8de37","Type":"ContainerStarted","Data":"4b880a28a7a52c5aa23590a5e6a31e9a5e0b58ecc13bdeaf718db2355f47bb60"} Apr 17 14:28:04.900934 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:04.900936 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-74bb7799d9-qhps7" event={"ID":"3492345b-fc9e-4e01-b9b3-5dfa31a8de37","Type":"ContainerStarted","Data":"49de765a2a4938b93812d3e0651b621ef1fed53fe1d854c297a62bb2bd4c431e"} Apr 17 14:28:04.902243 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:04.902224 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-9d4b6777b-mslwt_fba84e6b-7f61-427c-94d1-489ee9dadc9e/console-operator/1.log" Apr 17 14:28:04.902526 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:04.902510 2573 scope.go:117] "RemoveContainer" containerID="a9aa05cc8857957458dcfed6c8a6d2f40ad93ffed712ea3fdc190b9f6e7a49b5" Apr 17 14:28:04.902705 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:28:04.902687 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-9d4b6777b-mslwt_openshift-console-operator(fba84e6b-7f61-427c-94d1-489ee9dadc9e)\"" pod="openshift-console-operator/console-operator-9d4b6777b-mslwt" podUID="fba84e6b-7f61-427c-94d1-489ee9dadc9e" Apr 17 14:28:04.921275 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:04.921232 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-74bb7799d9-qhps7" podStartSLOduration=0.920954921 podStartE2EDuration="1.921217167s" podCreationTimestamp="2026-04-17 14:28:03 +0000 UTC" firstStartedPulling="2026-04-17 14:28:03.703224207 +0000 UTC m=+75.747652996" lastFinishedPulling="2026-04-17 14:28:04.703486447 +0000 UTC m=+76.747915242" observedRunningTime="2026-04-17 14:28:04.920020329 +0000 UTC m=+76.964449130" watchObservedRunningTime="2026-04-17 14:28:04.921217167 +0000 UTC m=+76.965645973" Apr 17 14:28:06.136351 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:06.136316 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-865cb79987-b52hc"] Apr 17 14:28:06.139276 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:06.139259 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-865cb79987-b52hc" Apr 17 14:28:06.141628 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:06.141603 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Apr 17 14:28:06.142436 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:06.142421 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Apr 17 14:28:06.142553 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:06.142444 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Apr 17 14:28:06.142553 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:06.142444 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Apr 17 14:28:06.142553 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:06.142445 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-g5pcl\"" Apr 17 14:28:06.148204 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:06.148187 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-865cb79987-b52hc"] Apr 17 14:28:06.200208 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:06.200187 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5b22\" (UniqueName: \"kubernetes.io/projected/ad46b9f7-7a11-4768-b680-bb15f38144c8-kube-api-access-r5b22\") pod \"service-ca-865cb79987-b52hc\" (UID: \"ad46b9f7-7a11-4768-b680-bb15f38144c8\") " pod="openshift-service-ca/service-ca-865cb79987-b52hc" Apr 17 14:28:06.200316 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:06.200214 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ad46b9f7-7a11-4768-b680-bb15f38144c8-signing-key\") pod \"service-ca-865cb79987-b52hc\" (UID: \"ad46b9f7-7a11-4768-b680-bb15f38144c8\") " pod="openshift-service-ca/service-ca-865cb79987-b52hc" Apr 17 14:28:06.200316 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:06.200255 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ad46b9f7-7a11-4768-b680-bb15f38144c8-signing-cabundle\") pod \"service-ca-865cb79987-b52hc\" (UID: \"ad46b9f7-7a11-4768-b680-bb15f38144c8\") " pod="openshift-service-ca/service-ca-865cb79987-b52hc" Apr 17 14:28:06.300985 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:06.300956 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r5b22\" (UniqueName: \"kubernetes.io/projected/ad46b9f7-7a11-4768-b680-bb15f38144c8-kube-api-access-r5b22\") pod \"service-ca-865cb79987-b52hc\" (UID: \"ad46b9f7-7a11-4768-b680-bb15f38144c8\") " pod="openshift-service-ca/service-ca-865cb79987-b52hc" Apr 17 14:28:06.301109 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:06.301001 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ad46b9f7-7a11-4768-b680-bb15f38144c8-signing-key\") pod \"service-ca-865cb79987-b52hc\" (UID: \"ad46b9f7-7a11-4768-b680-bb15f38144c8\") " pod="openshift-service-ca/service-ca-865cb79987-b52hc" Apr 17 14:28:06.301109 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:06.301040 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ad46b9f7-7a11-4768-b680-bb15f38144c8-signing-cabundle\") pod \"service-ca-865cb79987-b52hc\" (UID: \"ad46b9f7-7a11-4768-b680-bb15f38144c8\") " pod="openshift-service-ca/service-ca-865cb79987-b52hc" Apr 17 14:28:06.301586 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:06.301560 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ad46b9f7-7a11-4768-b680-bb15f38144c8-signing-cabundle\") pod \"service-ca-865cb79987-b52hc\" (UID: \"ad46b9f7-7a11-4768-b680-bb15f38144c8\") " pod="openshift-service-ca/service-ca-865cb79987-b52hc" Apr 17 14:28:06.303409 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:06.303390 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ad46b9f7-7a11-4768-b680-bb15f38144c8-signing-key\") pod \"service-ca-865cb79987-b52hc\" (UID: \"ad46b9f7-7a11-4768-b680-bb15f38144c8\") " pod="openshift-service-ca/service-ca-865cb79987-b52hc" Apr 17 14:28:06.309070 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:06.309051 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5b22\" (UniqueName: \"kubernetes.io/projected/ad46b9f7-7a11-4768-b680-bb15f38144c8-kube-api-access-r5b22\") pod \"service-ca-865cb79987-b52hc\" (UID: \"ad46b9f7-7a11-4768-b680-bb15f38144c8\") " pod="openshift-service-ca/service-ca-865cb79987-b52hc" Apr 17 14:28:06.447676 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:06.447602 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-865cb79987-b52hc" Apr 17 14:28:06.502914 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:06.502415 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d16f0ef-1c78-4702-8694-f5c03fdb065b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-75587bd455-jsfqq\" (UID: \"0d16f0ef-1c78-4702-8694-f5c03fdb065b\") " pod="openshift-monitoring/cluster-monitoring-operator-75587bd455-jsfqq" Apr 17 14:28:06.502914 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:28:06.502629 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Apr 17 14:28:06.502914 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:28:06.502707 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d16f0ef-1c78-4702-8694-f5c03fdb065b-cluster-monitoring-operator-tls podName:0d16f0ef-1c78-4702-8694-f5c03fdb065b nodeName:}" failed. No retries permitted until 2026-04-17 14:28:14.502684815 +0000 UTC m=+86.547113620 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0d16f0ef-1c78-4702-8694-f5c03fdb065b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-75587bd455-jsfqq" (UID: "0d16f0ef-1c78-4702-8694-f5c03fdb065b") : secret "cluster-monitoring-operator-tls" not found Apr 17 14:28:06.563808 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:06.563762 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-865cb79987-b52hc"] Apr 17 14:28:06.568264 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:28:06.568237 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad46b9f7_7a11_4768_b680_bb15f38144c8.slice/crio-fcc652723d02daa47ccef91f475cd53ddf771db583c0b903b8f30ad0136fb53c WatchSource:0}: Error finding container fcc652723d02daa47ccef91f475cd53ddf771db583c0b903b8f30ad0136fb53c: Status 404 returned error can't find the container with id fcc652723d02daa47ccef91f475cd53ddf771db583c0b903b8f30ad0136fb53c Apr 17 14:28:06.908518 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:06.908485 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-865cb79987-b52hc" event={"ID":"ad46b9f7-7a11-4768-b680-bb15f38144c8","Type":"ContainerStarted","Data":"de9c27859d671097477e3989698fad9b818d807900044b74feaaf307eeeeddec"} Apr 17 14:28:06.908518 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:06.908519 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-865cb79987-b52hc" event={"ID":"ad46b9f7-7a11-4768-b680-bb15f38144c8","Type":"ContainerStarted","Data":"fcc652723d02daa47ccef91f475cd53ddf771db583c0b903b8f30ad0136fb53c"} Apr 17 14:28:06.923269 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:06.923224 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-865cb79987-b52hc" podStartSLOduration=0.923211933 podStartE2EDuration="923.211933ms" podCreationTimestamp="2026-04-17 14:28:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-17 14:28:06.922960963 +0000 UTC m=+78.967389763" watchObservedRunningTime="2026-04-17 14:28:06.923211933 +0000 UTC m=+78.967640740" Apr 17 14:28:07.062956 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:07.062929 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pqwhd_ab4fc13b-36d4-4f8b-9f8a-52c2424a807d/dns-node-resolver/0.log" Apr 17 14:28:08.064155 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:08.064123 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wfhf5_a44848f6-e8dc-4204-9db4-a4c4ca9cffdd/node-ca/0.log" Apr 17 14:28:09.063185 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:09.063156 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-74bb7799d9-qhps7_3492345b-fc9e-4e01-b9b3-5dfa31a8de37/migrator/0.log" Apr 17 14:28:09.263362 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:09.263334 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-74bb7799d9-qhps7_3492345b-fc9e-4e01-b9b3-5dfa31a8de37/graceful-termination/0.log" Apr 17 14:28:09.462305 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:09.462283 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-9d4b6777b-mslwt" Apr 17 14:28:09.462445 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:09.462320 2573 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-9d4b6777b-mslwt" Apr 17 14:28:09.462658 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:09.462647 2573 scope.go:117] "RemoveContainer" containerID="a9aa05cc8857957458dcfed6c8a6d2f40ad93ffed712ea3fdc190b9f6e7a49b5" Apr 17 14:28:09.462815 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:28:09.462799 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-9d4b6777b-mslwt_openshift-console-operator(fba84e6b-7f61-427c-94d1-489ee9dadc9e)\"" pod="openshift-console-operator/console-operator-9d4b6777b-mslwt" podUID="fba84e6b-7f61-427c-94d1-489ee9dadc9e" Apr 17 14:28:14.559072 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:14.559035 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d16f0ef-1c78-4702-8694-f5c03fdb065b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-75587bd455-jsfqq\" (UID: \"0d16f0ef-1c78-4702-8694-f5c03fdb065b\") " pod="openshift-monitoring/cluster-monitoring-operator-75587bd455-jsfqq" Apr 17 14:28:14.559463 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:28:14.559203 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Apr 17 14:28:14.559463 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:28:14.559311 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d16f0ef-1c78-4702-8694-f5c03fdb065b-cluster-monitoring-operator-tls podName:0d16f0ef-1c78-4702-8694-f5c03fdb065b nodeName:}" failed. No retries permitted until 2026-04-17 14:28:30.559290721 +0000 UTC m=+102.603719509 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0d16f0ef-1c78-4702-8694-f5c03fdb065b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-75587bd455-jsfqq" (UID: "0d16f0ef-1c78-4702-8694-f5c03fdb065b") : secret "cluster-monitoring-operator-tls" not found Apr 17 14:28:23.620961 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:23.620930 2573 scope.go:117] "RemoveContainer" containerID="a9aa05cc8857957458dcfed6c8a6d2f40ad93ffed712ea3fdc190b9f6e7a49b5" Apr 17 14:28:23.953541 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:23.953467 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-9d4b6777b-mslwt_fba84e6b-7f61-427c-94d1-489ee9dadc9e/console-operator/2.log" Apr 17 14:28:23.953811 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:23.953797 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-9d4b6777b-mslwt_fba84e6b-7f61-427c-94d1-489ee9dadc9e/console-operator/1.log" Apr 17 14:28:23.953865 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:23.953827 2573 generic.go:358] "Generic (PLEG): container finished" podID="fba84e6b-7f61-427c-94d1-489ee9dadc9e" containerID="1e3f9ace139093d7e6f84b8d4713e249d1bfc1f42d29f1f05d1be8aee1a9be47" exitCode=255 Apr 17 14:28:23.953900 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:23.953878 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-9d4b6777b-mslwt" event={"ID":"fba84e6b-7f61-427c-94d1-489ee9dadc9e","Type":"ContainerDied","Data":"1e3f9ace139093d7e6f84b8d4713e249d1bfc1f42d29f1f05d1be8aee1a9be47"} Apr 17 14:28:23.953932 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:23.953909 2573 scope.go:117] "RemoveContainer" containerID="a9aa05cc8857957458dcfed6c8a6d2f40ad93ffed712ea3fdc190b9f6e7a49b5" Apr 17 14:28:23.954214 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:23.954189 2573 scope.go:117] "RemoveContainer" containerID="1e3f9ace139093d7e6f84b8d4713e249d1bfc1f42d29f1f05d1be8aee1a9be47" Apr 17 14:28:23.954400 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:28:23.954379 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-9d4b6777b-mslwt_openshift-console-operator(fba84e6b-7f61-427c-94d1-489ee9dadc9e)\"" pod="openshift-console-operator/console-operator-9d4b6777b-mslwt" podUID="fba84e6b-7f61-427c-94d1-489ee9dadc9e" Apr 17 14:28:24.735786 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:24.735758 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/75b3dec2-6f28-4d4d-ae26-d694cb6e25de-metrics-tls\") pod \"dns-default-zrllc\" (UID: \"75b3dec2-6f28-4d4d-ae26-d694cb6e25de\") " pod="openshift-dns/dns-default-zrllc" Apr 17 14:28:24.736165 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:24.735798 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3c4b5228-3ecd-4956-b222-fa218091ebaf-cert\") pod \"ingress-canary-fwpd5\" (UID: \"3c4b5228-3ecd-4956-b222-fa218091ebaf\") " pod="openshift-ingress-canary/ingress-canary-fwpd5" Apr 17 14:28:24.738066 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:24.738039 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/75b3dec2-6f28-4d4d-ae26-d694cb6e25de-metrics-tls\") pod \"dns-default-zrllc\" (UID: \"75b3dec2-6f28-4d4d-ae26-d694cb6e25de\") " pod="openshift-dns/dns-default-zrllc" Apr 17 14:28:24.738256 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:24.738236 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3c4b5228-3ecd-4956-b222-fa218091ebaf-cert\") pod \"ingress-canary-fwpd5\" (UID: \"3c4b5228-3ecd-4956-b222-fa218091ebaf\") " pod="openshift-ingress-canary/ingress-canary-fwpd5" Apr 17 14:28:24.813870 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:24.813805 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-p2qzh\"" Apr 17 14:28:24.822658 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:24.822641 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zrllc" Apr 17 14:28:24.826013 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:24.825997 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-qz9tk\"" Apr 17 14:28:24.834692 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:24.834676 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fwpd5" Apr 17 14:28:24.945177 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:24.945153 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zrllc"] Apr 17 14:28:24.948444 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:28:24.948410 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75b3dec2_6f28_4d4d_ae26_d694cb6e25de.slice/crio-d87bd43cb675a92d419d54f69abc34bcaef1d793d92e988e79662ee29171b87d WatchSource:0}: Error finding container d87bd43cb675a92d419d54f69abc34bcaef1d793d92e988e79662ee29171b87d: Status 404 returned error can't find the container with id d87bd43cb675a92d419d54f69abc34bcaef1d793d92e988e79662ee29171b87d Apr 17 14:28:24.956826 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:24.956772 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zrllc" event={"ID":"75b3dec2-6f28-4d4d-ae26-d694cb6e25de","Type":"ContainerStarted","Data":"d87bd43cb675a92d419d54f69abc34bcaef1d793d92e988e79662ee29171b87d"} Apr 17 14:28:24.957768 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:24.957725 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fwpd5"] Apr 17 14:28:24.958748 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:24.958683 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-9d4b6777b-mslwt_fba84e6b-7f61-427c-94d1-489ee9dadc9e/console-operator/2.log" Apr 17 14:28:24.960429 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:28:24.960404 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c4b5228_3ecd_4956_b222_fa218091ebaf.slice/crio-21cc5bc14e78f3ac4df5eebce9ed5be9d747a34ad7f0182f7eb3b6579f0e9d6a WatchSource:0}: Error finding container 21cc5bc14e78f3ac4df5eebce9ed5be9d747a34ad7f0182f7eb3b6579f0e9d6a: Status 404 returned error can't find the container with id 21cc5bc14e78f3ac4df5eebce9ed5be9d747a34ad7f0182f7eb3b6579f0e9d6a Apr 17 14:28:25.962696 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:25.962658 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fwpd5" event={"ID":"3c4b5228-3ecd-4956-b222-fa218091ebaf","Type":"ContainerStarted","Data":"21cc5bc14e78f3ac4df5eebce9ed5be9d747a34ad7f0182f7eb3b6579f0e9d6a"} Apr 17 14:28:27.550325 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:27.550281 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-cb95c66f6-zxr4r"] Apr 17 14:28:27.552137 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:27.552122 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-cb95c66f6-zxr4r" Apr 17 14:28:27.555584 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:27.555558 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Apr 17 14:28:27.555727 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:27.555557 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-gc9g9\"" Apr 17 14:28:27.555727 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:27.555656 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Apr 17 14:28:27.566878 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:27.566832 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-cb95c66f6-zxr4r"] Apr 17 14:28:27.571178 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:27.571154 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-c5jbb"] Apr 17 14:28:27.573421 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:27.573404 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-c5jbb" Apr 17 14:28:27.575733 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:27.575709 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wp7x7\"" Apr 17 14:28:27.576056 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:27.576041 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Apr 17 14:28:27.576171 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:27.576154 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Apr 17 14:28:27.585230 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:27.585210 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-c5jbb"] Apr 17 14:28:27.657150 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:27.657123 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c80a8ac8-eef8-4f03-8d83-63e2e428dea8-data-volume\") pod \"insights-runtime-extractor-c5jbb\" (UID: \"c80a8ac8-eef8-4f03-8d83-63e2e428dea8\") " pod="openshift-insights/insights-runtime-extractor-c5jbb" Apr 17 14:28:27.657150 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:27.657152 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c80a8ac8-eef8-4f03-8d83-63e2e428dea8-crio-socket\") pod \"insights-runtime-extractor-c5jbb\" (UID: \"c80a8ac8-eef8-4f03-8d83-63e2e428dea8\") " pod="openshift-insights/insights-runtime-extractor-c5jbb" Apr 17 14:28:27.657325 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:27.657173 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c80a8ac8-eef8-4f03-8d83-63e2e428dea8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c5jbb\" (UID: \"c80a8ac8-eef8-4f03-8d83-63e2e428dea8\") " pod="openshift-insights/insights-runtime-extractor-c5jbb" Apr 17 14:28:27.657325 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:27.657192 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2892c2c4-2d4e-4751-944f-0bceddeef837-nginx-conf\") pod \"networking-console-plugin-cb95c66f6-zxr4r\" (UID: \"2892c2c4-2d4e-4751-944f-0bceddeef837\") " pod="openshift-network-console/networking-console-plugin-cb95c66f6-zxr4r" Apr 17 14:28:27.657325 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:27.657269 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c80a8ac8-eef8-4f03-8d83-63e2e428dea8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c5jbb\" (UID: \"c80a8ac8-eef8-4f03-8d83-63e2e428dea8\") " pod="openshift-insights/insights-runtime-extractor-c5jbb" Apr 17 14:28:27.657450 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:27.657339 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7g7th\" (UniqueName: \"kubernetes.io/projected/c80a8ac8-eef8-4f03-8d83-63e2e428dea8-kube-api-access-7g7th\") pod \"insights-runtime-extractor-c5jbb\" (UID: \"c80a8ac8-eef8-4f03-8d83-63e2e428dea8\") " pod="openshift-insights/insights-runtime-extractor-c5jbb" Apr 17 14:28:27.657450 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:27.657376 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2892c2c4-2d4e-4751-944f-0bceddeef837-networking-console-plugin-cert\") pod \"networking-console-plugin-cb95c66f6-zxr4r\" (UID: \"2892c2c4-2d4e-4751-944f-0bceddeef837\") " pod="openshift-network-console/networking-console-plugin-cb95c66f6-zxr4r" Apr 17 14:28:27.758023 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:27.757991 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c80a8ac8-eef8-4f03-8d83-63e2e428dea8-data-volume\") pod \"insights-runtime-extractor-c5jbb\" (UID: \"c80a8ac8-eef8-4f03-8d83-63e2e428dea8\") " pod="openshift-insights/insights-runtime-extractor-c5jbb" Apr 17 14:28:27.758023 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:27.758030 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c80a8ac8-eef8-4f03-8d83-63e2e428dea8-crio-socket\") pod \"insights-runtime-extractor-c5jbb\" (UID: \"c80a8ac8-eef8-4f03-8d83-63e2e428dea8\") " pod="openshift-insights/insights-runtime-extractor-c5jbb" Apr 17 14:28:27.758223 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:27.758050 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c80a8ac8-eef8-4f03-8d83-63e2e428dea8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c5jbb\" (UID: \"c80a8ac8-eef8-4f03-8d83-63e2e428dea8\") " pod="openshift-insights/insights-runtime-extractor-c5jbb" Apr 17 14:28:27.758223 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:27.758093 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2892c2c4-2d4e-4751-944f-0bceddeef837-nginx-conf\") pod \"networking-console-plugin-cb95c66f6-zxr4r\" (UID: \"2892c2c4-2d4e-4751-944f-0bceddeef837\") " pod="openshift-network-console/networking-console-plugin-cb95c66f6-zxr4r" Apr 17 14:28:27.758223 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:27.758116 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c80a8ac8-eef8-4f03-8d83-63e2e428dea8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c5jbb\" (UID: \"c80a8ac8-eef8-4f03-8d83-63e2e428dea8\") " pod="openshift-insights/insights-runtime-extractor-c5jbb" Apr 17 14:28:27.758223 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:27.758143 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7g7th\" (UniqueName: \"kubernetes.io/projected/c80a8ac8-eef8-4f03-8d83-63e2e428dea8-kube-api-access-7g7th\") pod \"insights-runtime-extractor-c5jbb\" (UID: \"c80a8ac8-eef8-4f03-8d83-63e2e428dea8\") " pod="openshift-insights/insights-runtime-extractor-c5jbb" Apr 17 14:28:27.758223 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:27.758165 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c80a8ac8-eef8-4f03-8d83-63e2e428dea8-crio-socket\") pod \"insights-runtime-extractor-c5jbb\" (UID: \"c80a8ac8-eef8-4f03-8d83-63e2e428dea8\") " pod="openshift-insights/insights-runtime-extractor-c5jbb" Apr 17 14:28:27.758223 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:27.758201 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2892c2c4-2d4e-4751-944f-0bceddeef837-networking-console-plugin-cert\") pod \"networking-console-plugin-cb95c66f6-zxr4r\" (UID: \"2892c2c4-2d4e-4751-944f-0bceddeef837\") " pod="openshift-network-console/networking-console-plugin-cb95c66f6-zxr4r" Apr 17 14:28:27.758442 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:27.758379 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c80a8ac8-eef8-4f03-8d83-63e2e428dea8-data-volume\") pod \"insights-runtime-extractor-c5jbb\" (UID: \"c80a8ac8-eef8-4f03-8d83-63e2e428dea8\") " pod="openshift-insights/insights-runtime-extractor-c5jbb" Apr 17 14:28:27.758752 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:27.758731 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c80a8ac8-eef8-4f03-8d83-63e2e428dea8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c5jbb\" (UID: \"c80a8ac8-eef8-4f03-8d83-63e2e428dea8\") " pod="openshift-insights/insights-runtime-extractor-c5jbb" Apr 17 14:28:27.758865 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:27.758772 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2892c2c4-2d4e-4751-944f-0bceddeef837-nginx-conf\") pod \"networking-console-plugin-cb95c66f6-zxr4r\" (UID: \"2892c2c4-2d4e-4751-944f-0bceddeef837\") " pod="openshift-network-console/networking-console-plugin-cb95c66f6-zxr4r" Apr 17 14:28:27.760475 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:27.760454 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c80a8ac8-eef8-4f03-8d83-63e2e428dea8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c5jbb\" (UID: \"c80a8ac8-eef8-4f03-8d83-63e2e428dea8\") " pod="openshift-insights/insights-runtime-extractor-c5jbb" Apr 17 14:28:27.766296 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:27.766272 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7g7th\" (UniqueName: \"kubernetes.io/projected/c80a8ac8-eef8-4f03-8d83-63e2e428dea8-kube-api-access-7g7th\") pod \"insights-runtime-extractor-c5jbb\" (UID: \"c80a8ac8-eef8-4f03-8d83-63e2e428dea8\") " pod="openshift-insights/insights-runtime-extractor-c5jbb" Apr 17 14:28:27.770669 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:27.770645 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2892c2c4-2d4e-4751-944f-0bceddeef837-networking-console-plugin-cert\") pod \"networking-console-plugin-cb95c66f6-zxr4r\" (UID: \"2892c2c4-2d4e-4751-944f-0bceddeef837\") " pod="openshift-network-console/networking-console-plugin-cb95c66f6-zxr4r" Apr 17 14:28:27.860873 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:27.860797 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-cb95c66f6-zxr4r" Apr 17 14:28:27.872970 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:27.872947 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-n9zdz" Apr 17 14:28:27.881462 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:27.881437 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-c5jbb" Apr 17 14:28:27.970376 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:27.970320 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fwpd5" event={"ID":"3c4b5228-3ecd-4956-b222-fa218091ebaf","Type":"ContainerStarted","Data":"ee5f41740b753a60a6614ec653e14bc14f4d7d419b6c3dece4daa9f92e61fcdb"} Apr 17 14:28:27.972406 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:27.972328 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zrllc" event={"ID":"75b3dec2-6f28-4d4d-ae26-d694cb6e25de","Type":"ContainerStarted","Data":"31c74da7008a8667d3ac4797fbf0a6fb375d377222f75dd92e8d9b29c0afb060"} Apr 17 14:28:27.972406 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:27.972363 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zrllc" event={"ID":"75b3dec2-6f28-4d4d-ae26-d694cb6e25de","Type":"ContainerStarted","Data":"40f5e13c6291eeb20d47a6a0223404cb3f92b05568b83d27aaf644934b71fb8b"} Apr 17 14:28:27.972563 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:27.972464 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-zrllc" Apr 17 14:28:27.998999 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:27.998914 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-fwpd5" podStartSLOduration=65.91022189 podStartE2EDuration="1m7.998894122s" podCreationTimestamp="2026-04-17 14:27:20 +0000 UTC" firstStartedPulling="2026-04-17 14:28:24.9620214 +0000 UTC m=+97.006450184" lastFinishedPulling="2026-04-17 14:28:27.050693631 +0000 UTC m=+99.095122416" observedRunningTime="2026-04-17 14:28:27.984724345 +0000 UTC m=+100.029153153" watchObservedRunningTime="2026-04-17 14:28:27.998894122 +0000 UTC m=+100.043322931" Apr 17 14:28:28.000180 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:28.000153 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-cb95c66f6-zxr4r"] Apr 17 14:28:28.003381 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:28:28.003357 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2892c2c4_2d4e_4751_944f_0bceddeef837.slice/crio-9eee671310d5e7fa8bbbddcb3d2a5580cf108c189b41d7fbdae452b3042facf1 WatchSource:0}: Error finding container 9eee671310d5e7fa8bbbddcb3d2a5580cf108c189b41d7fbdae452b3042facf1: Status 404 returned error can't find the container with id 9eee671310d5e7fa8bbbddcb3d2a5580cf108c189b41d7fbdae452b3042facf1 Apr 17 14:28:28.009240 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:28.009195 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-zrllc" podStartSLOduration=65.914123741 podStartE2EDuration="1m8.009178944s" podCreationTimestamp="2026-04-17 14:27:20 +0000 UTC" firstStartedPulling="2026-04-17 14:28:24.953316287 +0000 UTC m=+96.997745072" lastFinishedPulling="2026-04-17 14:28:27.04837149 +0000 UTC m=+99.092800275" observedRunningTime="2026-04-17 14:28:28.008221171 +0000 UTC m=+100.052649978" watchObservedRunningTime="2026-04-17 14:28:28.009178944 +0000 UTC m=+100.053607753" Apr 17 14:28:28.019638 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:28.019617 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-c5jbb"] Apr 17 14:28:28.023343 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:28:28.023319 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc80a8ac8_eef8_4f03_8d83_63e2e428dea8.slice/crio-53152744c97e2a22f53354f5d8b7e7782503b605eb975d35fd4c85a6cce97aff WatchSource:0}: Error finding container 53152744c97e2a22f53354f5d8b7e7782503b605eb975d35fd4c85a6cce97aff: Status 404 returned error can't find the container with id 53152744c97e2a22f53354f5d8b7e7782503b605eb975d35fd4c85a6cce97aff Apr 17 14:28:28.976633 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:28.976592 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-cb95c66f6-zxr4r" event={"ID":"2892c2c4-2d4e-4751-944f-0bceddeef837","Type":"ContainerStarted","Data":"9eee671310d5e7fa8bbbddcb3d2a5580cf108c189b41d7fbdae452b3042facf1"} Apr 17 14:28:28.978038 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:28.978004 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c5jbb" event={"ID":"c80a8ac8-eef8-4f03-8d83-63e2e428dea8","Type":"ContainerStarted","Data":"a35e6f463190c53162710a732b43883ad60d5a87a4a2d3702864a879aa383b54"} Apr 17 14:28:28.978038 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:28.978032 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c5jbb" event={"ID":"c80a8ac8-eef8-4f03-8d83-63e2e428dea8","Type":"ContainerStarted","Data":"53152744c97e2a22f53354f5d8b7e7782503b605eb975d35fd4c85a6cce97aff"} Apr 17 14:28:29.462229 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:29.462198 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-9d4b6777b-mslwt" Apr 17 14:28:29.462355 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:29.462239 2573 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-9d4b6777b-mslwt" Apr 17 14:28:29.462648 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:29.462625 2573 scope.go:117] "RemoveContainer" containerID="1e3f9ace139093d7e6f84b8d4713e249d1bfc1f42d29f1f05d1be8aee1a9be47" Apr 17 14:28:29.462870 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:28:29.462853 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-9d4b6777b-mslwt_openshift-console-operator(fba84e6b-7f61-427c-94d1-489ee9dadc9e)\"" pod="openshift-console-operator/console-operator-9d4b6777b-mslwt" podUID="fba84e6b-7f61-427c-94d1-489ee9dadc9e" Apr 17 14:28:29.982928 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:29.982890 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c5jbb" event={"ID":"c80a8ac8-eef8-4f03-8d83-63e2e428dea8","Type":"ContainerStarted","Data":"fb8f21622f9e786df2c1c81ae0dae4bed12bd69dcf9ab23263c0546e451f4a04"} Apr 17 14:28:29.984302 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:29.984275 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-cb95c66f6-zxr4r" event={"ID":"2892c2c4-2d4e-4751-944f-0bceddeef837","Type":"ContainerStarted","Data":"0b22642fe00f29c63fc207049f3daa58702b6225b4996fd3212a19530fe290d3"} Apr 17 14:28:29.999006 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:29.998941 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-cb95c66f6-zxr4r" podStartSLOduration=2.038745284 podStartE2EDuration="2.998927459s" podCreationTimestamp="2026-04-17 14:28:27 +0000 UTC" firstStartedPulling="2026-04-17 14:28:28.005674349 +0000 UTC m=+100.050103135" lastFinishedPulling="2026-04-17 14:28:28.965856522 +0000 UTC m=+101.010285310" observedRunningTime="2026-04-17 14:28:29.997798403 +0000 UTC m=+102.042227212" watchObservedRunningTime="2026-04-17 14:28:29.998927459 +0000 UTC m=+102.043356317" Apr 17 14:28:30.580823 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:30.580734 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d16f0ef-1c78-4702-8694-f5c03fdb065b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-75587bd455-jsfqq\" (UID: \"0d16f0ef-1c78-4702-8694-f5c03fdb065b\") " pod="openshift-monitoring/cluster-monitoring-operator-75587bd455-jsfqq" Apr 17 14:28:30.583089 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:30.583071 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d16f0ef-1c78-4702-8694-f5c03fdb065b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-75587bd455-jsfqq\" (UID: \"0d16f0ef-1c78-4702-8694-f5c03fdb065b\") " pod="openshift-monitoring/cluster-monitoring-operator-75587bd455-jsfqq" Apr 17 14:28:30.849900 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:30.849815 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-75587bd455-jsfqq" Apr 17 14:28:30.978760 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:30.978727 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-75587bd455-jsfqq"] Apr 17 14:28:30.983135 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:28:30.983102 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d16f0ef_1c78_4702_8694_f5c03fdb065b.slice/crio-19531a3224c2852665f47a467e4fe3863c911a1e7444132747ad9fd21997da16 WatchSource:0}: Error finding container 19531a3224c2852665f47a467e4fe3863c911a1e7444132747ad9fd21997da16: Status 404 returned error can't find the container with id 19531a3224c2852665f47a467e4fe3863c911a1e7444132747ad9fd21997da16 Apr 17 14:28:30.989204 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:30.989176 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c5jbb" event={"ID":"c80a8ac8-eef8-4f03-8d83-63e2e428dea8","Type":"ContainerStarted","Data":"58dd1c63c436c6d9faa7ffe1f12fd8af619c3474f319a2f86449b8a4e6fb5515"} Apr 17 14:28:30.990189 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:30.990166 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-75587bd455-jsfqq" event={"ID":"0d16f0ef-1c78-4702-8694-f5c03fdb065b","Type":"ContainerStarted","Data":"19531a3224c2852665f47a467e4fe3863c911a1e7444132747ad9fd21997da16"} Apr 17 14:28:33.503191 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:33.503144 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-c5jbb" podStartSLOduration=4.353985075 podStartE2EDuration="6.503129469s" podCreationTimestamp="2026-04-17 14:28:27 +0000 UTC" firstStartedPulling="2026-04-17 14:28:28.077471625 +0000 UTC m=+100.121900410" lastFinishedPulling="2026-04-17 14:28:30.226616016 +0000 UTC m=+102.271044804" observedRunningTime="2026-04-17 14:28:31.006495926 +0000 UTC m=+103.050924748" watchObservedRunningTime="2026-04-17 14:28:33.503129469 +0000 UTC m=+105.547558335" Apr 17 14:28:33.503555 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:33.503270 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-tzhn4"] Apr 17 14:28:33.522861 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:33.522835 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-tzhn4"] Apr 17 14:28:33.523014 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:33.522943 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-tzhn4" Apr 17 14:28:33.526120 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:33.526097 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-kl8mc\"" Apr 17 14:28:33.526550 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:33.526137 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Apr 17 14:28:33.602778 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:33.602747 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/786ddbf4-4340-4973-be6d-6f4390936345-tls-certificates\") pod \"prometheus-operator-admission-webhook-57cf98b594-tzhn4\" (UID: \"786ddbf4-4340-4973-be6d-6f4390936345\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-tzhn4" Apr 17 14:28:33.703473 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:33.703437 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/786ddbf4-4340-4973-be6d-6f4390936345-tls-certificates\") pod \"prometheus-operator-admission-webhook-57cf98b594-tzhn4\" (UID: \"786ddbf4-4340-4973-be6d-6f4390936345\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-tzhn4" Apr 17 14:28:33.705802 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:33.705776 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/786ddbf4-4340-4973-be6d-6f4390936345-tls-certificates\") pod \"prometheus-operator-admission-webhook-57cf98b594-tzhn4\" (UID: \"786ddbf4-4340-4973-be6d-6f4390936345\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-tzhn4" Apr 17 14:28:33.834076 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:33.834000 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-tzhn4" Apr 17 14:28:33.944003 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:33.943959 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-tzhn4"] Apr 17 14:28:33.947241 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:28:33.947207 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod786ddbf4_4340_4973_be6d_6f4390936345.slice/crio-57ac9df48b87c4588274d783665499061b0b33f9afb2e312ad32efa8c8880a8a WatchSource:0}: Error finding container 57ac9df48b87c4588274d783665499061b0b33f9afb2e312ad32efa8c8880a8a: Status 404 returned error can't find the container with id 57ac9df48b87c4588274d783665499061b0b33f9afb2e312ad32efa8c8880a8a Apr 17 14:28:33.998872 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:33.998834 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-75587bd455-jsfqq" event={"ID":"0d16f0ef-1c78-4702-8694-f5c03fdb065b","Type":"ContainerStarted","Data":"6fb0f300cc162652b45972c1e8ca20c113f9fe96c10c1fc7c9e1b3f2858e2aa0"} Apr 17 14:28:33.999939 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:33.999915 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-tzhn4" event={"ID":"786ddbf4-4340-4973-be6d-6f4390936345","Type":"ContainerStarted","Data":"57ac9df48b87c4588274d783665499061b0b33f9afb2e312ad32efa8c8880a8a"} Apr 17 14:28:34.014772 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:34.014734 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-75587bd455-jsfqq" podStartSLOduration=34.033199507 podStartE2EDuration="36.014720662s" podCreationTimestamp="2026-04-17 14:27:58 +0000 UTC" firstStartedPulling="2026-04-17 14:28:30.985081369 +0000 UTC m=+103.029510154" lastFinishedPulling="2026-04-17 14:28:32.966602524 +0000 UTC m=+105.011031309" observedRunningTime="2026-04-17 14:28:34.014101193 +0000 UTC m=+106.058529999" watchObservedRunningTime="2026-04-17 14:28:34.014720662 +0000 UTC m=+106.059149486" Apr 17 14:28:35.004027 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:35.003995 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-tzhn4" event={"ID":"786ddbf4-4340-4973-be6d-6f4390936345","Type":"ContainerStarted","Data":"3bc3c66f928b3d9ab27089a060a4fd1a8d655bb47d00f66040eb4ea8e857b466"} Apr 17 14:28:35.004363 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:35.004274 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-tzhn4" Apr 17 14:28:35.008480 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:35.008461 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-tzhn4" Apr 17 14:28:35.020776 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:35.020734 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-tzhn4" podStartSLOduration=1.046083585 podStartE2EDuration="2.020722134s" podCreationTimestamp="2026-04-17 14:28:33 +0000 UTC" firstStartedPulling="2026-04-17 14:28:33.94925968 +0000 UTC m=+105.993688466" lastFinishedPulling="2026-04-17 14:28:34.92389823 +0000 UTC m=+106.968327015" observedRunningTime="2026-04-17 14:28:35.019574141 +0000 UTC m=+107.064002951" watchObservedRunningTime="2026-04-17 14:28:35.020722134 +0000 UTC m=+107.065150941" Apr 17 14:28:35.567055 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:35.567023 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5676c8c784-k2tvr"] Apr 17 14:28:35.568970 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:35.568953 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5676c8c784-k2tvr" Apr 17 14:28:35.572558 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:35.572534 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Apr 17 14:28:35.572558 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:35.572553 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Apr 17 14:28:35.572736 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:35.572557 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Apr 17 14:28:35.572736 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:35.572558 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-6svhm\"" Apr 17 14:28:35.578490 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:35.578465 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5676c8c784-k2tvr"] Apr 17 14:28:35.618298 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:35.618273 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jr45m\" (UniqueName: \"kubernetes.io/projected/6e1ecc2e-402b-422d-93ae-898fca47f8a1-kube-api-access-jr45m\") pod \"prometheus-operator-5676c8c784-k2tvr\" (UID: \"6e1ecc2e-402b-422d-93ae-898fca47f8a1\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-k2tvr" Apr 17 14:28:35.618394 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:35.618308 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6e1ecc2e-402b-422d-93ae-898fca47f8a1-prometheus-operator-tls\") pod \"prometheus-operator-5676c8c784-k2tvr\" (UID: \"6e1ecc2e-402b-422d-93ae-898fca47f8a1\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-k2tvr" Apr 17 14:28:35.618394 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:35.618343 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6e1ecc2e-402b-422d-93ae-898fca47f8a1-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5676c8c784-k2tvr\" (UID: \"6e1ecc2e-402b-422d-93ae-898fca47f8a1\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-k2tvr" Apr 17 14:28:35.618394 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:35.618383 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e1ecc2e-402b-422d-93ae-898fca47f8a1-metrics-client-ca\") pod \"prometheus-operator-5676c8c784-k2tvr\" (UID: \"6e1ecc2e-402b-422d-93ae-898fca47f8a1\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-k2tvr" Apr 17 14:28:35.719041 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:35.719019 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jr45m\" (UniqueName: \"kubernetes.io/projected/6e1ecc2e-402b-422d-93ae-898fca47f8a1-kube-api-access-jr45m\") pod \"prometheus-operator-5676c8c784-k2tvr\" (UID: \"6e1ecc2e-402b-422d-93ae-898fca47f8a1\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-k2tvr" Apr 17 14:28:35.719170 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:35.719062 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6e1ecc2e-402b-422d-93ae-898fca47f8a1-prometheus-operator-tls\") pod \"prometheus-operator-5676c8c784-k2tvr\" (UID: \"6e1ecc2e-402b-422d-93ae-898fca47f8a1\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-k2tvr" Apr 17 14:28:35.719170 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:35.719121 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6e1ecc2e-402b-422d-93ae-898fca47f8a1-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5676c8c784-k2tvr\" (UID: \"6e1ecc2e-402b-422d-93ae-898fca47f8a1\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-k2tvr" Apr 17 14:28:35.719170 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:35.719151 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e1ecc2e-402b-422d-93ae-898fca47f8a1-metrics-client-ca\") pod \"prometheus-operator-5676c8c784-k2tvr\" (UID: \"6e1ecc2e-402b-422d-93ae-898fca47f8a1\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-k2tvr" Apr 17 14:28:35.719321 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:28:35.719245 2573 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Apr 17 14:28:35.719321 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:28:35.719311 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e1ecc2e-402b-422d-93ae-898fca47f8a1-prometheus-operator-tls podName:6e1ecc2e-402b-422d-93ae-898fca47f8a1 nodeName:}" failed. No retries permitted until 2026-04-17 14:28:36.219294128 +0000 UTC m=+108.263722925 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/6e1ecc2e-402b-422d-93ae-898fca47f8a1-prometheus-operator-tls") pod "prometheus-operator-5676c8c784-k2tvr" (UID: "6e1ecc2e-402b-422d-93ae-898fca47f8a1") : secret "prometheus-operator-tls" not found Apr 17 14:28:35.719785 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:35.719766 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e1ecc2e-402b-422d-93ae-898fca47f8a1-metrics-client-ca\") pod \"prometheus-operator-5676c8c784-k2tvr\" (UID: \"6e1ecc2e-402b-422d-93ae-898fca47f8a1\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-k2tvr" Apr 17 14:28:35.721526 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:35.721505 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6e1ecc2e-402b-422d-93ae-898fca47f8a1-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5676c8c784-k2tvr\" (UID: \"6e1ecc2e-402b-422d-93ae-898fca47f8a1\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-k2tvr" Apr 17 14:28:35.727239 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:35.727218 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jr45m\" (UniqueName: \"kubernetes.io/projected/6e1ecc2e-402b-422d-93ae-898fca47f8a1-kube-api-access-jr45m\") pod \"prometheus-operator-5676c8c784-k2tvr\" (UID: \"6e1ecc2e-402b-422d-93ae-898fca47f8a1\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-k2tvr" Apr 17 14:28:36.223179 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:36.223125 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6e1ecc2e-402b-422d-93ae-898fca47f8a1-prometheus-operator-tls\") pod \"prometheus-operator-5676c8c784-k2tvr\" (UID: \"6e1ecc2e-402b-422d-93ae-898fca47f8a1\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-k2tvr" Apr 17 14:28:36.225464 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:36.225441 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6e1ecc2e-402b-422d-93ae-898fca47f8a1-prometheus-operator-tls\") pod \"prometheus-operator-5676c8c784-k2tvr\" (UID: \"6e1ecc2e-402b-422d-93ae-898fca47f8a1\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-k2tvr" Apr 17 14:28:36.479274 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:36.479173 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5676c8c784-k2tvr" Apr 17 14:28:36.590330 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:36.590301 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5676c8c784-k2tvr"] Apr 17 14:28:36.593642 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:28:36.593615 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e1ecc2e_402b_422d_93ae_898fca47f8a1.slice/crio-d6aa82c34edb3faa4540c12f3f415a5e9dfaca53dd1708fc6bf64a525b4888c1 WatchSource:0}: Error finding container d6aa82c34edb3faa4540c12f3f415a5e9dfaca53dd1708fc6bf64a525b4888c1: Status 404 returned error can't find the container with id d6aa82c34edb3faa4540c12f3f415a5e9dfaca53dd1708fc6bf64a525b4888c1 Apr 17 14:28:37.010098 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:37.010065 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5676c8c784-k2tvr" event={"ID":"6e1ecc2e-402b-422d-93ae-898fca47f8a1","Type":"ContainerStarted","Data":"d6aa82c34edb3faa4540c12f3f415a5e9dfaca53dd1708fc6bf64a525b4888c1"} Apr 17 14:28:37.980133 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:37.980104 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-zrllc" Apr 17 14:28:38.014400 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:38.014369 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5676c8c784-k2tvr" event={"ID":"6e1ecc2e-402b-422d-93ae-898fca47f8a1","Type":"ContainerStarted","Data":"a3e46c07783a65fdc2fe9a654f66208215cded2e36789d32dea1b9e8089143bf"} Apr 17 14:28:38.014400 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:38.014403 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5676c8c784-k2tvr" event={"ID":"6e1ecc2e-402b-422d-93ae-898fca47f8a1","Type":"ContainerStarted","Data":"b1a1c803685dcc448d51c6ac3a39e689d47ba13822865a5dc382197dc73996e8"} Apr 17 14:28:38.029635 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:38.029588 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5676c8c784-k2tvr" podStartSLOduration=1.918651705 podStartE2EDuration="3.029575479s" podCreationTimestamp="2026-04-17 14:28:35 +0000 UTC" firstStartedPulling="2026-04-17 14:28:36.595923072 +0000 UTC m=+108.640351857" lastFinishedPulling="2026-04-17 14:28:37.706846843 +0000 UTC m=+109.751275631" observedRunningTime="2026-04-17 14:28:38.028615096 +0000 UTC m=+110.073043902" watchObservedRunningTime="2026-04-17 14:28:38.029575479 +0000 UTC m=+110.074004285" Apr 17 14:28:39.886294 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:39.886261 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9d44df66c-jtv5k"] Apr 17 14:28:39.889466 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:39.889443 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9d44df66c-jtv5k" Apr 17 14:28:39.891853 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:39.891827 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Apr 17 14:28:39.892222 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:39.892191 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-km724\"" Apr 17 14:28:39.892333 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:39.892240 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Apr 17 14:28:39.899995 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:39.899960 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9d44df66c-jtv5k"] Apr 17 14:28:39.906262 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:39.906240 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-2c2t6"] Apr 17 14:28:39.915241 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:39.915216 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2c2t6" Apr 17 14:28:39.921197 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:39.919882 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2m46t\"" Apr 17 14:28:39.921197 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:39.919929 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Apr 17 14:28:39.921197 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:39.920379 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Apr 17 14:28:39.921703 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:39.921672 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Apr 17 14:28:39.952494 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:39.952467 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7992c17a-fc81-48b6-8a2e-0b328dc8e0be-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9d44df66c-jtv5k\" (UID: \"7992c17a-fc81-48b6-8a2e-0b328dc8e0be\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-jtv5k" Apr 17 14:28:39.952609 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:39.952525 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7992c17a-fc81-48b6-8a2e-0b328dc8e0be-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9d44df66c-jtv5k\" (UID: \"7992c17a-fc81-48b6-8a2e-0b328dc8e0be\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-jtv5k" Apr 17 14:28:39.952609 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:39.952581 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7992c17a-fc81-48b6-8a2e-0b328dc8e0be-metrics-client-ca\") pod \"openshift-state-metrics-9d44df66c-jtv5k\" (UID: \"7992c17a-fc81-48b6-8a2e-0b328dc8e0be\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-jtv5k" Apr 17 14:28:39.952687 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:39.952617 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8fr6\" (UniqueName: \"kubernetes.io/projected/7992c17a-fc81-48b6-8a2e-0b328dc8e0be-kube-api-access-g8fr6\") pod \"openshift-state-metrics-9d44df66c-jtv5k\" (UID: \"7992c17a-fc81-48b6-8a2e-0b328dc8e0be\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-jtv5k" Apr 17 14:28:40.053862 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:40.053824 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/71d47eeb-08ae-4c12-9082-6f8cd2c2d8fb-node-exporter-textfile\") pod \"node-exporter-2c2t6\" (UID: \"71d47eeb-08ae-4c12-9082-6f8cd2c2d8fb\") " pod="openshift-monitoring/node-exporter-2c2t6" Apr 17 14:28:40.053862 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:40.053865 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/71d47eeb-08ae-4c12-9082-6f8cd2c2d8fb-node-exporter-accelerators-collector-config\") pod \"node-exporter-2c2t6\" (UID: \"71d47eeb-08ae-4c12-9082-6f8cd2c2d8fb\") " pod="openshift-monitoring/node-exporter-2c2t6" Apr 17 14:28:40.054086 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:40.053895 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/71d47eeb-08ae-4c12-9082-6f8cd2c2d8fb-node-exporter-wtmp\") pod \"node-exporter-2c2t6\" (UID: \"71d47eeb-08ae-4c12-9082-6f8cd2c2d8fb\") " pod="openshift-monitoring/node-exporter-2c2t6" Apr 17 14:28:40.054086 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:40.053952 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8rpm\" (UniqueName: \"kubernetes.io/projected/71d47eeb-08ae-4c12-9082-6f8cd2c2d8fb-kube-api-access-b8rpm\") pod \"node-exporter-2c2t6\" (UID: \"71d47eeb-08ae-4c12-9082-6f8cd2c2d8fb\") " pod="openshift-monitoring/node-exporter-2c2t6" Apr 17 14:28:40.054086 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:40.054074 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7992c17a-fc81-48b6-8a2e-0b328dc8e0be-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9d44df66c-jtv5k\" (UID: \"7992c17a-fc81-48b6-8a2e-0b328dc8e0be\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-jtv5k" Apr 17 14:28:40.054201 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:40.054104 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/71d47eeb-08ae-4c12-9082-6f8cd2c2d8fb-root\") pod \"node-exporter-2c2t6\" (UID: \"71d47eeb-08ae-4c12-9082-6f8cd2c2d8fb\") " pod="openshift-monitoring/node-exporter-2c2t6" Apr 17 14:28:40.054201 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:40.054128 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/71d47eeb-08ae-4c12-9082-6f8cd2c2d8fb-node-exporter-tls\") pod \"node-exporter-2c2t6\" (UID: \"71d47eeb-08ae-4c12-9082-6f8cd2c2d8fb\") " pod="openshift-monitoring/node-exporter-2c2t6" Apr 17 14:28:40.054263 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:40.054233 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/71d47eeb-08ae-4c12-9082-6f8cd2c2d8fb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2c2t6\" (UID: \"71d47eeb-08ae-4c12-9082-6f8cd2c2d8fb\") " pod="openshift-monitoring/node-exporter-2c2t6" Apr 17 14:28:40.054299 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:40.054262 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7992c17a-fc81-48b6-8a2e-0b328dc8e0be-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9d44df66c-jtv5k\" (UID: \"7992c17a-fc81-48b6-8a2e-0b328dc8e0be\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-jtv5k" Apr 17 14:28:40.054299 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:40.054286 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/71d47eeb-08ae-4c12-9082-6f8cd2c2d8fb-sys\") pod \"node-exporter-2c2t6\" (UID: \"71d47eeb-08ae-4c12-9082-6f8cd2c2d8fb\") " pod="openshift-monitoring/node-exporter-2c2t6" Apr 17 14:28:40.054374 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:40.054315 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7992c17a-fc81-48b6-8a2e-0b328dc8e0be-metrics-client-ca\") pod \"openshift-state-metrics-9d44df66c-jtv5k\" (UID: \"7992c17a-fc81-48b6-8a2e-0b328dc8e0be\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-jtv5k" Apr 17 14:28:40.054374 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:40.054346 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g8fr6\" (UniqueName: \"kubernetes.io/projected/7992c17a-fc81-48b6-8a2e-0b328dc8e0be-kube-api-access-g8fr6\") pod \"openshift-state-metrics-9d44df66c-jtv5k\" (UID: \"7992c17a-fc81-48b6-8a2e-0b328dc8e0be\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-jtv5k" Apr 17 14:28:40.054469 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:40.054375 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/71d47eeb-08ae-4c12-9082-6f8cd2c2d8fb-metrics-client-ca\") pod \"node-exporter-2c2t6\" (UID: \"71d47eeb-08ae-4c12-9082-6f8cd2c2d8fb\") " pod="openshift-monitoring/node-exporter-2c2t6" Apr 17 14:28:40.055097 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:40.055073 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7992c17a-fc81-48b6-8a2e-0b328dc8e0be-metrics-client-ca\") pod \"openshift-state-metrics-9d44df66c-jtv5k\" (UID: \"7992c17a-fc81-48b6-8a2e-0b328dc8e0be\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-jtv5k" Apr 17 14:28:40.056570 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:40.056544 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7992c17a-fc81-48b6-8a2e-0b328dc8e0be-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9d44df66c-jtv5k\" (UID: \"7992c17a-fc81-48b6-8a2e-0b328dc8e0be\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-jtv5k" Apr 17 14:28:40.056703 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:40.056684 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7992c17a-fc81-48b6-8a2e-0b328dc8e0be-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9d44df66c-jtv5k\" (UID: \"7992c17a-fc81-48b6-8a2e-0b328dc8e0be\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-jtv5k" Apr 17 14:28:40.066633 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:40.066609 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8fr6\" (UniqueName: \"kubernetes.io/projected/7992c17a-fc81-48b6-8a2e-0b328dc8e0be-kube-api-access-g8fr6\") pod \"openshift-state-metrics-9d44df66c-jtv5k\" (UID: \"7992c17a-fc81-48b6-8a2e-0b328dc8e0be\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-jtv5k" Apr 17 14:28:40.154830 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:40.154754 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/71d47eeb-08ae-4c12-9082-6f8cd2c2d8fb-node-exporter-textfile\") pod \"node-exporter-2c2t6\" (UID: \"71d47eeb-08ae-4c12-9082-6f8cd2c2d8fb\") " pod="openshift-monitoring/node-exporter-2c2t6" Apr 17 14:28:40.154830 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:40.154790 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/71d47eeb-08ae-4c12-9082-6f8cd2c2d8fb-node-exporter-accelerators-collector-config\") pod \"node-exporter-2c2t6\" (UID: \"71d47eeb-08ae-4c12-9082-6f8cd2c2d8fb\") " pod="openshift-monitoring/node-exporter-2c2t6" Apr 17 14:28:40.154830 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:40.154815 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/71d47eeb-08ae-4c12-9082-6f8cd2c2d8fb-node-exporter-wtmp\") pod \"node-exporter-2c2t6\" (UID: \"71d47eeb-08ae-4c12-9082-6f8cd2c2d8fb\") " pod="openshift-monitoring/node-exporter-2c2t6" Apr 17 14:28:40.155106 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:40.154834 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b8rpm\" (UniqueName: \"kubernetes.io/projected/71d47eeb-08ae-4c12-9082-6f8cd2c2d8fb-kube-api-access-b8rpm\") pod \"node-exporter-2c2t6\" (UID: \"71d47eeb-08ae-4c12-9082-6f8cd2c2d8fb\") " pod="openshift-monitoring/node-exporter-2c2t6" Apr 17 14:28:40.155106 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:40.154887 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/71d47eeb-08ae-4c12-9082-6f8cd2c2d8fb-root\") pod \"node-exporter-2c2t6\" (UID: \"71d47eeb-08ae-4c12-9082-6f8cd2c2d8fb\") " pod="openshift-monitoring/node-exporter-2c2t6" Apr 17 14:28:40.155106 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:40.154911 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/71d47eeb-08ae-4c12-9082-6f8cd2c2d8fb-node-exporter-tls\") pod \"node-exporter-2c2t6\" (UID: \"71d47eeb-08ae-4c12-9082-6f8cd2c2d8fb\") " pod="openshift-monitoring/node-exporter-2c2t6" Apr 17 14:28:40.155106 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:40.154947 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/71d47eeb-08ae-4c12-9082-6f8cd2c2d8fb-node-exporter-wtmp\") pod \"node-exporter-2c2t6\" (UID: \"71d47eeb-08ae-4c12-9082-6f8cd2c2d8fb\") " pod="openshift-monitoring/node-exporter-2c2t6" Apr 17 14:28:40.155106 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:40.154955 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/71d47eeb-08ae-4c12-9082-6f8cd2c2d8fb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2c2t6\" (UID: \"71d47eeb-08ae-4c12-9082-6f8cd2c2d8fb\") " pod="openshift-monitoring/node-exporter-2c2t6" Apr 17 14:28:40.155106 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:40.155047 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/71d47eeb-08ae-4c12-9082-6f8cd2c2d8fb-sys\") pod \"node-exporter-2c2t6\" (UID: \"71d47eeb-08ae-4c12-9082-6f8cd2c2d8fb\") " pod="openshift-monitoring/node-exporter-2c2t6" Apr 17 14:28:40.155106 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:40.155008 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/71d47eeb-08ae-4c12-9082-6f8cd2c2d8fb-root\") pod \"node-exporter-2c2t6\" (UID: \"71d47eeb-08ae-4c12-9082-6f8cd2c2d8fb\") " pod="openshift-monitoring/node-exporter-2c2t6" Apr 17 14:28:40.155106 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:40.155089 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/71d47eeb-08ae-4c12-9082-6f8cd2c2d8fb-metrics-client-ca\") pod \"node-exporter-2c2t6\" (UID: \"71d47eeb-08ae-4c12-9082-6f8cd2c2d8fb\") " pod="openshift-monitoring/node-exporter-2c2t6" Apr 17 14:28:40.155545 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:40.155119 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/71d47eeb-08ae-4c12-9082-6f8cd2c2d8fb-sys\") pod \"node-exporter-2c2t6\" (UID: \"71d47eeb-08ae-4c12-9082-6f8cd2c2d8fb\") " pod="openshift-monitoring/node-exporter-2c2t6" Apr 17 14:28:40.155545 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:40.155255 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/71d47eeb-08ae-4c12-9082-6f8cd2c2d8fb-node-exporter-textfile\") pod \"node-exporter-2c2t6\" (UID: \"71d47eeb-08ae-4c12-9082-6f8cd2c2d8fb\") " pod="openshift-monitoring/node-exporter-2c2t6" Apr 17 14:28:40.155640 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:40.155621 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/71d47eeb-08ae-4c12-9082-6f8cd2c2d8fb-metrics-client-ca\") pod \"node-exporter-2c2t6\" (UID: \"71d47eeb-08ae-4c12-9082-6f8cd2c2d8fb\") " pod="openshift-monitoring/node-exporter-2c2t6" Apr 17 14:28:40.155689 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:40.155628 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/71d47eeb-08ae-4c12-9082-6f8cd2c2d8fb-node-exporter-accelerators-collector-config\") pod \"node-exporter-2c2t6\" (UID: \"71d47eeb-08ae-4c12-9082-6f8cd2c2d8fb\") " pod="openshift-monitoring/node-exporter-2c2t6" Apr 17 14:28:40.157414 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:40.157391 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/71d47eeb-08ae-4c12-9082-6f8cd2c2d8fb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2c2t6\" (UID: \"71d47eeb-08ae-4c12-9082-6f8cd2c2d8fb\") " pod="openshift-monitoring/node-exporter-2c2t6" Apr 17 14:28:40.157562 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:40.157519 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/71d47eeb-08ae-4c12-9082-6f8cd2c2d8fb-node-exporter-tls\") pod \"node-exporter-2c2t6\" (UID: \"71d47eeb-08ae-4c12-9082-6f8cd2c2d8fb\") " pod="openshift-monitoring/node-exporter-2c2t6" Apr 17 14:28:40.162121 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:40.162105 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8rpm\" (UniqueName: \"kubernetes.io/projected/71d47eeb-08ae-4c12-9082-6f8cd2c2d8fb-kube-api-access-b8rpm\") pod \"node-exporter-2c2t6\" (UID: \"71d47eeb-08ae-4c12-9082-6f8cd2c2d8fb\") " pod="openshift-monitoring/node-exporter-2c2t6" Apr 17 14:28:40.201096 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:40.201069 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9d44df66c-jtv5k" Apr 17 14:28:40.227162 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:40.227134 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2c2t6" Apr 17 14:28:40.235616 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:28:40.235588 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71d47eeb_08ae_4c12_9082_6f8cd2c2d8fb.slice/crio-08b5d3fa3d68f51e8cdcbf1586f56393379de9f56821cdeb5899c11f25c7b11d WatchSource:0}: Error finding container 08b5d3fa3d68f51e8cdcbf1586f56393379de9f56821cdeb5899c11f25c7b11d: Status 404 returned error can't find the container with id 08b5d3fa3d68f51e8cdcbf1586f56393379de9f56821cdeb5899c11f25c7b11d Apr 17 14:28:40.323854 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:40.323692 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9d44df66c-jtv5k"] Apr 17 14:28:40.326747 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:28:40.326718 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7992c17a_fc81_48b6_8a2e_0b328dc8e0be.slice/crio-3ff9e3020365a132413ba3f779c80228008abc9ae03e23ccb804ab7c103c5d2d WatchSource:0}: Error finding container 3ff9e3020365a132413ba3f779c80228008abc9ae03e23ccb804ab7c103c5d2d: Status 404 returned error can't find the container with id 3ff9e3020365a132413ba3f779c80228008abc9ae03e23ccb804ab7c103c5d2d Apr 17 14:28:40.959628 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:40.959595 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Apr 17 14:28:40.964052 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:40.964026 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:28:40.966436 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:40.966383 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Apr 17 14:28:40.966577 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:40.966464 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Apr 17 14:28:40.966577 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:40.966480 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Apr 17 14:28:40.966737 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:40.966727 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Apr 17 14:28:40.966852 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:40.966830 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Apr 17 14:28:40.966852 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:40.966841 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Apr 17 14:28:40.966967 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:40.966923 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Apr 17 14:28:40.967097 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:40.967067 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-cgffr\"" Apr 17 14:28:40.967206 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:40.967116 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Apr 17 14:28:40.967206 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:40.967177 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Apr 17 14:28:40.977099 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:40.975956 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Apr 17 14:28:41.025827 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:41.025788 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9d44df66c-jtv5k" event={"ID":"7992c17a-fc81-48b6-8a2e-0b328dc8e0be","Type":"ContainerStarted","Data":"661b53afbba1a2ed4e6dd1a43ec42ed0835e3ed1e362f8433e1f11caafd9502c"} Apr 17 14:28:41.025827 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:41.025825 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9d44df66c-jtv5k" event={"ID":"7992c17a-fc81-48b6-8a2e-0b328dc8e0be","Type":"ContainerStarted","Data":"91597518cc45a44b86625dc54f08a32e1702d7baf5e022820c1576514e1b0d47"} Apr 17 14:28:41.026047 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:41.025842 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9d44df66c-jtv5k" event={"ID":"7992c17a-fc81-48b6-8a2e-0b328dc8e0be","Type":"ContainerStarted","Data":"3ff9e3020365a132413ba3f779c80228008abc9ae03e23ccb804ab7c103c5d2d"} Apr 17 14:28:41.027238 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:41.027205 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2c2t6" event={"ID":"71d47eeb-08ae-4c12-9082-6f8cd2c2d8fb","Type":"ContainerStarted","Data":"08b5d3fa3d68f51e8cdcbf1586f56393379de9f56821cdeb5899c11f25c7b11d"} Apr 17 14:28:41.064594 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:41.064282 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0289877f-ea8c-446b-b36e-257b370137e2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0289877f-ea8c-446b-b36e-257b370137e2\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:28:41.064594 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:41.064337 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0289877f-ea8c-446b-b36e-257b370137e2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0289877f-ea8c-446b-b36e-257b370137e2\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:28:41.064594 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:41.064399 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0289877f-ea8c-446b-b36e-257b370137e2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0289877f-ea8c-446b-b36e-257b370137e2\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:28:41.064594 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:41.064436 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9gzt\" (UniqueName: \"kubernetes.io/projected/0289877f-ea8c-446b-b36e-257b370137e2-kube-api-access-f9gzt\") pod \"alertmanager-main-0\" (UID: \"0289877f-ea8c-446b-b36e-257b370137e2\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:28:41.064594 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:41.064468 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0289877f-ea8c-446b-b36e-257b370137e2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0289877f-ea8c-446b-b36e-257b370137e2\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:28:41.064594 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:41.064509 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0289877f-ea8c-446b-b36e-257b370137e2-config-out\") pod \"alertmanager-main-0\" (UID: \"0289877f-ea8c-446b-b36e-257b370137e2\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:28:41.064594 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:41.064541 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0289877f-ea8c-446b-b36e-257b370137e2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0289877f-ea8c-446b-b36e-257b370137e2\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:28:41.064594 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:41.064566 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0289877f-ea8c-446b-b36e-257b370137e2-config-volume\") pod \"alertmanager-main-0\" (UID: \"0289877f-ea8c-446b-b36e-257b370137e2\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:28:41.065054 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:41.064640 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0289877f-ea8c-446b-b36e-257b370137e2-web-config\") pod \"alertmanager-main-0\" (UID: \"0289877f-ea8c-446b-b36e-257b370137e2\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:28:41.065054 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:41.064682 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0289877f-ea8c-446b-b36e-257b370137e2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0289877f-ea8c-446b-b36e-257b370137e2\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:28:41.065054 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:41.064711 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0289877f-ea8c-446b-b36e-257b370137e2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0289877f-ea8c-446b-b36e-257b370137e2\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:28:41.065054 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:41.064753 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0289877f-ea8c-446b-b36e-257b370137e2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0289877f-ea8c-446b-b36e-257b370137e2\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:28:41.065054 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:41.064791 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0289877f-ea8c-446b-b36e-257b370137e2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0289877f-ea8c-446b-b36e-257b370137e2\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:28:41.165895 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:41.165864 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0289877f-ea8c-446b-b36e-257b370137e2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0289877f-ea8c-446b-b36e-257b370137e2\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:28:41.166051 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:41.165911 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f9gzt\" (UniqueName: \"kubernetes.io/projected/0289877f-ea8c-446b-b36e-257b370137e2-kube-api-access-f9gzt\") pod \"alertmanager-main-0\" (UID: \"0289877f-ea8c-446b-b36e-257b370137e2\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:28:41.166051 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:41.165941 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0289877f-ea8c-446b-b36e-257b370137e2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0289877f-ea8c-446b-b36e-257b370137e2\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:28:41.166051 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:41.165968 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0289877f-ea8c-446b-b36e-257b370137e2-config-out\") pod \"alertmanager-main-0\" (UID: \"0289877f-ea8c-446b-b36e-257b370137e2\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:28:41.166326 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:41.166298 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0289877f-ea8c-446b-b36e-257b370137e2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0289877f-ea8c-446b-b36e-257b370137e2\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:28:41.166390 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:41.166368 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0289877f-ea8c-446b-b36e-257b370137e2-config-volume\") pod \"alertmanager-main-0\" (UID: \"0289877f-ea8c-446b-b36e-257b370137e2\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:28:41.166442 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:41.166420 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0289877f-ea8c-446b-b36e-257b370137e2-web-config\") pod \"alertmanager-main-0\" (UID: \"0289877f-ea8c-446b-b36e-257b370137e2\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:28:41.166491 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:41.166455 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0289877f-ea8c-446b-b36e-257b370137e2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0289877f-ea8c-446b-b36e-257b370137e2\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:28:41.166546 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:41.166490 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0289877f-ea8c-446b-b36e-257b370137e2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0289877f-ea8c-446b-b36e-257b370137e2\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:28:41.166546 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:41.166537 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0289877f-ea8c-446b-b36e-257b370137e2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0289877f-ea8c-446b-b36e-257b370137e2\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:28:41.166638 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:41.166582 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0289877f-ea8c-446b-b36e-257b370137e2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0289877f-ea8c-446b-b36e-257b370137e2\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:28:41.166638 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:41.166610 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0289877f-ea8c-446b-b36e-257b370137e2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0289877f-ea8c-446b-b36e-257b370137e2\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:28:41.166733 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:41.166648 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0289877f-ea8c-446b-b36e-257b370137e2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0289877f-ea8c-446b-b36e-257b370137e2\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:28:41.168391 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:28:41.167241 2573 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Apr 17 14:28:41.168391 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:28:41.167307 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0289877f-ea8c-446b-b36e-257b370137e2-secret-alertmanager-main-tls podName:0289877f-ea8c-446b-b36e-257b370137e2 nodeName:}" failed. No retries permitted until 2026-04-17 14:28:41.667286749 +0000 UTC m=+113.711715539 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/0289877f-ea8c-446b-b36e-257b370137e2-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "0289877f-ea8c-446b-b36e-257b370137e2") : secret "alertmanager-main-tls" not found Apr 17 14:28:41.168391 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:41.167755 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0289877f-ea8c-446b-b36e-257b370137e2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0289877f-ea8c-446b-b36e-257b370137e2\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:28:41.168391 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:41.168260 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0289877f-ea8c-446b-b36e-257b370137e2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0289877f-ea8c-446b-b36e-257b370137e2\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:28:41.168645 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:41.168432 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0289877f-ea8c-446b-b36e-257b370137e2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0289877f-ea8c-446b-b36e-257b370137e2\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:28:41.168855 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:41.168812 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0289877f-ea8c-446b-b36e-257b370137e2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0289877f-ea8c-446b-b36e-257b370137e2\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:28:41.171311 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:41.171284 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0289877f-ea8c-446b-b36e-257b370137e2-web-config\") pod \"alertmanager-main-0\" (UID: \"0289877f-ea8c-446b-b36e-257b370137e2\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:28:41.172613 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:41.172590 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0289877f-ea8c-446b-b36e-257b370137e2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0289877f-ea8c-446b-b36e-257b370137e2\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:28:41.172942 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:41.172923 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0289877f-ea8c-446b-b36e-257b370137e2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0289877f-ea8c-446b-b36e-257b370137e2\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:28:41.173856 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:41.173759 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0289877f-ea8c-446b-b36e-257b370137e2-config-volume\") pod \"alertmanager-main-0\" (UID: \"0289877f-ea8c-446b-b36e-257b370137e2\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:28:41.174371 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:41.174330 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9gzt\" (UniqueName: \"kubernetes.io/projected/0289877f-ea8c-446b-b36e-257b370137e2-kube-api-access-f9gzt\") pod \"alertmanager-main-0\" (UID: \"0289877f-ea8c-446b-b36e-257b370137e2\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:28:41.174568 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:41.174546 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0289877f-ea8c-446b-b36e-257b370137e2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0289877f-ea8c-446b-b36e-257b370137e2\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:28:41.175219 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:41.175159 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0289877f-ea8c-446b-b36e-257b370137e2-config-out\") pod \"alertmanager-main-0\" (UID: \"0289877f-ea8c-446b-b36e-257b370137e2\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:28:41.176173 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:41.176152 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0289877f-ea8c-446b-b36e-257b370137e2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0289877f-ea8c-446b-b36e-257b370137e2\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:28:41.669278 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:41.669243 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0289877f-ea8c-446b-b36e-257b370137e2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0289877f-ea8c-446b-b36e-257b370137e2\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:28:41.671802 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:41.671778 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0289877f-ea8c-446b-b36e-257b370137e2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0289877f-ea8c-446b-b36e-257b370137e2\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:28:41.878234 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:41.878154 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:28:42.006771 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:42.005057 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Apr 17 14:28:42.009518 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:28:42.009491 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0289877f_ea8c_446b_b36e_257b370137e2.slice/crio-7b32fa2655b0bf08e9213ab7876bfc68394c730cad297172a9fe4d0ec5729d7a WatchSource:0}: Error finding container 7b32fa2655b0bf08e9213ab7876bfc68394c730cad297172a9fe4d0ec5729d7a: Status 404 returned error can't find the container with id 7b32fa2655b0bf08e9213ab7876bfc68394c730cad297172a9fe4d0ec5729d7a Apr 17 14:28:42.032209 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:42.032182 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9d44df66c-jtv5k" event={"ID":"7992c17a-fc81-48b6-8a2e-0b328dc8e0be","Type":"ContainerStarted","Data":"9f1800078aaea294f9f245467958b7a34dbd4cf92cab9f35631b00e8b6e1d68c"} Apr 17 14:28:42.033550 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:42.033527 2573 generic.go:358] "Generic (PLEG): container finished" podID="71d47eeb-08ae-4c12-9082-6f8cd2c2d8fb" containerID="5381d4bfab6ca3df631dc43c0d308b3b1b95dff86227b1ec2e428065343cdd05" exitCode=0 Apr 17 14:28:42.033649 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:42.033585 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2c2t6" event={"ID":"71d47eeb-08ae-4c12-9082-6f8cd2c2d8fb","Type":"ContainerDied","Data":"5381d4bfab6ca3df631dc43c0d308b3b1b95dff86227b1ec2e428065343cdd05"} Apr 17 14:28:42.034617 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:42.034591 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0289877f-ea8c-446b-b36e-257b370137e2","Type":"ContainerStarted","Data":"7b32fa2655b0bf08e9213ab7876bfc68394c730cad297172a9fe4d0ec5729d7a"} Apr 17 14:28:42.048880 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:42.048835 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9d44df66c-jtv5k" podStartSLOduration=2.00110536 podStartE2EDuration="3.04882318s" podCreationTimestamp="2026-04-17 14:28:39 +0000 UTC" firstStartedPulling="2026-04-17 14:28:40.443108083 +0000 UTC m=+112.487536868" lastFinishedPulling="2026-04-17 14:28:41.490825896 +0000 UTC m=+113.535254688" observedRunningTime="2026-04-17 14:28:42.04720925 +0000 UTC m=+114.091638050" watchObservedRunningTime="2026-04-17 14:28:42.04882318 +0000 UTC m=+114.093252033" Apr 17 14:28:42.884249 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:42.884217 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5bdb554c7b-94rmc"] Apr 17 14:28:42.888291 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:42.888266 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5bdb554c7b-94rmc" Apr 17 14:28:42.890949 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:42.890919 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Apr 17 14:28:42.890949 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:42.890942 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Apr 17 14:28:42.891158 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:42.891044 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-cn627\"" Apr 17 14:28:42.891158 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:42.891078 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Apr 17 14:28:42.891776 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:42.891633 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Apr 17 14:28:42.891776 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:42.891644 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-73o050otd80qt\"" Apr 17 14:28:42.891776 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:42.891708 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Apr 17 14:28:42.896477 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:42.896438 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5bdb554c7b-94rmc"] Apr 17 14:28:42.981145 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:42.981101 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a86d4183-4bc6-429d-ac6b-9af46953e43f-secret-thanos-querier-tls\") pod \"thanos-querier-5bdb554c7b-94rmc\" (UID: \"a86d4183-4bc6-429d-ac6b-9af46953e43f\") " pod="openshift-monitoring/thanos-querier-5bdb554c7b-94rmc" Apr 17 14:28:42.981394 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:42.981236 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a86d4183-4bc6-429d-ac6b-9af46953e43f-metrics-client-ca\") pod \"thanos-querier-5bdb554c7b-94rmc\" (UID: \"a86d4183-4bc6-429d-ac6b-9af46953e43f\") " pod="openshift-monitoring/thanos-querier-5bdb554c7b-94rmc" Apr 17 14:28:42.981394 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:42.981305 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a86d4183-4bc6-429d-ac6b-9af46953e43f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5bdb554c7b-94rmc\" (UID: \"a86d4183-4bc6-429d-ac6b-9af46953e43f\") " pod="openshift-monitoring/thanos-querier-5bdb554c7b-94rmc" Apr 17 14:28:42.981542 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:42.981418 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a86d4183-4bc6-429d-ac6b-9af46953e43f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5bdb554c7b-94rmc\" (UID: \"a86d4183-4bc6-429d-ac6b-9af46953e43f\") " pod="openshift-monitoring/thanos-querier-5bdb554c7b-94rmc" Apr 17 14:28:42.981542 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:42.981464 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a86d4183-4bc6-429d-ac6b-9af46953e43f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5bdb554c7b-94rmc\" (UID: \"a86d4183-4bc6-429d-ac6b-9af46953e43f\") " pod="openshift-monitoring/thanos-querier-5bdb554c7b-94rmc" Apr 17 14:28:42.981645 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:42.981547 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a86d4183-4bc6-429d-ac6b-9af46953e43f-secret-grpc-tls\") pod \"thanos-querier-5bdb554c7b-94rmc\" (UID: \"a86d4183-4bc6-429d-ac6b-9af46953e43f\") " pod="openshift-monitoring/thanos-querier-5bdb554c7b-94rmc" Apr 17 14:28:42.981645 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:42.981597 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a86d4183-4bc6-429d-ac6b-9af46953e43f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5bdb554c7b-94rmc\" (UID: \"a86d4183-4bc6-429d-ac6b-9af46953e43f\") " pod="openshift-monitoring/thanos-querier-5bdb554c7b-94rmc" Apr 17 14:28:42.981741 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:42.981658 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h29h5\" (UniqueName: \"kubernetes.io/projected/a86d4183-4bc6-429d-ac6b-9af46953e43f-kube-api-access-h29h5\") pod \"thanos-querier-5bdb554c7b-94rmc\" (UID: \"a86d4183-4bc6-429d-ac6b-9af46953e43f\") " pod="openshift-monitoring/thanos-querier-5bdb554c7b-94rmc" Apr 17 14:28:43.040061 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:43.040029 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2c2t6" event={"ID":"71d47eeb-08ae-4c12-9082-6f8cd2c2d8fb","Type":"ContainerStarted","Data":"6c57f3bf6138e0a7a15e8125c499e8b8e983af895038d0ebcfac275fab48c0cf"} Apr 17 14:28:43.040444 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:43.040069 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2c2t6" event={"ID":"71d47eeb-08ae-4c12-9082-6f8cd2c2d8fb","Type":"ContainerStarted","Data":"bca32226d4bfb79a0f991d55884f201debcbccd189ea4b23caca1615e8328eda"} Apr 17 14:28:43.061064 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:43.061020 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-2c2t6" podStartSLOduration=3.255091477 podStartE2EDuration="4.061006959s" podCreationTimestamp="2026-04-17 14:28:39 +0000 UTC" firstStartedPulling="2026-04-17 14:28:40.238881701 +0000 UTC m=+112.283310486" lastFinishedPulling="2026-04-17 14:28:41.044797166 +0000 UTC m=+113.089225968" observedRunningTime="2026-04-17 14:28:43.059358881 +0000 UTC m=+115.103787690" watchObservedRunningTime="2026-04-17 14:28:43.061006959 +0000 UTC m=+115.105435766" Apr 17 14:28:43.082065 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:43.082039 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a86d4183-4bc6-429d-ac6b-9af46953e43f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5bdb554c7b-94rmc\" (UID: \"a86d4183-4bc6-429d-ac6b-9af46953e43f\") " pod="openshift-monitoring/thanos-querier-5bdb554c7b-94rmc" Apr 17 14:28:43.082169 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:43.082086 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a86d4183-4bc6-429d-ac6b-9af46953e43f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5bdb554c7b-94rmc\" (UID: \"a86d4183-4bc6-429d-ac6b-9af46953e43f\") " pod="openshift-monitoring/thanos-querier-5bdb554c7b-94rmc" Apr 17 14:28:43.082169 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:43.082118 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a86d4183-4bc6-429d-ac6b-9af46953e43f-secret-grpc-tls\") pod \"thanos-querier-5bdb554c7b-94rmc\" (UID: \"a86d4183-4bc6-429d-ac6b-9af46953e43f\") " pod="openshift-monitoring/thanos-querier-5bdb554c7b-94rmc" Apr 17 14:28:43.082169 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:43.082154 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a86d4183-4bc6-429d-ac6b-9af46953e43f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5bdb554c7b-94rmc\" (UID: \"a86d4183-4bc6-429d-ac6b-9af46953e43f\") " pod="openshift-monitoring/thanos-querier-5bdb554c7b-94rmc" Apr 17 14:28:43.082310 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:43.082198 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h29h5\" (UniqueName: \"kubernetes.io/projected/a86d4183-4bc6-429d-ac6b-9af46953e43f-kube-api-access-h29h5\") pod \"thanos-querier-5bdb554c7b-94rmc\" (UID: \"a86d4183-4bc6-429d-ac6b-9af46953e43f\") " pod="openshift-monitoring/thanos-querier-5bdb554c7b-94rmc" Apr 17 14:28:43.082310 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:43.082228 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a86d4183-4bc6-429d-ac6b-9af46953e43f-secret-thanos-querier-tls\") pod \"thanos-querier-5bdb554c7b-94rmc\" (UID: \"a86d4183-4bc6-429d-ac6b-9af46953e43f\") " pod="openshift-monitoring/thanos-querier-5bdb554c7b-94rmc" Apr 17 14:28:43.082310 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:43.082297 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a86d4183-4bc6-429d-ac6b-9af46953e43f-metrics-client-ca\") pod \"thanos-querier-5bdb554c7b-94rmc\" (UID: \"a86d4183-4bc6-429d-ac6b-9af46953e43f\") " pod="openshift-monitoring/thanos-querier-5bdb554c7b-94rmc" Apr 17 14:28:43.082310 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:43.082338 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a86d4183-4bc6-429d-ac6b-9af46953e43f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5bdb554c7b-94rmc\" (UID: \"a86d4183-4bc6-429d-ac6b-9af46953e43f\") " pod="openshift-monitoring/thanos-querier-5bdb554c7b-94rmc" Apr 17 14:28:43.083218 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:43.083196 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a86d4183-4bc6-429d-ac6b-9af46953e43f-metrics-client-ca\") pod \"thanos-querier-5bdb554c7b-94rmc\" (UID: \"a86d4183-4bc6-429d-ac6b-9af46953e43f\") " pod="openshift-monitoring/thanos-querier-5bdb554c7b-94rmc" Apr 17 14:28:43.085110 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:43.085045 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a86d4183-4bc6-429d-ac6b-9af46953e43f-secret-grpc-tls\") pod \"thanos-querier-5bdb554c7b-94rmc\" (UID: \"a86d4183-4bc6-429d-ac6b-9af46953e43f\") " pod="openshift-monitoring/thanos-querier-5bdb554c7b-94rmc" Apr 17 14:28:43.085220 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:43.085114 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a86d4183-4bc6-429d-ac6b-9af46953e43f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5bdb554c7b-94rmc\" (UID: \"a86d4183-4bc6-429d-ac6b-9af46953e43f\") " pod="openshift-monitoring/thanos-querier-5bdb554c7b-94rmc" Apr 17 14:28:43.085220 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:43.085191 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a86d4183-4bc6-429d-ac6b-9af46953e43f-secret-thanos-querier-tls\") pod \"thanos-querier-5bdb554c7b-94rmc\" (UID: \"a86d4183-4bc6-429d-ac6b-9af46953e43f\") " pod="openshift-monitoring/thanos-querier-5bdb554c7b-94rmc" Apr 17 14:28:43.085606 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:43.085585 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a86d4183-4bc6-429d-ac6b-9af46953e43f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5bdb554c7b-94rmc\" (UID: \"a86d4183-4bc6-429d-ac6b-9af46953e43f\") " pod="openshift-monitoring/thanos-querier-5bdb554c7b-94rmc" Apr 17 14:28:43.085678 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:43.085617 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a86d4183-4bc6-429d-ac6b-9af46953e43f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5bdb554c7b-94rmc\" (UID: \"a86d4183-4bc6-429d-ac6b-9af46953e43f\") " pod="openshift-monitoring/thanos-querier-5bdb554c7b-94rmc" Apr 17 14:28:43.086198 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:43.086179 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a86d4183-4bc6-429d-ac6b-9af46953e43f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5bdb554c7b-94rmc\" (UID: \"a86d4183-4bc6-429d-ac6b-9af46953e43f\") " pod="openshift-monitoring/thanos-querier-5bdb554c7b-94rmc" Apr 17 14:28:43.089247 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:43.089229 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h29h5\" (UniqueName: \"kubernetes.io/projected/a86d4183-4bc6-429d-ac6b-9af46953e43f-kube-api-access-h29h5\") pod \"thanos-querier-5bdb554c7b-94rmc\" (UID: \"a86d4183-4bc6-429d-ac6b-9af46953e43f\") " pod="openshift-monitoring/thanos-querier-5bdb554c7b-94rmc" Apr 17 14:28:43.200494 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:43.200471 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5bdb554c7b-94rmc" Apr 17 14:28:43.317194 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:43.317166 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5bdb554c7b-94rmc"] Apr 17 14:28:43.320757 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:28:43.320733 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda86d4183_4bc6_429d_ac6b_9af46953e43f.slice/crio-d68290a4c1afb3966c137838ed3180a0a6b4cd432db9486de816dea2d5bf478a WatchSource:0}: Error finding container d68290a4c1afb3966c137838ed3180a0a6b4cd432db9486de816dea2d5bf478a: Status 404 returned error can't find the container with id d68290a4c1afb3966c137838ed3180a0a6b4cd432db9486de816dea2d5bf478a Apr 17 14:28:44.045190 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:44.045159 2573 generic.go:358] "Generic (PLEG): container finished" podID="0289877f-ea8c-446b-b36e-257b370137e2" containerID="b29e74d26d5b96fb8ab8b44cdafb04c0d736ea57e8a25e3893201654937ca501" exitCode=0 Apr 17 14:28:44.045655 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:44.045271 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0289877f-ea8c-446b-b36e-257b370137e2","Type":"ContainerDied","Data":"b29e74d26d5b96fb8ab8b44cdafb04c0d736ea57e8a25e3893201654937ca501"} Apr 17 14:28:44.046668 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:44.046641 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5bdb554c7b-94rmc" event={"ID":"a86d4183-4bc6-429d-ac6b-9af46953e43f","Type":"ContainerStarted","Data":"d68290a4c1afb3966c137838ed3180a0a6b4cd432db9486de816dea2d5bf478a"} Apr 17 14:28:44.209614 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:44.209577 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5bfd896cd5-2lsjv"] Apr 17 14:28:44.211893 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:44.211866 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5bfd896cd5-2lsjv" Apr 17 14:28:44.214356 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:44.214330 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Apr 17 14:28:44.214502 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:44.214383 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Apr 17 14:28:44.214502 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:44.214409 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-ggwds\"" Apr 17 14:28:44.214502 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:44.214438 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Apr 17 14:28:44.214502 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:44.214339 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Apr 17 14:28:44.214715 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:44.214562 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-bvnf1fr2jk379\"" Apr 17 14:28:44.220647 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:44.220624 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5bfd896cd5-2lsjv"] Apr 17 14:28:44.294817 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:44.294787 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/68d85a25-0424-4cd5-9406-f978cd902241-audit-log\") pod \"metrics-server-5bfd896cd5-2lsjv\" (UID: \"68d85a25-0424-4cd5-9406-f978cd902241\") " pod="openshift-monitoring/metrics-server-5bfd896cd5-2lsjv" Apr 17 14:28:44.294817 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:44.294830 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68d85a25-0424-4cd5-9406-f978cd902241-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5bfd896cd5-2lsjv\" (UID: \"68d85a25-0424-4cd5-9406-f978cd902241\") " pod="openshift-monitoring/metrics-server-5bfd896cd5-2lsjv" Apr 17 14:28:44.295056 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:44.294902 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/68d85a25-0424-4cd5-9406-f978cd902241-secret-metrics-server-tls\") pod \"metrics-server-5bfd896cd5-2lsjv\" (UID: \"68d85a25-0424-4cd5-9406-f978cd902241\") " pod="openshift-monitoring/metrics-server-5bfd896cd5-2lsjv" Apr 17 14:28:44.295056 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:44.295012 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/68d85a25-0424-4cd5-9406-f978cd902241-metrics-server-audit-profiles\") pod \"metrics-server-5bfd896cd5-2lsjv\" (UID: \"68d85a25-0424-4cd5-9406-f978cd902241\") " pod="openshift-monitoring/metrics-server-5bfd896cd5-2lsjv" Apr 17 14:28:44.295164 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:44.295064 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68d85a25-0424-4cd5-9406-f978cd902241-client-ca-bundle\") pod \"metrics-server-5bfd896cd5-2lsjv\" (UID: \"68d85a25-0424-4cd5-9406-f978cd902241\") " pod="openshift-monitoring/metrics-server-5bfd896cd5-2lsjv" Apr 17 14:28:44.295250 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:44.295157 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/68d85a25-0424-4cd5-9406-f978cd902241-secret-metrics-server-client-certs\") pod \"metrics-server-5bfd896cd5-2lsjv\" (UID: \"68d85a25-0424-4cd5-9406-f978cd902241\") " pod="openshift-monitoring/metrics-server-5bfd896cd5-2lsjv" Apr 17 14:28:44.295300 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:44.295246 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrxnp\" (UniqueName: \"kubernetes.io/projected/68d85a25-0424-4cd5-9406-f978cd902241-kube-api-access-xrxnp\") pod \"metrics-server-5bfd896cd5-2lsjv\" (UID: \"68d85a25-0424-4cd5-9406-f978cd902241\") " pod="openshift-monitoring/metrics-server-5bfd896cd5-2lsjv" Apr 17 14:28:44.395752 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:44.395715 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/68d85a25-0424-4cd5-9406-f978cd902241-audit-log\") pod \"metrics-server-5bfd896cd5-2lsjv\" (UID: \"68d85a25-0424-4cd5-9406-f978cd902241\") " pod="openshift-monitoring/metrics-server-5bfd896cd5-2lsjv" Apr 17 14:28:44.395927 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:44.395756 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68d85a25-0424-4cd5-9406-f978cd902241-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5bfd896cd5-2lsjv\" (UID: \"68d85a25-0424-4cd5-9406-f978cd902241\") " pod="openshift-monitoring/metrics-server-5bfd896cd5-2lsjv" Apr 17 14:28:44.395927 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:44.395804 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/68d85a25-0424-4cd5-9406-f978cd902241-secret-metrics-server-tls\") pod \"metrics-server-5bfd896cd5-2lsjv\" (UID: \"68d85a25-0424-4cd5-9406-f978cd902241\") " pod="openshift-monitoring/metrics-server-5bfd896cd5-2lsjv" Apr 17 14:28:44.395927 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:44.395829 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/68d85a25-0424-4cd5-9406-f978cd902241-metrics-server-audit-profiles\") pod \"metrics-server-5bfd896cd5-2lsjv\" (UID: \"68d85a25-0424-4cd5-9406-f978cd902241\") " pod="openshift-monitoring/metrics-server-5bfd896cd5-2lsjv" Apr 17 14:28:44.395927 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:44.395891 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68d85a25-0424-4cd5-9406-f978cd902241-client-ca-bundle\") pod \"metrics-server-5bfd896cd5-2lsjv\" (UID: \"68d85a25-0424-4cd5-9406-f978cd902241\") " pod="openshift-monitoring/metrics-server-5bfd896cd5-2lsjv" Apr 17 14:28:44.396171 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:44.395940 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/68d85a25-0424-4cd5-9406-f978cd902241-secret-metrics-server-client-certs\") pod \"metrics-server-5bfd896cd5-2lsjv\" (UID: \"68d85a25-0424-4cd5-9406-f978cd902241\") " pod="openshift-monitoring/metrics-server-5bfd896cd5-2lsjv" Apr 17 14:28:44.396171 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:44.396012 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xrxnp\" (UniqueName: \"kubernetes.io/projected/68d85a25-0424-4cd5-9406-f978cd902241-kube-api-access-xrxnp\") pod \"metrics-server-5bfd896cd5-2lsjv\" (UID: \"68d85a25-0424-4cd5-9406-f978cd902241\") " pod="openshift-monitoring/metrics-server-5bfd896cd5-2lsjv" Apr 17 14:28:44.396171 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:44.396153 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/68d85a25-0424-4cd5-9406-f978cd902241-audit-log\") pod \"metrics-server-5bfd896cd5-2lsjv\" (UID: \"68d85a25-0424-4cd5-9406-f978cd902241\") " pod="openshift-monitoring/metrics-server-5bfd896cd5-2lsjv" Apr 17 14:28:44.397214 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:44.397186 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68d85a25-0424-4cd5-9406-f978cd902241-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5bfd896cd5-2lsjv\" (UID: \"68d85a25-0424-4cd5-9406-f978cd902241\") " pod="openshift-monitoring/metrics-server-5bfd896cd5-2lsjv" Apr 17 14:28:44.397333 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:44.397197 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/68d85a25-0424-4cd5-9406-f978cd902241-metrics-server-audit-profiles\") pod \"metrics-server-5bfd896cd5-2lsjv\" (UID: \"68d85a25-0424-4cd5-9406-f978cd902241\") " pod="openshift-monitoring/metrics-server-5bfd896cd5-2lsjv" Apr 17 14:28:44.398320 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:44.398300 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/68d85a25-0424-4cd5-9406-f978cd902241-secret-metrics-server-tls\") pod \"metrics-server-5bfd896cd5-2lsjv\" (UID: \"68d85a25-0424-4cd5-9406-f978cd902241\") " pod="openshift-monitoring/metrics-server-5bfd896cd5-2lsjv" Apr 17 14:28:44.398436 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:44.398419 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68d85a25-0424-4cd5-9406-f978cd902241-client-ca-bundle\") pod \"metrics-server-5bfd896cd5-2lsjv\" (UID: \"68d85a25-0424-4cd5-9406-f978cd902241\") " pod="openshift-monitoring/metrics-server-5bfd896cd5-2lsjv" Apr 17 14:28:44.398494 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:44.398437 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/68d85a25-0424-4cd5-9406-f978cd902241-secret-metrics-server-client-certs\") pod \"metrics-server-5bfd896cd5-2lsjv\" (UID: \"68d85a25-0424-4cd5-9406-f978cd902241\") " pod="openshift-monitoring/metrics-server-5bfd896cd5-2lsjv" Apr 17 14:28:44.403302 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:44.403284 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrxnp\" (UniqueName: \"kubernetes.io/projected/68d85a25-0424-4cd5-9406-f978cd902241-kube-api-access-xrxnp\") pod \"metrics-server-5bfd896cd5-2lsjv\" (UID: \"68d85a25-0424-4cd5-9406-f978cd902241\") " pod="openshift-monitoring/metrics-server-5bfd896cd5-2lsjv" Apr 17 14:28:44.524220 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:44.524183 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5bfd896cd5-2lsjv" Apr 17 14:28:44.621279 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:44.620867 2573 scope.go:117] "RemoveContainer" containerID="1e3f9ace139093d7e6f84b8d4713e249d1bfc1f42d29f1f05d1be8aee1a9be47" Apr 17 14:28:44.668239 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:44.668193 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5bfd896cd5-2lsjv"] Apr 17 14:28:44.681273 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:44.681253 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7dccd58f55-ccvd2"] Apr 17 14:28:44.684182 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:44.684165 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7dccd58f55-ccvd2" Apr 17 14:28:44.686665 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:44.686605 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-79h7n\"" Apr 17 14:28:44.687032 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:44.686781 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Apr 17 14:28:44.692876 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:44.692848 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7dccd58f55-ccvd2"] Apr 17 14:28:44.800530 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:44.800434 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e9666b08-158c-4cf6-be87-86e937099375-monitoring-plugin-cert\") pod \"monitoring-plugin-7dccd58f55-ccvd2\" (UID: \"e9666b08-158c-4cf6-be87-86e937099375\") " pod="openshift-monitoring/monitoring-plugin-7dccd58f55-ccvd2" Apr 17 14:28:44.902333 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:44.902129 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e9666b08-158c-4cf6-be87-86e937099375-monitoring-plugin-cert\") pod \"monitoring-plugin-7dccd58f55-ccvd2\" (UID: \"e9666b08-158c-4cf6-be87-86e937099375\") " pod="openshift-monitoring/monitoring-plugin-7dccd58f55-ccvd2" Apr 17 14:28:44.902502 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:28:44.902341 2573 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Apr 17 14:28:44.902502 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:28:44.902411 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9666b08-158c-4cf6-be87-86e937099375-monitoring-plugin-cert podName:e9666b08-158c-4cf6-be87-86e937099375 nodeName:}" failed. No retries permitted until 2026-04-17 14:28:45.402389588 +0000 UTC m=+117.446818394 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/e9666b08-158c-4cf6-be87-86e937099375-monitoring-plugin-cert") pod "monitoring-plugin-7dccd58f55-ccvd2" (UID: "e9666b08-158c-4cf6-be87-86e937099375") : secret "monitoring-plugin-cert" not found Apr 17 14:28:45.052003 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:45.051900 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-9d4b6777b-mslwt_fba84e6b-7f61-427c-94d1-489ee9dadc9e/console-operator/2.log" Apr 17 14:28:45.052533 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:45.052494 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-9d4b6777b-mslwt" event={"ID":"fba84e6b-7f61-427c-94d1-489ee9dadc9e","Type":"ContainerStarted","Data":"afdff546f8b7ba6a87c0a749bf4137ffbb0596463e7b26f9ca47bba51776bac5"} Apr 17 14:28:45.052950 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:45.052928 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-9d4b6777b-mslwt" Apr 17 14:28:45.069240 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:45.069135 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-9d4b6777b-mslwt" podStartSLOduration=44.219577563 podStartE2EDuration="47.069118243s" podCreationTimestamp="2026-04-17 14:27:58 +0000 UTC" firstStartedPulling="2026-04-17 14:27:59.590453866 +0000 UTC m=+71.634882652" lastFinishedPulling="2026-04-17 14:28:02.439994484 +0000 UTC m=+74.484423332" observedRunningTime="2026-04-17 14:28:45.067659777 +0000 UTC m=+117.112088585" watchObservedRunningTime="2026-04-17 14:28:45.069118243 +0000 UTC m=+117.113547053" Apr 17 14:28:45.319033 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:28:45.319002 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68d85a25_0424_4cd5_9406_f978cd902241.slice/crio-5357ffa9ff3f304cd00a83411d37f351aaa10b2e7d57c5b6ba67df250b413ef1 WatchSource:0}: Error finding container 5357ffa9ff3f304cd00a83411d37f351aaa10b2e7d57c5b6ba67df250b413ef1: Status 404 returned error can't find the container with id 5357ffa9ff3f304cd00a83411d37f351aaa10b2e7d57c5b6ba67df250b413ef1 Apr 17 14:28:45.406537 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:45.406503 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e9666b08-158c-4cf6-be87-86e937099375-monitoring-plugin-cert\") pod \"monitoring-plugin-7dccd58f55-ccvd2\" (UID: \"e9666b08-158c-4cf6-be87-86e937099375\") " pod="openshift-monitoring/monitoring-plugin-7dccd58f55-ccvd2" Apr 17 14:28:45.409526 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:45.409497 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e9666b08-158c-4cf6-be87-86e937099375-monitoring-plugin-cert\") pod \"monitoring-plugin-7dccd58f55-ccvd2\" (UID: \"e9666b08-158c-4cf6-be87-86e937099375\") " pod="openshift-monitoring/monitoring-plugin-7dccd58f55-ccvd2" Apr 17 14:28:45.599166 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:45.599083 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7dccd58f55-ccvd2" Apr 17 14:28:45.826290 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:45.826217 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7dccd58f55-ccvd2"] Apr 17 14:28:45.830099 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:28:45.830063 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9666b08_158c_4cf6_be87_86e937099375.slice/crio-1c556080fc2dbef19cc75eb79e73e79e514d983f2bac72d0bc30c667b2583ffb WatchSource:0}: Error finding container 1c556080fc2dbef19cc75eb79e73e79e514d983f2bac72d0bc30c667b2583ffb: Status 404 returned error can't find the container with id 1c556080fc2dbef19cc75eb79e73e79e514d983f2bac72d0bc30c667b2583ffb Apr 17 14:28:46.053474 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.053017 2573 patch_prober.go:28] interesting pod/console-operator-9d4b6777b-mslwt container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.134.0.10:8443/readyz\": context deadline exceeded" start-of-body= Apr 17 14:28:46.053474 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.053074 2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-9d4b6777b-mslwt" podUID="fba84e6b-7f61-427c-94d1-489ee9dadc9e" containerName="console-operator" probeResult="failure" output="Get \"https://10.134.0.10:8443/readyz\": context deadline exceeded" Apr 17 14:28:46.069164 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.062426 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0289877f-ea8c-446b-b36e-257b370137e2","Type":"ContainerStarted","Data":"a56c3f4ca1ffbba641d1f08125f771bfe62805e048407e50d5c8f144cbb103a4"} Apr 17 14:28:46.069164 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.062468 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0289877f-ea8c-446b-b36e-257b370137e2","Type":"ContainerStarted","Data":"cc5bf95a0559fa909876d219a9e36c29a9ec3ccdf4177f237b9f6def1c269ea4"} Apr 17 14:28:46.069164 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.062485 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0289877f-ea8c-446b-b36e-257b370137e2","Type":"ContainerStarted","Data":"cd117402cd15280e3d97c5e65849241982a0ca4ad3db951e259900de8689eff6"} Apr 17 14:28:46.069164 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.062498 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0289877f-ea8c-446b-b36e-257b370137e2","Type":"ContainerStarted","Data":"fef23486c601878015e48624e5495159a688e1a116c56f41b04b639ead495482"} Apr 17 14:28:46.069164 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.066427 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7dccd58f55-ccvd2" event={"ID":"e9666b08-158c-4cf6-be87-86e937099375","Type":"ContainerStarted","Data":"1c556080fc2dbef19cc75eb79e73e79e514d983f2bac72d0bc30c667b2583ffb"} Apr 17 14:28:46.069164 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.067745 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5bfd896cd5-2lsjv" event={"ID":"68d85a25-0424-4cd5-9406-f978cd902241","Type":"ContainerStarted","Data":"5357ffa9ff3f304cd00a83411d37f351aaa10b2e7d57c5b6ba67df250b413ef1"} Apr 17 14:28:46.072870 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.072791 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5bdb554c7b-94rmc" event={"ID":"a86d4183-4bc6-429d-ac6b-9af46953e43f","Type":"ContainerStarted","Data":"8e33d0343f982d909162742b43f64e1ff9ea9320471b99c8f5e23d6ebd924582"} Apr 17 14:28:46.072870 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.072827 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5bdb554c7b-94rmc" event={"ID":"a86d4183-4bc6-429d-ac6b-9af46953e43f","Type":"ContainerStarted","Data":"001bd796f6c326f502dac1bab5ed3f57bff33e8d20ec124777569f1068cbd1dd"} Apr 17 14:28:46.072870 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.072841 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5bdb554c7b-94rmc" event={"ID":"a86d4183-4bc6-429d-ac6b-9af46953e43f","Type":"ContainerStarted","Data":"488b6b27ce78d3f966b2efbc2ed19da30476926381ad711be644b4fd02023214"} Apr 17 14:28:46.162884 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.162791 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Apr 17 14:28:46.167120 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.167093 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:28:46.169568 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.169538 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Apr 17 14:28:46.169708 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.169610 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Apr 17 14:28:46.169827 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.169810 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-c62pz\"" Apr 17 14:28:46.171134 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.170101 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Apr 17 14:28:46.171134 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.170189 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Apr 17 14:28:46.171134 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.170373 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Apr 17 14:28:46.171134 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.170458 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Apr 17 14:28:46.171134 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.170568 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Apr 17 14:28:46.171134 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.170666 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Apr 17 14:28:46.171134 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.170754 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-aicf4jkkvrve7\"" Apr 17 14:28:46.171134 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.171042 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Apr 17 14:28:46.171575 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.171247 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Apr 17 14:28:46.174050 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.173862 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Apr 17 14:28:46.179552 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.179381 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Apr 17 14:28:46.179552 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.179512 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Apr 17 14:28:46.312253 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.312227 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-9d4b6777b-mslwt" Apr 17 14:28:46.315957 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.315926 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d43bc47f-c681-4689-afd6-546a552c87a4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d43bc47f-c681-4689-afd6-546a552c87a4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:28:46.316155 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.316096 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d43bc47f-c681-4689-afd6-546a552c87a4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d43bc47f-c681-4689-afd6-546a552c87a4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:28:46.316155 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.316139 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d43bc47f-c681-4689-afd6-546a552c87a4-config\") pod \"prometheus-k8s-0\" (UID: \"d43bc47f-c681-4689-afd6-546a552c87a4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:28:46.316255 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.316167 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d43bc47f-c681-4689-afd6-546a552c87a4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d43bc47f-c681-4689-afd6-546a552c87a4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:28:46.316255 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.316236 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d43bc47f-c681-4689-afd6-546a552c87a4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d43bc47f-c681-4689-afd6-546a552c87a4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:28:46.316368 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.316274 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d43bc47f-c681-4689-afd6-546a552c87a4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d43bc47f-c681-4689-afd6-546a552c87a4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:28:46.316368 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.316301 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d43bc47f-c681-4689-afd6-546a552c87a4-config-out\") pod \"prometheus-k8s-0\" (UID: \"d43bc47f-c681-4689-afd6-546a552c87a4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:28:46.316368 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.316345 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d43bc47f-c681-4689-afd6-546a552c87a4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d43bc47f-c681-4689-afd6-546a552c87a4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:28:46.316368 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.316366 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d43bc47f-c681-4689-afd6-546a552c87a4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d43bc47f-c681-4689-afd6-546a552c87a4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:28:46.316573 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.316446 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d43bc47f-c681-4689-afd6-546a552c87a4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d43bc47f-c681-4689-afd6-546a552c87a4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:28:46.316573 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.316487 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d43bc47f-c681-4689-afd6-546a552c87a4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d43bc47f-c681-4689-afd6-546a552c87a4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:28:46.316573 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.316519 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d43bc47f-c681-4689-afd6-546a552c87a4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d43bc47f-c681-4689-afd6-546a552c87a4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:28:46.316573 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.316563 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d43bc47f-c681-4689-afd6-546a552c87a4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d43bc47f-c681-4689-afd6-546a552c87a4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:28:46.317020 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.316602 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d43bc47f-c681-4689-afd6-546a552c87a4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d43bc47f-c681-4689-afd6-546a552c87a4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:28:46.317020 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.316626 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d43bc47f-c681-4689-afd6-546a552c87a4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d43bc47f-c681-4689-afd6-546a552c87a4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:28:46.317020 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.316656 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d43bc47f-c681-4689-afd6-546a552c87a4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d43bc47f-c681-4689-afd6-546a552c87a4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:28:46.317020 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.316692 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvldz\" (UniqueName: \"kubernetes.io/projected/d43bc47f-c681-4689-afd6-546a552c87a4-kube-api-access-cvldz\") pod \"prometheus-k8s-0\" (UID: \"d43bc47f-c681-4689-afd6-546a552c87a4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:28:46.317020 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.316721 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d43bc47f-c681-4689-afd6-546a552c87a4-web-config\") pod \"prometheus-k8s-0\" (UID: \"d43bc47f-c681-4689-afd6-546a552c87a4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:28:46.419320 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.417720 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d43bc47f-c681-4689-afd6-546a552c87a4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d43bc47f-c681-4689-afd6-546a552c87a4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:28:46.419320 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.417801 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d43bc47f-c681-4689-afd6-546a552c87a4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d43bc47f-c681-4689-afd6-546a552c87a4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:28:46.419320 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.417834 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d43bc47f-c681-4689-afd6-546a552c87a4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d43bc47f-c681-4689-afd6-546a552c87a4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:28:46.419320 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.417880 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d43bc47f-c681-4689-afd6-546a552c87a4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d43bc47f-c681-4689-afd6-546a552c87a4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:28:46.419320 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.417922 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d43bc47f-c681-4689-afd6-546a552c87a4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d43bc47f-c681-4689-afd6-546a552c87a4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:28:46.419320 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.417949 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d43bc47f-c681-4689-afd6-546a552c87a4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d43bc47f-c681-4689-afd6-546a552c87a4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:28:46.419320 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.417995 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d43bc47f-c681-4689-afd6-546a552c87a4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d43bc47f-c681-4689-afd6-546a552c87a4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:28:46.419320 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.418020 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cvldz\" (UniqueName: \"kubernetes.io/projected/d43bc47f-c681-4689-afd6-546a552c87a4-kube-api-access-cvldz\") pod \"prometheus-k8s-0\" (UID: \"d43bc47f-c681-4689-afd6-546a552c87a4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:28:46.419320 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.418050 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d43bc47f-c681-4689-afd6-546a552c87a4-web-config\") pod \"prometheus-k8s-0\" (UID: \"d43bc47f-c681-4689-afd6-546a552c87a4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:28:46.419320 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.418077 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d43bc47f-c681-4689-afd6-546a552c87a4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d43bc47f-c681-4689-afd6-546a552c87a4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:28:46.419320 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.418135 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d43bc47f-c681-4689-afd6-546a552c87a4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d43bc47f-c681-4689-afd6-546a552c87a4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:28:46.419320 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.418167 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d43bc47f-c681-4689-afd6-546a552c87a4-config\") pod \"prometheus-k8s-0\" (UID: \"d43bc47f-c681-4689-afd6-546a552c87a4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:28:46.419320 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.418196 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d43bc47f-c681-4689-afd6-546a552c87a4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d43bc47f-c681-4689-afd6-546a552c87a4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:28:46.419320 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.418225 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d43bc47f-c681-4689-afd6-546a552c87a4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d43bc47f-c681-4689-afd6-546a552c87a4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:28:46.419320 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.418251 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d43bc47f-c681-4689-afd6-546a552c87a4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d43bc47f-c681-4689-afd6-546a552c87a4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:28:46.419320 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.418277 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d43bc47f-c681-4689-afd6-546a552c87a4-config-out\") pod \"prometheus-k8s-0\" (UID: \"d43bc47f-c681-4689-afd6-546a552c87a4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:28:46.419320 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.418324 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d43bc47f-c681-4689-afd6-546a552c87a4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d43bc47f-c681-4689-afd6-546a552c87a4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:28:46.420266 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.418348 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d43bc47f-c681-4689-afd6-546a552c87a4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d43bc47f-c681-4689-afd6-546a552c87a4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:28:46.423108 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.422762 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d43bc47f-c681-4689-afd6-546a552c87a4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d43bc47f-c681-4689-afd6-546a552c87a4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:28:46.423108 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.422831 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d43bc47f-c681-4689-afd6-546a552c87a4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d43bc47f-c681-4689-afd6-546a552c87a4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:28:46.424450 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.423903 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d43bc47f-c681-4689-afd6-546a552c87a4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d43bc47f-c681-4689-afd6-546a552c87a4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:28:46.426024 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.424933 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d43bc47f-c681-4689-afd6-546a552c87a4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d43bc47f-c681-4689-afd6-546a552c87a4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:28:46.426024 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.425238 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d43bc47f-c681-4689-afd6-546a552c87a4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d43bc47f-c681-4689-afd6-546a552c87a4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:28:46.426024 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.425599 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d43bc47f-c681-4689-afd6-546a552c87a4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d43bc47f-c681-4689-afd6-546a552c87a4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:28:46.426024 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.425960 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d43bc47f-c681-4689-afd6-546a552c87a4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d43bc47f-c681-4689-afd6-546a552c87a4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:28:46.429739 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.429693 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d43bc47f-c681-4689-afd6-546a552c87a4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d43bc47f-c681-4689-afd6-546a552c87a4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:28:46.433611 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.433570 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvldz\" (UniqueName: \"kubernetes.io/projected/d43bc47f-c681-4689-afd6-546a552c87a4-kube-api-access-cvldz\") pod \"prometheus-k8s-0\" (UID: \"d43bc47f-c681-4689-afd6-546a552c87a4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:28:46.435712 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.435646 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d43bc47f-c681-4689-afd6-546a552c87a4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d43bc47f-c681-4689-afd6-546a552c87a4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:28:46.437655 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.437607 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d43bc47f-c681-4689-afd6-546a552c87a4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d43bc47f-c681-4689-afd6-546a552c87a4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:28:46.438377 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.438306 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d43bc47f-c681-4689-afd6-546a552c87a4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d43bc47f-c681-4689-afd6-546a552c87a4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:28:46.438906 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.438521 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d43bc47f-c681-4689-afd6-546a552c87a4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d43bc47f-c681-4689-afd6-546a552c87a4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:28:46.439746 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.439677 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d43bc47f-c681-4689-afd6-546a552c87a4-web-config\") pod \"prometheus-k8s-0\" (UID: \"d43bc47f-c681-4689-afd6-546a552c87a4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:28:46.442554 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.442513 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d43bc47f-c681-4689-afd6-546a552c87a4-config-out\") pod \"prometheus-k8s-0\" (UID: \"d43bc47f-c681-4689-afd6-546a552c87a4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:28:46.447131 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.444907 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d43bc47f-c681-4689-afd6-546a552c87a4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d43bc47f-c681-4689-afd6-546a552c87a4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:28:46.447131 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.445311 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d43bc47f-c681-4689-afd6-546a552c87a4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d43bc47f-c681-4689-afd6-546a552c87a4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:28:46.447131 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.446075 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/d43bc47f-c681-4689-afd6-546a552c87a4-config\") pod \"prometheus-k8s-0\" (UID: \"d43bc47f-c681-4689-afd6-546a552c87a4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:28:46.486119 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.486077 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:28:46.694998 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:46.694782 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Apr 17 14:28:47.080217 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:47.080175 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0289877f-ea8c-446b-b36e-257b370137e2","Type":"ContainerStarted","Data":"bb22df815805690a56741186609fecaac74105db269237744c3d8f391bdd316f"} Apr 17 14:28:47.101068 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:28:47.101036 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd43bc47f_c681_4689_afd6_546a552c87a4.slice/crio-691a7eff324a0781ab966aa3e45836a9824ec823293df5f38d48cf63e4136904 WatchSource:0}: Error finding container 691a7eff324a0781ab966aa3e45836a9824ec823293df5f38d48cf63e4136904: Status 404 returned error can't find the container with id 691a7eff324a0781ab966aa3e45836a9824ec823293df5f38d48cf63e4136904 Apr 17 14:28:48.089394 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:48.089359 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0289877f-ea8c-446b-b36e-257b370137e2","Type":"ContainerStarted","Data":"e9c8bab536ca43f54879fcad538ee5e60436856ca9b1caa1b60cd421f7e048d3"} Apr 17 14:28:48.090730 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:48.090701 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7dccd58f55-ccvd2" event={"ID":"e9666b08-158c-4cf6-be87-86e937099375","Type":"ContainerStarted","Data":"81e82e697e09b2a14811f3c9388b0f0fac4b754f99a59a2737f8056fddce9873"} Apr 17 14:28:48.090939 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:48.090897 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7dccd58f55-ccvd2" Apr 17 14:28:48.092165 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:48.092138 2573 generic.go:358] "Generic (PLEG): container finished" podID="d43bc47f-c681-4689-afd6-546a552c87a4" containerID="e9f7b31c9948cfee84bbfcf2dd4997a1f9cb7160baa92e5951e13e94e9d1f9c2" exitCode=0 Apr 17 14:28:48.092296 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:48.092202 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d43bc47f-c681-4689-afd6-546a552c87a4","Type":"ContainerDied","Data":"e9f7b31c9948cfee84bbfcf2dd4997a1f9cb7160baa92e5951e13e94e9d1f9c2"} Apr 17 14:28:48.092296 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:48.092236 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d43bc47f-c681-4689-afd6-546a552c87a4","Type":"ContainerStarted","Data":"691a7eff324a0781ab966aa3e45836a9824ec823293df5f38d48cf63e4136904"} Apr 17 14:28:48.093913 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:48.093714 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5bfd896cd5-2lsjv" event={"ID":"68d85a25-0424-4cd5-9406-f978cd902241","Type":"ContainerStarted","Data":"ed7db40374e68106034d3f88f5cd6f1e9506f6d9f7208851cb4e6171932ad99b"} Apr 17 14:28:48.096871 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:48.096851 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5bdb554c7b-94rmc" event={"ID":"a86d4183-4bc6-429d-ac6b-9af46953e43f","Type":"ContainerStarted","Data":"4606c9feff83bfda3cda2a3242f90ba52db3ee71057ec47d78902b194ea96071"} Apr 17 14:28:48.096871 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:48.096874 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5bdb554c7b-94rmc" event={"ID":"a86d4183-4bc6-429d-ac6b-9af46953e43f","Type":"ContainerStarted","Data":"2127da5f878323fcac515f5ea77f4908ef47cbd44bcd47a5f673f9668f305219"} Apr 17 14:28:48.097067 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:48.096885 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5bdb554c7b-94rmc" event={"ID":"a86d4183-4bc6-429d-ac6b-9af46953e43f","Type":"ContainerStarted","Data":"2d5409ea16c1c9291e490de457253fb53b1a0de3bdc512de80d54b6ca31cef1c"} Apr 17 14:28:48.097067 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:48.097029 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5bdb554c7b-94rmc" Apr 17 14:28:48.097459 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:48.097439 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7dccd58f55-ccvd2" Apr 17 14:28:48.115640 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:48.115434 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.511995094 podStartE2EDuration="8.115419799s" podCreationTimestamp="2026-04-17 14:28:40 +0000 UTC" firstStartedPulling="2026-04-17 14:28:42.011353892 +0000 UTC m=+114.055782680" lastFinishedPulling="2026-04-17 14:28:47.614778594 +0000 UTC m=+119.659207385" observedRunningTime="2026-04-17 14:28:48.113024127 +0000 UTC m=+120.157452933" watchObservedRunningTime="2026-04-17 14:28:48.115419799 +0000 UTC m=+120.159848609" Apr 17 14:28:48.133565 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:48.133528 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5bdb554c7b-94rmc" podStartSLOduration=1.841006611 podStartE2EDuration="6.133519183s" podCreationTimestamp="2026-04-17 14:28:42 +0000 UTC" firstStartedPulling="2026-04-17 14:28:43.322625247 +0000 UTC m=+115.367054031" lastFinishedPulling="2026-04-17 14:28:47.615137817 +0000 UTC m=+119.659566603" observedRunningTime="2026-04-17 14:28:48.131708346 +0000 UTC m=+120.176137153" watchObservedRunningTime="2026-04-17 14:28:48.133519183 +0000 UTC m=+120.177947991" Apr 17 14:28:48.149327 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:48.149167 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7dccd58f55-ccvd2" podStartSLOduration=2.363102538 podStartE2EDuration="4.149153519s" podCreationTimestamp="2026-04-17 14:28:44 +0000 UTC" firstStartedPulling="2026-04-17 14:28:45.83326696 +0000 UTC m=+117.877695749" lastFinishedPulling="2026-04-17 14:28:47.619317929 +0000 UTC m=+119.663746730" observedRunningTime="2026-04-17 14:28:48.148888434 +0000 UTC m=+120.193317242" watchObservedRunningTime="2026-04-17 14:28:48.149153519 +0000 UTC m=+120.193582328" Apr 17 14:28:48.191416 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:48.191375 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5bfd896cd5-2lsjv" podStartSLOduration=1.897999373 podStartE2EDuration="4.191361664s" podCreationTimestamp="2026-04-17 14:28:44 +0000 UTC" firstStartedPulling="2026-04-17 14:28:45.32120614 +0000 UTC m=+117.365634925" lastFinishedPulling="2026-04-17 14:28:47.614568412 +0000 UTC m=+119.658997216" observedRunningTime="2026-04-17 14:28:48.190590948 +0000 UTC m=+120.235019767" watchObservedRunningTime="2026-04-17 14:28:48.191361664 +0000 UTC m=+120.235790471" Apr 17 14:28:51.112491 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:51.112333 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d43bc47f-c681-4689-afd6-546a552c87a4","Type":"ContainerStarted","Data":"5688310f65f4d738847e60c81b6b0bcefdea51cdc5910722d7bc208856153429"} Apr 17 14:28:51.112491 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:51.112377 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d43bc47f-c681-4689-afd6-546a552c87a4","Type":"ContainerStarted","Data":"4a48ef031c1f8c33e5610714de541345f554a2f44a163e3fbb56336b4e48733b"} Apr 17 14:28:51.112491 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:51.112389 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d43bc47f-c681-4689-afd6-546a552c87a4","Type":"ContainerStarted","Data":"12a580c67fdae59612e20262f2df95258f8b41bb04d172e45c007941034852a3"} Apr 17 14:28:51.112491 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:51.112402 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d43bc47f-c681-4689-afd6-546a552c87a4","Type":"ContainerStarted","Data":"acd25c3bdafa484b16099558b39c05a84a91963746a891791366c94ababdfa31"} Apr 17 14:28:51.112491 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:51.112413 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d43bc47f-c681-4689-afd6-546a552c87a4","Type":"ContainerStarted","Data":"c0cd306b14d4b3c2037e0301f81a2837c6000a0d6ef2a7920ebaebe4506958fa"} Apr 17 14:28:51.112491 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:51.112426 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d43bc47f-c681-4689-afd6-546a552c87a4","Type":"ContainerStarted","Data":"3385a65933d967233334abd32488768afc1aeecb0b3c7444473c11039689df2d"} Apr 17 14:28:51.139280 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:51.139222 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.669297203 podStartE2EDuration="5.139207631s" podCreationTimestamp="2026-04-17 14:28:46 +0000 UTC" firstStartedPulling="2026-04-17 14:28:48.093433176 +0000 UTC m=+120.137861963" lastFinishedPulling="2026-04-17 14:28:50.563343603 +0000 UTC m=+122.607772391" observedRunningTime="2026-04-17 14:28:51.137168281 +0000 UTC m=+123.181597093" watchObservedRunningTime="2026-04-17 14:28:51.139207631 +0000 UTC m=+123.183636437" Apr 17 14:28:51.487212 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:51.487187 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:28:54.109844 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:54.109818 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5bdb554c7b-94rmc" Apr 17 14:28:57.225818 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:57.225771 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bedbded4-1a39-4b5a-b15a-2f9d05548508-metrics-certs\") pod \"network-metrics-daemon-khctm\" (UID: \"bedbded4-1a39-4b5a-b15a-2f9d05548508\") " pod="openshift-multus/network-metrics-daemon-khctm" Apr 17 14:28:57.228035 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:57.228016 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bedbded4-1a39-4b5a-b15a-2f9d05548508-metrics-certs\") pod \"network-metrics-daemon-khctm\" (UID: \"bedbded4-1a39-4b5a-b15a-2f9d05548508\") " pod="openshift-multus/network-metrics-daemon-khctm" Apr 17 14:28:57.434877 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:57.434840 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-w222h\"" Apr 17 14:28:57.442815 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:57.442791 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khctm" Apr 17 14:28:57.559657 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:57.559630 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-khctm"] Apr 17 14:28:57.562265 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:28:57.562234 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbedbded4_1a39_4b5a_b15a_2f9d05548508.slice/crio-d4c39175bd6d104e91bdc325e2095dc09062a7ae072b6ed80d4dc71917bfcbe5 WatchSource:0}: Error finding container d4c39175bd6d104e91bdc325e2095dc09062a7ae072b6ed80d4dc71917bfcbe5: Status 404 returned error can't find the container with id d4c39175bd6d104e91bdc325e2095dc09062a7ae072b6ed80d4dc71917bfcbe5 Apr 17 14:28:58.137310 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:58.137253 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-khctm" event={"ID":"bedbded4-1a39-4b5a-b15a-2f9d05548508","Type":"ContainerStarted","Data":"d4c39175bd6d104e91bdc325e2095dc09062a7ae072b6ed80d4dc71917bfcbe5"} Apr 17 14:28:59.141571 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:59.141533 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-khctm" event={"ID":"bedbded4-1a39-4b5a-b15a-2f9d05548508","Type":"ContainerStarted","Data":"3193b2f645cac209f6ebc30d21a7e45a71b4df13270d35261380f02bff137cf6"} Apr 17 14:28:59.141571 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:59.141572 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-khctm" event={"ID":"bedbded4-1a39-4b5a-b15a-2f9d05548508","Type":"ContainerStarted","Data":"d8c1a2e67e5ce81ffd036aa33319bbaf32fec9a7e93b99920cb802926f58f90b"} Apr 17 14:28:59.157010 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:28:59.156948 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-khctm" podStartSLOduration=130.096655183 podStartE2EDuration="2m11.1569356s" podCreationTimestamp="2026-04-17 14:26:48 +0000 UTC" firstStartedPulling="2026-04-17 14:28:57.564050093 +0000 UTC m=+129.608478892" lastFinishedPulling="2026-04-17 14:28:58.62433052 +0000 UTC m=+130.668759309" observedRunningTime="2026-04-17 14:28:59.155198145 +0000 UTC m=+131.199626954" watchObservedRunningTime="2026-04-17 14:28:59.1569356 +0000 UTC m=+131.201364407" Apr 17 14:29:04.524702 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:29:04.524662 2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5bfd896cd5-2lsjv" Apr 17 14:29:04.524702 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:29:04.524705 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5bfd896cd5-2lsjv" Apr 17 14:29:14.189149 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:29:14.189114 2573 generic.go:358] "Generic (PLEG): container finished" podID="937afaa8-5b13-4dd9-9bba-cbe6d6606c4f" containerID="9a6a605979cd4580f68bed4d3eb1503e44f97678d05e520c7ca9ea2433defde7" exitCode=0 Apr 17 14:29:14.189533 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:29:14.189185 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-585dfdc468-vmfdz" event={"ID":"937afaa8-5b13-4dd9-9bba-cbe6d6606c4f","Type":"ContainerDied","Data":"9a6a605979cd4580f68bed4d3eb1503e44f97678d05e520c7ca9ea2433defde7"} Apr 17 14:29:14.189533 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:29:14.189517 2573 scope.go:117] "RemoveContainer" containerID="9a6a605979cd4580f68bed4d3eb1503e44f97678d05e520c7ca9ea2433defde7" Apr 17 14:29:15.197279 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:29:15.197245 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-585dfdc468-vmfdz" event={"ID":"937afaa8-5b13-4dd9-9bba-cbe6d6606c4f","Type":"ContainerStarted","Data":"cc2cb0da5bd976e794bf58609be3566c4828676559305f8729f5c5ce96899928"} Apr 17 14:29:24.530084 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:29:24.530054 2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5bfd896cd5-2lsjv" Apr 17 14:29:24.533861 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:29:24.533837 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5bfd896cd5-2lsjv" Apr 17 14:29:28.238146 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:29:28.238109 2573 generic.go:358] "Generic (PLEG): container finished" podID="bcfc0e78-bf12-499f-874d-3b0c3b9f6e21" containerID="f2a7d7007b3b83dcabe9d080e4700dd07325c6cd572563dc83e8ac5e5be3e6c4" exitCode=0 Apr 17 14:29:28.238505 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:29:28.238181 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-d6fc45fc5-lxq9m" event={"ID":"bcfc0e78-bf12-499f-874d-3b0c3b9f6e21","Type":"ContainerDied","Data":"f2a7d7007b3b83dcabe9d080e4700dd07325c6cd572563dc83e8ac5e5be3e6c4"} Apr 17 14:29:28.238505 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:29:28.238487 2573 scope.go:117] "RemoveContainer" containerID="f2a7d7007b3b83dcabe9d080e4700dd07325c6cd572563dc83e8ac5e5be3e6c4" Apr 17 14:29:29.242569 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:29:29.242533 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-d6fc45fc5-lxq9m" event={"ID":"bcfc0e78-bf12-499f-874d-3b0c3b9f6e21","Type":"ContainerStarted","Data":"c408da3140c9ab68149571b238c466aec9e9a3baef7a917e3f2543bfbaf8fca4"} Apr 17 14:29:46.487101 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:29:46.487015 2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:29:46.505897 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:29:46.505871 2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:29:47.311395 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:29:47.311367 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:30:00.130474 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:00.130432 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Apr 17 14:30:00.130943 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:00.130911 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0289877f-ea8c-446b-b36e-257b370137e2" containerName="alertmanager" containerID="cri-o://fef23486c601878015e48624e5495159a688e1a116c56f41b04b639ead495482" gracePeriod=120 Apr 17 14:30:00.131040 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:00.130985 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0289877f-ea8c-446b-b36e-257b370137e2" containerName="kube-rbac-proxy-metric" containerID="cri-o://bb22df815805690a56741186609fecaac74105db269237744c3d8f391bdd316f" gracePeriod=120 Apr 17 14:30:00.131098 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:00.131047 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0289877f-ea8c-446b-b36e-257b370137e2" containerName="prom-label-proxy" containerID="cri-o://e9c8bab536ca43f54879fcad538ee5e60436856ca9b1caa1b60cd421f7e048d3" gracePeriod=120 Apr 17 14:30:00.131147 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:00.131069 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0289877f-ea8c-446b-b36e-257b370137e2" containerName="config-reloader" containerID="cri-o://cd117402cd15280e3d97c5e65849241982a0ca4ad3db951e259900de8689eff6" gracePeriod=120 Apr 17 14:30:00.131147 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:00.131106 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0289877f-ea8c-446b-b36e-257b370137e2" containerName="kube-rbac-proxy" containerID="cri-o://a56c3f4ca1ffbba641d1f08125f771bfe62805e048407e50d5c8f144cbb103a4" gracePeriod=120 Apr 17 14:30:00.131147 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:00.131053 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0289877f-ea8c-446b-b36e-257b370137e2" containerName="kube-rbac-proxy-web" containerID="cri-o://cc5bf95a0559fa909876d219a9e36c29a9ec3ccdf4177f237b9f6def1c269ea4" gracePeriod=120 Apr 17 14:30:00.336963 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:00.336932 2573 generic.go:358] "Generic (PLEG): container finished" podID="0289877f-ea8c-446b-b36e-257b370137e2" containerID="e9c8bab536ca43f54879fcad538ee5e60436856ca9b1caa1b60cd421f7e048d3" exitCode=0 Apr 17 14:30:00.336963 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:00.336959 2573 generic.go:358] "Generic (PLEG): container finished" podID="0289877f-ea8c-446b-b36e-257b370137e2" containerID="bb22df815805690a56741186609fecaac74105db269237744c3d8f391bdd316f" exitCode=0 Apr 17 14:30:00.337154 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:00.336984 2573 generic.go:358] "Generic (PLEG): container finished" podID="0289877f-ea8c-446b-b36e-257b370137e2" containerID="a56c3f4ca1ffbba641d1f08125f771bfe62805e048407e50d5c8f144cbb103a4" exitCode=0 Apr 17 14:30:00.337154 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:00.336994 2573 generic.go:358] "Generic (PLEG): container finished" podID="0289877f-ea8c-446b-b36e-257b370137e2" containerID="cd117402cd15280e3d97c5e65849241982a0ca4ad3db951e259900de8689eff6" exitCode=0 Apr 17 14:30:00.337154 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:00.337001 2573 generic.go:358] "Generic (PLEG): container finished" podID="0289877f-ea8c-446b-b36e-257b370137e2" containerID="fef23486c601878015e48624e5495159a688e1a116c56f41b04b639ead495482" exitCode=0 Apr 17 14:30:00.337154 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:00.337011 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0289877f-ea8c-446b-b36e-257b370137e2","Type":"ContainerDied","Data":"e9c8bab536ca43f54879fcad538ee5e60436856ca9b1caa1b60cd421f7e048d3"} Apr 17 14:30:00.337154 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:00.337043 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0289877f-ea8c-446b-b36e-257b370137e2","Type":"ContainerDied","Data":"bb22df815805690a56741186609fecaac74105db269237744c3d8f391bdd316f"} Apr 17 14:30:00.337154 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:00.337053 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0289877f-ea8c-446b-b36e-257b370137e2","Type":"ContainerDied","Data":"a56c3f4ca1ffbba641d1f08125f771bfe62805e048407e50d5c8f144cbb103a4"} Apr 17 14:30:00.337154 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:00.337063 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0289877f-ea8c-446b-b36e-257b370137e2","Type":"ContainerDied","Data":"cd117402cd15280e3d97c5e65849241982a0ca4ad3db951e259900de8689eff6"} Apr 17 14:30:00.337154 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:00.337071 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0289877f-ea8c-446b-b36e-257b370137e2","Type":"ContainerDied","Data":"fef23486c601878015e48624e5495159a688e1a116c56f41b04b639ead495482"} Apr 17 14:30:01.342604 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:01.342573 2573 generic.go:358] "Generic (PLEG): container finished" podID="0289877f-ea8c-446b-b36e-257b370137e2" containerID="cc5bf95a0559fa909876d219a9e36c29a9ec3ccdf4177f237b9f6def1c269ea4" exitCode=0 Apr 17 14:30:01.342932 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:01.342614 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0289877f-ea8c-446b-b36e-257b370137e2","Type":"ContainerDied","Data":"cc5bf95a0559fa909876d219a9e36c29a9ec3ccdf4177f237b9f6def1c269ea4"} Apr 17 14:30:01.377701 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:01.377680 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:30:01.466022 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:01.465994 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0289877f-ea8c-446b-b36e-257b370137e2-alertmanager-main-db\") pod \"0289877f-ea8c-446b-b36e-257b370137e2\" (UID: \"0289877f-ea8c-446b-b36e-257b370137e2\") " Apr 17 14:30:01.466185 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:01.466039 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0289877f-ea8c-446b-b36e-257b370137e2-config-volume\") pod \"0289877f-ea8c-446b-b36e-257b370137e2\" (UID: \"0289877f-ea8c-446b-b36e-257b370137e2\") " Apr 17 14:30:01.466185 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:01.466160 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0289877f-ea8c-446b-b36e-257b370137e2-secret-alertmanager-kube-rbac-proxy\") pod \"0289877f-ea8c-446b-b36e-257b370137e2\" (UID: \"0289877f-ea8c-446b-b36e-257b370137e2\") " Apr 17 14:30:01.466309 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:01.466207 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0289877f-ea8c-446b-b36e-257b370137e2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"0289877f-ea8c-446b-b36e-257b370137e2\" (UID: \"0289877f-ea8c-446b-b36e-257b370137e2\") " Apr 17 14:30:01.466309 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:01.466234 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0289877f-ea8c-446b-b36e-257b370137e2-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "0289877f-ea8c-446b-b36e-257b370137e2" (UID: "0289877f-ea8c-446b-b36e-257b370137e2"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Apr 17 14:30:01.466309 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:01.466242 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0289877f-ea8c-446b-b36e-257b370137e2-cluster-tls-config\") pod \"0289877f-ea8c-446b-b36e-257b370137e2\" (UID: \"0289877f-ea8c-446b-b36e-257b370137e2\") " Apr 17 14:30:01.466309 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:01.466297 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0289877f-ea8c-446b-b36e-257b370137e2-secret-alertmanager-kube-rbac-proxy-web\") pod \"0289877f-ea8c-446b-b36e-257b370137e2\" (UID: \"0289877f-ea8c-446b-b36e-257b370137e2\") " Apr 17 14:30:01.466516 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:01.466335 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0289877f-ea8c-446b-b36e-257b370137e2-tls-assets\") pod \"0289877f-ea8c-446b-b36e-257b370137e2\" (UID: \"0289877f-ea8c-446b-b36e-257b370137e2\") " Apr 17 14:30:01.466516 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:01.466385 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f9gzt\" (UniqueName: \"kubernetes.io/projected/0289877f-ea8c-446b-b36e-257b370137e2-kube-api-access-f9gzt\") pod \"0289877f-ea8c-446b-b36e-257b370137e2\" (UID: \"0289877f-ea8c-446b-b36e-257b370137e2\") " Apr 17 14:30:01.466516 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:01.466412 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0289877f-ea8c-446b-b36e-257b370137e2-config-out\") pod \"0289877f-ea8c-446b-b36e-257b370137e2\" (UID: \"0289877f-ea8c-446b-b36e-257b370137e2\") " Apr 17 14:30:01.466516 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:01.466445 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0289877f-ea8c-446b-b36e-257b370137e2-web-config\") pod \"0289877f-ea8c-446b-b36e-257b370137e2\" (UID: \"0289877f-ea8c-446b-b36e-257b370137e2\") " Apr 17 14:30:01.466516 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:01.466489 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0289877f-ea8c-446b-b36e-257b370137e2-alertmanager-trusted-ca-bundle\") pod \"0289877f-ea8c-446b-b36e-257b370137e2\" (UID: \"0289877f-ea8c-446b-b36e-257b370137e2\") " Apr 17 14:30:01.466763 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:01.466537 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0289877f-ea8c-446b-b36e-257b370137e2-metrics-client-ca\") pod \"0289877f-ea8c-446b-b36e-257b370137e2\" (UID: \"0289877f-ea8c-446b-b36e-257b370137e2\") " Apr 17 14:30:01.466763 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:01.466593 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0289877f-ea8c-446b-b36e-257b370137e2-secret-alertmanager-main-tls\") pod \"0289877f-ea8c-446b-b36e-257b370137e2\" (UID: \"0289877f-ea8c-446b-b36e-257b370137e2\") " Apr 17 14:30:01.466906 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:01.466886 2573 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0289877f-ea8c-446b-b36e-257b370137e2-alertmanager-main-db\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\"" Apr 17 14:30:01.468673 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:01.468621 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0289877f-ea8c-446b-b36e-257b370137e2-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "0289877f-ea8c-446b-b36e-257b370137e2" (UID: "0289877f-ea8c-446b-b36e-257b370137e2"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 17 14:30:01.468820 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:01.468702 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0289877f-ea8c-446b-b36e-257b370137e2-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "0289877f-ea8c-446b-b36e-257b370137e2" (UID: "0289877f-ea8c-446b-b36e-257b370137e2"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 17 14:30:01.468944 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:01.468919 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0289877f-ea8c-446b-b36e-257b370137e2-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "0289877f-ea8c-446b-b36e-257b370137e2" (UID: "0289877f-ea8c-446b-b36e-257b370137e2"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 14:30:01.469408 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:01.469368 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0289877f-ea8c-446b-b36e-257b370137e2-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "0289877f-ea8c-446b-b36e-257b370137e2" (UID: "0289877f-ea8c-446b-b36e-257b370137e2"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 14:30:01.469622 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:01.469593 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0289877f-ea8c-446b-b36e-257b370137e2-config-volume" (OuterVolumeSpecName: "config-volume") pod "0289877f-ea8c-446b-b36e-257b370137e2" (UID: "0289877f-ea8c-446b-b36e-257b370137e2"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 14:30:01.469909 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:01.469888 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0289877f-ea8c-446b-b36e-257b370137e2-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "0289877f-ea8c-446b-b36e-257b370137e2" (UID: "0289877f-ea8c-446b-b36e-257b370137e2"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 14:30:01.470111 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:01.470082 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0289877f-ea8c-446b-b36e-257b370137e2-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "0289877f-ea8c-446b-b36e-257b370137e2" (UID: "0289877f-ea8c-446b-b36e-257b370137e2"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 17 14:30:01.470312 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:01.470284 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0289877f-ea8c-446b-b36e-257b370137e2-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "0289877f-ea8c-446b-b36e-257b370137e2" (UID: "0289877f-ea8c-446b-b36e-257b370137e2"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 14:30:01.470533 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:01.470507 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0289877f-ea8c-446b-b36e-257b370137e2-kube-api-access-f9gzt" (OuterVolumeSpecName: "kube-api-access-f9gzt") pod "0289877f-ea8c-446b-b36e-257b370137e2" (UID: "0289877f-ea8c-446b-b36e-257b370137e2"). InnerVolumeSpecName "kube-api-access-f9gzt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 17 14:30:01.470801 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:01.470785 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0289877f-ea8c-446b-b36e-257b370137e2-config-out" (OuterVolumeSpecName: "config-out") pod "0289877f-ea8c-446b-b36e-257b370137e2" (UID: "0289877f-ea8c-446b-b36e-257b370137e2"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Apr 17 14:30:01.473995 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:01.473954 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0289877f-ea8c-446b-b36e-257b370137e2-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "0289877f-ea8c-446b-b36e-257b370137e2" (UID: "0289877f-ea8c-446b-b36e-257b370137e2"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 14:30:01.480892 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:01.480865 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0289877f-ea8c-446b-b36e-257b370137e2-web-config" (OuterVolumeSpecName: "web-config") pod "0289877f-ea8c-446b-b36e-257b370137e2" (UID: "0289877f-ea8c-446b-b36e-257b370137e2"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 14:30:01.567583 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:01.567549 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f9gzt\" (UniqueName: \"kubernetes.io/projected/0289877f-ea8c-446b-b36e-257b370137e2-kube-api-access-f9gzt\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\"" Apr 17 14:30:01.567583 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:01.567582 2573 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0289877f-ea8c-446b-b36e-257b370137e2-config-out\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\"" Apr 17 14:30:01.567809 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:01.567596 2573 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0289877f-ea8c-446b-b36e-257b370137e2-web-config\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\"" Apr 17 14:30:01.567809 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:01.567610 2573 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0289877f-ea8c-446b-b36e-257b370137e2-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\"" Apr 17 14:30:01.567809 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:01.567626 2573 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0289877f-ea8c-446b-b36e-257b370137e2-metrics-client-ca\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\"" Apr 17 14:30:01.567809 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:01.567638 2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0289877f-ea8c-446b-b36e-257b370137e2-secret-alertmanager-main-tls\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\"" Apr 17 14:30:01.567809 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:01.567651 2573 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0289877f-ea8c-446b-b36e-257b370137e2-config-volume\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\"" Apr 17 14:30:01.567809 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:01.567663 2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0289877f-ea8c-446b-b36e-257b370137e2-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\"" Apr 17 14:30:01.567809 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:01.567676 2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0289877f-ea8c-446b-b36e-257b370137e2-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\"" Apr 17 14:30:01.567809 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:01.567688 2573 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0289877f-ea8c-446b-b36e-257b370137e2-cluster-tls-config\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\"" Apr 17 14:30:01.567809 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:01.567700 2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0289877f-ea8c-446b-b36e-257b370137e2-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\"" Apr 17 14:30:01.567809 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:01.567713 2573 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0289877f-ea8c-446b-b36e-257b370137e2-tls-assets\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\"" Apr 17 14:30:02.347907 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.347877 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0289877f-ea8c-446b-b36e-257b370137e2","Type":"ContainerDied","Data":"7b32fa2655b0bf08e9213ab7876bfc68394c730cad297172a9fe4d0ec5729d7a"} Apr 17 14:30:02.348299 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.347914 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:30:02.348299 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.347924 2573 scope.go:117] "RemoveContainer" containerID="e9c8bab536ca43f54879fcad538ee5e60436856ca9b1caa1b60cd421f7e048d3" Apr 17 14:30:02.355558 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.355538 2573 scope.go:117] "RemoveContainer" containerID="bb22df815805690a56741186609fecaac74105db269237744c3d8f391bdd316f" Apr 17 14:30:02.361943 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.361926 2573 scope.go:117] "RemoveContainer" containerID="a56c3f4ca1ffbba641d1f08125f771bfe62805e048407e50d5c8f144cbb103a4" Apr 17 14:30:02.368322 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.368301 2573 scope.go:117] "RemoveContainer" containerID="cc5bf95a0559fa909876d219a9e36c29a9ec3ccdf4177f237b9f6def1c269ea4" Apr 17 14:30:02.372708 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.372685 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Apr 17 14:30:02.376348 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.376327 2573 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Apr 17 14:30:02.376710 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.376681 2573 scope.go:117] "RemoveContainer" containerID="cd117402cd15280e3d97c5e65849241982a0ca4ad3db951e259900de8689eff6" Apr 17 14:30:02.383122 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.383091 2573 scope.go:117] "RemoveContainer" containerID="fef23486c601878015e48624e5495159a688e1a116c56f41b04b639ead495482" Apr 17 14:30:02.389482 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.389466 2573 scope.go:117] "RemoveContainer" containerID="b29e74d26d5b96fb8ab8b44cdafb04c0d736ea57e8a25e3893201654937ca501" Apr 17 14:30:02.399461 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.399440 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Apr 17 14:30:02.399790 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.399775 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0289877f-ea8c-446b-b36e-257b370137e2" containerName="kube-rbac-proxy" Apr 17 14:30:02.399877 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.399793 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0289877f-ea8c-446b-b36e-257b370137e2" containerName="kube-rbac-proxy" Apr 17 14:30:02.399877 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.399807 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0289877f-ea8c-446b-b36e-257b370137e2" containerName="prom-label-proxy" Apr 17 14:30:02.399877 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.399817 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0289877f-ea8c-446b-b36e-257b370137e2" containerName="prom-label-proxy" Apr 17 14:30:02.399877 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.399840 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0289877f-ea8c-446b-b36e-257b370137e2" containerName="kube-rbac-proxy-metric" Apr 17 14:30:02.399877 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.399848 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0289877f-ea8c-446b-b36e-257b370137e2" containerName="kube-rbac-proxy-metric" Apr 17 14:30:02.399877 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.399863 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0289877f-ea8c-446b-b36e-257b370137e2" containerName="kube-rbac-proxy-web" Apr 17 14:30:02.399877 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.399871 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0289877f-ea8c-446b-b36e-257b370137e2" containerName="kube-rbac-proxy-web" Apr 17 14:30:02.400229 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.399882 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0289877f-ea8c-446b-b36e-257b370137e2" containerName="config-reloader" Apr 17 14:30:02.400229 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.399890 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0289877f-ea8c-446b-b36e-257b370137e2" containerName="config-reloader" Apr 17 14:30:02.400229 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.399903 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0289877f-ea8c-446b-b36e-257b370137e2" containerName="alertmanager" Apr 17 14:30:02.400229 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.399912 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0289877f-ea8c-446b-b36e-257b370137e2" containerName="alertmanager" Apr 17 14:30:02.400229 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.399928 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0289877f-ea8c-446b-b36e-257b370137e2" containerName="init-config-reloader" Apr 17 14:30:02.400229 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.399936 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0289877f-ea8c-446b-b36e-257b370137e2" containerName="init-config-reloader" Apr 17 14:30:02.400229 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.400034 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="0289877f-ea8c-446b-b36e-257b370137e2" containerName="kube-rbac-proxy" Apr 17 14:30:02.400229 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.400049 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="0289877f-ea8c-446b-b36e-257b370137e2" containerName="config-reloader" Apr 17 14:30:02.400229 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.400063 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="0289877f-ea8c-446b-b36e-257b370137e2" containerName="kube-rbac-proxy-metric" Apr 17 14:30:02.400229 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.400075 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="0289877f-ea8c-446b-b36e-257b370137e2" containerName="alertmanager" Apr 17 14:30:02.400229 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.400085 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="0289877f-ea8c-446b-b36e-257b370137e2" containerName="prom-label-proxy" Apr 17 14:30:02.400229 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.400095 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="0289877f-ea8c-446b-b36e-257b370137e2" containerName="kube-rbac-proxy-web" Apr 17 14:30:02.406509 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.406493 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:30:02.409052 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.409024 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Apr 17 14:30:02.409154 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.409073 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Apr 17 14:30:02.409154 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.409144 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Apr 17 14:30:02.409286 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.409255 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Apr 17 14:30:02.409368 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.409314 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-cgffr\"" Apr 17 14:30:02.409368 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.409330 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Apr 17 14:30:02.409368 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.409337 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Apr 17 14:30:02.409759 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.409742 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Apr 17 14:30:02.409864 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.409846 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Apr 17 14:30:02.414367 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.414340 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Apr 17 14:30:02.415756 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.415737 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Apr 17 14:30:02.476854 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.476825 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/30b08991-dd86-428a-b15c-50075950f382-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"30b08991-dd86-428a-b15c-50075950f382\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:30:02.477001 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.476867 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30b08991-dd86-428a-b15c-50075950f382-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"30b08991-dd86-428a-b15c-50075950f382\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:30:02.477001 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.476896 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/30b08991-dd86-428a-b15c-50075950f382-web-config\") pod \"alertmanager-main-0\" (UID: \"30b08991-dd86-428a-b15c-50075950f382\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:30:02.477001 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.476927 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgv6v\" (UniqueName: \"kubernetes.io/projected/30b08991-dd86-428a-b15c-50075950f382-kube-api-access-jgv6v\") pod \"alertmanager-main-0\" (UID: \"30b08991-dd86-428a-b15c-50075950f382\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:30:02.477001 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.476956 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/30b08991-dd86-428a-b15c-50075950f382-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"30b08991-dd86-428a-b15c-50075950f382\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:30:02.477152 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.477032 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/30b08991-dd86-428a-b15c-50075950f382-config-volume\") pod \"alertmanager-main-0\" (UID: \"30b08991-dd86-428a-b15c-50075950f382\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:30:02.477152 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.477068 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/30b08991-dd86-428a-b15c-50075950f382-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"30b08991-dd86-428a-b15c-50075950f382\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:30:02.477152 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.477085 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/30b08991-dd86-428a-b15c-50075950f382-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"30b08991-dd86-428a-b15c-50075950f382\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:30:02.477152 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.477124 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/30b08991-dd86-428a-b15c-50075950f382-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"30b08991-dd86-428a-b15c-50075950f382\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:30:02.477152 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.477148 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/30b08991-dd86-428a-b15c-50075950f382-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"30b08991-dd86-428a-b15c-50075950f382\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:30:02.477296 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.477195 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/30b08991-dd86-428a-b15c-50075950f382-config-out\") pod \"alertmanager-main-0\" (UID: \"30b08991-dd86-428a-b15c-50075950f382\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:30:02.477296 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.477213 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30b08991-dd86-428a-b15c-50075950f382-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"30b08991-dd86-428a-b15c-50075950f382\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:30:02.477296 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.477241 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/30b08991-dd86-428a-b15c-50075950f382-tls-assets\") pod \"alertmanager-main-0\" (UID: \"30b08991-dd86-428a-b15c-50075950f382\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:30:02.577520 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.577490 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jgv6v\" (UniqueName: \"kubernetes.io/projected/30b08991-dd86-428a-b15c-50075950f382-kube-api-access-jgv6v\") pod \"alertmanager-main-0\" (UID: \"30b08991-dd86-428a-b15c-50075950f382\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:30:02.577658 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.577527 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/30b08991-dd86-428a-b15c-50075950f382-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"30b08991-dd86-428a-b15c-50075950f382\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:30:02.577658 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.577550 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/30b08991-dd86-428a-b15c-50075950f382-config-volume\") pod \"alertmanager-main-0\" (UID: \"30b08991-dd86-428a-b15c-50075950f382\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:30:02.577658 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.577571 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/30b08991-dd86-428a-b15c-50075950f382-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"30b08991-dd86-428a-b15c-50075950f382\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:30:02.577658 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.577587 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/30b08991-dd86-428a-b15c-50075950f382-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"30b08991-dd86-428a-b15c-50075950f382\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:30:02.577658 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.577615 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/30b08991-dd86-428a-b15c-50075950f382-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"30b08991-dd86-428a-b15c-50075950f382\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:30:02.577920 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.577660 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/30b08991-dd86-428a-b15c-50075950f382-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"30b08991-dd86-428a-b15c-50075950f382\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:30:02.577920 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.577717 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/30b08991-dd86-428a-b15c-50075950f382-config-out\") pod \"alertmanager-main-0\" (UID: \"30b08991-dd86-428a-b15c-50075950f382\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:30:02.577920 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.577744 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30b08991-dd86-428a-b15c-50075950f382-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"30b08991-dd86-428a-b15c-50075950f382\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:30:02.577920 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.577771 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/30b08991-dd86-428a-b15c-50075950f382-tls-assets\") pod \"alertmanager-main-0\" (UID: \"30b08991-dd86-428a-b15c-50075950f382\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:30:02.577920 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.577800 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/30b08991-dd86-428a-b15c-50075950f382-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"30b08991-dd86-428a-b15c-50075950f382\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:30:02.577920 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.577827 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30b08991-dd86-428a-b15c-50075950f382-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"30b08991-dd86-428a-b15c-50075950f382\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:30:02.577920 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.577858 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/30b08991-dd86-428a-b15c-50075950f382-web-config\") pod \"alertmanager-main-0\" (UID: \"30b08991-dd86-428a-b15c-50075950f382\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:30:02.579468 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.579408 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/30b08991-dd86-428a-b15c-50075950f382-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"30b08991-dd86-428a-b15c-50075950f382\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:30:02.579698 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.579647 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30b08991-dd86-428a-b15c-50075950f382-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"30b08991-dd86-428a-b15c-50075950f382\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:30:02.579800 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.579741 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30b08991-dd86-428a-b15c-50075950f382-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"30b08991-dd86-428a-b15c-50075950f382\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:30:02.580633 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.580589 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/30b08991-dd86-428a-b15c-50075950f382-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"30b08991-dd86-428a-b15c-50075950f382\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:30:02.580633 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.580612 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/30b08991-dd86-428a-b15c-50075950f382-config-out\") pod \"alertmanager-main-0\" (UID: \"30b08991-dd86-428a-b15c-50075950f382\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:30:02.580805 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.580733 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/30b08991-dd86-428a-b15c-50075950f382-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"30b08991-dd86-428a-b15c-50075950f382\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:30:02.581070 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.581011 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/30b08991-dd86-428a-b15c-50075950f382-tls-assets\") pod \"alertmanager-main-0\" (UID: \"30b08991-dd86-428a-b15c-50075950f382\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:30:02.581070 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.581018 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/30b08991-dd86-428a-b15c-50075950f382-config-volume\") pod \"alertmanager-main-0\" (UID: \"30b08991-dd86-428a-b15c-50075950f382\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:30:02.581356 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.581337 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/30b08991-dd86-428a-b15c-50075950f382-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"30b08991-dd86-428a-b15c-50075950f382\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:30:02.581412 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.581397 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/30b08991-dd86-428a-b15c-50075950f382-web-config\") pod \"alertmanager-main-0\" (UID: \"30b08991-dd86-428a-b15c-50075950f382\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:30:02.581818 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.581796 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/30b08991-dd86-428a-b15c-50075950f382-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"30b08991-dd86-428a-b15c-50075950f382\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:30:02.582492 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.582472 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/30b08991-dd86-428a-b15c-50075950f382-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"30b08991-dd86-428a-b15c-50075950f382\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:30:02.585262 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.585243 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgv6v\" (UniqueName: \"kubernetes.io/projected/30b08991-dd86-428a-b15c-50075950f382-kube-api-access-jgv6v\") pod \"alertmanager-main-0\" (UID: \"30b08991-dd86-428a-b15c-50075950f382\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:30:02.624327 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.624271 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0289877f-ea8c-446b-b36e-257b370137e2" path="/var/lib/kubelet/pods/0289877f-ea8c-446b-b36e-257b370137e2/volumes" Apr 17 14:30:02.716610 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.716590 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Apr 17 14:30:02.840631 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:02.840611 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Apr 17 14:30:02.842665 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:30:02.842631 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30b08991_dd86_428a_b15c_50075950f382.slice/crio-9bcca33db5cf03859845171bfb4357604a961ad805c93d6b114c80d195b3473c WatchSource:0}: Error finding container 9bcca33db5cf03859845171bfb4357604a961ad805c93d6b114c80d195b3473c: Status 404 returned error can't find the container with id 9bcca33db5cf03859845171bfb4357604a961ad805c93d6b114c80d195b3473c Apr 17 14:30:03.352644 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:03.352610 2573 generic.go:358] "Generic (PLEG): container finished" podID="30b08991-dd86-428a-b15c-50075950f382" containerID="2eff40aaa70cdc57c976aafd56e758d0f2fa31e43177f92e49591db38d4e2143" exitCode=0 Apr 17 14:30:03.353114 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:03.352710 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"30b08991-dd86-428a-b15c-50075950f382","Type":"ContainerDied","Data":"2eff40aaa70cdc57c976aafd56e758d0f2fa31e43177f92e49591db38d4e2143"} Apr 17 14:30:03.353114 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:03.352759 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"30b08991-dd86-428a-b15c-50075950f382","Type":"ContainerStarted","Data":"9bcca33db5cf03859845171bfb4357604a961ad805c93d6b114c80d195b3473c"} Apr 17 14:30:04.158238 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.158198 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-584c4d667d-6pbls"] Apr 17 14:30:04.162063 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.162039 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-584c4d667d-6pbls" Apr 17 14:30:04.164703 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.164570 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Apr 17 14:30:04.165003 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.164939 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-5wvms\"" Apr 17 14:30:04.165197 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.165140 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Apr 17 14:30:04.165197 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.165157 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Apr 17 14:30:04.165337 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.165213 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Apr 17 14:30:04.165417 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.165379 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Apr 17 14:30:04.169315 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.169200 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Apr 17 14:30:04.172575 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.172531 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-584c4d667d-6pbls"] Apr 17 14:30:04.292991 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.292944 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a4245b39-3601-4e3f-9ee6-f312dcb7048b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-584c4d667d-6pbls\" (UID: \"a4245b39-3601-4e3f-9ee6-f312dcb7048b\") " pod="openshift-monitoring/telemeter-client-584c4d667d-6pbls" Apr 17 14:30:04.293175 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.293004 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4245b39-3601-4e3f-9ee6-f312dcb7048b-serving-certs-ca-bundle\") pod \"telemeter-client-584c4d667d-6pbls\" (UID: \"a4245b39-3601-4e3f-9ee6-f312dcb7048b\") " pod="openshift-monitoring/telemeter-client-584c4d667d-6pbls" Apr 17 14:30:04.293175 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.293105 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a4245b39-3601-4e3f-9ee6-f312dcb7048b-metrics-client-ca\") pod \"telemeter-client-584c4d667d-6pbls\" (UID: \"a4245b39-3601-4e3f-9ee6-f312dcb7048b\") " pod="openshift-monitoring/telemeter-client-584c4d667d-6pbls" Apr 17 14:30:04.293175 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.293140 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4245b39-3601-4e3f-9ee6-f312dcb7048b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-584c4d667d-6pbls\" (UID: \"a4245b39-3601-4e3f-9ee6-f312dcb7048b\") " pod="openshift-monitoring/telemeter-client-584c4d667d-6pbls" Apr 17 14:30:04.293175 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.293164 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a4245b39-3601-4e3f-9ee6-f312dcb7048b-secret-telemeter-client\") pod \"telemeter-client-584c4d667d-6pbls\" (UID: \"a4245b39-3601-4e3f-9ee6-f312dcb7048b\") " pod="openshift-monitoring/telemeter-client-584c4d667d-6pbls" Apr 17 14:30:04.293390 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.293207 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a4245b39-3601-4e3f-9ee6-f312dcb7048b-telemeter-client-tls\") pod \"telemeter-client-584c4d667d-6pbls\" (UID: \"a4245b39-3601-4e3f-9ee6-f312dcb7048b\") " pod="openshift-monitoring/telemeter-client-584c4d667d-6pbls" Apr 17 14:30:04.293390 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.293244 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a4245b39-3601-4e3f-9ee6-f312dcb7048b-federate-client-tls\") pod \"telemeter-client-584c4d667d-6pbls\" (UID: \"a4245b39-3601-4e3f-9ee6-f312dcb7048b\") " pod="openshift-monitoring/telemeter-client-584c4d667d-6pbls" Apr 17 14:30:04.293390 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.293282 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj72j\" (UniqueName: \"kubernetes.io/projected/a4245b39-3601-4e3f-9ee6-f312dcb7048b-kube-api-access-gj72j\") pod \"telemeter-client-584c4d667d-6pbls\" (UID: \"a4245b39-3601-4e3f-9ee6-f312dcb7048b\") " pod="openshift-monitoring/telemeter-client-584c4d667d-6pbls" Apr 17 14:30:04.360463 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.360433 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"30b08991-dd86-428a-b15c-50075950f382","Type":"ContainerStarted","Data":"f8e01b51f173bf54af2c973cd4124a2467b6b0817029f2639eac9ab5648ac3c3"} Apr 17 14:30:04.360463 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.360465 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"30b08991-dd86-428a-b15c-50075950f382","Type":"ContainerStarted","Data":"7edc1350e5549950d2b127e7ccb7bd52f78e36a93687387d70077d627836b3fe"} Apr 17 14:30:04.360853 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.360477 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"30b08991-dd86-428a-b15c-50075950f382","Type":"ContainerStarted","Data":"4426c15f0051423f149b09fc7a4042dc490ba8541b1d160aca143e30b8801e39"} Apr 17 14:30:04.360853 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.360489 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"30b08991-dd86-428a-b15c-50075950f382","Type":"ContainerStarted","Data":"07361dcff4af5113f70e961dc26cf1ed78da56161639aac8dce4a2c9ccb480af"} Apr 17 14:30:04.360853 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.360499 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"30b08991-dd86-428a-b15c-50075950f382","Type":"ContainerStarted","Data":"b68e3e5af8606a62646c33242aee5472f8e5845c85dd8d7662daef95e7a0faee"} Apr 17 14:30:04.360853 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.360507 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"30b08991-dd86-428a-b15c-50075950f382","Type":"ContainerStarted","Data":"d9190ed84bc3ed8877652a4d56d1d3ae2a87b9af5ba9c7ff7e6ef91ca9718886"} Apr 17 14:30:04.388220 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.388167 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.388151884 podStartE2EDuration="2.388151884s" podCreationTimestamp="2026-04-17 14:30:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-17 14:30:04.386244918 +0000 UTC m=+196.430673749" watchObservedRunningTime="2026-04-17 14:30:04.388151884 +0000 UTC m=+196.432580691" Apr 17 14:30:04.394422 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.394393 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gj72j\" (UniqueName: \"kubernetes.io/projected/a4245b39-3601-4e3f-9ee6-f312dcb7048b-kube-api-access-gj72j\") pod \"telemeter-client-584c4d667d-6pbls\" (UID: \"a4245b39-3601-4e3f-9ee6-f312dcb7048b\") " pod="openshift-monitoring/telemeter-client-584c4d667d-6pbls" Apr 17 14:30:04.394590 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.394443 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a4245b39-3601-4e3f-9ee6-f312dcb7048b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-584c4d667d-6pbls\" (UID: \"a4245b39-3601-4e3f-9ee6-f312dcb7048b\") " pod="openshift-monitoring/telemeter-client-584c4d667d-6pbls" Apr 17 14:30:04.394590 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.394496 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4245b39-3601-4e3f-9ee6-f312dcb7048b-serving-certs-ca-bundle\") pod \"telemeter-client-584c4d667d-6pbls\" (UID: \"a4245b39-3601-4e3f-9ee6-f312dcb7048b\") " pod="openshift-monitoring/telemeter-client-584c4d667d-6pbls" Apr 17 14:30:04.394590 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.394567 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a4245b39-3601-4e3f-9ee6-f312dcb7048b-metrics-client-ca\") pod \"telemeter-client-584c4d667d-6pbls\" (UID: \"a4245b39-3601-4e3f-9ee6-f312dcb7048b\") " pod="openshift-monitoring/telemeter-client-584c4d667d-6pbls" Apr 17 14:30:04.394793 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.394603 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4245b39-3601-4e3f-9ee6-f312dcb7048b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-584c4d667d-6pbls\" (UID: \"a4245b39-3601-4e3f-9ee6-f312dcb7048b\") " pod="openshift-monitoring/telemeter-client-584c4d667d-6pbls" Apr 17 14:30:04.394793 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.394633 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a4245b39-3601-4e3f-9ee6-f312dcb7048b-secret-telemeter-client\") pod \"telemeter-client-584c4d667d-6pbls\" (UID: \"a4245b39-3601-4e3f-9ee6-f312dcb7048b\") " pod="openshift-monitoring/telemeter-client-584c4d667d-6pbls" Apr 17 14:30:04.394793 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.394667 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a4245b39-3601-4e3f-9ee6-f312dcb7048b-telemeter-client-tls\") pod \"telemeter-client-584c4d667d-6pbls\" (UID: \"a4245b39-3601-4e3f-9ee6-f312dcb7048b\") " pod="openshift-monitoring/telemeter-client-584c4d667d-6pbls" Apr 17 14:30:04.394793 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.394720 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a4245b39-3601-4e3f-9ee6-f312dcb7048b-federate-client-tls\") pod \"telemeter-client-584c4d667d-6pbls\" (UID: \"a4245b39-3601-4e3f-9ee6-f312dcb7048b\") " pod="openshift-monitoring/telemeter-client-584c4d667d-6pbls" Apr 17 14:30:04.395317 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.395272 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4245b39-3601-4e3f-9ee6-f312dcb7048b-serving-certs-ca-bundle\") pod \"telemeter-client-584c4d667d-6pbls\" (UID: \"a4245b39-3601-4e3f-9ee6-f312dcb7048b\") " pod="openshift-monitoring/telemeter-client-584c4d667d-6pbls" Apr 17 14:30:04.395427 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.395411 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a4245b39-3601-4e3f-9ee6-f312dcb7048b-metrics-client-ca\") pod \"telemeter-client-584c4d667d-6pbls\" (UID: \"a4245b39-3601-4e3f-9ee6-f312dcb7048b\") " pod="openshift-monitoring/telemeter-client-584c4d667d-6pbls" Apr 17 14:30:04.395596 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.395550 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4245b39-3601-4e3f-9ee6-f312dcb7048b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-584c4d667d-6pbls\" (UID: \"a4245b39-3601-4e3f-9ee6-f312dcb7048b\") " pod="openshift-monitoring/telemeter-client-584c4d667d-6pbls" Apr 17 14:30:04.397732 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.397705 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a4245b39-3601-4e3f-9ee6-f312dcb7048b-telemeter-client-tls\") pod \"telemeter-client-584c4d667d-6pbls\" (UID: \"a4245b39-3601-4e3f-9ee6-f312dcb7048b\") " pod="openshift-monitoring/telemeter-client-584c4d667d-6pbls" Apr 17 14:30:04.398117 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.398093 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a4245b39-3601-4e3f-9ee6-f312dcb7048b-federate-client-tls\") pod \"telemeter-client-584c4d667d-6pbls\" (UID: \"a4245b39-3601-4e3f-9ee6-f312dcb7048b\") " pod="openshift-monitoring/telemeter-client-584c4d667d-6pbls" Apr 17 14:30:04.398219 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.398128 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a4245b39-3601-4e3f-9ee6-f312dcb7048b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-584c4d667d-6pbls\" (UID: \"a4245b39-3601-4e3f-9ee6-f312dcb7048b\") " pod="openshift-monitoring/telemeter-client-584c4d667d-6pbls" Apr 17 14:30:04.398279 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.398233 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a4245b39-3601-4e3f-9ee6-f312dcb7048b-secret-telemeter-client\") pod \"telemeter-client-584c4d667d-6pbls\" (UID: \"a4245b39-3601-4e3f-9ee6-f312dcb7048b\") " pod="openshift-monitoring/telemeter-client-584c4d667d-6pbls" Apr 17 14:30:04.404738 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.404708 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj72j\" (UniqueName: \"kubernetes.io/projected/a4245b39-3601-4e3f-9ee6-f312dcb7048b-kube-api-access-gj72j\") pod \"telemeter-client-584c4d667d-6pbls\" (UID: \"a4245b39-3601-4e3f-9ee6-f312dcb7048b\") " pod="openshift-monitoring/telemeter-client-584c4d667d-6pbls" Apr 17 14:30:04.462319 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.460030 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Apr 17 14:30:04.462319 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.460944 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d43bc47f-c681-4689-afd6-546a552c87a4" containerName="prometheus" containerID="cri-o://3385a65933d967233334abd32488768afc1aeecb0b3c7444473c11039689df2d" gracePeriod=600 Apr 17 14:30:04.462319 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.461175 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d43bc47f-c681-4689-afd6-546a552c87a4" containerName="kube-rbac-proxy" containerID="cri-o://4a48ef031c1f8c33e5610714de541345f554a2f44a163e3fbb56336b4e48733b" gracePeriod=600 Apr 17 14:30:04.462319 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.461340 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d43bc47f-c681-4689-afd6-546a552c87a4" containerName="kube-rbac-proxy-thanos" containerID="cri-o://5688310f65f4d738847e60c81b6b0bcefdea51cdc5910722d7bc208856153429" gracePeriod=600 Apr 17 14:30:04.462319 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.461358 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d43bc47f-c681-4689-afd6-546a552c87a4" containerName="kube-rbac-proxy-web" containerID="cri-o://12a580c67fdae59612e20262f2df95258f8b41bb04d172e45c007941034852a3" gracePeriod=600 Apr 17 14:30:04.462319 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.461370 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d43bc47f-c681-4689-afd6-546a552c87a4" containerName="config-reloader" containerID="cri-o://c0cd306b14d4b3c2037e0301f81a2837c6000a0d6ef2a7920ebaebe4506958fa" gracePeriod=600 Apr 17 14:30:04.462319 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.461380 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d43bc47f-c681-4689-afd6-546a552c87a4" containerName="thanos-sidecar" containerID="cri-o://acd25c3bdafa484b16099558b39c05a84a91963746a891791366c94ababdfa31" gracePeriod=600 Apr 17 14:30:04.474668 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.474639 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-584c4d667d-6pbls" Apr 17 14:30:04.642390 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.642364 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-584c4d667d-6pbls"] Apr 17 14:30:04.644140 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:30:04.644103 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4245b39_3601_4e3f_9ee6_f312dcb7048b.slice/crio-da75ecc965bbc243a9a123ceebd978da517c5762fcbd1aacf13db59579e6f47b WatchSource:0}: Error finding container da75ecc965bbc243a9a123ceebd978da517c5762fcbd1aacf13db59579e6f47b: Status 404 returned error can't find the container with id da75ecc965bbc243a9a123ceebd978da517c5762fcbd1aacf13db59579e6f47b Apr 17 14:30:04.716407 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.716354 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:30:04.799136 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.799107 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d43bc47f-c681-4689-afd6-546a552c87a4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"d43bc47f-c681-4689-afd6-546a552c87a4\" (UID: \"d43bc47f-c681-4689-afd6-546a552c87a4\") " Apr 17 14:30:04.799289 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.799157 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cvldz\" (UniqueName: \"kubernetes.io/projected/d43bc47f-c681-4689-afd6-546a552c87a4-kube-api-access-cvldz\") pod \"d43bc47f-c681-4689-afd6-546a552c87a4\" (UID: \"d43bc47f-c681-4689-afd6-546a552c87a4\") " Apr 17 14:30:04.799289 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.799183 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d43bc47f-c681-4689-afd6-546a552c87a4-secret-kube-rbac-proxy\") pod \"d43bc47f-c681-4689-afd6-546a552c87a4\" (UID: \"d43bc47f-c681-4689-afd6-546a552c87a4\") " Apr 17 14:30:04.799289 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.799205 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d43bc47f-c681-4689-afd6-546a552c87a4-tls-assets\") pod \"d43bc47f-c681-4689-afd6-546a552c87a4\" (UID: \"d43bc47f-c681-4689-afd6-546a552c87a4\") " Apr 17 14:30:04.799289 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.799244 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d43bc47f-c681-4689-afd6-546a552c87a4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"d43bc47f-c681-4689-afd6-546a552c87a4\" (UID: \"d43bc47f-c681-4689-afd6-546a552c87a4\") " Apr 17 14:30:04.799289 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.799267 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d43bc47f-c681-4689-afd6-546a552c87a4-secret-metrics-client-certs\") pod \"d43bc47f-c681-4689-afd6-546a552c87a4\" (UID: \"d43bc47f-c681-4689-afd6-546a552c87a4\") " Apr 17 14:30:04.799545 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.799306 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d43bc47f-c681-4689-afd6-546a552c87a4-secret-grpc-tls\") pod \"d43bc47f-c681-4689-afd6-546a552c87a4\" (UID: \"d43bc47f-c681-4689-afd6-546a552c87a4\") " Apr 17 14:30:04.799545 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.799333 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d43bc47f-c681-4689-afd6-546a552c87a4-prometheus-trusted-ca-bundle\") pod \"d43bc47f-c681-4689-afd6-546a552c87a4\" (UID: \"d43bc47f-c681-4689-afd6-546a552c87a4\") " Apr 17 14:30:04.799545 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.799368 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d43bc47f-c681-4689-afd6-546a552c87a4-thanos-prometheus-http-client-file\") pod \"d43bc47f-c681-4689-afd6-546a552c87a4\" (UID: \"d43bc47f-c681-4689-afd6-546a552c87a4\") " Apr 17 14:30:04.799545 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.799402 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d43bc47f-c681-4689-afd6-546a552c87a4-config\") pod \"d43bc47f-c681-4689-afd6-546a552c87a4\" (UID: \"d43bc47f-c681-4689-afd6-546a552c87a4\") " Apr 17 14:30:04.799545 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.799446 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d43bc47f-c681-4689-afd6-546a552c87a4-prometheus-k8s-db\") pod \"d43bc47f-c681-4689-afd6-546a552c87a4\" (UID: \"d43bc47f-c681-4689-afd6-546a552c87a4\") " Apr 17 14:30:04.799545 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.799487 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d43bc47f-c681-4689-afd6-546a552c87a4-configmap-kubelet-serving-ca-bundle\") pod \"d43bc47f-c681-4689-afd6-546a552c87a4\" (UID: \"d43bc47f-c681-4689-afd6-546a552c87a4\") " Apr 17 14:30:04.799545 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.799514 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d43bc47f-c681-4689-afd6-546a552c87a4-configmap-metrics-client-ca\") pod \"d43bc47f-c681-4689-afd6-546a552c87a4\" (UID: \"d43bc47f-c681-4689-afd6-546a552c87a4\") " Apr 17 14:30:04.799857 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.799555 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d43bc47f-c681-4689-afd6-546a552c87a4-config-out\") pod \"d43bc47f-c681-4689-afd6-546a552c87a4\" (UID: \"d43bc47f-c681-4689-afd6-546a552c87a4\") " Apr 17 14:30:04.799857 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.799599 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d43bc47f-c681-4689-afd6-546a552c87a4-configmap-serving-certs-ca-bundle\") pod \"d43bc47f-c681-4689-afd6-546a552c87a4\" (UID: \"d43bc47f-c681-4689-afd6-546a552c87a4\") " Apr 17 14:30:04.799857 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.799655 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d43bc47f-c681-4689-afd6-546a552c87a4-secret-prometheus-k8s-tls\") pod \"d43bc47f-c681-4689-afd6-546a552c87a4\" (UID: \"d43bc47f-c681-4689-afd6-546a552c87a4\") " Apr 17 14:30:04.799857 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.799682 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d43bc47f-c681-4689-afd6-546a552c87a4-prometheus-k8s-rulefiles-0\") pod \"d43bc47f-c681-4689-afd6-546a552c87a4\" (UID: \"d43bc47f-c681-4689-afd6-546a552c87a4\") " Apr 17 14:30:04.799857 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.799717 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d43bc47f-c681-4689-afd6-546a552c87a4-web-config\") pod \"d43bc47f-c681-4689-afd6-546a552c87a4\" (UID: \"d43bc47f-c681-4689-afd6-546a552c87a4\") " Apr 17 14:30:04.801769 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.800478 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d43bc47f-c681-4689-afd6-546a552c87a4-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "d43bc47f-c681-4689-afd6-546a552c87a4" (UID: "d43bc47f-c681-4689-afd6-546a552c87a4"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 17 14:30:04.801769 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.800600 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d43bc47f-c681-4689-afd6-546a552c87a4-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "d43bc47f-c681-4689-afd6-546a552c87a4" (UID: "d43bc47f-c681-4689-afd6-546a552c87a4"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Apr 17 14:30:04.801769 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.801504 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d43bc47f-c681-4689-afd6-546a552c87a4-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "d43bc47f-c681-4689-afd6-546a552c87a4" (UID: "d43bc47f-c681-4689-afd6-546a552c87a4"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 17 14:30:04.801769 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.801737 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d43bc47f-c681-4689-afd6-546a552c87a4-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "d43bc47f-c681-4689-afd6-546a552c87a4" (UID: "d43bc47f-c681-4689-afd6-546a552c87a4"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 17 14:30:04.802506 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.802313 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d43bc47f-c681-4689-afd6-546a552c87a4-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "d43bc47f-c681-4689-afd6-546a552c87a4" (UID: "d43bc47f-c681-4689-afd6-546a552c87a4"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 17 14:30:04.802677 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.802554 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d43bc47f-c681-4689-afd6-546a552c87a4-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "d43bc47f-c681-4689-afd6-546a552c87a4" (UID: "d43bc47f-c681-4689-afd6-546a552c87a4"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 17 14:30:04.802964 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.802907 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d43bc47f-c681-4689-afd6-546a552c87a4-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "d43bc47f-c681-4689-afd6-546a552c87a4" (UID: "d43bc47f-c681-4689-afd6-546a552c87a4"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 14:30:04.803186 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.803152 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d43bc47f-c681-4689-afd6-546a552c87a4-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "d43bc47f-c681-4689-afd6-546a552c87a4" (UID: "d43bc47f-c681-4689-afd6-546a552c87a4"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 14:30:04.803922 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.803900 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d43bc47f-c681-4689-afd6-546a552c87a4-kube-api-access-cvldz" (OuterVolumeSpecName: "kube-api-access-cvldz") pod "d43bc47f-c681-4689-afd6-546a552c87a4" (UID: "d43bc47f-c681-4689-afd6-546a552c87a4"). InnerVolumeSpecName "kube-api-access-cvldz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 17 14:30:04.804204 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.804185 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d43bc47f-c681-4689-afd6-546a552c87a4-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "d43bc47f-c681-4689-afd6-546a552c87a4" (UID: "d43bc47f-c681-4689-afd6-546a552c87a4"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 17 14:30:04.804760 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.804727 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d43bc47f-c681-4689-afd6-546a552c87a4-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "d43bc47f-c681-4689-afd6-546a552c87a4" (UID: "d43bc47f-c681-4689-afd6-546a552c87a4"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 14:30:04.806240 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.804759 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d43bc47f-c681-4689-afd6-546a552c87a4-config" (OuterVolumeSpecName: "config") pod "d43bc47f-c681-4689-afd6-546a552c87a4" (UID: "d43bc47f-c681-4689-afd6-546a552c87a4"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 14:30:04.806240 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.805518 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d43bc47f-c681-4689-afd6-546a552c87a4-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "d43bc47f-c681-4689-afd6-546a552c87a4" (UID: "d43bc47f-c681-4689-afd6-546a552c87a4"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 14:30:04.806240 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.805523 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d43bc47f-c681-4689-afd6-546a552c87a4-config-out" (OuterVolumeSpecName: "config-out") pod "d43bc47f-c681-4689-afd6-546a552c87a4" (UID: "d43bc47f-c681-4689-afd6-546a552c87a4"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Apr 17 14:30:04.807004 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.806949 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d43bc47f-c681-4689-afd6-546a552c87a4-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "d43bc47f-c681-4689-afd6-546a552c87a4" (UID: "d43bc47f-c681-4689-afd6-546a552c87a4"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 14:30:04.807105 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.806997 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d43bc47f-c681-4689-afd6-546a552c87a4-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "d43bc47f-c681-4689-afd6-546a552c87a4" (UID: "d43bc47f-c681-4689-afd6-546a552c87a4"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 14:30:04.807158 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.807136 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d43bc47f-c681-4689-afd6-546a552c87a4-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "d43bc47f-c681-4689-afd6-546a552c87a4" (UID: "d43bc47f-c681-4689-afd6-546a552c87a4"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 14:30:04.817762 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.817741 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d43bc47f-c681-4689-afd6-546a552c87a4-web-config" (OuterVolumeSpecName: "web-config") pod "d43bc47f-c681-4689-afd6-546a552c87a4" (UID: "d43bc47f-c681-4689-afd6-546a552c87a4"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 14:30:04.900748 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.900704 2573 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d43bc47f-c681-4689-afd6-546a552c87a4-config-out\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\"" Apr 17 14:30:04.900748 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.900745 2573 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d43bc47f-c681-4689-afd6-546a552c87a4-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\"" Apr 17 14:30:04.901020 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.900761 2573 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d43bc47f-c681-4689-afd6-546a552c87a4-secret-prometheus-k8s-tls\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\"" Apr 17 14:30:04.901020 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.900777 2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d43bc47f-c681-4689-afd6-546a552c87a4-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\"" Apr 17 14:30:04.901020 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.900791 2573 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d43bc47f-c681-4689-afd6-546a552c87a4-web-config\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\"" Apr 17 14:30:04.901020 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.900803 2573 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d43bc47f-c681-4689-afd6-546a552c87a4-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\"" Apr 17 14:30:04.901020 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.900816 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cvldz\" (UniqueName: \"kubernetes.io/projected/d43bc47f-c681-4689-afd6-546a552c87a4-kube-api-access-cvldz\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\"" Apr 17 14:30:04.901020 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.900829 2573 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d43bc47f-c681-4689-afd6-546a552c87a4-secret-kube-rbac-proxy\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\"" Apr 17 14:30:04.901020 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.900842 2573 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d43bc47f-c681-4689-afd6-546a552c87a4-tls-assets\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\"" Apr 17 14:30:04.901020 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.900856 2573 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d43bc47f-c681-4689-afd6-546a552c87a4-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\"" Apr 17 14:30:04.901020 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.900870 2573 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d43bc47f-c681-4689-afd6-546a552c87a4-secret-metrics-client-certs\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\"" Apr 17 14:30:04.901020 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.900882 2573 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d43bc47f-c681-4689-afd6-546a552c87a4-secret-grpc-tls\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\"" Apr 17 14:30:04.901020 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.900895 2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d43bc47f-c681-4689-afd6-546a552c87a4-prometheus-trusted-ca-bundle\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\"" Apr 17 14:30:04.901020 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.900907 2573 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d43bc47f-c681-4689-afd6-546a552c87a4-thanos-prometheus-http-client-file\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\"" Apr 17 14:30:04.901020 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.900920 2573 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/d43bc47f-c681-4689-afd6-546a552c87a4-config\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\"" Apr 17 14:30:04.901020 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.900932 2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d43bc47f-c681-4689-afd6-546a552c87a4-prometheus-k8s-db\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\"" Apr 17 14:30:04.901020 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.900946 2573 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d43bc47f-c681-4689-afd6-546a552c87a4-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\"" Apr 17 14:30:04.901020 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:04.900961 2573 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d43bc47f-c681-4689-afd6-546a552c87a4-configmap-metrics-client-ca\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\"" Apr 17 14:30:05.367322 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.367280 2573 generic.go:358] "Generic (PLEG): container finished" podID="d43bc47f-c681-4689-afd6-546a552c87a4" containerID="5688310f65f4d738847e60c81b6b0bcefdea51cdc5910722d7bc208856153429" exitCode=0 Apr 17 14:30:05.367322 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.367316 2573 generic.go:358] "Generic (PLEG): container finished" podID="d43bc47f-c681-4689-afd6-546a552c87a4" containerID="4a48ef031c1f8c33e5610714de541345f554a2f44a163e3fbb56336b4e48733b" exitCode=0 Apr 17 14:30:05.367322 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.367326 2573 generic.go:358] "Generic (PLEG): container finished" podID="d43bc47f-c681-4689-afd6-546a552c87a4" containerID="12a580c67fdae59612e20262f2df95258f8b41bb04d172e45c007941034852a3" exitCode=0 Apr 17 14:30:05.367837 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.367335 2573 generic.go:358] "Generic (PLEG): container finished" podID="d43bc47f-c681-4689-afd6-546a552c87a4" containerID="acd25c3bdafa484b16099558b39c05a84a91963746a891791366c94ababdfa31" exitCode=0 Apr 17 14:30:05.367837 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.367341 2573 generic.go:358] "Generic (PLEG): container finished" podID="d43bc47f-c681-4689-afd6-546a552c87a4" containerID="c0cd306b14d4b3c2037e0301f81a2837c6000a0d6ef2a7920ebaebe4506958fa" exitCode=0 Apr 17 14:30:05.367837 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.367346 2573 generic.go:358] "Generic (PLEG): container finished" podID="d43bc47f-c681-4689-afd6-546a552c87a4" containerID="3385a65933d967233334abd32488768afc1aeecb0b3c7444473c11039689df2d" exitCode=0 Apr 17 14:30:05.367837 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.367369 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d43bc47f-c681-4689-afd6-546a552c87a4","Type":"ContainerDied","Data":"5688310f65f4d738847e60c81b6b0bcefdea51cdc5910722d7bc208856153429"} Apr 17 14:30:05.367837 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.367413 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d43bc47f-c681-4689-afd6-546a552c87a4","Type":"ContainerDied","Data":"4a48ef031c1f8c33e5610714de541345f554a2f44a163e3fbb56336b4e48733b"} Apr 17 14:30:05.367837 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.367420 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:30:05.367837 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.367429 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d43bc47f-c681-4689-afd6-546a552c87a4","Type":"ContainerDied","Data":"12a580c67fdae59612e20262f2df95258f8b41bb04d172e45c007941034852a3"} Apr 17 14:30:05.367837 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.367448 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d43bc47f-c681-4689-afd6-546a552c87a4","Type":"ContainerDied","Data":"acd25c3bdafa484b16099558b39c05a84a91963746a891791366c94ababdfa31"} Apr 17 14:30:05.367837 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.367463 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d43bc47f-c681-4689-afd6-546a552c87a4","Type":"ContainerDied","Data":"c0cd306b14d4b3c2037e0301f81a2837c6000a0d6ef2a7920ebaebe4506958fa"} Apr 17 14:30:05.367837 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.367428 2573 scope.go:117] "RemoveContainer" containerID="5688310f65f4d738847e60c81b6b0bcefdea51cdc5910722d7bc208856153429" Apr 17 14:30:05.367837 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.367477 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d43bc47f-c681-4689-afd6-546a552c87a4","Type":"ContainerDied","Data":"3385a65933d967233334abd32488768afc1aeecb0b3c7444473c11039689df2d"} Apr 17 14:30:05.367837 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.367493 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d43bc47f-c681-4689-afd6-546a552c87a4","Type":"ContainerDied","Data":"691a7eff324a0781ab966aa3e45836a9824ec823293df5f38d48cf63e4136904"} Apr 17 14:30:05.369186 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.369156 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-584c4d667d-6pbls" event={"ID":"a4245b39-3601-4e3f-9ee6-f312dcb7048b","Type":"ContainerStarted","Data":"da75ecc965bbc243a9a123ceebd978da517c5762fcbd1aacf13db59579e6f47b"} Apr 17 14:30:05.376712 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.376647 2573 scope.go:117] "RemoveContainer" containerID="4a48ef031c1f8c33e5610714de541345f554a2f44a163e3fbb56336b4e48733b" Apr 17 14:30:05.384697 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.384676 2573 scope.go:117] "RemoveContainer" containerID="12a580c67fdae59612e20262f2df95258f8b41bb04d172e45c007941034852a3" Apr 17 14:30:05.393387 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.393367 2573 scope.go:117] "RemoveContainer" containerID="acd25c3bdafa484b16099558b39c05a84a91963746a891791366c94ababdfa31" Apr 17 14:30:05.394393 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.394330 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Apr 17 14:30:05.396739 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.396711 2573 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Apr 17 14:30:05.401490 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.401469 2573 scope.go:117] "RemoveContainer" containerID="c0cd306b14d4b3c2037e0301f81a2837c6000a0d6ef2a7920ebaebe4506958fa" Apr 17 14:30:05.409940 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.409892 2573 scope.go:117] "RemoveContainer" containerID="3385a65933d967233334abd32488768afc1aeecb0b3c7444473c11039689df2d" Apr 17 14:30:05.418264 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.418244 2573 scope.go:117] "RemoveContainer" containerID="e9f7b31c9948cfee84bbfcf2dd4997a1f9cb7160baa92e5951e13e94e9d1f9c2" Apr 17 14:30:05.420894 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.420864 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Apr 17 14:30:05.421333 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.421314 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d43bc47f-c681-4689-afd6-546a552c87a4" containerName="thanos-sidecar" Apr 17 14:30:05.421333 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.421334 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d43bc47f-c681-4689-afd6-546a552c87a4" containerName="thanos-sidecar" Apr 17 14:30:05.421462 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.421347 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d43bc47f-c681-4689-afd6-546a552c87a4" containerName="kube-rbac-proxy-thanos" Apr 17 14:30:05.421462 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.421353 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d43bc47f-c681-4689-afd6-546a552c87a4" containerName="kube-rbac-proxy-thanos" Apr 17 14:30:05.421462 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.421361 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d43bc47f-c681-4689-afd6-546a552c87a4" containerName="init-config-reloader" Apr 17 14:30:05.421462 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.421368 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d43bc47f-c681-4689-afd6-546a552c87a4" containerName="init-config-reloader" Apr 17 14:30:05.421462 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.421380 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d43bc47f-c681-4689-afd6-546a552c87a4" containerName="config-reloader" Apr 17 14:30:05.421462 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.421389 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d43bc47f-c681-4689-afd6-546a552c87a4" containerName="config-reloader" Apr 17 14:30:05.421462 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.421399 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d43bc47f-c681-4689-afd6-546a552c87a4" containerName="prometheus" Apr 17 14:30:05.421462 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.421407 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d43bc47f-c681-4689-afd6-546a552c87a4" containerName="prometheus" Apr 17 14:30:05.421462 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.421423 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d43bc47f-c681-4689-afd6-546a552c87a4" containerName="kube-rbac-proxy-web" Apr 17 14:30:05.421462 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.421431 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d43bc47f-c681-4689-afd6-546a552c87a4" containerName="kube-rbac-proxy-web" Apr 17 14:30:05.421462 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.421445 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d43bc47f-c681-4689-afd6-546a552c87a4" containerName="kube-rbac-proxy" Apr 17 14:30:05.421462 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.421454 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d43bc47f-c681-4689-afd6-546a552c87a4" containerName="kube-rbac-proxy" Apr 17 14:30:05.421830 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.421545 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="d43bc47f-c681-4689-afd6-546a552c87a4" containerName="config-reloader" Apr 17 14:30:05.421830 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.421559 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="d43bc47f-c681-4689-afd6-546a552c87a4" containerName="thanos-sidecar" Apr 17 14:30:05.421830 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.421570 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="d43bc47f-c681-4689-afd6-546a552c87a4" containerName="kube-rbac-proxy-thanos" Apr 17 14:30:05.421830 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.421582 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="d43bc47f-c681-4689-afd6-546a552c87a4" containerName="kube-rbac-proxy" Apr 17 14:30:05.421830 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.421594 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="d43bc47f-c681-4689-afd6-546a552c87a4" containerName="kube-rbac-proxy-web" Apr 17 14:30:05.421830 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.421606 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="d43bc47f-c681-4689-afd6-546a552c87a4" containerName="prometheus" Apr 17 14:30:05.426960 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.426935 2573 scope.go:117] "RemoveContainer" containerID="5688310f65f4d738847e60c81b6b0bcefdea51cdc5910722d7bc208856153429" Apr 17 14:30:05.427272 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:30:05.427244 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5688310f65f4d738847e60c81b6b0bcefdea51cdc5910722d7bc208856153429\": container with ID starting with 5688310f65f4d738847e60c81b6b0bcefdea51cdc5910722d7bc208856153429 not found: ID does not exist" containerID="5688310f65f4d738847e60c81b6b0bcefdea51cdc5910722d7bc208856153429" Apr 17 14:30:05.427352 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.427281 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5688310f65f4d738847e60c81b6b0bcefdea51cdc5910722d7bc208856153429"} err="failed to get container status \"5688310f65f4d738847e60c81b6b0bcefdea51cdc5910722d7bc208856153429\": rpc error: code = NotFound desc = could not find container \"5688310f65f4d738847e60c81b6b0bcefdea51cdc5910722d7bc208856153429\": container with ID starting with 5688310f65f4d738847e60c81b6b0bcefdea51cdc5910722d7bc208856153429 not found: ID does not exist" Apr 17 14:30:05.427352 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.427312 2573 scope.go:117] "RemoveContainer" containerID="4a48ef031c1f8c33e5610714de541345f554a2f44a163e3fbb56336b4e48733b" Apr 17 14:30:05.427352 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.427321 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:30:05.427720 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:30:05.427578 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a48ef031c1f8c33e5610714de541345f554a2f44a163e3fbb56336b4e48733b\": container with ID starting with 4a48ef031c1f8c33e5610714de541345f554a2f44a163e3fbb56336b4e48733b not found: ID does not exist" containerID="4a48ef031c1f8c33e5610714de541345f554a2f44a163e3fbb56336b4e48733b" Apr 17 14:30:05.427720 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.427623 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a48ef031c1f8c33e5610714de541345f554a2f44a163e3fbb56336b4e48733b"} err="failed to get container status \"4a48ef031c1f8c33e5610714de541345f554a2f44a163e3fbb56336b4e48733b\": rpc error: code = NotFound desc = could not find container \"4a48ef031c1f8c33e5610714de541345f554a2f44a163e3fbb56336b4e48733b\": container with ID starting with 4a48ef031c1f8c33e5610714de541345f554a2f44a163e3fbb56336b4e48733b not found: ID does not exist" Apr 17 14:30:05.427720 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.427647 2573 scope.go:117] "RemoveContainer" containerID="12a580c67fdae59612e20262f2df95258f8b41bb04d172e45c007941034852a3" Apr 17 14:30:05.428049 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:30:05.427887 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12a580c67fdae59612e20262f2df95258f8b41bb04d172e45c007941034852a3\": container with ID starting with 12a580c67fdae59612e20262f2df95258f8b41bb04d172e45c007941034852a3 not found: ID does not exist" containerID="12a580c67fdae59612e20262f2df95258f8b41bb04d172e45c007941034852a3" Apr 17 14:30:05.428049 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.427910 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12a580c67fdae59612e20262f2df95258f8b41bb04d172e45c007941034852a3"} err="failed to get container status \"12a580c67fdae59612e20262f2df95258f8b41bb04d172e45c007941034852a3\": rpc error: code = NotFound desc = could not find container \"12a580c67fdae59612e20262f2df95258f8b41bb04d172e45c007941034852a3\": container with ID starting with 12a580c67fdae59612e20262f2df95258f8b41bb04d172e45c007941034852a3 not found: ID does not exist" Apr 17 14:30:05.428049 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.427930 2573 scope.go:117] "RemoveContainer" containerID="acd25c3bdafa484b16099558b39c05a84a91963746a891791366c94ababdfa31" Apr 17 14:30:05.428195 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:30:05.428165 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"acd25c3bdafa484b16099558b39c05a84a91963746a891791366c94ababdfa31\": container with ID starting with acd25c3bdafa484b16099558b39c05a84a91963746a891791366c94ababdfa31 not found: ID does not exist" containerID="acd25c3bdafa484b16099558b39c05a84a91963746a891791366c94ababdfa31" Apr 17 14:30:05.428245 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.428204 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acd25c3bdafa484b16099558b39c05a84a91963746a891791366c94ababdfa31"} err="failed to get container status \"acd25c3bdafa484b16099558b39c05a84a91963746a891791366c94ababdfa31\": rpc error: code = NotFound desc = could not find container \"acd25c3bdafa484b16099558b39c05a84a91963746a891791366c94ababdfa31\": container with ID starting with acd25c3bdafa484b16099558b39c05a84a91963746a891791366c94ababdfa31 not found: ID does not exist" Apr 17 14:30:05.428245 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.428225 2573 scope.go:117] "RemoveContainer" containerID="c0cd306b14d4b3c2037e0301f81a2837c6000a0d6ef2a7920ebaebe4506958fa" Apr 17 14:30:05.428460 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:30:05.428444 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0cd306b14d4b3c2037e0301f81a2837c6000a0d6ef2a7920ebaebe4506958fa\": container with ID starting with c0cd306b14d4b3c2037e0301f81a2837c6000a0d6ef2a7920ebaebe4506958fa not found: ID does not exist" containerID="c0cd306b14d4b3c2037e0301f81a2837c6000a0d6ef2a7920ebaebe4506958fa" Apr 17 14:30:05.428502 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.428465 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0cd306b14d4b3c2037e0301f81a2837c6000a0d6ef2a7920ebaebe4506958fa"} err="failed to get container status \"c0cd306b14d4b3c2037e0301f81a2837c6000a0d6ef2a7920ebaebe4506958fa\": rpc error: code = NotFound desc = could not find container \"c0cd306b14d4b3c2037e0301f81a2837c6000a0d6ef2a7920ebaebe4506958fa\": container with ID starting with c0cd306b14d4b3c2037e0301f81a2837c6000a0d6ef2a7920ebaebe4506958fa not found: ID does not exist" Apr 17 14:30:05.428502 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.428480 2573 scope.go:117] "RemoveContainer" containerID="3385a65933d967233334abd32488768afc1aeecb0b3c7444473c11039689df2d" Apr 17 14:30:05.428672 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:30:05.428655 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3385a65933d967233334abd32488768afc1aeecb0b3c7444473c11039689df2d\": container with ID starting with 3385a65933d967233334abd32488768afc1aeecb0b3c7444473c11039689df2d not found: ID does not exist" containerID="3385a65933d967233334abd32488768afc1aeecb0b3c7444473c11039689df2d" Apr 17 14:30:05.428731 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.428676 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3385a65933d967233334abd32488768afc1aeecb0b3c7444473c11039689df2d"} err="failed to get container status \"3385a65933d967233334abd32488768afc1aeecb0b3c7444473c11039689df2d\": rpc error: code = NotFound desc = could not find container \"3385a65933d967233334abd32488768afc1aeecb0b3c7444473c11039689df2d\": container with ID starting with 3385a65933d967233334abd32488768afc1aeecb0b3c7444473c11039689df2d not found: ID does not exist" Apr 17 14:30:05.428731 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.428696 2573 scope.go:117] "RemoveContainer" containerID="e9f7b31c9948cfee84bbfcf2dd4997a1f9cb7160baa92e5951e13e94e9d1f9c2" Apr 17 14:30:05.428923 ip-10-0-131-47 kubenswrapper[2573]: E0417 14:30:05.428905 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9f7b31c9948cfee84bbfcf2dd4997a1f9cb7160baa92e5951e13e94e9d1f9c2\": container with ID starting with e9f7b31c9948cfee84bbfcf2dd4997a1f9cb7160baa92e5951e13e94e9d1f9c2 not found: ID does not exist" containerID="e9f7b31c9948cfee84bbfcf2dd4997a1f9cb7160baa92e5951e13e94e9d1f9c2" Apr 17 14:30:05.429002 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.428949 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9f7b31c9948cfee84bbfcf2dd4997a1f9cb7160baa92e5951e13e94e9d1f9c2"} err="failed to get container status \"e9f7b31c9948cfee84bbfcf2dd4997a1f9cb7160baa92e5951e13e94e9d1f9c2\": rpc error: code = NotFound desc = could not find container \"e9f7b31c9948cfee84bbfcf2dd4997a1f9cb7160baa92e5951e13e94e9d1f9c2\": container with ID starting with e9f7b31c9948cfee84bbfcf2dd4997a1f9cb7160baa92e5951e13e94e9d1f9c2 not found: ID does not exist" Apr 17 14:30:05.429002 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.428994 2573 scope.go:117] "RemoveContainer" containerID="5688310f65f4d738847e60c81b6b0bcefdea51cdc5910722d7bc208856153429" Apr 17 14:30:05.429252 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.429227 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5688310f65f4d738847e60c81b6b0bcefdea51cdc5910722d7bc208856153429"} err="failed to get container status \"5688310f65f4d738847e60c81b6b0bcefdea51cdc5910722d7bc208856153429\": rpc error: code = NotFound desc = could not find container \"5688310f65f4d738847e60c81b6b0bcefdea51cdc5910722d7bc208856153429\": container with ID starting with 5688310f65f4d738847e60c81b6b0bcefdea51cdc5910722d7bc208856153429 not found: ID does not exist" Apr 17 14:30:05.429252 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.429250 2573 scope.go:117] "RemoveContainer" containerID="4a48ef031c1f8c33e5610714de541345f554a2f44a163e3fbb56336b4e48733b" Apr 17 14:30:05.429545 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.429521 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a48ef031c1f8c33e5610714de541345f554a2f44a163e3fbb56336b4e48733b"} err="failed to get container status \"4a48ef031c1f8c33e5610714de541345f554a2f44a163e3fbb56336b4e48733b\": rpc error: code = NotFound desc = could not find container \"4a48ef031c1f8c33e5610714de541345f554a2f44a163e3fbb56336b4e48733b\": container with ID starting with 4a48ef031c1f8c33e5610714de541345f554a2f44a163e3fbb56336b4e48733b not found: ID does not exist" Apr 17 14:30:05.429606 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.429547 2573 scope.go:117] "RemoveContainer" containerID="12a580c67fdae59612e20262f2df95258f8b41bb04d172e45c007941034852a3" Apr 17 14:30:05.429794 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.429775 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12a580c67fdae59612e20262f2df95258f8b41bb04d172e45c007941034852a3"} err="failed to get container status \"12a580c67fdae59612e20262f2df95258f8b41bb04d172e45c007941034852a3\": rpc error: code = NotFound desc = could not find container \"12a580c67fdae59612e20262f2df95258f8b41bb04d172e45c007941034852a3\": container with ID starting with 12a580c67fdae59612e20262f2df95258f8b41bb04d172e45c007941034852a3 not found: ID does not exist" Apr 17 14:30:05.429871 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.429796 2573 scope.go:117] "RemoveContainer" containerID="acd25c3bdafa484b16099558b39c05a84a91963746a891791366c94ababdfa31" Apr 17 14:30:05.429943 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.429927 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-c62pz\"" Apr 17 14:30:05.430062 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.430038 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acd25c3bdafa484b16099558b39c05a84a91963746a891791366c94ababdfa31"} err="failed to get container status \"acd25c3bdafa484b16099558b39c05a84a91963746a891791366c94ababdfa31\": rpc error: code = NotFound desc = could not find container \"acd25c3bdafa484b16099558b39c05a84a91963746a891791366c94ababdfa31\": container with ID starting with acd25c3bdafa484b16099558b39c05a84a91963746a891791366c94ababdfa31 not found: ID does not exist" Apr 17 14:30:05.430193 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.430178 2573 scope.go:117] "RemoveContainer" containerID="c0cd306b14d4b3c2037e0301f81a2837c6000a0d6ef2a7920ebaebe4506958fa" Apr 17 14:30:05.430334 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.430119 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Apr 17 14:30:05.430334 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.430327 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Apr 17 14:30:05.430448 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.430146 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-aicf4jkkvrve7\"" Apr 17 14:30:05.430448 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.430198 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Apr 17 14:30:05.430448 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.430096 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Apr 17 14:30:05.430448 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.430399 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Apr 17 14:30:05.430634 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.430503 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Apr 17 14:30:05.430634 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.430548 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Apr 17 14:30:05.430771 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.430754 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Apr 17 14:30:05.430771 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.430769 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Apr 17 14:30:05.430903 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.430842 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0cd306b14d4b3c2037e0301f81a2837c6000a0d6ef2a7920ebaebe4506958fa"} err="failed to get container status \"c0cd306b14d4b3c2037e0301f81a2837c6000a0d6ef2a7920ebaebe4506958fa\": rpc error: code = NotFound desc = could not find container \"c0cd306b14d4b3c2037e0301f81a2837c6000a0d6ef2a7920ebaebe4506958fa\": container with ID starting with c0cd306b14d4b3c2037e0301f81a2837c6000a0d6ef2a7920ebaebe4506958fa not found: ID does not exist" Apr 17 14:30:05.430903 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.430867 2573 scope.go:117] "RemoveContainer" containerID="3385a65933d967233334abd32488768afc1aeecb0b3c7444473c11039689df2d" Apr 17 14:30:05.431031 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.430993 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Apr 17 14:30:05.431147 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.431122 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3385a65933d967233334abd32488768afc1aeecb0b3c7444473c11039689df2d"} err="failed to get container status \"3385a65933d967233334abd32488768afc1aeecb0b3c7444473c11039689df2d\": rpc error: code = NotFound desc = could not find container \"3385a65933d967233334abd32488768afc1aeecb0b3c7444473c11039689df2d\": container with ID starting with 3385a65933d967233334abd32488768afc1aeecb0b3c7444473c11039689df2d not found: ID does not exist" Apr 17 14:30:05.431210 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.431150 2573 scope.go:117] "RemoveContainer" containerID="e9f7b31c9948cfee84bbfcf2dd4997a1f9cb7160baa92e5951e13e94e9d1f9c2" Apr 17 14:30:05.431405 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.431387 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9f7b31c9948cfee84bbfcf2dd4997a1f9cb7160baa92e5951e13e94e9d1f9c2"} err="failed to get container status \"e9f7b31c9948cfee84bbfcf2dd4997a1f9cb7160baa92e5951e13e94e9d1f9c2\": rpc error: code = NotFound desc = could not find container \"e9f7b31c9948cfee84bbfcf2dd4997a1f9cb7160baa92e5951e13e94e9d1f9c2\": container with ID starting with e9f7b31c9948cfee84bbfcf2dd4997a1f9cb7160baa92e5951e13e94e9d1f9c2 not found: ID does not exist" Apr 17 14:30:05.431405 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.431405 2573 scope.go:117] "RemoveContainer" containerID="5688310f65f4d738847e60c81b6b0bcefdea51cdc5910722d7bc208856153429" Apr 17 14:30:05.431647 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.431622 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5688310f65f4d738847e60c81b6b0bcefdea51cdc5910722d7bc208856153429"} err="failed to get container status \"5688310f65f4d738847e60c81b6b0bcefdea51cdc5910722d7bc208856153429\": rpc error: code = NotFound desc = could not find container \"5688310f65f4d738847e60c81b6b0bcefdea51cdc5910722d7bc208856153429\": container with ID starting with 5688310f65f4d738847e60c81b6b0bcefdea51cdc5910722d7bc208856153429 not found: ID does not exist" Apr 17 14:30:05.431711 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.431649 2573 scope.go:117] "RemoveContainer" containerID="4a48ef031c1f8c33e5610714de541345f554a2f44a163e3fbb56336b4e48733b" Apr 17 14:30:05.431944 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.431918 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a48ef031c1f8c33e5610714de541345f554a2f44a163e3fbb56336b4e48733b"} err="failed to get container status \"4a48ef031c1f8c33e5610714de541345f554a2f44a163e3fbb56336b4e48733b\": rpc error: code = NotFound desc = could not find container \"4a48ef031c1f8c33e5610714de541345f554a2f44a163e3fbb56336b4e48733b\": container with ID starting with 4a48ef031c1f8c33e5610714de541345f554a2f44a163e3fbb56336b4e48733b not found: ID does not exist" Apr 17 14:30:05.432081 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.431945 2573 scope.go:117] "RemoveContainer" containerID="12a580c67fdae59612e20262f2df95258f8b41bb04d172e45c007941034852a3" Apr 17 14:30:05.432288 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.432249 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12a580c67fdae59612e20262f2df95258f8b41bb04d172e45c007941034852a3"} err="failed to get container status \"12a580c67fdae59612e20262f2df95258f8b41bb04d172e45c007941034852a3\": rpc error: code = NotFound desc = could not find container \"12a580c67fdae59612e20262f2df95258f8b41bb04d172e45c007941034852a3\": container with ID starting with 12a580c67fdae59612e20262f2df95258f8b41bb04d172e45c007941034852a3 not found: ID does not exist" Apr 17 14:30:05.432288 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.432279 2573 scope.go:117] "RemoveContainer" containerID="acd25c3bdafa484b16099558b39c05a84a91963746a891791366c94ababdfa31" Apr 17 14:30:05.432555 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.432530 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acd25c3bdafa484b16099558b39c05a84a91963746a891791366c94ababdfa31"} err="failed to get container status \"acd25c3bdafa484b16099558b39c05a84a91963746a891791366c94ababdfa31\": rpc error: code = NotFound desc = could not find container \"acd25c3bdafa484b16099558b39c05a84a91963746a891791366c94ababdfa31\": container with ID starting with acd25c3bdafa484b16099558b39c05a84a91963746a891791366c94ababdfa31 not found: ID does not exist" Apr 17 14:30:05.432650 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.432558 2573 scope.go:117] "RemoveContainer" containerID="c0cd306b14d4b3c2037e0301f81a2837c6000a0d6ef2a7920ebaebe4506958fa" Apr 17 14:30:05.432726 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.432650 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Apr 17 14:30:05.432868 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.432839 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0cd306b14d4b3c2037e0301f81a2837c6000a0d6ef2a7920ebaebe4506958fa"} err="failed to get container status \"c0cd306b14d4b3c2037e0301f81a2837c6000a0d6ef2a7920ebaebe4506958fa\": rpc error: code = NotFound desc = could not find container \"c0cd306b14d4b3c2037e0301f81a2837c6000a0d6ef2a7920ebaebe4506958fa\": container with ID starting with c0cd306b14d4b3c2037e0301f81a2837c6000a0d6ef2a7920ebaebe4506958fa not found: ID does not exist" Apr 17 14:30:05.432952 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.432868 2573 scope.go:117] "RemoveContainer" containerID="3385a65933d967233334abd32488768afc1aeecb0b3c7444473c11039689df2d" Apr 17 14:30:05.433206 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.433174 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3385a65933d967233334abd32488768afc1aeecb0b3c7444473c11039689df2d"} err="failed to get container status \"3385a65933d967233334abd32488768afc1aeecb0b3c7444473c11039689df2d\": rpc error: code = NotFound desc = could not find container \"3385a65933d967233334abd32488768afc1aeecb0b3c7444473c11039689df2d\": container with ID starting with 3385a65933d967233334abd32488768afc1aeecb0b3c7444473c11039689df2d not found: ID does not exist" Apr 17 14:30:05.433345 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.433208 2573 scope.go:117] "RemoveContainer" containerID="e9f7b31c9948cfee84bbfcf2dd4997a1f9cb7160baa92e5951e13e94e9d1f9c2" Apr 17 14:30:05.433641 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.433578 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9f7b31c9948cfee84bbfcf2dd4997a1f9cb7160baa92e5951e13e94e9d1f9c2"} err="failed to get container status \"e9f7b31c9948cfee84bbfcf2dd4997a1f9cb7160baa92e5951e13e94e9d1f9c2\": rpc error: code = NotFound desc = could not find container \"e9f7b31c9948cfee84bbfcf2dd4997a1f9cb7160baa92e5951e13e94e9d1f9c2\": container with ID starting with e9f7b31c9948cfee84bbfcf2dd4997a1f9cb7160baa92e5951e13e94e9d1f9c2 not found: ID does not exist" Apr 17 14:30:05.433641 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.433614 2573 scope.go:117] "RemoveContainer" containerID="5688310f65f4d738847e60c81b6b0bcefdea51cdc5910722d7bc208856153429" Apr 17 14:30:05.434339 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.434291 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5688310f65f4d738847e60c81b6b0bcefdea51cdc5910722d7bc208856153429"} err="failed to get container status \"5688310f65f4d738847e60c81b6b0bcefdea51cdc5910722d7bc208856153429\": rpc error: code = NotFound desc = could not find container \"5688310f65f4d738847e60c81b6b0bcefdea51cdc5910722d7bc208856153429\": container with ID starting with 5688310f65f4d738847e60c81b6b0bcefdea51cdc5910722d7bc208856153429 not found: ID does not exist" Apr 17 14:30:05.434421 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.434342 2573 scope.go:117] "RemoveContainer" containerID="4a48ef031c1f8c33e5610714de541345f554a2f44a163e3fbb56336b4e48733b" Apr 17 14:30:05.434859 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.434770 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a48ef031c1f8c33e5610714de541345f554a2f44a163e3fbb56336b4e48733b"} err="failed to get container status \"4a48ef031c1f8c33e5610714de541345f554a2f44a163e3fbb56336b4e48733b\": rpc error: code = NotFound desc = could not find container \"4a48ef031c1f8c33e5610714de541345f554a2f44a163e3fbb56336b4e48733b\": container with ID starting with 4a48ef031c1f8c33e5610714de541345f554a2f44a163e3fbb56336b4e48733b not found: ID does not exist" Apr 17 14:30:05.434859 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.434796 2573 scope.go:117] "RemoveContainer" containerID="12a580c67fdae59612e20262f2df95258f8b41bb04d172e45c007941034852a3" Apr 17 14:30:05.435104 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.435082 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12a580c67fdae59612e20262f2df95258f8b41bb04d172e45c007941034852a3"} err="failed to get container status \"12a580c67fdae59612e20262f2df95258f8b41bb04d172e45c007941034852a3\": rpc error: code = NotFound desc = could not find container \"12a580c67fdae59612e20262f2df95258f8b41bb04d172e45c007941034852a3\": container with ID starting with 12a580c67fdae59612e20262f2df95258f8b41bb04d172e45c007941034852a3 not found: ID does not exist" Apr 17 14:30:05.435179 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.435105 2573 scope.go:117] "RemoveContainer" containerID="acd25c3bdafa484b16099558b39c05a84a91963746a891791366c94ababdfa31" Apr 17 14:30:05.435389 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.435370 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Apr 17 14:30:05.435776 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.435756 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acd25c3bdafa484b16099558b39c05a84a91963746a891791366c94ababdfa31"} err="failed to get container status \"acd25c3bdafa484b16099558b39c05a84a91963746a891791366c94ababdfa31\": rpc error: code = NotFound desc = could not find container \"acd25c3bdafa484b16099558b39c05a84a91963746a891791366c94ababdfa31\": container with ID starting with acd25c3bdafa484b16099558b39c05a84a91963746a891791366c94ababdfa31 not found: ID does not exist" Apr 17 14:30:05.435855 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.435780 2573 scope.go:117] "RemoveContainer" containerID="c0cd306b14d4b3c2037e0301f81a2837c6000a0d6ef2a7920ebaebe4506958fa" Apr 17 14:30:05.436795 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.436612 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Apr 17 14:30:05.436795 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.436690 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0cd306b14d4b3c2037e0301f81a2837c6000a0d6ef2a7920ebaebe4506958fa"} err="failed to get container status \"c0cd306b14d4b3c2037e0301f81a2837c6000a0d6ef2a7920ebaebe4506958fa\": rpc error: code = NotFound desc = could not find container \"c0cd306b14d4b3c2037e0301f81a2837c6000a0d6ef2a7920ebaebe4506958fa\": container with ID starting with c0cd306b14d4b3c2037e0301f81a2837c6000a0d6ef2a7920ebaebe4506958fa not found: ID does not exist" Apr 17 14:30:05.436795 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.436710 2573 scope.go:117] "RemoveContainer" containerID="3385a65933d967233334abd32488768afc1aeecb0b3c7444473c11039689df2d" Apr 17 14:30:05.437304 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.437199 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3385a65933d967233334abd32488768afc1aeecb0b3c7444473c11039689df2d"} err="failed to get container status \"3385a65933d967233334abd32488768afc1aeecb0b3c7444473c11039689df2d\": rpc error: code = NotFound desc = could not find container \"3385a65933d967233334abd32488768afc1aeecb0b3c7444473c11039689df2d\": container with ID starting with 3385a65933d967233334abd32488768afc1aeecb0b3c7444473c11039689df2d not found: ID does not exist" Apr 17 14:30:05.437304 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.437236 2573 scope.go:117] "RemoveContainer" containerID="e9f7b31c9948cfee84bbfcf2dd4997a1f9cb7160baa92e5951e13e94e9d1f9c2" Apr 17 14:30:05.437594 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.437510 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9f7b31c9948cfee84bbfcf2dd4997a1f9cb7160baa92e5951e13e94e9d1f9c2"} err="failed to get container status \"e9f7b31c9948cfee84bbfcf2dd4997a1f9cb7160baa92e5951e13e94e9d1f9c2\": rpc error: code = NotFound desc = could not find container \"e9f7b31c9948cfee84bbfcf2dd4997a1f9cb7160baa92e5951e13e94e9d1f9c2\": container with ID starting with e9f7b31c9948cfee84bbfcf2dd4997a1f9cb7160baa92e5951e13e94e9d1f9c2 not found: ID does not exist" Apr 17 14:30:05.437594 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.437534 2573 scope.go:117] "RemoveContainer" containerID="5688310f65f4d738847e60c81b6b0bcefdea51cdc5910722d7bc208856153429" Apr 17 14:30:05.438004 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.437897 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5688310f65f4d738847e60c81b6b0bcefdea51cdc5910722d7bc208856153429"} err="failed to get container status \"5688310f65f4d738847e60c81b6b0bcefdea51cdc5910722d7bc208856153429\": rpc error: code = NotFound desc = could not find container \"5688310f65f4d738847e60c81b6b0bcefdea51cdc5910722d7bc208856153429\": container with ID starting with 5688310f65f4d738847e60c81b6b0bcefdea51cdc5910722d7bc208856153429 not found: ID does not exist" Apr 17 14:30:05.438004 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.437919 2573 scope.go:117] "RemoveContainer" containerID="4a48ef031c1f8c33e5610714de541345f554a2f44a163e3fbb56336b4e48733b" Apr 17 14:30:05.438436 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.438328 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a48ef031c1f8c33e5610714de541345f554a2f44a163e3fbb56336b4e48733b"} err="failed to get container status \"4a48ef031c1f8c33e5610714de541345f554a2f44a163e3fbb56336b4e48733b\": rpc error: code = NotFound desc = could not find container \"4a48ef031c1f8c33e5610714de541345f554a2f44a163e3fbb56336b4e48733b\": container with ID starting with 4a48ef031c1f8c33e5610714de541345f554a2f44a163e3fbb56336b4e48733b not found: ID does not exist" Apr 17 14:30:05.438436 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.438352 2573 scope.go:117] "RemoveContainer" containerID="12a580c67fdae59612e20262f2df95258f8b41bb04d172e45c007941034852a3" Apr 17 14:30:05.438869 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.438793 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12a580c67fdae59612e20262f2df95258f8b41bb04d172e45c007941034852a3"} err="failed to get container status \"12a580c67fdae59612e20262f2df95258f8b41bb04d172e45c007941034852a3\": rpc error: code = NotFound desc = could not find container \"12a580c67fdae59612e20262f2df95258f8b41bb04d172e45c007941034852a3\": container with ID starting with 12a580c67fdae59612e20262f2df95258f8b41bb04d172e45c007941034852a3 not found: ID does not exist" Apr 17 14:30:05.438869 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.438815 2573 scope.go:117] "RemoveContainer" containerID="acd25c3bdafa484b16099558b39c05a84a91963746a891791366c94ababdfa31" Apr 17 14:30:05.439498 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.439408 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acd25c3bdafa484b16099558b39c05a84a91963746a891791366c94ababdfa31"} err="failed to get container status \"acd25c3bdafa484b16099558b39c05a84a91963746a891791366c94ababdfa31\": rpc error: code = NotFound desc = could not find container \"acd25c3bdafa484b16099558b39c05a84a91963746a891791366c94ababdfa31\": container with ID starting with acd25c3bdafa484b16099558b39c05a84a91963746a891791366c94ababdfa31 not found: ID does not exist" Apr 17 14:30:05.439498 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.439434 2573 scope.go:117] "RemoveContainer" containerID="c0cd306b14d4b3c2037e0301f81a2837c6000a0d6ef2a7920ebaebe4506958fa" Apr 17 14:30:05.439954 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.439902 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0cd306b14d4b3c2037e0301f81a2837c6000a0d6ef2a7920ebaebe4506958fa"} err="failed to get container status \"c0cd306b14d4b3c2037e0301f81a2837c6000a0d6ef2a7920ebaebe4506958fa\": rpc error: code = NotFound desc = could not find container \"c0cd306b14d4b3c2037e0301f81a2837c6000a0d6ef2a7920ebaebe4506958fa\": container with ID starting with c0cd306b14d4b3c2037e0301f81a2837c6000a0d6ef2a7920ebaebe4506958fa not found: ID does not exist" Apr 17 14:30:05.439954 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.439931 2573 scope.go:117] "RemoveContainer" containerID="3385a65933d967233334abd32488768afc1aeecb0b3c7444473c11039689df2d" Apr 17 14:30:05.440194 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.440173 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3385a65933d967233334abd32488768afc1aeecb0b3c7444473c11039689df2d"} err="failed to get container status \"3385a65933d967233334abd32488768afc1aeecb0b3c7444473c11039689df2d\": rpc error: code = NotFound desc = could not find container \"3385a65933d967233334abd32488768afc1aeecb0b3c7444473c11039689df2d\": container with ID starting with 3385a65933d967233334abd32488768afc1aeecb0b3c7444473c11039689df2d not found: ID does not exist" Apr 17 14:30:05.440274 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.440199 2573 scope.go:117] "RemoveContainer" containerID="e9f7b31c9948cfee84bbfcf2dd4997a1f9cb7160baa92e5951e13e94e9d1f9c2" Apr 17 14:30:05.440911 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.440504 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9f7b31c9948cfee84bbfcf2dd4997a1f9cb7160baa92e5951e13e94e9d1f9c2"} err="failed to get container status \"e9f7b31c9948cfee84bbfcf2dd4997a1f9cb7160baa92e5951e13e94e9d1f9c2\": rpc error: code = NotFound desc = could not find container \"e9f7b31c9948cfee84bbfcf2dd4997a1f9cb7160baa92e5951e13e94e9d1f9c2\": container with ID starting with e9f7b31c9948cfee84bbfcf2dd4997a1f9cb7160baa92e5951e13e94e9d1f9c2 not found: ID does not exist" Apr 17 14:30:05.440911 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.440538 2573 scope.go:117] "RemoveContainer" containerID="5688310f65f4d738847e60c81b6b0bcefdea51cdc5910722d7bc208856153429" Apr 17 14:30:05.441078 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.440935 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5688310f65f4d738847e60c81b6b0bcefdea51cdc5910722d7bc208856153429"} err="failed to get container status \"5688310f65f4d738847e60c81b6b0bcefdea51cdc5910722d7bc208856153429\": rpc error: code = NotFound desc = could not find container \"5688310f65f4d738847e60c81b6b0bcefdea51cdc5910722d7bc208856153429\": container with ID starting with 5688310f65f4d738847e60c81b6b0bcefdea51cdc5910722d7bc208856153429 not found: ID does not exist" Apr 17 14:30:05.441078 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.440954 2573 scope.go:117] "RemoveContainer" containerID="4a48ef031c1f8c33e5610714de541345f554a2f44a163e3fbb56336b4e48733b" Apr 17 14:30:05.441206 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.441184 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a48ef031c1f8c33e5610714de541345f554a2f44a163e3fbb56336b4e48733b"} err="failed to get container status \"4a48ef031c1f8c33e5610714de541345f554a2f44a163e3fbb56336b4e48733b\": rpc error: code = NotFound desc = could not find container \"4a48ef031c1f8c33e5610714de541345f554a2f44a163e3fbb56336b4e48733b\": container with ID starting with 4a48ef031c1f8c33e5610714de541345f554a2f44a163e3fbb56336b4e48733b not found: ID does not exist" Apr 17 14:30:05.441206 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.441206 2573 scope.go:117] "RemoveContainer" containerID="12a580c67fdae59612e20262f2df95258f8b41bb04d172e45c007941034852a3" Apr 17 14:30:05.441497 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.441476 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12a580c67fdae59612e20262f2df95258f8b41bb04d172e45c007941034852a3"} err="failed to get container status \"12a580c67fdae59612e20262f2df95258f8b41bb04d172e45c007941034852a3\": rpc error: code = NotFound desc = could not find container \"12a580c67fdae59612e20262f2df95258f8b41bb04d172e45c007941034852a3\": container with ID starting with 12a580c67fdae59612e20262f2df95258f8b41bb04d172e45c007941034852a3 not found: ID does not exist" Apr 17 14:30:05.441497 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.441496 2573 scope.go:117] "RemoveContainer" containerID="acd25c3bdafa484b16099558b39c05a84a91963746a891791366c94ababdfa31" Apr 17 14:30:05.441753 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.441732 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acd25c3bdafa484b16099558b39c05a84a91963746a891791366c94ababdfa31"} err="failed to get container status \"acd25c3bdafa484b16099558b39c05a84a91963746a891791366c94ababdfa31\": rpc error: code = NotFound desc = could not find container \"acd25c3bdafa484b16099558b39c05a84a91963746a891791366c94ababdfa31\": container with ID starting with acd25c3bdafa484b16099558b39c05a84a91963746a891791366c94ababdfa31 not found: ID does not exist" Apr 17 14:30:05.441753 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.441751 2573 scope.go:117] "RemoveContainer" containerID="c0cd306b14d4b3c2037e0301f81a2837c6000a0d6ef2a7920ebaebe4506958fa" Apr 17 14:30:05.442011 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.441987 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0cd306b14d4b3c2037e0301f81a2837c6000a0d6ef2a7920ebaebe4506958fa"} err="failed to get container status \"c0cd306b14d4b3c2037e0301f81a2837c6000a0d6ef2a7920ebaebe4506958fa\": rpc error: code = NotFound desc = could not find container \"c0cd306b14d4b3c2037e0301f81a2837c6000a0d6ef2a7920ebaebe4506958fa\": container with ID starting with c0cd306b14d4b3c2037e0301f81a2837c6000a0d6ef2a7920ebaebe4506958fa not found: ID does not exist" Apr 17 14:30:05.442059 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.442014 2573 scope.go:117] "RemoveContainer" containerID="3385a65933d967233334abd32488768afc1aeecb0b3c7444473c11039689df2d" Apr 17 14:30:05.442262 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.442242 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3385a65933d967233334abd32488768afc1aeecb0b3c7444473c11039689df2d"} err="failed to get container status \"3385a65933d967233334abd32488768afc1aeecb0b3c7444473c11039689df2d\": rpc error: code = NotFound desc = could not find container \"3385a65933d967233334abd32488768afc1aeecb0b3c7444473c11039689df2d\": container with ID starting with 3385a65933d967233334abd32488768afc1aeecb0b3c7444473c11039689df2d not found: ID does not exist" Apr 17 14:30:05.442326 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.442264 2573 scope.go:117] "RemoveContainer" containerID="e9f7b31c9948cfee84bbfcf2dd4997a1f9cb7160baa92e5951e13e94e9d1f9c2" Apr 17 14:30:05.442487 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.442471 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9f7b31c9948cfee84bbfcf2dd4997a1f9cb7160baa92e5951e13e94e9d1f9c2"} err="failed to get container status \"e9f7b31c9948cfee84bbfcf2dd4997a1f9cb7160baa92e5951e13e94e9d1f9c2\": rpc error: code = NotFound desc = could not find container \"e9f7b31c9948cfee84bbfcf2dd4997a1f9cb7160baa92e5951e13e94e9d1f9c2\": container with ID starting with e9f7b31c9948cfee84bbfcf2dd4997a1f9cb7160baa92e5951e13e94e9d1f9c2 not found: ID does not exist" Apr 17 14:30:05.507688 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.507617 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:30:05.507688 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.507657 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:30:05.507887 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.507697 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:30:05.507887 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.507780 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:30:05.507887 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.507821 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:30:05.507887 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.507851 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:30:05.508101 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.507901 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:30:05.508101 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.507927 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptnmb\" (UniqueName: \"kubernetes.io/projected/fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8-kube-api-access-ptnmb\") pod \"prometheus-k8s-0\" (UID: \"fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:30:05.508101 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.507991 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:30:05.508101 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.508039 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:30:05.508101 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.508068 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8-config-out\") pod \"prometheus-k8s-0\" (UID: \"fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:30:05.508101 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.508087 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8-web-config\") pod \"prometheus-k8s-0\" (UID: \"fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:30:05.508389 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.508130 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:30:05.508389 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.508251 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8-config\") pod \"prometheus-k8s-0\" (UID: \"fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:30:05.508389 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.508324 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:30:05.508389 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.508364 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:30:05.508577 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.508412 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:30:05.508577 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.508482 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:30:05.609869 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.609833 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:30:05.609869 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.609872 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:30:05.610139 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.609908 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:30:05.610139 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.609940 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:30:05.610139 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.609995 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:30:05.610139 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.610021 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:30:05.610139 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.610046 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:30:05.610383 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.610187 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ptnmb\" (UniqueName: \"kubernetes.io/projected/fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8-kube-api-access-ptnmb\") pod \"prometheus-k8s-0\" (UID: \"fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:30:05.610383 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.610228 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:30:05.610383 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.610261 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:30:05.610383 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.610289 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8-config-out\") pod \"prometheus-k8s-0\" (UID: \"fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:30:05.610383 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.610315 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8-web-config\") pod \"prometheus-k8s-0\" (UID: \"fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:30:05.610383 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.610365 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:30:05.610665 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.610404 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8-config\") pod \"prometheus-k8s-0\" (UID: \"fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:30:05.610665 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.610436 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:30:05.610665 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.610468 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:30:05.610665 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.610499 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:30:05.610665 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.610541 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:30:05.610899 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.610801 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:30:05.610899 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.610806 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:30:05.611482 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.611455 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:30:05.613890 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.613173 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:30:05.613890 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.613464 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:30:05.613890 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.613593 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:30:05.613890 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.613606 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:30:05.614546 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.614244 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:30:05.614688 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.614666 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:30:05.615457 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.615313 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:30:05.615457 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.615417 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:30:05.616296 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.616268 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:30:05.616393 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.616299 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:30:05.616751 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.616726 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8-config-out\") pod \"prometheus-k8s-0\" (UID: \"fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:30:05.617092 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.617046 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:30:05.617201 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.617182 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8-web-config\") pod \"prometheus-k8s-0\" (UID: \"fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:30:05.617486 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.617469 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8-config\") pod \"prometheus-k8s-0\" (UID: \"fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:30:05.621858 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.621835 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptnmb\" (UniqueName: \"kubernetes.io/projected/fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8-kube-api-access-ptnmb\") pod \"prometheus-k8s-0\" (UID: \"fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:30:05.740251 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.740216 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:30:05.876859 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:05.876823 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Apr 17 14:30:05.879918 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:30:05.879889 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfee3849a_6a4f_4b90_8b25_cf2a9c2e52c8.slice/crio-667f4a27ad9ba2bc69e2513e7187069de54924b8a18e1a9ab91e6ee9f5b25766 WatchSource:0}: Error finding container 667f4a27ad9ba2bc69e2513e7187069de54924b8a18e1a9ab91e6ee9f5b25766: Status 404 returned error can't find the container with id 667f4a27ad9ba2bc69e2513e7187069de54924b8a18e1a9ab91e6ee9f5b25766 Apr 17 14:30:06.373386 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:06.373337 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8","Type":"ContainerStarted","Data":"f7e51524b0c015e41d29b1e261b8a482af56514b7f9a6f5dc96a5d3462d6ca8c"} Apr 17 14:30:06.373828 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:06.373397 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8","Type":"ContainerStarted","Data":"667f4a27ad9ba2bc69e2513e7187069de54924b8a18e1a9ab91e6ee9f5b25766"} Apr 17 14:30:06.624618 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:06.624568 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d43bc47f-c681-4689-afd6-546a552c87a4" path="/var/lib/kubelet/pods/d43bc47f-c681-4689-afd6-546a552c87a4/volumes" Apr 17 14:30:07.380317 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:07.380281 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-584c4d667d-6pbls" event={"ID":"a4245b39-3601-4e3f-9ee6-f312dcb7048b","Type":"ContainerStarted","Data":"b5de5bcd09ea38164c02190d2a44d12dbde5ba08d441e7b2b359c6204691d36b"} Apr 17 14:30:07.380317 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:07.380323 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-584c4d667d-6pbls" event={"ID":"a4245b39-3601-4e3f-9ee6-f312dcb7048b","Type":"ContainerStarted","Data":"418a3d91cc624bcdd2f6b414691e2fa14bf2f58dec18422093abcbc63c47acd7"} Apr 17 14:30:07.380828 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:07.380337 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-584c4d667d-6pbls" event={"ID":"a4245b39-3601-4e3f-9ee6-f312dcb7048b","Type":"ContainerStarted","Data":"ad3b8962159e9bdb44da217c7564b32daceadc83feb75a61322c4eba4e977a33"} Apr 17 14:30:07.381566 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:07.381541 2573 generic.go:358] "Generic (PLEG): container finished" podID="fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8" containerID="f7e51524b0c015e41d29b1e261b8a482af56514b7f9a6f5dc96a5d3462d6ca8c" exitCode=0 Apr 17 14:30:07.381666 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:07.381620 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8","Type":"ContainerDied","Data":"f7e51524b0c015e41d29b1e261b8a482af56514b7f9a6f5dc96a5d3462d6ca8c"} Apr 17 14:30:07.401908 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:07.401852 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-584c4d667d-6pbls" podStartSLOduration=1.596079822 podStartE2EDuration="3.401835537s" podCreationTimestamp="2026-04-17 14:30:04 +0000 UTC" firstStartedPulling="2026-04-17 14:30:04.646343799 +0000 UTC m=+196.690772585" lastFinishedPulling="2026-04-17 14:30:06.452099501 +0000 UTC m=+198.496528300" observedRunningTime="2026-04-17 14:30:07.401280126 +0000 UTC m=+199.445708934" watchObservedRunningTime="2026-04-17 14:30:07.401835537 +0000 UTC m=+199.446264378" Apr 17 14:30:08.389722 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:08.389682 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8","Type":"ContainerStarted","Data":"d32975b6416882efcdef86a8bb2324cc64245f9a7553d2d2d05486ac66023123"} Apr 17 14:30:08.390206 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:08.389730 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8","Type":"ContainerStarted","Data":"cd62674c166d3d85396ac4f73cd851e2434d5cfe8d82367562f3c56497f50b95"} Apr 17 14:30:08.390206 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:08.389773 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8","Type":"ContainerStarted","Data":"bf68309ff7a2811f9d0b44c06c40e9cc68768a26621daa4b819bb7f643e9c4f9"} Apr 17 14:30:08.390206 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:08.389787 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8","Type":"ContainerStarted","Data":"80afb97d711e50f7ceedef6fda870cbba4d26e12d2395469a01a812a8da652ce"} Apr 17 14:30:08.390206 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:08.389813 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8","Type":"ContainerStarted","Data":"df8a22e1fd842382fe2dc09c2ea4405072bb0b70a089ea90383ee2329ab971a4"} Apr 17 14:30:08.390206 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:08.389825 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8","Type":"ContainerStarted","Data":"fde7bba266ae0199e0692f09f2d85337c4f86886b1b69fdd85dc3c9d55378f5b"} Apr 17 14:30:08.417201 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:08.417136 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.417118591 podStartE2EDuration="3.417118591s" podCreationTimestamp="2026-04-17 14:30:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-17 14:30:08.414175793 +0000 UTC m=+200.458604600" watchObservedRunningTime="2026-04-17 14:30:08.417118591 +0000 UTC m=+200.461547399" Apr 17 14:30:10.741252 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:30:10.741213 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:31:05.741080 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:31:05.740999 2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:31:05.756316 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:31:05.756291 2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:31:06.577211 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:31:06.577180 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Apr 17 14:31:48.461807 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:31:48.461779 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-9d4b6777b-mslwt_fba84e6b-7f61-427c-94d1-489ee9dadc9e/console-operator/2.log" Apr 17 14:31:48.462336 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:31:48.461837 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-9d4b6777b-mslwt_fba84e6b-7f61-427c-94d1-489ee9dadc9e/console-operator/2.log" Apr 17 14:31:48.465178 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:31:48.465156 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t4wf8_826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52/ovn-acl-logging/0.log" Apr 17 14:31:48.465314 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:31:48.465236 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t4wf8_826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52/ovn-acl-logging/0.log" Apr 17 14:31:48.474339 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:31:48.474322 2573 kubelet.go:1628] "Image garbage collection succeeded" Apr 17 14:32:07.166875 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:32:07.166838 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-xl5nl"] Apr 17 14:32:07.170028 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:32:07.170014 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xl5nl" Apr 17 14:32:07.172376 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:32:07.172358 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Apr 17 14:32:07.176341 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:32:07.176321 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xl5nl"] Apr 17 14:32:07.345576 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:32:07.345555 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3c168487-fc7f-4a23-87e0-9425a74e9530-original-pull-secret\") pod \"global-pull-secret-syncer-xl5nl\" (UID: \"3c168487-fc7f-4a23-87e0-9425a74e9530\") " pod="kube-system/global-pull-secret-syncer-xl5nl" Apr 17 14:32:07.345684 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:32:07.345598 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3c168487-fc7f-4a23-87e0-9425a74e9530-kubelet-config\") pod \"global-pull-secret-syncer-xl5nl\" (UID: \"3c168487-fc7f-4a23-87e0-9425a74e9530\") " pod="kube-system/global-pull-secret-syncer-xl5nl" Apr 17 14:32:07.345731 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:32:07.345681 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3c168487-fc7f-4a23-87e0-9425a74e9530-dbus\") pod \"global-pull-secret-syncer-xl5nl\" (UID: \"3c168487-fc7f-4a23-87e0-9425a74e9530\") " pod="kube-system/global-pull-secret-syncer-xl5nl" Apr 17 14:32:07.446233 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:32:07.446178 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3c168487-fc7f-4a23-87e0-9425a74e9530-original-pull-secret\") pod \"global-pull-secret-syncer-xl5nl\" (UID: \"3c168487-fc7f-4a23-87e0-9425a74e9530\") " pod="kube-system/global-pull-secret-syncer-xl5nl" Apr 17 14:32:07.446233 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:32:07.446221 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3c168487-fc7f-4a23-87e0-9425a74e9530-kubelet-config\") pod \"global-pull-secret-syncer-xl5nl\" (UID: \"3c168487-fc7f-4a23-87e0-9425a74e9530\") " pod="kube-system/global-pull-secret-syncer-xl5nl" Apr 17 14:32:07.446354 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:32:07.446262 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3c168487-fc7f-4a23-87e0-9425a74e9530-dbus\") pod \"global-pull-secret-syncer-xl5nl\" (UID: \"3c168487-fc7f-4a23-87e0-9425a74e9530\") " pod="kube-system/global-pull-secret-syncer-xl5nl" Apr 17 14:32:07.446392 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:32:07.446368 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3c168487-fc7f-4a23-87e0-9425a74e9530-kubelet-config\") pod \"global-pull-secret-syncer-xl5nl\" (UID: \"3c168487-fc7f-4a23-87e0-9425a74e9530\") " pod="kube-system/global-pull-secret-syncer-xl5nl" Apr 17 14:32:07.446467 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:32:07.446375 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3c168487-fc7f-4a23-87e0-9425a74e9530-dbus\") pod \"global-pull-secret-syncer-xl5nl\" (UID: \"3c168487-fc7f-4a23-87e0-9425a74e9530\") " pod="kube-system/global-pull-secret-syncer-xl5nl" Apr 17 14:32:07.448433 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:32:07.448409 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3c168487-fc7f-4a23-87e0-9425a74e9530-original-pull-secret\") pod \"global-pull-secret-syncer-xl5nl\" (UID: \"3c168487-fc7f-4a23-87e0-9425a74e9530\") " pod="kube-system/global-pull-secret-syncer-xl5nl" Apr 17 14:32:07.480547 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:32:07.480526 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xl5nl" Apr 17 14:32:07.600517 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:32:07.600486 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xl5nl"] Apr 17 14:32:07.604162 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:32:07.604136 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c168487_fc7f_4a23_87e0_9425a74e9530.slice/crio-5d8a7907c9363a63d168006fdc617543000fb945f1899e794d0b3cfe1f43b3f7 WatchSource:0}: Error finding container 5d8a7907c9363a63d168006fdc617543000fb945f1899e794d0b3cfe1f43b3f7: Status 404 returned error can't find the container with id 5d8a7907c9363a63d168006fdc617543000fb945f1899e794d0b3cfe1f43b3f7 Apr 17 14:32:07.605773 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:32:07.605757 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Apr 17 14:32:07.742336 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:32:07.742302 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xl5nl" event={"ID":"3c168487-fc7f-4a23-87e0-9425a74e9530","Type":"ContainerStarted","Data":"5d8a7907c9363a63d168006fdc617543000fb945f1899e794d0b3cfe1f43b3f7"} Apr 17 14:32:13.760763 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:32:13.760726 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xl5nl" event={"ID":"3c168487-fc7f-4a23-87e0-9425a74e9530","Type":"ContainerStarted","Data":"3de1c792a67ceeaf077cd0c838301ae716241dbc35b869a03090374e380b3ee3"} Apr 17 14:32:13.775519 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:32:13.775457 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-xl5nl" podStartSLOduration=1.16718736 podStartE2EDuration="6.775441344s" podCreationTimestamp="2026-04-17 14:32:07 +0000 UTC" firstStartedPulling="2026-04-17 14:32:07.605880302 +0000 UTC m=+319.650309088" lastFinishedPulling="2026-04-17 14:32:13.214134287 +0000 UTC m=+325.258563072" observedRunningTime="2026-04-17 14:32:13.773907236 +0000 UTC m=+325.818336044" watchObservedRunningTime="2026-04-17 14:32:13.775441344 +0000 UTC m=+325.819870207" Apr 17 14:33:43.976860 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:33:43.976831 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-operator-747c5859c7-5zdh6"] Apr 17 14:33:43.979907 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:33:43.979887 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-747c5859c7-5zdh6" Apr 17 14:33:43.982298 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:33:43.982275 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\"" Apr 17 14:33:43.982493 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:33:43.982478 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\"" Apr 17 14:33:43.983217 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:33:43.983199 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-operator-dockercfg-7f85m\"" Apr 17 14:33:43.987028 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:33:43.986847 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-747c5859c7-5zdh6"] Apr 17 14:33:44.070205 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:33:44.070179 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96024d01-54b7-459d-b2c0-2aecfe59abd5-tmp\") pod \"jobset-operator-747c5859c7-5zdh6\" (UID: \"96024d01-54b7-459d-b2c0-2aecfe59abd5\") " pod="openshift-jobset-operator/jobset-operator-747c5859c7-5zdh6" Apr 17 14:33:44.070373 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:33:44.070229 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5zv6\" (UniqueName: \"kubernetes.io/projected/96024d01-54b7-459d-b2c0-2aecfe59abd5-kube-api-access-d5zv6\") pod \"jobset-operator-747c5859c7-5zdh6\" (UID: \"96024d01-54b7-459d-b2c0-2aecfe59abd5\") " pod="openshift-jobset-operator/jobset-operator-747c5859c7-5zdh6" Apr 17 14:33:44.171048 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:33:44.171019 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96024d01-54b7-459d-b2c0-2aecfe59abd5-tmp\") pod \"jobset-operator-747c5859c7-5zdh6\" (UID: \"96024d01-54b7-459d-b2c0-2aecfe59abd5\") " pod="openshift-jobset-operator/jobset-operator-747c5859c7-5zdh6" Apr 17 14:33:44.171170 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:33:44.171058 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d5zv6\" (UniqueName: \"kubernetes.io/projected/96024d01-54b7-459d-b2c0-2aecfe59abd5-kube-api-access-d5zv6\") pod \"jobset-operator-747c5859c7-5zdh6\" (UID: \"96024d01-54b7-459d-b2c0-2aecfe59abd5\") " pod="openshift-jobset-operator/jobset-operator-747c5859c7-5zdh6" Apr 17 14:33:44.171387 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:33:44.171368 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96024d01-54b7-459d-b2c0-2aecfe59abd5-tmp\") pod \"jobset-operator-747c5859c7-5zdh6\" (UID: \"96024d01-54b7-459d-b2c0-2aecfe59abd5\") " pod="openshift-jobset-operator/jobset-operator-747c5859c7-5zdh6" Apr 17 14:33:44.178434 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:33:44.178407 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5zv6\" (UniqueName: \"kubernetes.io/projected/96024d01-54b7-459d-b2c0-2aecfe59abd5-kube-api-access-d5zv6\") pod \"jobset-operator-747c5859c7-5zdh6\" (UID: \"96024d01-54b7-459d-b2c0-2aecfe59abd5\") " pod="openshift-jobset-operator/jobset-operator-747c5859c7-5zdh6" Apr 17 14:33:44.298289 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:33:44.298220 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-747c5859c7-5zdh6" Apr 17 14:33:44.413326 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:33:44.413168 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-747c5859c7-5zdh6"] Apr 17 14:33:44.416242 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:33:44.416219 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod96024d01_54b7_459d_b2c0_2aecfe59abd5.slice/crio-1fde3cf434d449a0741eaa166aabd7e5e2e24a8a6326428d3d346c389dd52075 WatchSource:0}: Error finding container 1fde3cf434d449a0741eaa166aabd7e5e2e24a8a6326428d3d346c389dd52075: Status 404 returned error can't find the container with id 1fde3cf434d449a0741eaa166aabd7e5e2e24a8a6326428d3d346c389dd52075 Apr 17 14:33:45.033517 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:33:45.033477 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-747c5859c7-5zdh6" event={"ID":"96024d01-54b7-459d-b2c0-2aecfe59abd5","Type":"ContainerStarted","Data":"1fde3cf434d449a0741eaa166aabd7e5e2e24a8a6326428d3d346c389dd52075"} Apr 17 14:33:48.047558 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:33:48.047519 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-747c5859c7-5zdh6" event={"ID":"96024d01-54b7-459d-b2c0-2aecfe59abd5","Type":"ContainerStarted","Data":"a18ed102b7a167a0b85dbe007491e4e0687d1a87bb84bff8c0082c66f8ae7ed5"} Apr 17 14:33:48.063537 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:33:48.063486 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-operator-747c5859c7-5zdh6" podStartSLOduration=2.084874012 podStartE2EDuration="5.063468757s" podCreationTimestamp="2026-04-17 14:33:43 +0000 UTC" firstStartedPulling="2026-04-17 14:33:44.418136509 +0000 UTC m=+416.462565294" lastFinishedPulling="2026-04-17 14:33:47.39673124 +0000 UTC m=+419.441160039" observedRunningTime="2026-04-17 14:33:48.061788551 +0000 UTC m=+420.106217358" watchObservedRunningTime="2026-04-17 14:33:48.063468757 +0000 UTC m=+420.107897563" Apr 17 14:36:12.875936 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:36:12.875902 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-9j7w7/test-trainjob-77dkb-node-0-0-wsqq8"] Apr 17 14:36:12.878956 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:36:12.878940 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-9j7w7/test-trainjob-77dkb-node-0-0-wsqq8" Apr 17 14:36:12.881559 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:36:12.881533 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-9j7w7\"/\"openshift-service-ca.crt\"" Apr 17 14:36:12.881559 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:36:12.881548 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-9j7w7\"/\"kube-root-ca.crt\"" Apr 17 14:36:12.882391 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:36:12.882373 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-9j7w7\"/\"default-dockercfg-zg2w6\"" Apr 17 14:36:12.885366 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:36:12.885347 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-9j7w7/test-trainjob-77dkb-node-0-0-wsqq8"] Apr 17 14:36:13.018617 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:36:13.018580 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qj7j\" (UniqueName: \"kubernetes.io/projected/bc1f99b1-1bd4-4147-b2d6-972c5e3d32ae-kube-api-access-4qj7j\") pod \"test-trainjob-77dkb-node-0-0-wsqq8\" (UID: \"bc1f99b1-1bd4-4147-b2d6-972c5e3d32ae\") " pod="test-ns-9j7w7/test-trainjob-77dkb-node-0-0-wsqq8" Apr 17 14:36:13.119501 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:36:13.119471 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4qj7j\" (UniqueName: \"kubernetes.io/projected/bc1f99b1-1bd4-4147-b2d6-972c5e3d32ae-kube-api-access-4qj7j\") pod \"test-trainjob-77dkb-node-0-0-wsqq8\" (UID: \"bc1f99b1-1bd4-4147-b2d6-972c5e3d32ae\") " pod="test-ns-9j7w7/test-trainjob-77dkb-node-0-0-wsqq8" Apr 17 14:36:13.127710 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:36:13.127661 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qj7j\" (UniqueName: \"kubernetes.io/projected/bc1f99b1-1bd4-4147-b2d6-972c5e3d32ae-kube-api-access-4qj7j\") pod \"test-trainjob-77dkb-node-0-0-wsqq8\" (UID: \"bc1f99b1-1bd4-4147-b2d6-972c5e3d32ae\") " pod="test-ns-9j7w7/test-trainjob-77dkb-node-0-0-wsqq8" Apr 17 14:36:13.188573 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:36:13.188542 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-9j7w7/test-trainjob-77dkb-node-0-0-wsqq8" Apr 17 14:36:13.308040 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:36:13.308016 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-9j7w7/test-trainjob-77dkb-node-0-0-wsqq8"] Apr 17 14:36:13.310420 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:36:13.310382 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbc1f99b1_1bd4_4147_b2d6_972c5e3d32ae.slice/crio-92fab54dfe498e8d6ad1dfc7bc3607a2e69e5d8f05614f308ddacac6d1678a35 WatchSource:0}: Error finding container 92fab54dfe498e8d6ad1dfc7bc3607a2e69e5d8f05614f308ddacac6d1678a35: Status 404 returned error can't find the container with id 92fab54dfe498e8d6ad1dfc7bc3607a2e69e5d8f05614f308ddacac6d1678a35 Apr 17 14:36:13.533178 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:36:13.533142 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-9j7w7/test-trainjob-77dkb-node-0-0-wsqq8" event={"ID":"bc1f99b1-1bd4-4147-b2d6-972c5e3d32ae","Type":"ContainerStarted","Data":"92fab54dfe498e8d6ad1dfc7bc3607a2e69e5d8f05614f308ddacac6d1678a35"} Apr 17 14:36:48.501196 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:36:48.501162 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-9d4b6777b-mslwt_fba84e6b-7f61-427c-94d1-489ee9dadc9e/console-operator/2.log" Apr 17 14:36:48.501821 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:36:48.501364 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-9d4b6777b-mslwt_fba84e6b-7f61-427c-94d1-489ee9dadc9e/console-operator/2.log" Apr 17 14:36:48.505268 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:36:48.505244 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t4wf8_826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52/ovn-acl-logging/0.log" Apr 17 14:36:48.505415 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:36:48.505271 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t4wf8_826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52/ovn-acl-logging/0.log" Apr 17 14:40:44.524428 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:40:44.524376 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-9j7w7/test-trainjob-77dkb-node-0-0-wsqq8" event={"ID":"bc1f99b1-1bd4-4147-b2d6-972c5e3d32ae","Type":"ContainerStarted","Data":"5de801ebece5f752907e91a86bbc5b4518e5566c1775d8a3c7cc89acb517fa6a"} Apr 17 14:40:44.547319 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:40:44.547266 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-9j7w7/test-trainjob-77dkb-node-0-0-wsqq8" podStartSLOduration=1.910707063 podStartE2EDuration="4m32.547252347s" podCreationTimestamp="2026-04-17 14:36:12 +0000 UTC" firstStartedPulling="2026-04-17 14:36:13.312312667 +0000 UTC m=+565.356741451" lastFinishedPulling="2026-04-17 14:40:43.948857936 +0000 UTC m=+835.993286735" observedRunningTime="2026-04-17 14:40:44.546287621 +0000 UTC m=+836.590716571" watchObservedRunningTime="2026-04-17 14:40:44.547252347 +0000 UTC m=+836.591681155" Apr 17 14:40:49.542401 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:40:49.542372 2573 generic.go:358] "Generic (PLEG): container finished" podID="bc1f99b1-1bd4-4147-b2d6-972c5e3d32ae" containerID="5de801ebece5f752907e91a86bbc5b4518e5566c1775d8a3c7cc89acb517fa6a" exitCode=0 Apr 17 14:40:49.542753 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:40:49.542407 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-9j7w7/test-trainjob-77dkb-node-0-0-wsqq8" event={"ID":"bc1f99b1-1bd4-4147-b2d6-972c5e3d32ae","Type":"ContainerDied","Data":"5de801ebece5f752907e91a86bbc5b4518e5566c1775d8a3c7cc89acb517fa6a"} Apr 17 14:40:50.832496 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:40:50.832475 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-9j7w7/test-trainjob-77dkb-node-0-0-wsqq8" Apr 17 14:40:50.932527 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:40:50.932495 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4qj7j\" (UniqueName: \"kubernetes.io/projected/bc1f99b1-1bd4-4147-b2d6-972c5e3d32ae-kube-api-access-4qj7j\") pod \"bc1f99b1-1bd4-4147-b2d6-972c5e3d32ae\" (UID: \"bc1f99b1-1bd4-4147-b2d6-972c5e3d32ae\") " Apr 17 14:40:50.934693 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:40:50.934667 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc1f99b1-1bd4-4147-b2d6-972c5e3d32ae-kube-api-access-4qj7j" (OuterVolumeSpecName: "kube-api-access-4qj7j") pod "bc1f99b1-1bd4-4147-b2d6-972c5e3d32ae" (UID: "bc1f99b1-1bd4-4147-b2d6-972c5e3d32ae"). InnerVolumeSpecName "kube-api-access-4qj7j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 17 14:40:51.033216 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:40:51.033190 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4qj7j\" (UniqueName: \"kubernetes.io/projected/bc1f99b1-1bd4-4147-b2d6-972c5e3d32ae-kube-api-access-4qj7j\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\"" Apr 17 14:40:51.550123 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:40:51.550094 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-9j7w7/test-trainjob-77dkb-node-0-0-wsqq8" Apr 17 14:40:51.550287 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:40:51.550093 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-9j7w7/test-trainjob-77dkb-node-0-0-wsqq8" event={"ID":"bc1f99b1-1bd4-4147-b2d6-972c5e3d32ae","Type":"ContainerDied","Data":"92fab54dfe498e8d6ad1dfc7bc3607a2e69e5d8f05614f308ddacac6d1678a35"} Apr 17 14:40:51.550287 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:40:51.550197 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="92fab54dfe498e8d6ad1dfc7bc3607a2e69e5d8f05614f308ddacac6d1678a35" Apr 17 14:40:52.033077 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:40:52.033046 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-d7g6s/test-trainjob-5lcgk-node-0-0-rmtl7"] Apr 17 14:40:52.033428 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:40:52.033420 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc1f99b1-1bd4-4147-b2d6-972c5e3d32ae" containerName="node" Apr 17 14:40:52.033478 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:40:52.033431 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc1f99b1-1bd4-4147-b2d6-972c5e3d32ae" containerName="node" Apr 17 14:40:52.033516 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:40:52.033494 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="bc1f99b1-1bd4-4147-b2d6-972c5e3d32ae" containerName="node" Apr 17 14:40:52.059738 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:40:52.059712 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-d7g6s/test-trainjob-5lcgk-node-0-0-rmtl7"] Apr 17 14:40:52.059866 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:40:52.059811 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-d7g6s/test-trainjob-5lcgk-node-0-0-rmtl7" Apr 17 14:40:52.062338 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:40:52.062315 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-d7g6s\"/\"kube-root-ca.crt\"" Apr 17 14:40:52.062459 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:40:52.062315 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-d7g6s\"/\"openshift-service-ca.crt\"" Apr 17 14:40:52.063263 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:40:52.063247 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-d7g6s\"/\"default-dockercfg-8rlqs\"" Apr 17 14:40:52.145231 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:40:52.145207 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gvpp\" (UniqueName: \"kubernetes.io/projected/1f4962dc-ec6a-4e74-9e20-0cf4903eb357-kube-api-access-8gvpp\") pod \"test-trainjob-5lcgk-node-0-0-rmtl7\" (UID: \"1f4962dc-ec6a-4e74-9e20-0cf4903eb357\") " pod="test-ns-d7g6s/test-trainjob-5lcgk-node-0-0-rmtl7" Apr 17 14:40:52.246457 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:40:52.246430 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8gvpp\" (UniqueName: \"kubernetes.io/projected/1f4962dc-ec6a-4e74-9e20-0cf4903eb357-kube-api-access-8gvpp\") pod \"test-trainjob-5lcgk-node-0-0-rmtl7\" (UID: \"1f4962dc-ec6a-4e74-9e20-0cf4903eb357\") " pod="test-ns-d7g6s/test-trainjob-5lcgk-node-0-0-rmtl7" Apr 17 14:40:52.254648 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:40:52.254619 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gvpp\" (UniqueName: \"kubernetes.io/projected/1f4962dc-ec6a-4e74-9e20-0cf4903eb357-kube-api-access-8gvpp\") pod \"test-trainjob-5lcgk-node-0-0-rmtl7\" (UID: \"1f4962dc-ec6a-4e74-9e20-0cf4903eb357\") " pod="test-ns-d7g6s/test-trainjob-5lcgk-node-0-0-rmtl7" Apr 17 14:40:52.369615 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:40:52.369542 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-d7g6s/test-trainjob-5lcgk-node-0-0-rmtl7" Apr 17 14:40:52.646049 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:40:52.645966 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-d7g6s/test-trainjob-5lcgk-node-0-0-rmtl7"] Apr 17 14:40:52.649601 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:40:52.649571 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1f4962dc_ec6a_4e74_9e20_0cf4903eb357.slice/crio-cf04682e4aee3cc4ee06e0fdb658a3e760d512f0e16eadd6024996001d4b5bd3 WatchSource:0}: Error finding container cf04682e4aee3cc4ee06e0fdb658a3e760d512f0e16eadd6024996001d4b5bd3: Status 404 returned error can't find the container with id cf04682e4aee3cc4ee06e0fdb658a3e760d512f0e16eadd6024996001d4b5bd3 Apr 17 14:40:52.651512 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:40:52.651496 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Apr 17 14:40:53.559075 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:40:53.559026 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-d7g6s/test-trainjob-5lcgk-node-0-0-rmtl7" event={"ID":"1f4962dc-ec6a-4e74-9e20-0cf4903eb357","Type":"ContainerStarted","Data":"cf04682e4aee3cc4ee06e0fdb658a3e760d512f0e16eadd6024996001d4b5bd3"} Apr 17 14:41:48.539118 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:41:48.539046 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-9d4b6777b-mslwt_fba84e6b-7f61-427c-94d1-489ee9dadc9e/console-operator/2.log" Apr 17 14:41:48.539118 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:41:48.539048 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-9d4b6777b-mslwt_fba84e6b-7f61-427c-94d1-489ee9dadc9e/console-operator/2.log" Apr 17 14:41:48.548435 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:41:48.548414 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t4wf8_826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52/ovn-acl-logging/0.log" Apr 17 14:41:48.548552 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:41:48.548414 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t4wf8_826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52/ovn-acl-logging/0.log" Apr 17 14:45:19.536932 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:45:19.536899 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-d7g6s/test-trainjob-5lcgk-node-0-0-rmtl7" event={"ID":"1f4962dc-ec6a-4e74-9e20-0cf4903eb357","Type":"ContainerStarted","Data":"89a270dc5238da652e3251c39e9f0b84d7be07e80c23f8261af0d1aaed2d2319"} Apr 17 14:45:19.561293 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:45:19.561247 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-d7g6s/test-trainjob-5lcgk-node-0-0-rmtl7" podStartSLOduration=1.218360346 podStartE2EDuration="4m27.561232173s" podCreationTimestamp="2026-04-17 14:40:52 +0000 UTC" firstStartedPulling="2026-04-17 14:40:52.651620147 +0000 UTC m=+844.696048933" lastFinishedPulling="2026-04-17 14:45:18.994491971 +0000 UTC m=+1111.038920760" observedRunningTime="2026-04-17 14:45:19.560063235 +0000 UTC m=+1111.604492042" watchObservedRunningTime="2026-04-17 14:45:19.561232173 +0000 UTC m=+1111.605661014" Apr 17 14:45:25.558784 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:45:25.558749 2573 generic.go:358] "Generic (PLEG): container finished" podID="1f4962dc-ec6a-4e74-9e20-0cf4903eb357" containerID="89a270dc5238da652e3251c39e9f0b84d7be07e80c23f8261af0d1aaed2d2319" exitCode=0 Apr 17 14:45:25.559188 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:45:25.558827 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-d7g6s/test-trainjob-5lcgk-node-0-0-rmtl7" event={"ID":"1f4962dc-ec6a-4e74-9e20-0cf4903eb357","Type":"ContainerDied","Data":"89a270dc5238da652e3251c39e9f0b84d7be07e80c23f8261af0d1aaed2d2319"} Apr 17 14:45:26.767910 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:45:26.767883 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-d7g6s/test-trainjob-5lcgk-node-0-0-rmtl7" Apr 17 14:45:26.896219 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:45:26.896143 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8gvpp\" (UniqueName: \"kubernetes.io/projected/1f4962dc-ec6a-4e74-9e20-0cf4903eb357-kube-api-access-8gvpp\") pod \"1f4962dc-ec6a-4e74-9e20-0cf4903eb357\" (UID: \"1f4962dc-ec6a-4e74-9e20-0cf4903eb357\") " Apr 17 14:45:26.898272 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:45:26.898245 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f4962dc-ec6a-4e74-9e20-0cf4903eb357-kube-api-access-8gvpp" (OuterVolumeSpecName: "kube-api-access-8gvpp") pod "1f4962dc-ec6a-4e74-9e20-0cf4903eb357" (UID: "1f4962dc-ec6a-4e74-9e20-0cf4903eb357"). InnerVolumeSpecName "kube-api-access-8gvpp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 17 14:45:26.997784 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:45:26.997757 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8gvpp\" (UniqueName: \"kubernetes.io/projected/1f4962dc-ec6a-4e74-9e20-0cf4903eb357-kube-api-access-8gvpp\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\"" Apr 17 14:45:27.566354 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:45:27.566325 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-d7g6s/test-trainjob-5lcgk-node-0-0-rmtl7" Apr 17 14:45:27.566354 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:45:27.566349 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-d7g6s/test-trainjob-5lcgk-node-0-0-rmtl7" event={"ID":"1f4962dc-ec6a-4e74-9e20-0cf4903eb357","Type":"ContainerDied","Data":"cf04682e4aee3cc4ee06e0fdb658a3e760d512f0e16eadd6024996001d4b5bd3"} Apr 17 14:45:27.566559 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:45:27.566378 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cf04682e4aee3cc4ee06e0fdb658a3e760d512f0e16eadd6024996001d4b5bd3" Apr 17 14:45:28.172426 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:45:28.172393 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-mtk2p/test-trainjob-s7529-node-0-0-499qn"] Apr 17 14:45:28.172821 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:45:28.172781 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f4962dc-ec6a-4e74-9e20-0cf4903eb357" containerName="node" Apr 17 14:45:28.172821 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:45:28.172793 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f4962dc-ec6a-4e74-9e20-0cf4903eb357" containerName="node" Apr 17 14:45:28.172961 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:45:28.172862 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="1f4962dc-ec6a-4e74-9e20-0cf4903eb357" containerName="node" Apr 17 14:45:28.450848 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:45:28.450775 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-mtk2p/test-trainjob-s7529-node-0-0-499qn"] Apr 17 14:45:28.451014 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:45:28.450884 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-mtk2p/test-trainjob-s7529-node-0-0-499qn" Apr 17 14:45:28.453359 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:45:28.453336 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-mtk2p\"/\"openshift-service-ca.crt\"" Apr 17 14:45:28.453496 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:45:28.453375 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-mtk2p\"/\"kube-root-ca.crt\"" Apr 17 14:45:28.454224 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:45:28.454207 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-mtk2p\"/\"default-dockercfg-cqcnw\"" Apr 17 14:45:28.509363 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:45:28.509337 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4qpj\" (UniqueName: \"kubernetes.io/projected/080e01f1-2a0c-4b4e-8d17-060ad1edc5f8-kube-api-access-z4qpj\") pod \"test-trainjob-s7529-node-0-0-499qn\" (UID: \"080e01f1-2a0c-4b4e-8d17-060ad1edc5f8\") " pod="test-ns-mtk2p/test-trainjob-s7529-node-0-0-499qn" Apr 17 14:45:28.610383 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:45:28.610351 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z4qpj\" (UniqueName: \"kubernetes.io/projected/080e01f1-2a0c-4b4e-8d17-060ad1edc5f8-kube-api-access-z4qpj\") pod \"test-trainjob-s7529-node-0-0-499qn\" (UID: \"080e01f1-2a0c-4b4e-8d17-060ad1edc5f8\") " pod="test-ns-mtk2p/test-trainjob-s7529-node-0-0-499qn" Apr 17 14:45:28.618470 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:45:28.618443 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4qpj\" (UniqueName: \"kubernetes.io/projected/080e01f1-2a0c-4b4e-8d17-060ad1edc5f8-kube-api-access-z4qpj\") pod \"test-trainjob-s7529-node-0-0-499qn\" (UID: \"080e01f1-2a0c-4b4e-8d17-060ad1edc5f8\") " pod="test-ns-mtk2p/test-trainjob-s7529-node-0-0-499qn" Apr 17 14:45:28.760186 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:45:28.760153 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-mtk2p/test-trainjob-s7529-node-0-0-499qn" Apr 17 14:45:28.942130 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:45:28.942096 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-mtk2p/test-trainjob-s7529-node-0-0-499qn"] Apr 17 14:45:29.006804 ip-10-0-131-47 kubenswrapper[2573]: W0417 14:45:29.006772 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod080e01f1_2a0c_4b4e_8d17_060ad1edc5f8.slice/crio-722e2ee9ea6c3d0591f1e08fb58ba40963a76b0f6cc0df94920e2f2ce838527c WatchSource:0}: Error finding container 722e2ee9ea6c3d0591f1e08fb58ba40963a76b0f6cc0df94920e2f2ce838527c: Status 404 returned error can't find the container with id 722e2ee9ea6c3d0591f1e08fb58ba40963a76b0f6cc0df94920e2f2ce838527c Apr 17 14:45:29.574890 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:45:29.574855 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-mtk2p/test-trainjob-s7529-node-0-0-499qn" event={"ID":"080e01f1-2a0c-4b4e-8d17-060ad1edc5f8","Type":"ContainerStarted","Data":"722e2ee9ea6c3d0591f1e08fb58ba40963a76b0f6cc0df94920e2f2ce838527c"} Apr 17 14:46:55.586244 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:46:55.586210 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-9d4b6777b-mslwt_fba84e6b-7f61-427c-94d1-489ee9dadc9e/console-operator/2.log" Apr 17 14:46:55.586786 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:46:55.586448 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-9d4b6777b-mslwt_fba84e6b-7f61-427c-94d1-489ee9dadc9e/console-operator/2.log" Apr 17 14:46:55.589893 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:46:55.589869 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t4wf8_826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52/ovn-acl-logging/0.log" Apr 17 14:46:55.590216 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:46:55.590196 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t4wf8_826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52/ovn-acl-logging/0.log" Apr 17 14:46:56.918446 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:46:56.918399 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-mtk2p/test-trainjob-s7529-node-0-0-499qn" event={"ID":"080e01f1-2a0c-4b4e-8d17-060ad1edc5f8","Type":"ContainerStarted","Data":"5d32a602639e91998abf40b3c21d261b701af5cd2690b823d2cce722e9297a9d"} Apr 17 14:46:56.934433 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:46:56.934378 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-mtk2p/test-trainjob-s7529-node-0-0-499qn" podStartSLOduration=1.901407418 podStartE2EDuration="1m28.934363931s" podCreationTimestamp="2026-04-17 14:45:28 +0000 UTC" firstStartedPulling="2026-04-17 14:45:29.008678332 +0000 UTC m=+1121.053107117" lastFinishedPulling="2026-04-17 14:46:56.041634842 +0000 UTC m=+1208.086063630" observedRunningTime="2026-04-17 14:46:56.932723329 +0000 UTC m=+1208.977152137" watchObservedRunningTime="2026-04-17 14:46:56.934363931 +0000 UTC m=+1208.978792738" Apr 17 14:46:58.926283 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:46:58.926214 2573 generic.go:358] "Generic (PLEG): container finished" podID="080e01f1-2a0c-4b4e-8d17-060ad1edc5f8" containerID="5d32a602639e91998abf40b3c21d261b701af5cd2690b823d2cce722e9297a9d" exitCode=0 Apr 17 14:46:58.926631 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:46:58.926286 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-mtk2p/test-trainjob-s7529-node-0-0-499qn" event={"ID":"080e01f1-2a0c-4b4e-8d17-060ad1edc5f8","Type":"ContainerDied","Data":"5d32a602639e91998abf40b3c21d261b701af5cd2690b823d2cce722e9297a9d"} Apr 17 14:47:00.049826 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:47:00.049803 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-mtk2p/test-trainjob-s7529-node-0-0-499qn" Apr 17 14:47:00.202218 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:47:00.202143 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z4qpj\" (UniqueName: \"kubernetes.io/projected/080e01f1-2a0c-4b4e-8d17-060ad1edc5f8-kube-api-access-z4qpj\") pod \"080e01f1-2a0c-4b4e-8d17-060ad1edc5f8\" (UID: \"080e01f1-2a0c-4b4e-8d17-060ad1edc5f8\") " Apr 17 14:47:00.204355 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:47:00.204322 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/080e01f1-2a0c-4b4e-8d17-060ad1edc5f8-kube-api-access-z4qpj" (OuterVolumeSpecName: "kube-api-access-z4qpj") pod "080e01f1-2a0c-4b4e-8d17-060ad1edc5f8" (UID: "080e01f1-2a0c-4b4e-8d17-060ad1edc5f8"). InnerVolumeSpecName "kube-api-access-z4qpj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 17 14:47:00.303182 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:47:00.303145 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z4qpj\" (UniqueName: \"kubernetes.io/projected/080e01f1-2a0c-4b4e-8d17-060ad1edc5f8-kube-api-access-z4qpj\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\"" Apr 17 14:47:00.934473 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:47:00.934407 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-mtk2p/test-trainjob-s7529-node-0-0-499qn" Apr 17 14:47:00.934473 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:47:00.934426 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-mtk2p/test-trainjob-s7529-node-0-0-499qn" event={"ID":"080e01f1-2a0c-4b4e-8d17-060ad1edc5f8","Type":"ContainerDied","Data":"722e2ee9ea6c3d0591f1e08fb58ba40963a76b0f6cc0df94920e2f2ce838527c"} Apr 17 14:47:00.934473 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:47:00.934461 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="722e2ee9ea6c3d0591f1e08fb58ba40963a76b0f6cc0df94920e2f2ce838527c" Apr 17 14:51:55.612622 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:51:55.612591 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-9d4b6777b-mslwt_fba84e6b-7f61-427c-94d1-489ee9dadc9e/console-operator/2.log" Apr 17 14:51:55.615155 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:51:55.615125 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-9d4b6777b-mslwt_fba84e6b-7f61-427c-94d1-489ee9dadc9e/console-operator/2.log" Apr 17 14:51:55.615554 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:51:55.615537 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t4wf8_826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52/ovn-acl-logging/0.log" Apr 17 14:51:55.618095 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:51:55.618072 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t4wf8_826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52/ovn-acl-logging/0.log" Apr 17 14:56:55.638426 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:56:55.638396 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-9d4b6777b-mslwt_fba84e6b-7f61-427c-94d1-489ee9dadc9e/console-operator/2.log" Apr 17 14:56:55.641081 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:56:55.641058 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-9d4b6777b-mslwt_fba84e6b-7f61-427c-94d1-489ee9dadc9e/console-operator/2.log" Apr 17 14:56:55.641289 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:56:55.641276 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t4wf8_826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52/ovn-acl-logging/0.log" Apr 17 14:56:55.644055 ip-10-0-131-47 kubenswrapper[2573]: I0417 14:56:55.644034 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t4wf8_826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52/ovn-acl-logging/0.log" Apr 17 15:01:55.664169 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:01:55.664143 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-9d4b6777b-mslwt_fba84e6b-7f61-427c-94d1-489ee9dadc9e/console-operator/2.log" Apr 17 15:01:55.667022 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:01:55.667000 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t4wf8_826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52/ovn-acl-logging/0.log" Apr 17 15:01:55.667578 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:01:55.667557 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-9d4b6777b-mslwt_fba84e6b-7f61-427c-94d1-489ee9dadc9e/console-operator/2.log" Apr 17 15:01:55.670447 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:01:55.670430 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t4wf8_826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52/ovn-acl-logging/0.log" Apr 17 15:05:18.053618 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:05:18.053591 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-mtk2p_test-trainjob-s7529-node-0-0-499qn_080e01f1-2a0c-4b4e-8d17-060ad1edc5f8/node/0.log" Apr 17 15:05:18.141204 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:05:18.141175 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-d7g6s_test-trainjob-5lcgk-node-0-0-rmtl7_1f4962dc-ec6a-4e74-9e20-0cf4903eb357/node/0.log" Apr 17 15:05:18.637081 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:05:18.637049 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-9j7w7_test-trainjob-77dkb-node-0-0-wsqq8_bc1f99b1-1bd4-4147-b2d6-972c5e3d32ae/node/0.log" Apr 17 15:05:19.863565 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:05:19.863526 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-q2msj/must-gather-jgrt7"] Apr 17 15:05:19.864045 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:05:19.864026 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="080e01f1-2a0c-4b4e-8d17-060ad1edc5f8" containerName="node" Apr 17 15:05:19.864045 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:05:19.864048 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="080e01f1-2a0c-4b4e-8d17-060ad1edc5f8" containerName="node" Apr 17 15:05:19.864163 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:05:19.864122 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="080e01f1-2a0c-4b4e-8d17-060ad1edc5f8" containerName="node" Apr 17 15:05:19.867206 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:05:19.867190 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q2msj/must-gather-jgrt7" Apr 17 15:05:19.869396 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:05:19.869373 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-q2msj\"/\"default-dockercfg-cd7v8\"" Apr 17 15:05:19.869396 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:05:19.869387 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-q2msj\"/\"kube-root-ca.crt\"" Apr 17 15:05:19.869583 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:05:19.869532 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-q2msj\"/\"openshift-service-ca.crt\"" Apr 17 15:05:19.873165 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:05:19.873145 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-q2msj/must-gather-jgrt7"] Apr 17 15:05:20.015500 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:05:20.015470 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzscl\" (UniqueName: \"kubernetes.io/projected/2198a381-a448-4f27-9437-3b302ffde37c-kube-api-access-jzscl\") pod \"must-gather-jgrt7\" (UID: \"2198a381-a448-4f27-9437-3b302ffde37c\") " pod="openshift-must-gather-q2msj/must-gather-jgrt7" Apr 17 15:05:20.015642 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:05:20.015526 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2198a381-a448-4f27-9437-3b302ffde37c-must-gather-output\") pod \"must-gather-jgrt7\" (UID: \"2198a381-a448-4f27-9437-3b302ffde37c\") " pod="openshift-must-gather-q2msj/must-gather-jgrt7" Apr 17 15:05:20.116332 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:05:20.116249 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jzscl\" (UniqueName: \"kubernetes.io/projected/2198a381-a448-4f27-9437-3b302ffde37c-kube-api-access-jzscl\") pod \"must-gather-jgrt7\" (UID: \"2198a381-a448-4f27-9437-3b302ffde37c\") " pod="openshift-must-gather-q2msj/must-gather-jgrt7" Apr 17 15:05:20.116332 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:05:20.116305 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2198a381-a448-4f27-9437-3b302ffde37c-must-gather-output\") pod \"must-gather-jgrt7\" (UID: \"2198a381-a448-4f27-9437-3b302ffde37c\") " pod="openshift-must-gather-q2msj/must-gather-jgrt7" Apr 17 15:05:20.116644 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:05:20.116627 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2198a381-a448-4f27-9437-3b302ffde37c-must-gather-output\") pod \"must-gather-jgrt7\" (UID: \"2198a381-a448-4f27-9437-3b302ffde37c\") " pod="openshift-must-gather-q2msj/must-gather-jgrt7" Apr 17 15:05:20.124030 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:05:20.124010 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzscl\" (UniqueName: \"kubernetes.io/projected/2198a381-a448-4f27-9437-3b302ffde37c-kube-api-access-jzscl\") pod \"must-gather-jgrt7\" (UID: \"2198a381-a448-4f27-9437-3b302ffde37c\") " pod="openshift-must-gather-q2msj/must-gather-jgrt7" Apr 17 15:05:20.177226 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:05:20.177199 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q2msj/must-gather-jgrt7" Apr 17 15:05:20.299707 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:05:20.299680 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-q2msj/must-gather-jgrt7"] Apr 17 15:05:20.302027 ip-10-0-131-47 kubenswrapper[2573]: W0417 15:05:20.301994 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2198a381_a448_4f27_9437_3b302ffde37c.slice/crio-dacaf6d914e1897ac8a0e8263cb02f9a0d327c1295c4a0bd7fa886a6bb3c37a1 WatchSource:0}: Error finding container dacaf6d914e1897ac8a0e8263cb02f9a0d327c1295c4a0bd7fa886a6bb3c37a1: Status 404 returned error can't find the container with id dacaf6d914e1897ac8a0e8263cb02f9a0d327c1295c4a0bd7fa886a6bb3c37a1 Apr 17 15:05:20.303831 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:05:20.303812 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Apr 17 15:05:20.668081 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:05:20.668045 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q2msj/must-gather-jgrt7" event={"ID":"2198a381-a448-4f27-9437-3b302ffde37c","Type":"ContainerStarted","Data":"dacaf6d914e1897ac8a0e8263cb02f9a0d327c1295c4a0bd7fa886a6bb3c37a1"} Apr 17 15:05:23.203655 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:05:23.203620 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-mtk2p/test-trainjob-s7529-node-0-0-499qn"] Apr 17 15:05:23.207247 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:05:23.207209 2573 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-mtk2p/test-trainjob-s7529-node-0-0-499qn"] Apr 17 15:05:23.306554 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:05:23.306515 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-d7g6s/test-trainjob-5lcgk-node-0-0-rmtl7"] Apr 17 15:05:23.308734 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:05:23.308700 2573 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-d7g6s/test-trainjob-5lcgk-node-0-0-rmtl7"] Apr 17 15:05:23.857036 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:05:23.857002 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-9j7w7/test-trainjob-77dkb-node-0-0-wsqq8"] Apr 17 15:05:23.859572 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:05:23.859544 2573 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-9j7w7/test-trainjob-77dkb-node-0-0-wsqq8"] Apr 17 15:05:24.627016 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:05:24.626964 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="080e01f1-2a0c-4b4e-8d17-060ad1edc5f8" path="/var/lib/kubelet/pods/080e01f1-2a0c-4b4e-8d17-060ad1edc5f8/volumes" Apr 17 15:05:24.627430 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:05:24.627414 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f4962dc-ec6a-4e74-9e20-0cf4903eb357" path="/var/lib/kubelet/pods/1f4962dc-ec6a-4e74-9e20-0cf4903eb357/volumes" Apr 17 15:05:24.627828 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:05:24.627811 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc1f99b1-1bd4-4147-b2d6-972c5e3d32ae" path="/var/lib/kubelet/pods/bc1f99b1-1bd4-4147-b2d6-972c5e3d32ae/volumes" Apr 17 15:05:26.694661 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:05:26.694612 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q2msj/must-gather-jgrt7" event={"ID":"2198a381-a448-4f27-9437-3b302ffde37c","Type":"ContainerStarted","Data":"4de48c0a682be8353ca0550a7774a231a81972e34ff84f4d8898b0fc1f5f94cc"} Apr 17 15:05:26.695168 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:05:26.694669 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q2msj/must-gather-jgrt7" event={"ID":"2198a381-a448-4f27-9437-3b302ffde37c","Type":"ContainerStarted","Data":"5bf2ec5ba16677d53225f5223ced8a1de9812c043c9cfe9587ffc83a5b79ca80"} Apr 17 15:05:26.710193 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:05:26.710146 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-q2msj/must-gather-jgrt7" podStartSLOduration=2.3141195740000002 podStartE2EDuration="7.710131968s" podCreationTimestamp="2026-04-17 15:05:19 +0000 UTC" firstStartedPulling="2026-04-17 15:05:20.303935618 +0000 UTC m=+2312.348364402" lastFinishedPulling="2026-04-17 15:05:25.699948007 +0000 UTC m=+2317.744376796" observedRunningTime="2026-04-17 15:05:26.707912567 +0000 UTC m=+2318.752341374" watchObservedRunningTime="2026-04-17 15:05:26.710131968 +0000 UTC m=+2318.754560774" Apr 17 15:05:48.666532 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:05:48.666458 2573 scope.go:117] "RemoveContainer" containerID="5d32a602639e91998abf40b3c21d261b701af5cd2690b823d2cce722e9297a9d" Apr 17 15:05:48.685612 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:05:48.685589 2573 scope.go:117] "RemoveContainer" containerID="89a270dc5238da652e3251c39e9f0b84d7be07e80c23f8261af0d1aaed2d2319" Apr 17 15:05:48.710621 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:05:48.710595 2573 scope.go:117] "RemoveContainer" containerID="5de801ebece5f752907e91a86bbc5b4518e5566c1775d8a3c7cc89acb517fa6a" Apr 17 15:06:09.870204 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:09.870165 2573 generic.go:358] "Generic (PLEG): container finished" podID="2198a381-a448-4f27-9437-3b302ffde37c" containerID="5bf2ec5ba16677d53225f5223ced8a1de9812c043c9cfe9587ffc83a5b79ca80" exitCode=0 Apr 17 15:06:09.870608 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:09.870236 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q2msj/must-gather-jgrt7" event={"ID":"2198a381-a448-4f27-9437-3b302ffde37c","Type":"ContainerDied","Data":"5bf2ec5ba16677d53225f5223ced8a1de9812c043c9cfe9587ffc83a5b79ca80"} Apr 17 15:06:09.870608 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:09.870587 2573 scope.go:117] "RemoveContainer" containerID="5bf2ec5ba16677d53225f5223ced8a1de9812c043c9cfe9587ffc83a5b79ca80" Apr 17 15:06:10.710766 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:10.710734 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-q2msj_must-gather-jgrt7_2198a381-a448-4f27-9437-3b302ffde37c/gather/0.log" Apr 17 15:06:15.006315 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:15.006285 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-xl5nl_3c168487-fc7f-4a23-87e0-9425a74e9530/global-pull-secret-syncer/0.log" Apr 17 15:06:15.107122 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:15.107090 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xjs2v_733d18e1-1920-4e3c-83c4-b476253e1f4d/konnectivity-agent/0.log" Apr 17 15:06:15.172779 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:15.172747 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-47.ec2.internal_8b712f12e316b1a6ded9d349ca82d37a/haproxy/0.log" Apr 17 15:06:16.047598 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:16.047555 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-q2msj/must-gather-jgrt7"] Apr 17 15:06:16.048005 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:16.047771 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-must-gather-q2msj/must-gather-jgrt7" podUID="2198a381-a448-4f27-9437-3b302ffde37c" containerName="copy" containerID="cri-o://4de48c0a682be8353ca0550a7774a231a81972e34ff84f4d8898b0fc1f5f94cc" gracePeriod=2 Apr 17 15:06:16.050193 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:16.050160 2573 status_manager.go:895] "Failed to get status for pod" podUID="2198a381-a448-4f27-9437-3b302ffde37c" pod="openshift-must-gather-q2msj/must-gather-jgrt7" err="pods \"must-gather-jgrt7\" is forbidden: User \"system:node:ip-10-0-131-47.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-q2msj\": no relationship found between node 'ip-10-0-131-47.ec2.internal' and this object" Apr 17 15:06:16.052074 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:16.051855 2573 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-q2msj/must-gather-jgrt7"] Apr 17 15:06:16.282492 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:16.282466 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-q2msj_must-gather-jgrt7_2198a381-a448-4f27-9437-3b302ffde37c/copy/0.log" Apr 17 15:06:16.282823 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:16.282808 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q2msj/must-gather-jgrt7" Apr 17 15:06:16.284812 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:16.284790 2573 status_manager.go:895] "Failed to get status for pod" podUID="2198a381-a448-4f27-9437-3b302ffde37c" pod="openshift-must-gather-q2msj/must-gather-jgrt7" err="pods \"must-gather-jgrt7\" is forbidden: User \"system:node:ip-10-0-131-47.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-q2msj\": no relationship found between node 'ip-10-0-131-47.ec2.internal' and this object" Apr 17 15:06:16.343031 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:16.342931 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jzscl\" (UniqueName: \"kubernetes.io/projected/2198a381-a448-4f27-9437-3b302ffde37c-kube-api-access-jzscl\") pod \"2198a381-a448-4f27-9437-3b302ffde37c\" (UID: \"2198a381-a448-4f27-9437-3b302ffde37c\") " Apr 17 15:06:16.343031 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:16.342998 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2198a381-a448-4f27-9437-3b302ffde37c-must-gather-output\") pod \"2198a381-a448-4f27-9437-3b302ffde37c\" (UID: \"2198a381-a448-4f27-9437-3b302ffde37c\") " Apr 17 15:06:16.345250 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:16.345211 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2198a381-a448-4f27-9437-3b302ffde37c-kube-api-access-jzscl" (OuterVolumeSpecName: "kube-api-access-jzscl") pod "2198a381-a448-4f27-9437-3b302ffde37c" (UID: "2198a381-a448-4f27-9437-3b302ffde37c"). InnerVolumeSpecName "kube-api-access-jzscl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 17 15:06:16.345362 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:16.345281 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2198a381-a448-4f27-9437-3b302ffde37c-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "2198a381-a448-4f27-9437-3b302ffde37c" (UID: "2198a381-a448-4f27-9437-3b302ffde37c"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Apr 17 15:06:16.444542 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:16.444511 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jzscl\" (UniqueName: \"kubernetes.io/projected/2198a381-a448-4f27-9437-3b302ffde37c-kube-api-access-jzscl\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\"" Apr 17 15:06:16.444542 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:16.444540 2573 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2198a381-a448-4f27-9437-3b302ffde37c-must-gather-output\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\"" Apr 17 15:06:16.624696 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:16.624618 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2198a381-a448-4f27-9437-3b302ffde37c" path="/var/lib/kubelet/pods/2198a381-a448-4f27-9437-3b302ffde37c/volumes" Apr 17 15:06:16.893885 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:16.893813 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-q2msj_must-gather-jgrt7_2198a381-a448-4f27-9437-3b302ffde37c/copy/0.log" Apr 17 15:06:16.894150 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:16.894128 2573 generic.go:358] "Generic (PLEG): container finished" podID="2198a381-a448-4f27-9437-3b302ffde37c" containerID="4de48c0a682be8353ca0550a7774a231a81972e34ff84f4d8898b0fc1f5f94cc" exitCode=143 Apr 17 15:06:16.894211 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:16.894174 2573 scope.go:117] "RemoveContainer" containerID="4de48c0a682be8353ca0550a7774a231a81972e34ff84f4d8898b0fc1f5f94cc" Apr 17 15:06:16.894247 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:16.894238 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q2msj/must-gather-jgrt7" Apr 17 15:06:16.901631 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:16.901614 2573 scope.go:117] "RemoveContainer" containerID="5bf2ec5ba16677d53225f5223ced8a1de9812c043c9cfe9587ffc83a5b79ca80" Apr 17 15:06:16.913174 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:16.913157 2573 scope.go:117] "RemoveContainer" containerID="4de48c0a682be8353ca0550a7774a231a81972e34ff84f4d8898b0fc1f5f94cc" Apr 17 15:06:16.913410 ip-10-0-131-47 kubenswrapper[2573]: E0417 15:06:16.913394 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4de48c0a682be8353ca0550a7774a231a81972e34ff84f4d8898b0fc1f5f94cc\": container with ID starting with 4de48c0a682be8353ca0550a7774a231a81972e34ff84f4d8898b0fc1f5f94cc not found: ID does not exist" containerID="4de48c0a682be8353ca0550a7774a231a81972e34ff84f4d8898b0fc1f5f94cc" Apr 17 15:06:16.913454 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:16.913417 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4de48c0a682be8353ca0550a7774a231a81972e34ff84f4d8898b0fc1f5f94cc"} err="failed to get container status \"4de48c0a682be8353ca0550a7774a231a81972e34ff84f4d8898b0fc1f5f94cc\": rpc error: code = NotFound desc = could not find container \"4de48c0a682be8353ca0550a7774a231a81972e34ff84f4d8898b0fc1f5f94cc\": container with ID starting with 4de48c0a682be8353ca0550a7774a231a81972e34ff84f4d8898b0fc1f5f94cc not found: ID does not exist" Apr 17 15:06:16.913454 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:16.913435 2573 scope.go:117] "RemoveContainer" containerID="5bf2ec5ba16677d53225f5223ced8a1de9812c043c9cfe9587ffc83a5b79ca80" Apr 17 15:06:16.913656 ip-10-0-131-47 kubenswrapper[2573]: E0417 15:06:16.913640 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5bf2ec5ba16677d53225f5223ced8a1de9812c043c9cfe9587ffc83a5b79ca80\": container with ID starting with 5bf2ec5ba16677d53225f5223ced8a1de9812c043c9cfe9587ffc83a5b79ca80 not found: ID does not exist" containerID="5bf2ec5ba16677d53225f5223ced8a1de9812c043c9cfe9587ffc83a5b79ca80" Apr 17 15:06:16.913698 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:16.913660 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bf2ec5ba16677d53225f5223ced8a1de9812c043c9cfe9587ffc83a5b79ca80"} err="failed to get container status \"5bf2ec5ba16677d53225f5223ced8a1de9812c043c9cfe9587ffc83a5b79ca80\": rpc error: code = NotFound desc = could not find container \"5bf2ec5ba16677d53225f5223ced8a1de9812c043c9cfe9587ffc83a5b79ca80\": container with ID starting with 5bf2ec5ba16677d53225f5223ced8a1de9812c043c9cfe9587ffc83a5b79ca80 not found: ID does not exist" Apr 17 15:06:18.535395 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:18.535367 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_30b08991-dd86-428a-b15c-50075950f382/alertmanager/0.log" Apr 17 15:06:18.554575 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:18.554550 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_30b08991-dd86-428a-b15c-50075950f382/config-reloader/0.log" Apr 17 15:06:18.584869 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:18.584847 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_30b08991-dd86-428a-b15c-50075950f382/kube-rbac-proxy-web/0.log" Apr 17 15:06:18.604655 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:18.604629 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_30b08991-dd86-428a-b15c-50075950f382/kube-rbac-proxy/0.log" Apr 17 15:06:18.626638 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:18.626614 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_30b08991-dd86-428a-b15c-50075950f382/kube-rbac-proxy-metric/0.log" Apr 17 15:06:18.645413 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:18.645393 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_30b08991-dd86-428a-b15c-50075950f382/prom-label-proxy/0.log" Apr 17 15:06:18.663009 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:18.662989 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_30b08991-dd86-428a-b15c-50075950f382/init-config-reloader/0.log" Apr 17 15:06:18.705856 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:18.705804 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-75587bd455-jsfqq_0d16f0ef-1c78-4702-8694-f5c03fdb065b/cluster-monitoring-operator/0.log" Apr 17 15:06:18.791939 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:18.791875 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5bfd896cd5-2lsjv_68d85a25-0424-4cd5-9406-f978cd902241/metrics-server/0.log" Apr 17 15:06:18.812194 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:18.812173 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7dccd58f55-ccvd2_e9666b08-158c-4cf6-be87-86e937099375/monitoring-plugin/0.log" Apr 17 15:06:18.837781 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:18.837763 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2c2t6_71d47eeb-08ae-4c12-9082-6f8cd2c2d8fb/node-exporter/0.log" Apr 17 15:06:18.853166 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:18.853148 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2c2t6_71d47eeb-08ae-4c12-9082-6f8cd2c2d8fb/kube-rbac-proxy/0.log" Apr 17 15:06:18.871725 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:18.871708 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2c2t6_71d47eeb-08ae-4c12-9082-6f8cd2c2d8fb/init-textfile/0.log" Apr 17 15:06:19.020410 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:19.020384 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9d44df66c-jtv5k_7992c17a-fc81-48b6-8a2e-0b328dc8e0be/kube-rbac-proxy-main/0.log" Apr 17 15:06:19.036945 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:19.036920 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9d44df66c-jtv5k_7992c17a-fc81-48b6-8a2e-0b328dc8e0be/kube-rbac-proxy-self/0.log" Apr 17 15:06:19.053711 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:19.053637 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9d44df66c-jtv5k_7992c17a-fc81-48b6-8a2e-0b328dc8e0be/openshift-state-metrics/0.log" Apr 17 15:06:19.085756 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:19.085727 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8/prometheus/0.log" Apr 17 15:06:19.103179 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:19.103148 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8/config-reloader/0.log" Apr 17 15:06:19.122109 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:19.122086 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8/thanos-sidecar/0.log" Apr 17 15:06:19.138877 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:19.138859 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8/kube-rbac-proxy-web/0.log" Apr 17 15:06:19.155854 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:19.155837 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8/kube-rbac-proxy/0.log" Apr 17 15:06:19.173833 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:19.173816 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8/kube-rbac-proxy-thanos/0.log" Apr 17 15:06:19.192255 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:19.192239 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fee3849a-6a4f-4b90-8b25-cf2a9c2e52c8/init-config-reloader/0.log" Apr 17 15:06:19.220838 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:19.220808 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5676c8c784-k2tvr_6e1ecc2e-402b-422d-93ae-898fca47f8a1/prometheus-operator/0.log" Apr 17 15:06:19.234406 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:19.234375 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5676c8c784-k2tvr_6e1ecc2e-402b-422d-93ae-898fca47f8a1/kube-rbac-proxy/0.log" Apr 17 15:06:19.256138 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:19.256111 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-57cf98b594-tzhn4_786ddbf4-4340-4973-be6d-6f4390936345/prometheus-operator-admission-webhook/0.log" Apr 17 15:06:19.279307 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:19.279289 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-584c4d667d-6pbls_a4245b39-3601-4e3f-9ee6-f312dcb7048b/telemeter-client/0.log" Apr 17 15:06:19.298465 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:19.298447 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-584c4d667d-6pbls_a4245b39-3601-4e3f-9ee6-f312dcb7048b/reload/0.log" Apr 17 15:06:19.318596 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:19.318541 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-584c4d667d-6pbls_a4245b39-3601-4e3f-9ee6-f312dcb7048b/kube-rbac-proxy/0.log" Apr 17 15:06:19.340948 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:19.340928 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5bdb554c7b-94rmc_a86d4183-4bc6-429d-ac6b-9af46953e43f/thanos-query/0.log" Apr 17 15:06:19.359713 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:19.359694 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5bdb554c7b-94rmc_a86d4183-4bc6-429d-ac6b-9af46953e43f/kube-rbac-proxy-web/0.log" Apr 17 15:06:19.391673 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:19.391645 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5bdb554c7b-94rmc_a86d4183-4bc6-429d-ac6b-9af46953e43f/kube-rbac-proxy/0.log" Apr 17 15:06:19.414769 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:19.414745 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5bdb554c7b-94rmc_a86d4183-4bc6-429d-ac6b-9af46953e43f/prom-label-proxy/0.log" Apr 17 15:06:19.450922 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:19.450896 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5bdb554c7b-94rmc_a86d4183-4bc6-429d-ac6b-9af46953e43f/kube-rbac-proxy-rules/0.log" Apr 17 15:06:19.474143 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:19.474118 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5bdb554c7b-94rmc_a86d4183-4bc6-429d-ac6b-9af46953e43f/kube-rbac-proxy-metrics/0.log" Apr 17 15:06:20.558313 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:20.558232 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-cb95c66f6-zxr4r_2892c2c4-2d4e-4751-944f-0bceddeef837/networking-console-plugin/0.log" Apr 17 15:06:20.930817 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:20.930735 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-9d4b6777b-mslwt_fba84e6b-7f61-427c-94d1-489ee9dadc9e/console-operator/2.log" Apr 17 15:06:20.937963 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:20.937941 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-9d4b6777b-mslwt_fba84e6b-7f61-427c-94d1-489ee9dadc9e/console-operator/3.log" Apr 17 15:06:21.600615 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:21.600580 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-dfmtr/perf-node-gather-daemonset-kchb6"] Apr 17 15:06:21.601186 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:21.601167 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2198a381-a448-4f27-9437-3b302ffde37c" containerName="gather" Apr 17 15:06:21.601269 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:21.601189 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2198a381-a448-4f27-9437-3b302ffde37c" containerName="gather" Apr 17 15:06:21.601269 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:21.601205 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2198a381-a448-4f27-9437-3b302ffde37c" containerName="copy" Apr 17 15:06:21.601269 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:21.601213 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2198a381-a448-4f27-9437-3b302ffde37c" containerName="copy" Apr 17 15:06:21.601373 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:21.601312 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="2198a381-a448-4f27-9437-3b302ffde37c" containerName="gather" Apr 17 15:06:21.601373 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:21.601324 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="2198a381-a448-4f27-9437-3b302ffde37c" containerName="copy" Apr 17 15:06:21.604708 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:21.604687 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dfmtr/perf-node-gather-daemonset-kchb6" Apr 17 15:06:21.606934 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:21.606907 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dfmtr\"/\"kube-root-ca.crt\"" Apr 17 15:06:21.606934 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:21.606929 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dfmtr\"/\"openshift-service-ca.crt\"" Apr 17 15:06:21.607810 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:21.607782 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-dfmtr\"/\"default-dockercfg-4dlrr\"" Apr 17 15:06:21.610118 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:21.610098 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dfmtr/perf-node-gather-daemonset-kchb6"] Apr 17 15:06:21.688408 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:21.688378 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2b849449-08a1-4908-8784-a688aa4fd940-podres\") pod \"perf-node-gather-daemonset-kchb6\" (UID: \"2b849449-08a1-4908-8784-a688aa4fd940\") " pod="openshift-must-gather-dfmtr/perf-node-gather-daemonset-kchb6" Apr 17 15:06:21.688576 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:21.688441 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2b849449-08a1-4908-8784-a688aa4fd940-sys\") pod \"perf-node-gather-daemonset-kchb6\" (UID: \"2b849449-08a1-4908-8784-a688aa4fd940\") " pod="openshift-must-gather-dfmtr/perf-node-gather-daemonset-kchb6" Apr 17 15:06:21.688576 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:21.688506 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2b849449-08a1-4908-8784-a688aa4fd940-proc\") pod \"perf-node-gather-daemonset-kchb6\" (UID: \"2b849449-08a1-4908-8784-a688aa4fd940\") " pod="openshift-must-gather-dfmtr/perf-node-gather-daemonset-kchb6" Apr 17 15:06:21.688576 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:21.688555 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wwpl\" (UniqueName: \"kubernetes.io/projected/2b849449-08a1-4908-8784-a688aa4fd940-kube-api-access-9wwpl\") pod \"perf-node-gather-daemonset-kchb6\" (UID: \"2b849449-08a1-4908-8784-a688aa4fd940\") " pod="openshift-must-gather-dfmtr/perf-node-gather-daemonset-kchb6" Apr 17 15:06:21.688737 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:21.688612 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2b849449-08a1-4908-8784-a688aa4fd940-lib-modules\") pod \"perf-node-gather-daemonset-kchb6\" (UID: \"2b849449-08a1-4908-8784-a688aa4fd940\") " pod="openshift-must-gather-dfmtr/perf-node-gather-daemonset-kchb6" Apr 17 15:06:21.789351 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:21.789322 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2b849449-08a1-4908-8784-a688aa4fd940-podres\") pod \"perf-node-gather-daemonset-kchb6\" (UID: \"2b849449-08a1-4908-8784-a688aa4fd940\") " pod="openshift-must-gather-dfmtr/perf-node-gather-daemonset-kchb6" Apr 17 15:06:21.789482 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:21.789373 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2b849449-08a1-4908-8784-a688aa4fd940-sys\") pod \"perf-node-gather-daemonset-kchb6\" (UID: \"2b849449-08a1-4908-8784-a688aa4fd940\") " pod="openshift-must-gather-dfmtr/perf-node-gather-daemonset-kchb6" Apr 17 15:06:21.789482 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:21.789397 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2b849449-08a1-4908-8784-a688aa4fd940-proc\") pod \"perf-node-gather-daemonset-kchb6\" (UID: \"2b849449-08a1-4908-8784-a688aa4fd940\") " pod="openshift-must-gather-dfmtr/perf-node-gather-daemonset-kchb6" Apr 17 15:06:21.789482 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:21.789430 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9wwpl\" (UniqueName: \"kubernetes.io/projected/2b849449-08a1-4908-8784-a688aa4fd940-kube-api-access-9wwpl\") pod \"perf-node-gather-daemonset-kchb6\" (UID: \"2b849449-08a1-4908-8784-a688aa4fd940\") " pod="openshift-must-gather-dfmtr/perf-node-gather-daemonset-kchb6" Apr 17 15:06:21.789482 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:21.789464 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2b849449-08a1-4908-8784-a688aa4fd940-sys\") pod \"perf-node-gather-daemonset-kchb6\" (UID: \"2b849449-08a1-4908-8784-a688aa4fd940\") " pod="openshift-must-gather-dfmtr/perf-node-gather-daemonset-kchb6" Apr 17 15:06:21.789638 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:21.789469 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2b849449-08a1-4908-8784-a688aa4fd940-lib-modules\") pod \"perf-node-gather-daemonset-kchb6\" (UID: \"2b849449-08a1-4908-8784-a688aa4fd940\") " pod="openshift-must-gather-dfmtr/perf-node-gather-daemonset-kchb6" Apr 17 15:06:21.789638 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:21.789510 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2b849449-08a1-4908-8784-a688aa4fd940-proc\") pod \"perf-node-gather-daemonset-kchb6\" (UID: \"2b849449-08a1-4908-8784-a688aa4fd940\") " pod="openshift-must-gather-dfmtr/perf-node-gather-daemonset-kchb6" Apr 17 15:06:21.789638 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:21.789495 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2b849449-08a1-4908-8784-a688aa4fd940-podres\") pod \"perf-node-gather-daemonset-kchb6\" (UID: \"2b849449-08a1-4908-8784-a688aa4fd940\") " pod="openshift-must-gather-dfmtr/perf-node-gather-daemonset-kchb6" Apr 17 15:06:21.789638 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:21.789572 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2b849449-08a1-4908-8784-a688aa4fd940-lib-modules\") pod \"perf-node-gather-daemonset-kchb6\" (UID: \"2b849449-08a1-4908-8784-a688aa4fd940\") " pod="openshift-must-gather-dfmtr/perf-node-gather-daemonset-kchb6" Apr 17 15:06:21.796695 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:21.796670 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wwpl\" (UniqueName: \"kubernetes.io/projected/2b849449-08a1-4908-8784-a688aa4fd940-kube-api-access-9wwpl\") pod \"perf-node-gather-daemonset-kchb6\" (UID: \"2b849449-08a1-4908-8784-a688aa4fd940\") " pod="openshift-must-gather-dfmtr/perf-node-gather-daemonset-kchb6" Apr 17 15:06:21.915349 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:21.915286 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dfmtr/perf-node-gather-daemonset-kchb6" Apr 17 15:06:22.066774 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:22.066740 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dfmtr/perf-node-gather-daemonset-kchb6"] Apr 17 15:06:22.070492 ip-10-0-131-47 kubenswrapper[2573]: W0417 15:06:22.070464 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2b849449_08a1_4908_8784_a688aa4fd940.slice/crio-17505110a8bbef5e54329765b59c2a0be9c1897b86c05b6ff85022acb29ccc62 WatchSource:0}: Error finding container 17505110a8bbef5e54329765b59c2a0be9c1897b86c05b6ff85022acb29ccc62: Status 404 returned error can't find the container with id 17505110a8bbef5e54329765b59c2a0be9c1897b86c05b6ff85022acb29ccc62 Apr 17 15:06:22.331908 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:22.331882 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zrllc_75b3dec2-6f28-4d4d-ae26-d694cb6e25de/dns/0.log" Apr 17 15:06:22.347777 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:22.347749 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zrllc_75b3dec2-6f28-4d4d-ae26-d694cb6e25de/kube-rbac-proxy/0.log" Apr 17 15:06:22.403329 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:22.403305 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pqwhd_ab4fc13b-36d4-4f8b-9f8a-52c2424a807d/dns-node-resolver/0.log" Apr 17 15:06:22.818698 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:22.818668 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wfhf5_a44848f6-e8dc-4204-9db4-a4c4ca9cffdd/node-ca/0.log" Apr 17 15:06:22.916185 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:22.916155 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dfmtr/perf-node-gather-daemonset-kchb6" event={"ID":"2b849449-08a1-4908-8784-a688aa4fd940","Type":"ContainerStarted","Data":"6f219a05f507aa0dbde75b3fb818222bc1c5c5d94ae639e55425482f32ab8d63"} Apr 17 15:06:22.916185 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:22.916189 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dfmtr/perf-node-gather-daemonset-kchb6" event={"ID":"2b849449-08a1-4908-8784-a688aa4fd940","Type":"ContainerStarted","Data":"17505110a8bbef5e54329765b59c2a0be9c1897b86c05b6ff85022acb29ccc62"} Apr 17 15:06:22.916405 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:22.916298 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-dfmtr/perf-node-gather-daemonset-kchb6" Apr 17 15:06:22.932204 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:22.932163 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-dfmtr/perf-node-gather-daemonset-kchb6" podStartSLOduration=1.9321509639999999 podStartE2EDuration="1.932150964s" podCreationTimestamp="2026-04-17 15:06:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-17 15:06:22.930165231 +0000 UTC m=+2374.974594035" watchObservedRunningTime="2026-04-17 15:06:22.932150964 +0000 UTC m=+2374.976579770" Apr 17 15:06:23.733992 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:23.733947 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fwpd5_3c4b5228-3ecd-4956-b222-fa218091ebaf/serve-healthcheck-canary/0.log" Apr 17 15:06:24.072432 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:24.072354 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-585dfdc468-vmfdz_937afaa8-5b13-4dd9-9bba-cbe6d6606c4f/insights-operator/0.log" Apr 17 15:06:24.072843 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:24.072759 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-585dfdc468-vmfdz_937afaa8-5b13-4dd9-9bba-cbe6d6606c4f/insights-operator/1.log" Apr 17 15:06:24.149856 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:24.149838 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-c5jbb_c80a8ac8-eef8-4f03-8d83-63e2e428dea8/kube-rbac-proxy/0.log" Apr 17 15:06:24.167594 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:24.167576 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-c5jbb_c80a8ac8-eef8-4f03-8d83-63e2e428dea8/exporter/0.log" Apr 17 15:06:24.184525 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:24.184503 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-c5jbb_c80a8ac8-eef8-4f03-8d83-63e2e428dea8/extractor/0.log" Apr 17 15:06:25.743863 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:25.743803 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-operator-747c5859c7-5zdh6_96024d01-54b7-459d-b2c0-2aecfe59abd5/jobset-operator/0.log" Apr 17 15:06:28.524766 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:28.524739 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-74bb7799d9-qhps7_3492345b-fc9e-4e01-b9b3-5dfa31a8de37/migrator/0.log" Apr 17 15:06:28.539831 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:28.539808 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-74bb7799d9-qhps7_3492345b-fc9e-4e01-b9b3-5dfa31a8de37/graceful-termination/0.log" Apr 17 15:06:28.930339 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:28.930266 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-dfmtr/perf-node-gather-daemonset-kchb6" Apr 17 15:06:29.735483 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:29.735452 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dh4qj_1d47c42e-517c-405b-99a5-30609ea3d21d/kube-multus-additional-cni-plugins/0.log" Apr 17 15:06:29.754064 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:29.754037 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dh4qj_1d47c42e-517c-405b-99a5-30609ea3d21d/egress-router-binary-copy/0.log" Apr 17 15:06:29.770730 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:29.770708 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dh4qj_1d47c42e-517c-405b-99a5-30609ea3d21d/cni-plugins/0.log" Apr 17 15:06:29.789091 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:29.789066 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dh4qj_1d47c42e-517c-405b-99a5-30609ea3d21d/bond-cni-plugin/0.log" Apr 17 15:06:29.808338 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:29.808315 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dh4qj_1d47c42e-517c-405b-99a5-30609ea3d21d/routeoverride-cni/0.log" Apr 17 15:06:29.911082 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:29.911056 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dh4qj_1d47c42e-517c-405b-99a5-30609ea3d21d/whereabouts-cni-bincopy/0.log" Apr 17 15:06:29.926580 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:29.926559 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dh4qj_1d47c42e-517c-405b-99a5-30609ea3d21d/whereabouts-cni/0.log" Apr 17 15:06:30.112564 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:30.112482 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-j95gf_01db874f-c326-48bc-8c33-eeab64d1bf17/kube-multus/0.log" Apr 17 15:06:30.173519 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:30.173495 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-khctm_bedbded4-1a39-4b5a-b15a-2f9d05548508/network-metrics-daemon/0.log" Apr 17 15:06:30.188833 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:30.188807 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-khctm_bedbded4-1a39-4b5a-b15a-2f9d05548508/kube-rbac-proxy/0.log" Apr 17 15:06:31.521301 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:31.521269 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t4wf8_826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52/ovn-controller/0.log" Apr 17 15:06:31.535060 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:31.535028 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t4wf8_826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52/ovn-acl-logging/0.log" Apr 17 15:06:31.556373 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:31.556345 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t4wf8_826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52/ovn-acl-logging/1.log" Apr 17 15:06:31.574555 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:31.574528 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t4wf8_826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52/kube-rbac-proxy-node/0.log" Apr 17 15:06:31.592150 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:31.592122 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t4wf8_826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52/kube-rbac-proxy-ovn-metrics/0.log" Apr 17 15:06:31.605605 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:31.605585 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t4wf8_826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52/northd/0.log" Apr 17 15:06:31.621905 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:31.621882 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t4wf8_826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52/nbdb/0.log" Apr 17 15:06:31.639525 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:31.639505 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t4wf8_826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52/sbdb/0.log" Apr 17 15:06:31.791669 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:31.791602 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t4wf8_826a8fd1-f10a-48b9-b0a8-6a22a6fb1a52/ovnkube-controller/0.log" Apr 17 15:06:32.774751 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:32.774670 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-n9zdz_928be529-e62e-4b1a-8221-cf0def914796/network-check-target-container/0.log" Apr 17 15:06:33.573482 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:33.573450 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-2jvxm_574ada25-3a36-4d49-be15-436687239f1a/iptables-alerter/0.log" Apr 17 15:06:34.161453 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:34.161417 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-sj9xp_7c85ebb8-909c-4ad2-affb-b7280f1cce30/tuned/0.log" Apr 17 15:06:36.613705 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:36.613670 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-d6fc45fc5-lxq9m_bcfc0e78-bf12-499f-874d-3b0c3b9f6e21/service-ca-operator/1.log" Apr 17 15:06:36.615918 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:36.615896 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-d6fc45fc5-lxq9m_bcfc0e78-bf12-499f-874d-3b0c3b9f6e21/service-ca-operator/0.log" Apr 17 15:06:36.891526 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:36.891452 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca_service-ca-865cb79987-b52hc_ad46b9f7-7a11-4768-b680-bb15f38144c8/service-ca-controller/0.log" Apr 17 15:06:37.361548 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:37.361514 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-ss8x7_e3b540b1-5c0c-463a-8b61-9e636cd837c1/csi-driver/0.log" Apr 17 15:06:37.378164 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:37.378131 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-ss8x7_e3b540b1-5c0c-463a-8b61-9e636cd837c1/csi-node-driver-registrar/0.log" Apr 17 15:06:37.394573 ip-10-0-131-47 kubenswrapper[2573]: I0417 15:06:37.394545 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-ss8x7_e3b540b1-5c0c-463a-8b61-9e636cd837c1/csi-liveness-probe/0.log"