Jun 09 08:45:22.417054 ip-10-0-140-114 systemd[1]: Starting Kubernetes Kubelet... Jun 09 08:45:22.895690 ip-10-0-140-114 kubenswrapper[2567]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 08:45:22.895690 ip-10-0-140-114 kubenswrapper[2567]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 09 08:45:22.895690 ip-10-0-140-114 kubenswrapper[2567]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 08:45:22.895690 ip-10-0-140-114 kubenswrapper[2567]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 09 08:45:22.895690 ip-10-0-140-114 kubenswrapper[2567]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 08:45:22.896359 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.895775 2567 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 09 08:45:22.902399 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902377 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 08:45:22.902399 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902394 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 09 08:45:22.902399 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902397 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 08:45:22.902399 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902401 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 08:45:22.902515 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902405 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 08:45:22.902515 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902408 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 08:45:22.902515 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902411 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 08:45:22.902515 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902414 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 08:45:22.902515 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902419 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 08:45:22.902515 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902423 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 08:45:22.902515 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902426 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 08:45:22.902515 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902429 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 08:45:22.902515 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902432 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 08:45:22.902515 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902435 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 08:45:22.902515 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902437 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 08:45:22.902515 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902440 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 08:45:22.902515 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902442 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 08:45:22.902515 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902445 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 08:45:22.902515 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902448 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 08:45:22.902515 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902451 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 08:45:22.902515 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902454 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 08:45:22.902515 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902457 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 08:45:22.902515 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902460 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 08:45:22.902515 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902463 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 08:45:22.903003 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902465 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 08:45:22.903003 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902468 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 08:45:22.903003 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902471 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 08:45:22.903003 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902473 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 08:45:22.903003 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902476 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 08:45:22.903003 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902478 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 08:45:22.903003 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902481 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 08:45:22.903003 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902483 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 08:45:22.903003 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902486 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 08:45:22.903003 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902488 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 08:45:22.903003 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902491 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 08:45:22.903003 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902494 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 08:45:22.903003 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902496 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 08:45:22.903003 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902500 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 08:45:22.903003 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902504 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 08:45:22.903003 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902507 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 08:45:22.903003 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902509 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 08:45:22.903003 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902512 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 08:45:22.903003 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902515 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 08:45:22.903003 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902518 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 08:45:22.903499 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902521 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 08:45:22.903499 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902523 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 08:45:22.903499 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902526 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 08:45:22.903499 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902529 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 08:45:22.903499 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902532 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 08:45:22.903499 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902535 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 08:45:22.903499 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902537 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 08:45:22.903499 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902540 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 08:45:22.903499 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902542 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 08:45:22.903499 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902545 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 08:45:22.903499 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902547 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 08:45:22.903499 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902550 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 08:45:22.903499 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902553 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 08:45:22.903499 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902555 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 08:45:22.903499 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902559 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 08:45:22.903499 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902563 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 08:45:22.903499 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902566 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 08:45:22.903499 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902570 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 08:45:22.903499 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902573 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 08:45:22.903983 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902576 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 08:45:22.903983 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902579 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 08:45:22.903983 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902582 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 08:45:22.903983 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902585 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 08:45:22.903983 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902587 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 08:45:22.903983 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902590 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 08:45:22.903983 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902594 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 08:45:22.903983 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902597 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 08:45:22.903983 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902600 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 08:45:22.903983 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902603 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 08:45:22.903983 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902607 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 08:45:22.903983 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902610 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 08:45:22.903983 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902613 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 08:45:22.903983 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902615 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 08:45:22.903983 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902618 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 08:45:22.903983 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902621 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 08:45:22.903983 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902623 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 08:45:22.903983 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902626 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 08:45:22.903983 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902629 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 08:45:22.904449 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902631 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 08:45:22.904449 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902634 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 08:45:22.904449 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902637 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 08:45:22.904449 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902639 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 08:45:22.904449 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902642 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 08:45:22.904449 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902644 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 08:45:22.904449 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902661 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 08:45:22.904449 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902665 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 08:45:22.904449 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902669 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 08:45:22.904449 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902674 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 08:45:22.904449 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902678 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 08:45:22.904449 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902682 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 08:45:22.904449 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902685 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 08:45:22.904449 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902688 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 08:45:22.904449 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902691 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 08:45:22.904449 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902693 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 08:45:22.904449 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.902696 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 08:45:22.904449 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904087 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 08:45:22.904449 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904096 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 08:45:22.904449 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904100 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 08:45:22.904942 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904103 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 08:45:22.904942 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904106 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 08:45:22.904942 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904109 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 08:45:22.904942 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904112 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 08:45:22.904942 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904115 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 08:45:22.904942 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904117 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 08:45:22.904942 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904120 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 08:45:22.904942 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904123 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 08:45:22.904942 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904125 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 08:45:22.904942 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904128 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 08:45:22.904942 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904131 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 08:45:22.904942 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904133 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 08:45:22.904942 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904136 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 08:45:22.904942 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904139 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 08:45:22.904942 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904142 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 08:45:22.904942 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904145 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 08:45:22.904942 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904147 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 08:45:22.904942 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904150 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 08:45:22.904942 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904152 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 08:45:22.904942 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904155 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 08:45:22.904942 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904157 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 08:45:22.905518 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904160 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 08:45:22.905518 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904163 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 08:45:22.905518 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904165 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 08:45:22.905518 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904168 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 08:45:22.905518 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904171 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 08:45:22.905518 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904173 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 08:45:22.905518 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904176 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 08:45:22.905518 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904178 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 08:45:22.905518 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904181 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 08:45:22.905518 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904184 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 08:45:22.905518 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904186 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 08:45:22.905518 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904189 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 08:45:22.905518 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904191 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 08:45:22.905518 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904194 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 08:45:22.905518 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904197 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 08:45:22.905518 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904200 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 08:45:22.905518 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904203 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 08:45:22.905518 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904205 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 08:45:22.905518 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904209 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 08:45:22.906003 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904212 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 08:45:22.906003 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904215 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 08:45:22.906003 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904218 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 08:45:22.906003 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904221 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 08:45:22.906003 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904223 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 08:45:22.906003 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904227 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 08:45:22.906003 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904230 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 08:45:22.906003 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904233 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 08:45:22.906003 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904235 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 08:45:22.906003 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904238 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 08:45:22.906003 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904240 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 08:45:22.906003 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904244 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 08:45:22.906003 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904247 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 08:45:22.906003 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904249 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 08:45:22.906003 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904252 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 08:45:22.906003 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904254 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 08:45:22.906003 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904257 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 08:45:22.906003 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904260 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 08:45:22.906003 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904262 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 08:45:22.906003 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904265 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 08:45:22.906496 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904268 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 08:45:22.906496 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904272 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 08:45:22.906496 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904276 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 08:45:22.906496 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904278 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 08:45:22.906496 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904281 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 08:45:22.906496 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904283 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 08:45:22.906496 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904286 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 08:45:22.906496 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904289 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 08:45:22.906496 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904292 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 08:45:22.906496 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904295 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 08:45:22.906496 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904297 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 09 08:45:22.906496 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904300 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 08:45:22.906496 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904303 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 08:45:22.906496 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904305 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 08:45:22.906496 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904308 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 08:45:22.906496 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904310 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 08:45:22.906496 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904313 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 08:45:22.906496 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904316 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 08:45:22.906496 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904319 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 08:45:22.906993 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904322 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 08:45:22.906993 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904327 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 08:45:22.906993 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904330 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 08:45:22.906993 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904333 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 08:45:22.906993 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904336 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 08:45:22.906993 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904339 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 08:45:22.906993 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904342 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 08:45:22.906993 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904344 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 08:45:22.906993 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904347 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 08:45:22.906993 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904349 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 08:45:22.906993 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904352 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 08:45:22.906993 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904355 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 08:45:22.906993 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904357 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 08:45:22.906993 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904359 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 08:45:22.906993 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904362 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 08:45:22.906993 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904365 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 08:45:22.906993 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904368 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 08:45:22.906993 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904751 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 08:45:22.906993 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904756 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 08:45:22.907461 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904758 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 08:45:22.907461 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904761 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 08:45:22.907461 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904764 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 08:45:22.907461 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904768 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 08:45:22.907461 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904770 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 08:45:22.907461 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904773 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 08:45:22.907461 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904776 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 08:45:22.907461 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904778 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 08:45:22.907461 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904781 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 08:45:22.907461 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904783 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 08:45:22.907461 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904786 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 08:45:22.907461 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904789 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 08:45:22.907461 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904792 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 08:45:22.907461 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904794 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 08:45:22.907461 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904797 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 08:45:22.907461 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904800 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 08:45:22.907461 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904802 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 08:45:22.907461 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904805 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 08:45:22.907461 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904807 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 08:45:22.907461 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904810 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 08:45:22.907991 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904813 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 08:45:22.907991 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904815 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 08:45:22.907991 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904818 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 08:45:22.907991 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904821 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 08:45:22.907991 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904823 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 08:45:22.907991 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904826 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 08:45:22.907991 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904828 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 08:45:22.907991 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904831 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 08:45:22.907991 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904834 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 08:45:22.907991 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904837 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 08:45:22.907991 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904839 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 08:45:22.907991 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904843 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 08:45:22.907991 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904847 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 08:45:22.907991 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904849 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 08:45:22.907991 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904852 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 08:45:22.907991 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904855 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 08:45:22.907991 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904859 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 08:45:22.907991 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904861 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 08:45:22.907991 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904864 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 08:45:22.907991 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904866 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 08:45:22.908483 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904869 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 08:45:22.908483 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904871 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 08:45:22.908483 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904875 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 08:45:22.908483 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904878 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 08:45:22.908483 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904881 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 08:45:22.908483 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904885 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 08:45:22.908483 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904888 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 08:45:22.908483 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904892 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 08:45:22.908483 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904894 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 08:45:22.908483 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904897 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 08:45:22.908483 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904900 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 08:45:22.908483 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904903 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 08:45:22.908483 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904906 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 08:45:22.908483 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904909 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 08:45:22.908483 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904912 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 08:45:22.908483 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904914 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 09 08:45:22.908483 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904917 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 08:45:22.908483 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904920 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 08:45:22.908483 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904922 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 08:45:22.908483 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904926 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 08:45:22.908995 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904929 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 08:45:22.908995 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904931 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 08:45:22.908995 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904934 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 08:45:22.908995 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904937 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 08:45:22.908995 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904939 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 08:45:22.908995 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904942 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 08:45:22.908995 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904945 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 08:45:22.908995 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904947 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 08:45:22.908995 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904950 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 08:45:22.908995 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904953 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 08:45:22.908995 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904957 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 08:45:22.908995 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904959 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 08:45:22.908995 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904962 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 08:45:22.908995 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904964 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 08:45:22.908995 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904967 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 08:45:22.908995 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904970 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 08:45:22.908995 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904972 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 08:45:22.908995 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904975 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 08:45:22.908995 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904977 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 08:45:22.908995 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904980 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 08:45:22.909484 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904982 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 08:45:22.909484 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904985 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 08:45:22.909484 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904987 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 08:45:22.909484 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904990 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 08:45:22.909484 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904994 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 08:45:22.909484 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.904997 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 08:45:22.909484 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905000 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 08:45:22.909484 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905003 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 08:45:22.909484 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905006 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 08:45:22.909484 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905008 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 08:45:22.909484 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905011 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 08:45:22.909484 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905014 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 08:45:22.909484 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905017 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 08:45:22.909484 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905019 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 08:45:22.909484 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905022 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 08:45:22.909484 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905024 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 08:45:22.909484 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905027 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 08:45:22.909484 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905097 2567 flags.go:64] FLAG: --address="0.0.0.0" Jun 09 08:45:22.909484 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905105 2567 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 09 08:45:22.909484 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905111 2567 flags.go:64] FLAG: --anonymous-auth="true" Jun 09 08:45:22.910025 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905116 2567 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 09 08:45:22.910025 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905121 2567 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 09 08:45:22.910025 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905124 2567 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 09 08:45:22.910025 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905129 2567 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 09 08:45:22.910025 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905133 2567 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 09 08:45:22.910025 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905137 2567 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 09 08:45:22.910025 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905140 2567 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 09 08:45:22.910025 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905144 2567 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 09 08:45:22.910025 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905147 2567 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 09 08:45:22.910025 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905150 2567 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 09 08:45:22.910025 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905153 2567 flags.go:64] FLAG: --cgroup-root="" Jun 09 08:45:22.910025 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905156 2567 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 09 08:45:22.910025 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905159 2567 flags.go:64] FLAG: --client-ca-file="" Jun 09 08:45:22.910025 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905162 2567 flags.go:64] FLAG: --cloud-provider="external" Jun 09 08:45:22.910025 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905165 2567 flags.go:64] FLAG: --cluster-dns="[]" Jun 09 08:45:22.910025 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905170 2567 flags.go:64] FLAG: --cluster-domain="" Jun 09 08:45:22.910025 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905173 2567 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 09 08:45:22.910025 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905176 2567 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 09 08:45:22.910025 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905179 2567 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 09 08:45:22.910025 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905183 2567 flags.go:64] FLAG: --container-log-max-files="5" Jun 09 08:45:22.910025 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905186 2567 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 09 08:45:22.910025 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905189 2567 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 09 08:45:22.910025 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905192 2567 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 09 08:45:22.910589 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905196 2567 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 09 08:45:22.910589 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905199 2567 flags.go:64] FLAG: --contention-profiling="false" Jun 09 08:45:22.910589 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905202 2567 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 09 08:45:22.910589 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905205 2567 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 09 08:45:22.910589 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905208 2567 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 09 08:45:22.910589 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905212 2567 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 09 08:45:22.910589 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905216 2567 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 09 08:45:22.910589 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905219 2567 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 09 08:45:22.910589 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905222 2567 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 09 08:45:22.910589 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905226 2567 flags.go:64] FLAG: --enable-load-reader="false" Jun 09 08:45:22.910589 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905229 2567 flags.go:64] FLAG: --enable-server="true" Jun 09 08:45:22.910589 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905232 2567 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 09 08:45:22.910589 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905236 2567 flags.go:64] FLAG: --event-burst="100" Jun 09 08:45:22.910589 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905240 2567 flags.go:64] FLAG: --event-qps="50" Jun 09 08:45:22.910589 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905243 2567 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 09 08:45:22.910589 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905246 2567 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 09 08:45:22.910589 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905249 2567 flags.go:64] FLAG: --eviction-hard="" Jun 09 08:45:22.910589 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905252 2567 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 09 08:45:22.910589 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905255 2567 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 09 08:45:22.910589 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905258 2567 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 09 08:45:22.910589 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905261 2567 flags.go:64] FLAG: --eviction-soft="" Jun 09 08:45:22.910589 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905264 2567 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 09 08:45:22.910589 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905267 2567 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 09 08:45:22.910589 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905270 2567 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 09 08:45:22.910589 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905273 2567 flags.go:64] FLAG: --experimental-mounter-path="" Jun 09 08:45:22.911240 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905275 2567 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 09 08:45:22.911240 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905278 2567 flags.go:64] FLAG: --fail-swap-on="true" Jun 09 08:45:22.911240 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905281 2567 flags.go:64] FLAG: --feature-gates="" Jun 09 08:45:22.911240 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905285 2567 flags.go:64] FLAG: --file-check-frequency="20s" Jun 09 08:45:22.911240 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905288 2567 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 09 08:45:22.911240 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905291 2567 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 09 08:45:22.911240 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905294 2567 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 09 08:45:22.911240 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905297 2567 flags.go:64] FLAG: --healthz-port="10248" Jun 09 08:45:22.911240 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905301 2567 flags.go:64] FLAG: --help="false" Jun 09 08:45:22.911240 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905303 2567 flags.go:64] FLAG: --hostname-override="ip-10-0-140-114.ec2.internal" Jun 09 08:45:22.911240 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905307 2567 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 09 08:45:22.911240 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905309 2567 flags.go:64] FLAG: --http-check-frequency="20s" Jun 09 08:45:22.911240 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905315 2567 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 09 08:45:22.911240 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905318 2567 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 09 08:45:22.911240 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905322 2567 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 09 08:45:22.911240 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905324 2567 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 09 08:45:22.911240 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905327 2567 flags.go:64] FLAG: --image-service-endpoint="" Jun 09 08:45:22.911240 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905330 2567 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 09 08:45:22.911240 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905333 2567 flags.go:64] FLAG: --kube-api-burst="100" Jun 09 08:45:22.911240 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905336 2567 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 09 08:45:22.911240 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905340 2567 flags.go:64] FLAG: --kube-api-qps="50" Jun 09 08:45:22.911240 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905343 2567 flags.go:64] FLAG: --kube-reserved="" Jun 09 08:45:22.911240 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905346 2567 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 09 08:45:22.911240 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905348 2567 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 09 08:45:22.911892 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905352 2567 flags.go:64] FLAG: --kubelet-cgroups="" Jun 09 08:45:22.911892 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905354 2567 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 09 08:45:22.911892 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905357 2567 flags.go:64] FLAG: --lock-file="" Jun 09 08:45:22.911892 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905360 2567 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 09 08:45:22.911892 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905363 2567 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 09 08:45:22.911892 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905366 2567 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 09 08:45:22.911892 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905371 2567 flags.go:64] FLAG: --log-json-split-stream="false" Jun 09 08:45:22.911892 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905374 2567 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 09 08:45:22.911892 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905377 2567 flags.go:64] FLAG: --log-text-split-stream="false" Jun 09 08:45:22.911892 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905379 2567 flags.go:64] FLAG: --logging-format="text" Jun 09 08:45:22.911892 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905382 2567 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 09 08:45:22.911892 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905385 2567 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 09 08:45:22.911892 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905388 2567 flags.go:64] FLAG: --manifest-url="" Jun 09 08:45:22.911892 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905391 2567 flags.go:64] FLAG: --manifest-url-header="" Jun 09 08:45:22.911892 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905396 2567 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 09 08:45:22.911892 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905400 2567 flags.go:64] FLAG: --max-open-files="1000000" Jun 09 08:45:22.911892 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905405 2567 flags.go:64] FLAG: --max-pods="110" Jun 09 08:45:22.911892 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905407 2567 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 09 08:45:22.911892 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905411 2567 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 09 08:45:22.911892 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905413 2567 flags.go:64] FLAG: --memory-manager-policy="None" Jun 09 08:45:22.911892 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905417 2567 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 09 08:45:22.911892 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905421 2567 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 09 08:45:22.911892 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905424 2567 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 09 08:45:22.911892 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905427 2567 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 09 08:45:22.911892 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905434 2567 flags.go:64] FLAG: --node-status-max-images="50" Jun 09 08:45:22.912513 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905437 2567 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 09 08:45:22.912513 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905440 2567 flags.go:64] FLAG: --oom-score-adj="-999" Jun 09 08:45:22.912513 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905443 2567 flags.go:64] FLAG: --pod-cidr="" Jun 09 08:45:22.912513 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905447 2567 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 09 08:45:22.912513 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905452 2567 flags.go:64] FLAG: --pod-manifest-path="" Jun 09 08:45:22.912513 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905455 2567 flags.go:64] FLAG: --pod-max-pids="-1" Jun 09 08:45:22.912513 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905458 2567 flags.go:64] FLAG: --pods-per-core="0" Jun 09 08:45:22.912513 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905461 2567 flags.go:64] FLAG: --port="10250" Jun 09 08:45:22.912513 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905464 2567 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 09 08:45:22.912513 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905467 2567 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a2b0c124aca2f7f9" Jun 09 08:45:22.912513 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905470 2567 flags.go:64] FLAG: --qos-reserved="" Jun 09 08:45:22.912513 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905473 2567 flags.go:64] FLAG: --read-only-port="10255" Jun 09 08:45:22.912513 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905476 2567 flags.go:64] FLAG: --register-node="true" Jun 09 08:45:22.912513 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905479 2567 flags.go:64] FLAG: --register-with-taints="" Jun 09 08:45:22.912513 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905483 2567 flags.go:64] FLAG: --registry-burst="10" Jun 09 08:45:22.912513 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905486 2567 flags.go:64] FLAG: --registry-qps="5" Jun 09 08:45:22.912513 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905489 2567 flags.go:64] FLAG: --reserved-cpus="" Jun 09 08:45:22.912513 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905491 2567 flags.go:64] FLAG: --reserved-memory="" Jun 09 08:45:22.912513 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905498 2567 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 09 08:45:22.912513 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905501 2567 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 09 08:45:22.912513 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905504 2567 flags.go:64] FLAG: --rotate-certificates="false" Jun 09 08:45:22.912513 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905507 2567 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 09 08:45:22.912513 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905511 2567 flags.go:64] FLAG: --runonce="false" Jun 09 08:45:22.912513 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905514 2567 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 09 08:45:22.912513 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905517 2567 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 09 08:45:22.913157 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905521 2567 flags.go:64] FLAG: --seccomp-default="false" Jun 09 08:45:22.913157 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905524 2567 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 09 08:45:22.913157 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905527 2567 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 09 08:45:22.913157 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905532 2567 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 09 08:45:22.913157 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905535 2567 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 09 08:45:22.913157 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905538 2567 flags.go:64] FLAG: --storage-driver-password="root" Jun 09 08:45:22.913157 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905541 2567 flags.go:64] FLAG: --storage-driver-secure="false" Jun 09 08:45:22.913157 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905544 2567 flags.go:64] FLAG: --storage-driver-table="stats" Jun 09 08:45:22.913157 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905547 2567 flags.go:64] FLAG: --storage-driver-user="root" Jun 09 08:45:22.913157 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905550 2567 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 09 08:45:22.913157 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905553 2567 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 09 08:45:22.913157 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905556 2567 flags.go:64] FLAG: --system-cgroups="" Jun 09 08:45:22.913157 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905559 2567 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 09 08:45:22.913157 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905564 2567 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 09 08:45:22.913157 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905567 2567 flags.go:64] FLAG: --tls-cert-file="" Jun 09 08:45:22.913157 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905570 2567 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 09 08:45:22.913157 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905574 2567 flags.go:64] FLAG: --tls-min-version="" Jun 09 08:45:22.913157 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905577 2567 flags.go:64] FLAG: --tls-private-key-file="" Jun 09 08:45:22.913157 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905580 2567 flags.go:64] FLAG: --topology-manager-policy="none" Jun 09 08:45:22.913157 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905583 2567 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 09 08:45:22.913157 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905586 2567 flags.go:64] FLAG: --topology-manager-scope="container" Jun 09 08:45:22.913157 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905589 2567 flags.go:64] FLAG: --v="2" Jun 09 08:45:22.913157 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905593 2567 flags.go:64] FLAG: --version="false" Jun 09 08:45:22.913157 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905597 2567 flags.go:64] FLAG: --vmodule="" Jun 09 08:45:22.913157 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905601 2567 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 09 08:45:22.913835 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.905604 2567 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 09 08:45:22.913835 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905738 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 08:45:22.913835 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905742 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 08:45:22.913835 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905745 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 08:45:22.913835 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905750 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 08:45:22.913835 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905753 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 08:45:22.913835 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905756 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 08:45:22.913835 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905759 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 08:45:22.913835 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905762 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 08:45:22.913835 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905765 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 08:45:22.913835 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905769 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 08:45:22.913835 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905772 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 08:45:22.913835 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905774 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 08:45:22.913835 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905777 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 08:45:22.913835 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905780 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 08:45:22.913835 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905784 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 08:45:22.913835 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905788 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 08:45:22.913835 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905792 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 08:45:22.913835 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905795 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 08:45:22.914311 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905799 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 08:45:22.914311 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905801 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 08:45:22.914311 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905804 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 08:45:22.914311 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905807 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 08:45:22.914311 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905809 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 08:45:22.914311 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905812 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 08:45:22.914311 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905814 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 08:45:22.914311 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905817 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 08:45:22.914311 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905820 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 08:45:22.914311 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905823 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 08:45:22.914311 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905825 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 08:45:22.914311 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905828 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 08:45:22.914311 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905831 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 08:45:22.914311 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905833 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 08:45:22.914311 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905836 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 08:45:22.914311 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905839 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 08:45:22.914311 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905841 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 08:45:22.914311 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905846 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 08:45:22.914311 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905848 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 08:45:22.914311 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905851 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 08:45:22.914853 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905853 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 08:45:22.914853 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905856 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 08:45:22.914853 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905859 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 08:45:22.914853 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905863 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 08:45:22.914853 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905865 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 08:45:22.914853 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905868 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 08:45:22.914853 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905870 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 08:45:22.914853 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905873 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 08:45:22.914853 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905876 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 08:45:22.914853 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905878 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 08:45:22.914853 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905881 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 08:45:22.914853 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905883 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 08:45:22.914853 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905886 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 08:45:22.914853 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905889 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 08:45:22.914853 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905892 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 08:45:22.914853 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905894 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 08:45:22.914853 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905897 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 08:45:22.914853 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905899 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 08:45:22.914853 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905902 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 08:45:22.914853 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905904 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 08:45:22.915427 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905907 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 08:45:22.915427 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905909 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 08:45:22.915427 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905912 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 08:45:22.915427 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905914 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 08:45:22.915427 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905917 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 08:45:22.915427 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905919 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 08:45:22.915427 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905922 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 08:45:22.915427 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905924 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 08:45:22.915427 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905927 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 08:45:22.915427 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905931 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 09 08:45:22.915427 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905933 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 08:45:22.915427 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905936 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 08:45:22.915427 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905938 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 08:45:22.915427 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905941 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 08:45:22.915427 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905944 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 08:45:22.915427 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905948 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 08:45:22.915427 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905951 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 08:45:22.915427 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905953 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 08:45:22.915427 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905956 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 08:45:22.915427 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905959 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 08:45:22.915941 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905961 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 08:45:22.915941 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905964 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 08:45:22.915941 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905966 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 08:45:22.915941 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905969 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 08:45:22.915941 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905971 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 08:45:22.915941 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905974 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 08:45:22.915941 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905978 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 08:45:22.915941 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905980 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 08:45:22.915941 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905983 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 08:45:22.915941 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905985 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 08:45:22.915941 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905988 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 08:45:22.915941 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905991 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 08:45:22.915941 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905994 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 08:45:22.915941 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.905997 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 08:45:22.915941 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.906001 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 08:45:22.915941 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.906004 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 08:45:22.915941 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.906007 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 08:45:22.915941 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.906009 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 08:45:22.915941 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.906012 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 08:45:22.916397 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.906015 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 08:45:22.916397 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.906018 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 08:45:22.916397 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.906028 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 08:45:22.916397 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.913154 2567 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 09 08:45:22.916397 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.913170 2567 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 09 08:45:22.916397 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.913188 2567 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 09 08:45:22.916397 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.913193 2567 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 09 08:45:22.916397 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913250 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 08:45:22.916397 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913255 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 08:45:22.916397 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913258 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 08:45:22.916397 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913261 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 08:45:22.916397 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913264 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 08:45:22.916397 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913267 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 08:45:22.916397 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913270 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 08:45:22.916767 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913273 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 08:45:22.916767 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913275 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 08:45:22.916767 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913278 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 08:45:22.916767 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913281 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 08:45:22.916767 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913284 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 08:45:22.916767 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913287 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 08:45:22.916767 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913290 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 08:45:22.916767 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913293 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 08:45:22.916767 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913295 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 08:45:22.916767 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913298 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 08:45:22.916767 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913301 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 08:45:22.916767 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913303 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 08:45:22.916767 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913306 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 08:45:22.916767 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913308 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 08:45:22.916767 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913311 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 08:45:22.916767 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913315 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 08:45:22.916767 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913318 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 08:45:22.916767 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913321 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 08:45:22.916767 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913323 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 08:45:22.916767 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913326 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 08:45:22.917254 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913328 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 08:45:22.917254 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913331 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 08:45:22.917254 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913335 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 08:45:22.917254 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913338 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 08:45:22.917254 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913341 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 08:45:22.917254 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913344 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 08:45:22.917254 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913347 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 08:45:22.917254 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913350 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 08:45:22.917254 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913352 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 08:45:22.917254 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913356 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 08:45:22.917254 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913358 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 08:45:22.917254 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913361 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 08:45:22.917254 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913364 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 08:45:22.917254 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913366 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 08:45:22.917254 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913369 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 08:45:22.917254 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913372 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 08:45:22.917254 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913374 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 08:45:22.917254 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913378 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 08:45:22.917254 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913383 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 08:45:22.917748 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913386 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 08:45:22.917748 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913389 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 08:45:22.917748 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913392 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 08:45:22.917748 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913395 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 08:45:22.917748 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913398 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 08:45:22.917748 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913401 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 08:45:22.917748 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913403 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 08:45:22.917748 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913406 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 08:45:22.917748 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913409 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 08:45:22.917748 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913411 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 08:45:22.917748 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913413 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 08:45:22.917748 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913416 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 09 08:45:22.917748 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913419 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 08:45:22.917748 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913421 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 08:45:22.917748 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913424 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 08:45:22.917748 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913427 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 08:45:22.917748 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913430 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 08:45:22.917748 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913433 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 08:45:22.917748 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913435 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 08:45:22.917748 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913438 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 08:45:22.918229 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913441 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 08:45:22.918229 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913443 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 08:45:22.918229 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913446 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 08:45:22.918229 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913449 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 08:45:22.918229 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913451 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 08:45:22.918229 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913454 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 08:45:22.918229 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913457 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 08:45:22.918229 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913459 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 08:45:22.918229 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913462 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 08:45:22.918229 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913464 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 08:45:22.918229 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913467 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 08:45:22.918229 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913469 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 08:45:22.918229 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913472 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 08:45:22.918229 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913475 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 08:45:22.918229 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913477 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 08:45:22.918229 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913480 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 08:45:22.918229 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913482 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 08:45:22.918229 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913486 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 08:45:22.918229 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913490 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 08:45:22.918711 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913493 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 08:45:22.918711 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913497 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 08:45:22.918711 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913500 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 08:45:22.918711 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913504 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 08:45:22.918711 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913507 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 08:45:22.918711 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913509 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 08:45:22.918711 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913512 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 08:45:22.918711 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913515 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 08:45:22.918711 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913518 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 08:45:22.918711 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913521 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 08:45:22.918711 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913524 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 08:45:22.918711 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913526 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 08:45:22.918711 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913529 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 08:45:22.918711 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913532 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 08:45:22.918711 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.913537 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 08:45:22.919081 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913672 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 08:45:22.919081 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913678 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 08:45:22.919081 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913682 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 08:45:22.919081 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913686 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 08:45:22.919081 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913689 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 08:45:22.919081 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913692 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 08:45:22.919081 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913694 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 08:45:22.919081 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913697 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 08:45:22.919081 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913700 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 08:45:22.919081 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913703 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 08:45:22.919081 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913706 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 08:45:22.919081 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913710 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 08:45:22.919081 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913713 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 08:45:22.919081 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913716 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 08:45:22.919081 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913718 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 08:45:22.919081 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913721 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 08:45:22.919081 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913723 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 08:45:22.919081 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913726 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 08:45:22.919081 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913728 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 08:45:22.919561 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913731 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 08:45:22.919561 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913734 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 08:45:22.919561 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913736 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 08:45:22.919561 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913739 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 08:45:22.919561 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913741 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 08:45:22.919561 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913744 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 08:45:22.919561 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913747 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 08:45:22.919561 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913750 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 08:45:22.919561 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913753 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 08:45:22.919561 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913755 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 08:45:22.919561 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913758 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 08:45:22.919561 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913760 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 08:45:22.919561 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913763 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 08:45:22.919561 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913766 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 08:45:22.919561 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913768 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 08:45:22.919561 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913771 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 08:45:22.919561 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913773 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 08:45:22.919561 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913776 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 08:45:22.919561 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913778 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 08:45:22.920048 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913781 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 08:45:22.920048 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913783 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 08:45:22.920048 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913785 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 08:45:22.920048 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913788 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 08:45:22.920048 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913791 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 08:45:22.920048 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913793 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 08:45:22.920048 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913800 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 08:45:22.920048 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913803 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 08:45:22.920048 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913805 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 08:45:22.920048 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913808 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 08:45:22.920048 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913810 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 08:45:22.920048 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913813 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 08:45:22.920048 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913815 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 08:45:22.920048 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913818 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 08:45:22.920048 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913821 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 08:45:22.920048 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913823 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 08:45:22.920048 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913826 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 08:45:22.920048 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913828 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 08:45:22.920048 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913831 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 08:45:22.920048 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913833 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 08:45:22.920564 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913836 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 08:45:22.920564 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913839 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 08:45:22.920564 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913842 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 08:45:22.920564 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913845 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 08:45:22.920564 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913848 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 08:45:22.920564 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913850 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 08:45:22.920564 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913853 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 08:45:22.920564 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913855 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 08:45:22.920564 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913858 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 08:45:22.920564 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913861 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 08:45:22.920564 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913863 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 08:45:22.920564 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913866 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 08:45:22.920564 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913868 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 08:45:22.920564 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913871 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 08:45:22.920564 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913873 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 08:45:22.920564 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913876 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 08:45:22.920564 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913879 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 08:45:22.920564 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913881 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 08:45:22.920564 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913884 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 08:45:22.920564 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913887 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 08:45:22.921119 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913890 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 08:45:22.921119 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913892 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 08:45:22.921119 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913895 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 08:45:22.921119 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913897 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 08:45:22.921119 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913900 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 08:45:22.921119 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913902 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 08:45:22.921119 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913905 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 08:45:22.921119 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913908 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 08:45:22.921119 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913910 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 08:45:22.921119 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913913 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 08:45:22.921119 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913915 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 08:45:22.921119 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913918 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 08:45:22.921119 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913921 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 08:45:22.921119 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913924 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 08:45:22.921119 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913926 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 09 08:45:22.921119 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913929 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 08:45:22.921119 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913933 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 08:45:22.921119 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913936 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 08:45:22.921119 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913939 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 08:45:22.921585 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913941 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 08:45:22.921585 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:22.913944 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 08:45:22.921585 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.913949 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 08:45:22.921585 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.914061 2567 server.go:962] "Client rotation is on, will bootstrap in background" Jun 09 08:45:22.921585 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.916448 2567 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 09 08:45:22.921585 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.918142 2567 server.go:1019] "Starting client certificate rotation" Jun 09 08:45:22.921585 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.918237 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 08:45:22.921585 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.918280 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 08:45:22.921585 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.921001 2567 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 08:45:22.924532 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.924512 2567 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 08:45:22.937603 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.937577 2567 log.go:25] "Validated CRI v1 runtime API" Jun 09 08:45:22.940906 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.940887 2567 log.go:25] "Validated CRI v1 image API" Jun 09 08:45:22.941838 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.941816 2567 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 09 08:45:22.946707 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.946683 2567 fs.go:135] Filesystem UUIDs: map[39e528bd-b96d-495a-800c-98453df15750:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 7f864652-354c-4035-90f0-5f8c9f2f5006:/dev/nvme0n1p4] Jun 09 08:45:22.946778 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.946706 2567 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 09 08:45:22.952419 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.952294 2567 manager.go:216] Machine: {Timestamp:2026-06-09 08:45:22.950814177 +0000 UTC m=+0.395761517 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097072 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2eff16cd622e1dd497c54fbb7a385a SystemUUID:ec2eff16-cd62-2e1d-d497-c54fbb7a385a BootID:3bcd4ae2-fcf6-4631-b9ad-8cbedb5f7880 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:60:9c:e3:98:97 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:60:9c:e3:98:97 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:06:45:93:d9:b7:09 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 09 08:45:22.952419 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.952413 2567 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 09 08:45:22.952574 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.952501 2567 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 09 08:45:22.955406 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.955376 2567 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 09 08:45:22.955561 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.955408 2567 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-114.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 09 08:45:22.956044 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.956025 2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 08:45:22.956292 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.956280 2567 topology_manager.go:138] "Creating topology manager with none policy" Jun 09 08:45:22.956325 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.956296 2567 container_manager_linux.go:309] "Creating device plugin manager" Jun 09 08:45:22.956325 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.956304 2567 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 08:45:22.956325 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.956319 2567 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 08:45:22.957664 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.957630 2567 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 09 08:45:22.962139 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.962126 2567 state_mem.go:36] "Initialized new in-memory state store" Jun 09 08:45:22.962265 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.962255 2567 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 09 08:45:22.962306 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.962285 2567 kubelet.go:486] "Attempting to sync node with API server" Jun 09 08:45:22.962336 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.962313 2567 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 09 08:45:22.962336 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.962323 2567 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 09 08:45:22.962336 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.962335 2567 kubelet.go:398] "Adding apiserver pod source" Jun 09 08:45:22.962470 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.962345 2567 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 09 08:45:22.962721 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.962709 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 08:45:22.962759 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.962728 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 08:45:22.965168 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.965153 2567 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 09 08:45:22.966878 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.966863 2567 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 09 08:45:22.966932 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.966895 2567 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 09 08:45:22.967640 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.967628 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 09 08:45:22.967702 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.967669 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 09 08:45:22.967702 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.967677 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 09 08:45:22.967702 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.967683 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 09 08:45:22.967702 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.967692 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 09 08:45:22.967702 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.967697 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 09 08:45:22.967828 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.967738 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 09 08:45:22.967828 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.967743 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 09 08:45:22.967828 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.967750 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 09 08:45:22.967828 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.967755 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 09 08:45:22.967828 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.967768 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 09 08:45:22.967828 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.967775 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 09 08:45:22.968670 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.968644 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 09 08:45:22.968670 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.968667 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 09 08:45:22.971725 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.971711 2567 server.go:1268] "Started kubelet" Jun 09 08:45:22.972326 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.971891 2567 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 09 08:45:22.972326 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.972140 2567 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 09 08:45:22.972600 ip-10-0-140-114 systemd[1]: Started Kubernetes Kubelet. Jun 09 08:45:22.972739 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.972708 2567 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 09 08:45:22.974380 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.974365 2567 server.go:310] "Adding debug handlers to kubelet server" Jun 09 08:45:22.974380 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.974362 2567 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 09 08:45:22.978733 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:22.978702 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 09 08:45:22.978893 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:22.978868 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-114.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 09 08:45:22.979199 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.979174 2567 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-114.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 09 08:45:22.980799 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:22.980751 2567 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 09 08:45:22.982249 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:22.981069 2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-114.ec2.internal.18b75d43b1928db6 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-114.ec2.internal,UID:ip-10-0-140-114.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-114.ec2.internal,},FirstTimestamp:2026-06-09 08:45:22.971684278 +0000 UTC m=+0.416631622,LastTimestamp:2026-06-09 08:45:22.971684278 +0000 UTC m=+0.416631622,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-114.ec2.internal,}" Jun 09 08:45:22.986395 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.986367 2567 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 09 08:45:22.986395 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.986385 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 09 08:45:22.986709 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:22.986688 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-114.ec2.internal\" not found" Jun 09 08:45:22.987334 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.987315 2567 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 09 08:45:22.987425 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.987329 2567 factory.go:55] Registering systemd factory Jun 09 08:45:22.987425 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.987421 2567 factory.go:223] Registration of the systemd container factory successfully Jun 09 08:45:22.987524 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.987344 2567 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 09 08:45:22.987524 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.987486 2567 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 09 08:45:22.987665 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.987639 2567 reconstruct.go:97] "Volume reconstruction finished" Jun 09 08:45:22.987728 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.987667 2567 reconciler.go:29] "Reconciler: start to sync state" Jun 09 08:45:22.987791 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.987776 2567 factory.go:153] Registering CRI-O factory Jun 09 08:45:22.987838 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.987795 2567 factory.go:223] Registration of the crio container factory successfully Jun 09 08:45:22.987886 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.987853 2567 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 09 08:45:22.987886 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.987874 2567 factory.go:103] Registering Raw factory Jun 09 08:45:22.987886 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.987885 2567 manager.go:1196] Started watching for new ooms in manager Jun 09 08:45:22.988557 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.988532 2567 manager.go:349] Starting recovery of all containers Jun 09 08:45:22.995177 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:22.995151 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 09 08:45:22.995293 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:22.995260 2567 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-114.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 09 08:45:22.999177 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:22.999034 2567 manager.go:354] Recovery completed Jun 09 08:45:23.003831 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:23.003817 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 08:45:23.005826 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:23.005798 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-114.ec2.internal" event="NodeHasSufficientMemory" Jun 09 08:45:23.005904 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:23.005842 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-114.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 08:45:23.005904 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:23.005854 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-114.ec2.internal" event="NodeHasSufficientPID" Jun 09 08:45:23.006404 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:23.006389 2567 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 09 08:45:23.006404 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:23.006401 2567 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 09 08:45:23.006518 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:23.006416 2567 state_mem.go:36] "Initialized new in-memory state store" Jun 09 08:45:23.006518 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:23.006422 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 08:45:23.007771 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:23.007704 2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-114.ec2.internal.18b75d43b39b7e76 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-114.ec2.internal,UID:ip-10-0-140-114.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-114.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-114.ec2.internal,},FirstTimestamp:2026-06-09 08:45:23.00582463 +0000 UTC m=+0.450771971,LastTimestamp:2026-06-09 08:45:23.00582463 +0000 UTC m=+0.450771971,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-114.ec2.internal,}" Jun 09 08:45:23.008475 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:23.008460 2567 policy_none.go:49] "None policy: Start" Jun 09 08:45:23.008536 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:23.008478 2567 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 09 08:45:23.008536 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:23.008490 2567 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 09 08:45:23.009515 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:23.009496 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-114.ec2.internal" event="NodeHasSufficientMemory" Jun 09 08:45:23.009569 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:23.009526 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-114.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 08:45:23.009569 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:23.009536 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-114.ec2.internal" event="NodeHasSufficientPID" Jun 09 08:45:23.010116 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:23.010105 2567 policy_none.go:47] "Start" Jun 09 08:45:23.016483 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:23.016468 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6fvmt" Jun 09 08:45:23.019747 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:23.019683 2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-114.ec2.internal.18b75d43b39bdb8e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-114.ec2.internal,UID:ip-10-0-140-114.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-140-114.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-140-114.ec2.internal,},FirstTimestamp:2026-06-09 08:45:23.005848462 +0000 UTC m=+0.450795803,LastTimestamp:2026-06-09 08:45:23.005848462 +0000 UTC m=+0.450795803,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-114.ec2.internal,}" Jun 09 08:45:23.022355 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:23.022296 2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-114.ec2.internal.18b75d43b39c0118 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-114.ec2.internal,UID:ip-10-0-140-114.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-140-114.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-140-114.ec2.internal,},FirstTimestamp:2026-06-09 08:45:23.005858072 +0000 UTC m=+0.450805412,LastTimestamp:2026-06-09 08:45:23.005858072 +0000 UTC m=+0.450805412,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-114.ec2.internal,}" Jun 09 08:45:23.023445 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:23.023423 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6fvmt" Jun 09 08:45:23.055252 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:23.055229 2567 manager.go:337] "Starting Device Plugin manager" Jun 09 08:45:23.075324 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:23.055264 2567 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 09 08:45:23.075324 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:23.055274 2567 server.go:87] "Starting device plugin registration server" Jun 09 08:45:23.075324 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:23.055723 2567 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 09 08:45:23.075324 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:23.055734 2567 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 09 08:45:23.075324 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:23.055833 2567 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 09 08:45:23.075324 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:23.055911 2567 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 09 08:45:23.075324 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:23.055920 2567 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 09 08:45:23.075324 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:23.056382 2567 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 09 08:45:23.075324 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:23.056439 2567 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-114.ec2.internal\" not found" Jun 09 08:45:23.075324 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:23.066523 2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 09 08:45:23.075324 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:23.067705 2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 09 08:45:23.075324 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:23.067748 2567 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 09 08:45:23.075324 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:23.067772 2567 kubelet.go:2448] "Starting kubelet main sync loop" Jun 09 08:45:23.075324 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:23.067811 2567 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 09 08:45:23.075324 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:23.069998 2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 08:45:23.156610 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:23.156514 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 08:45:23.158341 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:23.158321 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-114.ec2.internal" event="NodeHasSufficientMemory" Jun 09 08:45:23.158420 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:23.158353 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-114.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 08:45:23.158420 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:23.158364 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-114.ec2.internal" event="NodeHasSufficientPID" Jun 09 08:45:23.158482 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:23.158422 2567 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-114.ec2.internal" Jun 09 08:45:23.168231 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:23.168207 2567 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-114.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-114.ec2.internal"] Jun 09 08:45:23.168283 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:23.168276 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 08:45:23.169264 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:23.169238 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-114.ec2.internal" event="NodeHasSufficientMemory" Jun 09 08:45:23.169365 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:23.169271 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-114.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 08:45:23.169365 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:23.169283 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-114.ec2.internal" event="NodeHasSufficientPID" Jun 09 08:45:23.171749 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:23.171733 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-114.ec2.internal" Jun 09 08:45:23.171800 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:23.171762 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 08:45:23.171848 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:23.171765 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 08:45:23.175036 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:23.175017 2567 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-114.ec2.internal" Jun 09 08:45:23.175137 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:23.175041 2567 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-114.ec2.internal\": node \"ip-10-0-140-114.ec2.internal\" not found" Jun 09 08:45:23.175196 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:23.175150 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-114.ec2.internal" event="NodeHasSufficientMemory" Jun 09 08:45:23.175196 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:23.175179 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-114.ec2.internal" event="NodeHasSufficientMemory" Jun 09 08:45:23.175196 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:23.175186 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-114.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 08:45:23.175325 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:23.175201 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-114.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 08:45:23.175325 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:23.175203 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-114.ec2.internal" event="NodeHasSufficientPID" Jun 09 08:45:23.175325 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:23.175212 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-114.ec2.internal" event="NodeHasSufficientPID" Jun 09 08:45:23.177588 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:23.177570 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-114.ec2.internal" Jun 09 08:45:23.177707 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:23.177598 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 08:45:23.178389 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:23.178370 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-114.ec2.internal" event="NodeHasSufficientMemory" Jun 09 08:45:23.178468 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:23.178396 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-114.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 08:45:23.178468 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:23.178405 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-114.ec2.internal" event="NodeHasSufficientPID" Jun 09 08:45:23.188727 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:23.188702 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b19be8fb830e82b1a846fc0a2b66a0b3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-114.ec2.internal\" (UID: \"b19be8fb830e82b1a846fc0a2b66a0b3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-114.ec2.internal" Jun 09 08:45:23.188853 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:23.188731 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b19be8fb830e82b1a846fc0a2b66a0b3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-114.ec2.internal\" (UID: \"b19be8fb830e82b1a846fc0a2b66a0b3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-114.ec2.internal" Jun 09 08:45:23.188853 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:23.188752 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2b5ea2489658268516287fa452cb2cb5-config\") pod \"kube-apiserver-proxy-ip-10-0-140-114.ec2.internal\" (UID: \"2b5ea2489658268516287fa452cb2cb5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-114.ec2.internal" Jun 09 08:45:23.193282 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:23.193264 2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-114.ec2.internal\" not found" node="ip-10-0-140-114.ec2.internal" Jun 09 08:45:23.197354 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:23.197336 2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-114.ec2.internal\" not found" node="ip-10-0-140-114.ec2.internal" Jun 09 08:45:23.216945 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:23.216919 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-114.ec2.internal\" not found" Jun 09 08:45:23.289218 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:23.289188 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b19be8fb830e82b1a846fc0a2b66a0b3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-114.ec2.internal\" (UID: \"b19be8fb830e82b1a846fc0a2b66a0b3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-114.ec2.internal" Jun 09 08:45:23.289218 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:23.289217 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b19be8fb830e82b1a846fc0a2b66a0b3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-114.ec2.internal\" (UID: \"b19be8fb830e82b1a846fc0a2b66a0b3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-114.ec2.internal" Jun 09 08:45:23.289425 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:23.289236 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2b5ea2489658268516287fa452cb2cb5-config\") pod \"kube-apiserver-proxy-ip-10-0-140-114.ec2.internal\" (UID: \"2b5ea2489658268516287fa452cb2cb5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-114.ec2.internal" Jun 09 08:45:23.289425 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:23.289277 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2b5ea2489658268516287fa452cb2cb5-config\") pod \"kube-apiserver-proxy-ip-10-0-140-114.ec2.internal\" (UID: \"2b5ea2489658268516287fa452cb2cb5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-114.ec2.internal" Jun 09 08:45:23.289425 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:23.289295 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b19be8fb830e82b1a846fc0a2b66a0b3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-114.ec2.internal\" (UID: \"b19be8fb830e82b1a846fc0a2b66a0b3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-114.ec2.internal" Jun 09 08:45:23.289425 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:23.289301 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b19be8fb830e82b1a846fc0a2b66a0b3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-114.ec2.internal\" (UID: \"b19be8fb830e82b1a846fc0a2b66a0b3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-114.ec2.internal" Jun 09 08:45:23.317809 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:23.317762 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-114.ec2.internal\" not found" Jun 09 08:45:23.418188 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:23.418107 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-114.ec2.internal\" not found" Jun 09 08:45:23.500935 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:23.500885 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-114.ec2.internal" Jun 09 08:45:23.504976 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:23.504803 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-114.ec2.internal" Jun 09 08:45:23.518241 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:23.518220 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-114.ec2.internal\" not found" Jun 09 08:45:23.618800 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:23.618756 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-114.ec2.internal\" not found" Jun 09 08:45:23.719377 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:23.719294 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-114.ec2.internal\" not found" Jun 09 08:45:23.810603 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:23.810569 2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 08:45:23.819636 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:23.819612 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-114.ec2.internal\" not found" Jun 09 08:45:23.917166 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:23.917131 2567 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 09 08:45:23.917697 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:23.917329 2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 08:45:23.917697 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:23.917335 2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 08:45:23.920284 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:23.920267 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-114.ec2.internal\" not found" Jun 09 08:45:24.020844 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:24.020768 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-114.ec2.internal\" not found" Jun 09 08:45:24.026950 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.026914 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-08 08:40:23 +0000 UTC" deadline="2028-02-19 19:12:31.919074114 +0000 UTC" Jun 09 08:45:24.026950 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.026947 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14890h27m7.892130219s" Jun 09 08:45:24.121800 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:24.121763 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-114.ec2.internal\" not found" Jun 09 08:45:24.186745 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:24.186713 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb19be8fb830e82b1a846fc0a2b66a0b3.slice/crio-bbc827934bfd450529c3faa7fb7586e390458a8c7d599126a497cd8bbc7588a7 WatchSource:0}: Error finding container bbc827934bfd450529c3faa7fb7586e390458a8c7d599126a497cd8bbc7588a7: Status 404 returned error can't find the container with id bbc827934bfd450529c3faa7fb7586e390458a8c7d599126a497cd8bbc7588a7 Jun 09 08:45:24.187199 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:24.187178 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b5ea2489658268516287fa452cb2cb5.slice/crio-12c8edcb15f5b58f83937f9b72ae3e3650586b3cba7a644ed5f192a1ea7505bf WatchSource:0}: Error finding container 12c8edcb15f5b58f83937f9b72ae3e3650586b3cba7a644ed5f192a1ea7505bf: Status 404 returned error can't find the container with id 12c8edcb15f5b58f83937f9b72ae3e3650586b3cba7a644ed5f192a1ea7505bf Jun 09 08:45:24.193999 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.193982 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 08:45:24.201476 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.201459 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 08:45:24.202543 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.202527 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-114.ec2.internal" event="NodeHasSufficientMemory" Jun 09 08:45:24.202615 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.202556 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-114.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 08:45:24.202615 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.202570 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-114.ec2.internal" event="NodeHasSufficientPID" Jun 09 08:45:24.222424 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:24.222396 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-114.ec2.internal\" not found" Jun 09 08:45:24.245971 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.245949 2567 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 08:45:24.322492 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:24.322457 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-114.ec2.internal\" not found" Jun 09 08:45:24.423079 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:24.423048 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-114.ec2.internal\" not found" Jun 09 08:45:24.449837 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.449815 2567 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 08:45:24.487474 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.487445 2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-114.ec2.internal" Jun 09 08:45:24.503541 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.503513 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 08:45:24.504735 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.504719 2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-114.ec2.internal" Jun 09 08:45:24.514639 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.514621 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 08:45:24.764808 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.764718 2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 08:45:24.962903 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.962875 2567 apiserver.go:52] "Watching apiserver" Jun 09 08:45:24.970976 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.970954 2567 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 09 08:45:24.972147 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.972113 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-ghb2d","openshift-multus/multus-additional-cni-plugins-jf7vr","openshift-network-diagnostics/network-check-target-4jvm8","openshift-ovn-kubernetes/ovnkube-node-rldts","kube-system/global-pull-secret-syncer-grvqt","kube-system/konnectivity-agent-cct9r","openshift-cluster-node-tuning-operator/tuned-7f5qb","openshift-dns/node-resolver-6l4gp","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-114.ec2.internal","openshift-multus/multus-fc2mh","openshift-multus/network-metrics-daemon-qchhg","openshift-network-operator/iptables-alerter-v6bhs","kube-system/kube-apiserver-proxy-ip-10-0-140-114.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6x82"] Jun 09 08:45:24.975042 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.975014 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7f5qb" Jun 09 08:45:24.977305 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.977282 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qchhg" Jun 09 08:45:24.977417 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:24.977357 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qchhg" podUID="955c937e-7a98-4e3a-b4bb-52e78c5ac289" Jun 09 08:45:24.977953 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.977584 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 09 08:45:24.977953 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.977834 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 09 08:45:24.977953 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.977861 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-ksrd4\"" Jun 09 08:45:24.979719 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.979223 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4jvm8" Jun 09 08:45:24.979719 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:24.979287 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4jvm8" podUID="8593ba17-a4fb-4caf-a018-e1e93147ffca" Jun 09 08:45:24.981599 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.981551 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rldts" Jun 09 08:45:24.983959 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.983748 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-vftv6\"" Jun 09 08:45:24.983959 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.983768 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 09 08:45:24.984114 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.984058 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 09 08:45:24.984306 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.984286 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 09 08:45:24.984402 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.984311 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 09 08:45:24.984402 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.984350 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 09 08:45:24.984526 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.984478 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 09 08:45:24.984526 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.984498 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-grvqt" Jun 09 08:45:24.984633 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:24.984549 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-grvqt" podUID="ae90f658-436b-42fc-b170-318cd82d55b1" Jun 09 08:45:24.986287 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.986253 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cct9r" Jun 09 08:45:24.987159 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.987135 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 09 08:45:24.988136 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.988119 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7cc65\"" Jun 09 08:45:24.988436 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.988417 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 09 08:45:24.988517 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.988427 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 09 08:45:24.988579 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.988530 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6x82" Jun 09 08:45:24.990391 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.990371 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 09 08:45:24.990471 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.990394 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 09 08:45:24.990558 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.990543 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9swqt\"" Jun 09 08:45:24.990617 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.990605 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 09 08:45:24.990912 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.990894 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6l4gp" Jun 09 08:45:24.992825 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.992805 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 09 08:45:24.993051 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.993007 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xtw6t\"" Jun 09 08:45:24.993109 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.993055 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 09 08:45:24.993440 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.993422 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jf7vr" Jun 09 08:45:24.995334 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.995302 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 09 08:45:24.995613 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.995596 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-b97fv\"" Jun 09 08:45:24.995958 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.995940 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 09 08:45:24.996991 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.996112 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 09 08:45:24.996991 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.996190 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fc2mh" Jun 09 08:45:24.996991 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.996119 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 09 08:45:24.996991 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.996618 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 09 08:45:24.997899 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.997542 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0ad0de63-3d32-4927-9f79-8f848b6f52f4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-p6x82\" (UID: \"0ad0de63-3d32-4927-9f79-8f848b6f52f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6x82" Jun 09 08:45:24.997899 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.997609 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac21d247-409c-489e-8d3a-396c01dee935-etc-openvswitch\") pod \"ovnkube-node-rldts\" (UID: \"ac21d247-409c-489e-8d3a-396c01dee935\") " pod="openshift-ovn-kubernetes/ovnkube-node-rldts" Jun 09 08:45:24.997899 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.997640 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac21d247-409c-489e-8d3a-396c01dee935-host-run-ovn-kubernetes\") pod \"ovnkube-node-rldts\" (UID: \"ac21d247-409c-489e-8d3a-396c01dee935\") " pod="openshift-ovn-kubernetes/ovnkube-node-rldts" Jun 09 08:45:24.997899 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.997685 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac21d247-409c-489e-8d3a-396c01dee935-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rldts\" (UID: \"ac21d247-409c-489e-8d3a-396c01dee935\") " pod="openshift-ovn-kubernetes/ovnkube-node-rldts" Jun 09 08:45:24.997899 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.997713 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ac21d247-409c-489e-8d3a-396c01dee935-ovn-node-metrics-cert\") pod \"ovnkube-node-rldts\" (UID: \"ac21d247-409c-489e-8d3a-396c01dee935\") " pod="openshift-ovn-kubernetes/ovnkube-node-rldts" Jun 09 08:45:24.997899 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.997734 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac799a26-bfc2-45ee-806d-771558fabc2a-sys\") pod \"tuned-7f5qb\" (UID: \"ac799a26-bfc2-45ee-806d-771558fabc2a\") " pod="openshift-cluster-node-tuning-operator/tuned-7f5qb" Jun 09 08:45:24.997899 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.997756 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac799a26-bfc2-45ee-806d-771558fabc2a-lib-modules\") pod \"tuned-7f5qb\" (UID: \"ac799a26-bfc2-45ee-806d-771558fabc2a\") " pod="openshift-cluster-node-tuning-operator/tuned-7f5qb" Jun 09 08:45:24.997899 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.997778 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac799a26-bfc2-45ee-806d-771558fabc2a-var-lib-kubelet\") pod \"tuned-7f5qb\" (UID: \"ac799a26-bfc2-45ee-806d-771558fabc2a\") " pod="openshift-cluster-node-tuning-operator/tuned-7f5qb" Jun 09 08:45:24.997899 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.997801 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ac799a26-bfc2-45ee-806d-771558fabc2a-etc-tuned\") pod \"tuned-7f5qb\" (UID: \"ac799a26-bfc2-45ee-806d-771558fabc2a\") " pod="openshift-cluster-node-tuning-operator/tuned-7f5qb" Jun 09 08:45:24.997899 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.997825 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ac21d247-409c-489e-8d3a-396c01dee935-systemd-units\") pod \"ovnkube-node-rldts\" (UID: \"ac21d247-409c-489e-8d3a-396c01dee935\") " pod="openshift-ovn-kubernetes/ovnkube-node-rldts" Jun 09 08:45:24.997899 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.997853 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ac21d247-409c-489e-8d3a-396c01dee935-run-ovn\") pod \"ovnkube-node-rldts\" (UID: \"ac21d247-409c-489e-8d3a-396c01dee935\") " pod="openshift-ovn-kubernetes/ovnkube-node-rldts" Jun 09 08:45:24.997899 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.997876 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ac21d247-409c-489e-8d3a-396c01dee935-ovnkube-script-lib\") pod \"ovnkube-node-rldts\" (UID: \"ac21d247-409c-489e-8d3a-396c01dee935\") " pod="openshift-ovn-kubernetes/ovnkube-node-rldts" Jun 09 08:45:24.997899 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.997902 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ac799a26-bfc2-45ee-806d-771558fabc2a-etc-sysconfig\") pod \"tuned-7f5qb\" (UID: \"ac799a26-bfc2-45ee-806d-771558fabc2a\") " pod="openshift-cluster-node-tuning-operator/tuned-7f5qb" Jun 09 08:45:24.998575 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.997926 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjllj\" (UniqueName: \"kubernetes.io/projected/0ad0de63-3d32-4927-9f79-8f848b6f52f4-kube-api-access-kjllj\") pod \"aws-ebs-csi-driver-node-p6x82\" (UID: \"0ad0de63-3d32-4927-9f79-8f848b6f52f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6x82" Jun 09 08:45:24.998575 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.997949 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/955c937e-7a98-4e3a-b4bb-52e78c5ac289-metrics-certs\") pod \"network-metrics-daemon-qchhg\" (UID: \"955c937e-7a98-4e3a-b4bb-52e78c5ac289\") " pod="openshift-multus/network-metrics-daemon-qchhg" Jun 09 08:45:24.998575 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.997970 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ac21d247-409c-489e-8d3a-396c01dee935-run-systemd\") pod \"ovnkube-node-rldts\" (UID: \"ac21d247-409c-489e-8d3a-396c01dee935\") " pod="openshift-ovn-kubernetes/ovnkube-node-rldts" Jun 09 08:45:24.998575 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.998016 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ac21d247-409c-489e-8d3a-396c01dee935-node-log\") pod \"ovnkube-node-rldts\" (UID: \"ac21d247-409c-489e-8d3a-396c01dee935\") " pod="openshift-ovn-kubernetes/ovnkube-node-rldts" Jun 09 08:45:24.998575 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.998038 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ac21d247-409c-489e-8d3a-396c01dee935-log-socket\") pod \"ovnkube-node-rldts\" (UID: \"ac21d247-409c-489e-8d3a-396c01dee935\") " pod="openshift-ovn-kubernetes/ovnkube-node-rldts" Jun 09 08:45:24.998575 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.998072 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ac21d247-409c-489e-8d3a-396c01dee935-host-cni-netd\") pod \"ovnkube-node-rldts\" (UID: \"ac21d247-409c-489e-8d3a-396c01dee935\") " pod="openshift-ovn-kubernetes/ovnkube-node-rldts" Jun 09 08:45:24.998575 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.998099 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ac799a26-bfc2-45ee-806d-771558fabc2a-tmp\") pod \"tuned-7f5qb\" (UID: \"ac799a26-bfc2-45ee-806d-771558fabc2a\") " pod="openshift-cluster-node-tuning-operator/tuned-7f5qb" Jun 09 08:45:24.998575 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.998126 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0ad0de63-3d32-4927-9f79-8f848b6f52f4-device-dir\") pod \"aws-ebs-csi-driver-node-p6x82\" (UID: \"0ad0de63-3d32-4927-9f79-8f848b6f52f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6x82" Jun 09 08:45:24.998575 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.998146 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ac21d247-409c-489e-8d3a-396c01dee935-host-slash\") pod \"ovnkube-node-rldts\" (UID: \"ac21d247-409c-489e-8d3a-396c01dee935\") " pod="openshift-ovn-kubernetes/ovnkube-node-rldts" Jun 09 08:45:24.998575 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.998167 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ac21d247-409c-489e-8d3a-396c01dee935-host-run-netns\") pod \"ovnkube-node-rldts\" (UID: \"ac21d247-409c-489e-8d3a-396c01dee935\") " pod="openshift-ovn-kubernetes/ovnkube-node-rldts" Jun 09 08:45:24.998575 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.998190 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ac21d247-409c-489e-8d3a-396c01dee935-ovnkube-config\") pod \"ovnkube-node-rldts\" (UID: \"ac21d247-409c-489e-8d3a-396c01dee935\") " pod="openshift-ovn-kubernetes/ovnkube-node-rldts" Jun 09 08:45:24.998575 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.998220 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ac21d247-409c-489e-8d3a-396c01dee935-env-overrides\") pod \"ovnkube-node-rldts\" (UID: \"ac21d247-409c-489e-8d3a-396c01dee935\") " pod="openshift-ovn-kubernetes/ovnkube-node-rldts" Jun 09 08:45:24.998575 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.998243 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rp6w\" (UniqueName: \"kubernetes.io/projected/ac21d247-409c-489e-8d3a-396c01dee935-kube-api-access-4rp6w\") pod \"ovnkube-node-rldts\" (UID: \"ac21d247-409c-489e-8d3a-396c01dee935\") " pod="openshift-ovn-kubernetes/ovnkube-node-rldts" Jun 09 08:45:24.998575 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.998265 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ac799a26-bfc2-45ee-806d-771558fabc2a-host\") pod \"tuned-7f5qb\" (UID: \"ac799a26-bfc2-45ee-806d-771558fabc2a\") " pod="openshift-cluster-node-tuning-operator/tuned-7f5qb" Jun 09 08:45:24.998575 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.998289 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0ad0de63-3d32-4927-9f79-8f848b6f52f4-socket-dir\") pod \"aws-ebs-csi-driver-node-p6x82\" (UID: \"0ad0de63-3d32-4927-9f79-8f848b6f52f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6x82" Jun 09 08:45:24.998575 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.998312 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0ad0de63-3d32-4927-9f79-8f848b6f52f4-sys-fs\") pod \"aws-ebs-csi-driver-node-p6x82\" (UID: \"0ad0de63-3d32-4927-9f79-8f848b6f52f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6x82" Jun 09 08:45:24.999313 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.998345 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzjbr\" (UniqueName: \"kubernetes.io/projected/955c937e-7a98-4e3a-b4bb-52e78c5ac289-kube-api-access-tzjbr\") pod \"network-metrics-daemon-qchhg\" (UID: \"955c937e-7a98-4e3a-b4bb-52e78c5ac289\") " pod="openshift-multus/network-metrics-daemon-qchhg" Jun 09 08:45:24.999313 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.998369 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac21d247-409c-489e-8d3a-396c01dee935-run-openvswitch\") pod \"ovnkube-node-rldts\" (UID: \"ac21d247-409c-489e-8d3a-396c01dee935\") " pod="openshift-ovn-kubernetes/ovnkube-node-rldts" Jun 09 08:45:24.999313 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.998391 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ae90f658-436b-42fc-b170-318cd82d55b1-dbus\") pod \"global-pull-secret-syncer-grvqt\" (UID: \"ae90f658-436b-42fc-b170-318cd82d55b1\") " pod="kube-system/global-pull-secret-syncer-grvqt" Jun 09 08:45:24.999313 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.998413 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0ad0de63-3d32-4927-9f79-8f848b6f52f4-etc-selinux\") pod \"aws-ebs-csi-driver-node-p6x82\" (UID: \"0ad0de63-3d32-4927-9f79-8f848b6f52f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6x82" Jun 09 08:45:24.999313 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.998436 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/849de24e-c8a4-4afd-a40b-45f1f35290b5-agent-certs\") pod \"konnectivity-agent-cct9r\" (UID: \"849de24e-c8a4-4afd-a40b-45f1f35290b5\") " pod="kube-system/konnectivity-agent-cct9r" Jun 09 08:45:24.999313 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.998463 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/849de24e-c8a4-4afd-a40b-45f1f35290b5-konnectivity-ca\") pod \"konnectivity-agent-cct9r\" (UID: \"849de24e-c8a4-4afd-a40b-45f1f35290b5\") " pod="kube-system/konnectivity-agent-cct9r" Jun 09 08:45:24.999313 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.998503 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ac799a26-bfc2-45ee-806d-771558fabc2a-etc-modprobe-d\") pod \"tuned-7f5qb\" (UID: \"ac799a26-bfc2-45ee-806d-771558fabc2a\") " pod="openshift-cluster-node-tuning-operator/tuned-7f5qb" Jun 09 08:45:24.999313 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.998528 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj5gh\" (UniqueName: \"kubernetes.io/projected/ac799a26-bfc2-45ee-806d-771558fabc2a-kube-api-access-gj5gh\") pod \"tuned-7f5qb\" (UID: \"ac799a26-bfc2-45ee-806d-771558fabc2a\") " pod="openshift-cluster-node-tuning-operator/tuned-7f5qb" Jun 09 08:45:24.999313 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.998553 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ae90f658-436b-42fc-b170-318cd82d55b1-kubelet-config\") pod \"global-pull-secret-syncer-grvqt\" (UID: \"ae90f658-436b-42fc-b170-318cd82d55b1\") " pod="kube-system/global-pull-secret-syncer-grvqt" Jun 09 08:45:24.999313 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.998592 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0ad0de63-3d32-4927-9f79-8f848b6f52f4-registration-dir\") pod \"aws-ebs-csi-driver-node-p6x82\" (UID: \"0ad0de63-3d32-4927-9f79-8f848b6f52f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6x82" Jun 09 08:45:24.999313 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.998617 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ac21d247-409c-489e-8d3a-396c01dee935-host-cni-bin\") pod \"ovnkube-node-rldts\" (UID: \"ac21d247-409c-489e-8d3a-396c01dee935\") " pod="openshift-ovn-kubernetes/ovnkube-node-rldts" Jun 09 08:45:24.999313 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.998663 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ac799a26-bfc2-45ee-806d-771558fabc2a-etc-sysctl-conf\") pod \"tuned-7f5qb\" (UID: \"ac799a26-bfc2-45ee-806d-771558fabc2a\") " pod="openshift-cluster-node-tuning-operator/tuned-7f5qb" Jun 09 08:45:24.999313 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.998694 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ac799a26-bfc2-45ee-806d-771558fabc2a-etc-systemd\") pod \"tuned-7f5qb\" (UID: \"ac799a26-bfc2-45ee-806d-771558fabc2a\") " pod="openshift-cluster-node-tuning-operator/tuned-7f5qb" Jun 09 08:45:24.999313 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.998716 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ac799a26-bfc2-45ee-806d-771558fabc2a-run\") pod \"tuned-7f5qb\" (UID: \"ac799a26-bfc2-45ee-806d-771558fabc2a\") " pod="openshift-cluster-node-tuning-operator/tuned-7f5qb" Jun 09 08:45:24.999313 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.998742 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjp8p\" (UniqueName: \"kubernetes.io/projected/8593ba17-a4fb-4caf-a018-e1e93147ffca-kube-api-access-kjp8p\") pod \"network-check-target-4jvm8\" (UID: \"8593ba17-a4fb-4caf-a018-e1e93147ffca\") " pod="openshift-network-diagnostics/network-check-target-4jvm8" Jun 09 08:45:24.999313 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.998768 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae90f658-436b-42fc-b170-318cd82d55b1-original-pull-secret\") pod \"global-pull-secret-syncer-grvqt\" (UID: \"ae90f658-436b-42fc-b170-318cd82d55b1\") " pod="kube-system/global-pull-secret-syncer-grvqt" Jun 09 08:45:25.000047 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.998792 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac21d247-409c-489e-8d3a-396c01dee935-host-kubelet\") pod \"ovnkube-node-rldts\" (UID: \"ac21d247-409c-489e-8d3a-396c01dee935\") " pod="openshift-ovn-kubernetes/ovnkube-node-rldts" Jun 09 08:45:25.000047 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.998818 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac21d247-409c-489e-8d3a-396c01dee935-var-lib-openvswitch\") pod \"ovnkube-node-rldts\" (UID: \"ac21d247-409c-489e-8d3a-396c01dee935\") " pod="openshift-ovn-kubernetes/ovnkube-node-rldts" Jun 09 08:45:25.000047 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.998856 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac799a26-bfc2-45ee-806d-771558fabc2a-etc-kubernetes\") pod \"tuned-7f5qb\" (UID: \"ac799a26-bfc2-45ee-806d-771558fabc2a\") " pod="openshift-cluster-node-tuning-operator/tuned-7f5qb" Jun 09 08:45:25.000047 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.998878 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ac799a26-bfc2-45ee-806d-771558fabc2a-etc-sysctl-d\") pod \"tuned-7f5qb\" (UID: \"ac799a26-bfc2-45ee-806d-771558fabc2a\") " pod="openshift-cluster-node-tuning-operator/tuned-7f5qb" Jun 09 08:45:25.000047 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.999134 2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 08:45:25.000047 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.999238 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 09 08:45:25.000047 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.999394 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-hjdvl\"" Jun 09 08:45:25.000047 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:24.999432 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ghb2d" Jun 09 08:45:25.000758 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.000737 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-v6bhs" Jun 09 08:45:25.001369 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.001335 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-jft97\"" Jun 09 08:45:25.001738 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.001713 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 09 08:45:25.002192 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.001715 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 09 08:45:25.002192 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.001906 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 09 08:45:25.002762 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.002563 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 09 08:45:25.002877 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.002859 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rdxhk\"" Jun 09 08:45:25.003092 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.003079 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 09 08:45:25.003351 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.003334 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 09 08:45:25.030534 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.030507 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-rczfz" Jun 09 08:45:25.037122 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.037097 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-rczfz" Jun 09 08:45:25.076291 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.076242 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-114.ec2.internal" event={"ID":"2b5ea2489658268516287fa452cb2cb5","Type":"ContainerStarted","Data":"12c8edcb15f5b58f83937f9b72ae3e3650586b3cba7a644ed5f192a1ea7505bf"} Jun 09 08:45:25.077672 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.077629 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-114.ec2.internal" event={"ID":"b19be8fb830e82b1a846fc0a2b66a0b3","Type":"ContainerStarted","Data":"bbc827934bfd450529c3faa7fb7586e390458a8c7d599126a497cd8bbc7588a7"} Jun 09 08:45:25.087970 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.087945 2567 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 09 08:45:25.099803 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.099771 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0ad0de63-3d32-4927-9f79-8f848b6f52f4-socket-dir\") pod \"aws-ebs-csi-driver-node-p6x82\" (UID: \"0ad0de63-3d32-4927-9f79-8f848b6f52f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6x82" Jun 09 08:45:25.099803 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.099806 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzjbr\" (UniqueName: \"kubernetes.io/projected/955c937e-7a98-4e3a-b4bb-52e78c5ac289-kube-api-access-tzjbr\") pod \"network-metrics-daemon-qchhg\" (UID: \"955c937e-7a98-4e3a-b4bb-52e78c5ac289\") " pod="openshift-multus/network-metrics-daemon-qchhg" Jun 09 08:45:25.100029 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.099824 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac21d247-409c-489e-8d3a-396c01dee935-run-openvswitch\") pod \"ovnkube-node-rldts\" (UID: \"ac21d247-409c-489e-8d3a-396c01dee935\") " pod="openshift-ovn-kubernetes/ovnkube-node-rldts" Jun 09 08:45:25.100029 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.099842 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2505c746-7f3b-4dcc-a6a1-956885ca7fc3-os-release\") pod \"multus-additional-cni-plugins-jf7vr\" (UID: \"2505c746-7f3b-4dcc-a6a1-956885ca7fc3\") " pod="openshift-multus/multus-additional-cni-plugins-jf7vr" Jun 09 08:45:25.100029 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.099860 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jr4q\" (UniqueName: \"kubernetes.io/projected/c1eca8fd-ed14-4a3b-a17b-bf84f42f7302-kube-api-access-2jr4q\") pod \"node-ca-ghb2d\" (UID: \"c1eca8fd-ed14-4a3b-a17b-bf84f42f7302\") " pod="openshift-image-registry/node-ca-ghb2d" Jun 09 08:45:25.100029 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.099895 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e-cni-binary-copy\") pod \"multus-fc2mh\" (UID: \"08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e\") " pod="openshift-multus/multus-fc2mh" Jun 09 08:45:25.100029 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.099908 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0ad0de63-3d32-4927-9f79-8f848b6f52f4-socket-dir\") pod \"aws-ebs-csi-driver-node-p6x82\" (UID: \"0ad0de63-3d32-4927-9f79-8f848b6f52f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6x82" Jun 09 08:45:25.100029 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.099906 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac21d247-409c-489e-8d3a-396c01dee935-run-openvswitch\") pod \"ovnkube-node-rldts\" (UID: \"ac21d247-409c-489e-8d3a-396c01dee935\") " pod="openshift-ovn-kubernetes/ovnkube-node-rldts" Jun 09 08:45:25.100359 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.100046 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e-hostroot\") pod \"multus-fc2mh\" (UID: \"08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e\") " pod="openshift-multus/multus-fc2mh" Jun 09 08:45:25.100359 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.100077 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ae90f658-436b-42fc-b170-318cd82d55b1-dbus\") pod \"global-pull-secret-syncer-grvqt\" (UID: \"ae90f658-436b-42fc-b170-318cd82d55b1\") " pod="kube-system/global-pull-secret-syncer-grvqt" Jun 09 08:45:25.100359 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.100153 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0ad0de63-3d32-4927-9f79-8f848b6f52f4-etc-selinux\") pod \"aws-ebs-csi-driver-node-p6x82\" (UID: \"0ad0de63-3d32-4927-9f79-8f848b6f52f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6x82" Jun 09 08:45:25.100359 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.100174 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2505c746-7f3b-4dcc-a6a1-956885ca7fc3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jf7vr\" (UID: \"2505c746-7f3b-4dcc-a6a1-956885ca7fc3\") " pod="openshift-multus/multus-additional-cni-plugins-jf7vr" Jun 09 08:45:25.100359 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.100192 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g76fh\" (UniqueName: \"kubernetes.io/projected/2505c746-7f3b-4dcc-a6a1-956885ca7fc3-kube-api-access-g76fh\") pod \"multus-additional-cni-plugins-jf7vr\" (UID: \"2505c746-7f3b-4dcc-a6a1-956885ca7fc3\") " pod="openshift-multus/multus-additional-cni-plugins-jf7vr" Jun 09 08:45:25.100359 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.100209 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e-host-run-netns\") pod \"multus-fc2mh\" (UID: \"08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e\") " pod="openshift-multus/multus-fc2mh" Jun 09 08:45:25.100359 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.100176 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ae90f658-436b-42fc-b170-318cd82d55b1-dbus\") pod \"global-pull-secret-syncer-grvqt\" (UID: \"ae90f658-436b-42fc-b170-318cd82d55b1\") " pod="kube-system/global-pull-secret-syncer-grvqt" Jun 09 08:45:25.100359 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.100247 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0ad0de63-3d32-4927-9f79-8f848b6f52f4-etc-selinux\") pod \"aws-ebs-csi-driver-node-p6x82\" (UID: \"0ad0de63-3d32-4927-9f79-8f848b6f52f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6x82" Jun 09 08:45:25.100359 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.100234 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ac799a26-bfc2-45ee-806d-771558fabc2a-etc-modprobe-d\") pod \"tuned-7f5qb\" (UID: \"ac799a26-bfc2-45ee-806d-771558fabc2a\") " pod="openshift-cluster-node-tuning-operator/tuned-7f5qb" Jun 09 08:45:25.100359 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.100280 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gj5gh\" (UniqueName: \"kubernetes.io/projected/ac799a26-bfc2-45ee-806d-771558fabc2a-kube-api-access-gj5gh\") pod \"tuned-7f5qb\" (UID: \"ac799a26-bfc2-45ee-806d-771558fabc2a\") " pod="openshift-cluster-node-tuning-operator/tuned-7f5qb" Jun 09 08:45:25.100359 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.100296 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0ad0de63-3d32-4927-9f79-8f848b6f52f4-registration-dir\") pod \"aws-ebs-csi-driver-node-p6x82\" (UID: \"0ad0de63-3d32-4927-9f79-8f848b6f52f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6x82" Jun 09 08:45:25.100359 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.100345 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/849de24e-c8a4-4afd-a40b-45f1f35290b5-agent-certs\") pod \"konnectivity-agent-cct9r\" (UID: \"849de24e-c8a4-4afd-a40b-45f1f35290b5\") " pod="kube-system/konnectivity-agent-cct9r" Jun 09 08:45:25.100359 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.100348 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ac799a26-bfc2-45ee-806d-771558fabc2a-etc-modprobe-d\") pod \"tuned-7f5qb\" (UID: \"ac799a26-bfc2-45ee-806d-771558fabc2a\") " pod="openshift-cluster-node-tuning-operator/tuned-7f5qb" Jun 09 08:45:25.100359 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.100365 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2505c746-7f3b-4dcc-a6a1-956885ca7fc3-cnibin\") pod \"multus-additional-cni-plugins-jf7vr\" (UID: \"2505c746-7f3b-4dcc-a6a1-956885ca7fc3\") " pod="openshift-multus/multus-additional-cni-plugins-jf7vr" Jun 09 08:45:25.101223 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.100389 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ac799a26-bfc2-45ee-806d-771558fabc2a-etc-sysctl-conf\") pod \"tuned-7f5qb\" (UID: \"ac799a26-bfc2-45ee-806d-771558fabc2a\") " pod="openshift-cluster-node-tuning-operator/tuned-7f5qb" Jun 09 08:45:25.101223 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.100400 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0ad0de63-3d32-4927-9f79-8f848b6f52f4-registration-dir\") pod \"aws-ebs-csi-driver-node-p6x82\" (UID: \"0ad0de63-3d32-4927-9f79-8f848b6f52f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6x82" Jun 09 08:45:25.101223 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.100412 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ac799a26-bfc2-45ee-806d-771558fabc2a-run\") pod \"tuned-7f5qb\" (UID: \"ac799a26-bfc2-45ee-806d-771558fabc2a\") " pod="openshift-cluster-node-tuning-operator/tuned-7f5qb" Jun 09 08:45:25.101223 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.100435 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae90f658-436b-42fc-b170-318cd82d55b1-original-pull-secret\") pod \"global-pull-secret-syncer-grvqt\" (UID: \"ae90f658-436b-42fc-b170-318cd82d55b1\") " pod="kube-system/global-pull-secret-syncer-grvqt" Jun 09 08:45:25.101223 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.100461 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac21d247-409c-489e-8d3a-396c01dee935-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rldts\" (UID: \"ac21d247-409c-489e-8d3a-396c01dee935\") " pod="openshift-ovn-kubernetes/ovnkube-node-rldts" Jun 09 08:45:25.101223 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.100495 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ac799a26-bfc2-45ee-806d-771558fabc2a-run\") pod \"tuned-7f5qb\" (UID: \"ac799a26-bfc2-45ee-806d-771558fabc2a\") " pod="openshift-cluster-node-tuning-operator/tuned-7f5qb" Jun 09 08:45:25.101223 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.100508 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac21d247-409c-489e-8d3a-396c01dee935-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rldts\" (UID: \"ac21d247-409c-489e-8d3a-396c01dee935\") " pod="openshift-ovn-kubernetes/ovnkube-node-rldts" Jun 09 08:45:25.101223 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.100526 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ac799a26-bfc2-45ee-806d-771558fabc2a-etc-sysctl-conf\") pod \"tuned-7f5qb\" (UID: \"ac799a26-bfc2-45ee-806d-771558fabc2a\") " pod="openshift-cluster-node-tuning-operator/tuned-7f5qb" Jun 09 08:45:25.101223 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:25.100539 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 08:45:25.101223 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.100575 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5c8cf271-8ccb-42a2-abe4-fe6565f5346b-hosts-file\") pod \"node-resolver-6l4gp\" (UID: \"5c8cf271-8ccb-42a2-abe4-fe6565f5346b\") " pod="openshift-dns/node-resolver-6l4gp" Jun 09 08:45:25.101223 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:25.100601 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae90f658-436b-42fc-b170-318cd82d55b1-original-pull-secret podName:ae90f658-436b-42fc-b170-318cd82d55b1 nodeName:}" failed. No retries permitted until 2026-06-09 08:45:25.600581593 +0000 UTC m=+3.045528938 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ae90f658-436b-42fc-b170-318cd82d55b1-original-pull-secret") pod "global-pull-secret-syncer-grvqt" (UID: "ae90f658-436b-42fc-b170-318cd82d55b1") : object "kube-system"/"original-pull-secret" not registered Jun 09 08:45:25.101223 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.100628 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c8cf271-8ccb-42a2-abe4-fe6565f5346b-tmp-dir\") pod \"node-resolver-6l4gp\" (UID: \"5c8cf271-8ccb-42a2-abe4-fe6565f5346b\") " pod="openshift-dns/node-resolver-6l4gp" Jun 09 08:45:25.101223 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.100666 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ac799a26-bfc2-45ee-806d-771558fabc2a-etc-sysctl-d\") pod \"tuned-7f5qb\" (UID: \"ac799a26-bfc2-45ee-806d-771558fabc2a\") " pod="openshift-cluster-node-tuning-operator/tuned-7f5qb" Jun 09 08:45:25.101223 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.100689 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac21d247-409c-489e-8d3a-396c01dee935-etc-openvswitch\") pod \"ovnkube-node-rldts\" (UID: \"ac21d247-409c-489e-8d3a-396c01dee935\") " pod="openshift-ovn-kubernetes/ovnkube-node-rldts" Jun 09 08:45:25.101223 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.100709 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac21d247-409c-489e-8d3a-396c01dee935-host-run-ovn-kubernetes\") pod \"ovnkube-node-rldts\" (UID: \"ac21d247-409c-489e-8d3a-396c01dee935\") " pod="openshift-ovn-kubernetes/ovnkube-node-rldts" Jun 09 08:45:25.101223 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.100733 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e-system-cni-dir\") pod \"multus-fc2mh\" (UID: \"08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e\") " pod="openshift-multus/multus-fc2mh" Jun 09 08:45:25.101223 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.100737 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac21d247-409c-489e-8d3a-396c01dee935-etc-openvswitch\") pod \"ovnkube-node-rldts\" (UID: \"ac21d247-409c-489e-8d3a-396c01dee935\") " pod="openshift-ovn-kubernetes/ovnkube-node-rldts" Jun 09 08:45:25.102092 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.100755 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e-multus-conf-dir\") pod \"multus-fc2mh\" (UID: \"08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e\") " pod="openshift-multus/multus-fc2mh" Jun 09 08:45:25.102092 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.100761 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ac799a26-bfc2-45ee-806d-771558fabc2a-etc-sysctl-d\") pod \"tuned-7f5qb\" (UID: \"ac799a26-bfc2-45ee-806d-771558fabc2a\") " pod="openshift-cluster-node-tuning-operator/tuned-7f5qb" Jun 09 08:45:25.102092 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.100767 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac21d247-409c-489e-8d3a-396c01dee935-host-run-ovn-kubernetes\") pod \"ovnkube-node-rldts\" (UID: \"ac21d247-409c-489e-8d3a-396c01dee935\") " pod="openshift-ovn-kubernetes/ovnkube-node-rldts" Jun 09 08:45:25.102092 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.100800 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e-multus-daemon-config\") pod \"multus-fc2mh\" (UID: \"08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e\") " pod="openshift-multus/multus-fc2mh" Jun 09 08:45:25.102092 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.100816 2567 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 09 08:45:25.102092 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.100830 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac799a26-bfc2-45ee-806d-771558fabc2a-var-lib-kubelet\") pod \"tuned-7f5qb\" (UID: \"ac799a26-bfc2-45ee-806d-771558fabc2a\") " pod="openshift-cluster-node-tuning-operator/tuned-7f5qb" Jun 09 08:45:25.102092 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.100854 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ac21d247-409c-489e-8d3a-396c01dee935-run-ovn\") pod \"ovnkube-node-rldts\" (UID: \"ac21d247-409c-489e-8d3a-396c01dee935\") " pod="openshift-ovn-kubernetes/ovnkube-node-rldts" Jun 09 08:45:25.102092 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.100874 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ac21d247-409c-489e-8d3a-396c01dee935-ovnkube-script-lib\") pod \"ovnkube-node-rldts\" (UID: \"ac21d247-409c-489e-8d3a-396c01dee935\") " pod="openshift-ovn-kubernetes/ovnkube-node-rldts" Jun 09 08:45:25.102092 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.100888 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac799a26-bfc2-45ee-806d-771558fabc2a-var-lib-kubelet\") pod \"tuned-7f5qb\" (UID: \"ac799a26-bfc2-45ee-806d-771558fabc2a\") " pod="openshift-cluster-node-tuning-operator/tuned-7f5qb" Jun 09 08:45:25.102092 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.100894 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ac21d247-409c-489e-8d3a-396c01dee935-run-systemd\") pod \"ovnkube-node-rldts\" (UID: \"ac21d247-409c-489e-8d3a-396c01dee935\") " pod="openshift-ovn-kubernetes/ovnkube-node-rldts" Jun 09 08:45:25.102092 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.100915 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ac21d247-409c-489e-8d3a-396c01dee935-node-log\") pod \"ovnkube-node-rldts\" (UID: \"ac21d247-409c-489e-8d3a-396c01dee935\") " pod="openshift-ovn-kubernetes/ovnkube-node-rldts" Jun 09 08:45:25.102092 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.100918 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ac21d247-409c-489e-8d3a-396c01dee935-run-ovn\") pod \"ovnkube-node-rldts\" (UID: \"ac21d247-409c-489e-8d3a-396c01dee935\") " pod="openshift-ovn-kubernetes/ovnkube-node-rldts" Jun 09 08:45:25.102092 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.100945 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ac21d247-409c-489e-8d3a-396c01dee935-log-socket\") pod \"ovnkube-node-rldts\" (UID: \"ac21d247-409c-489e-8d3a-396c01dee935\") " pod="openshift-ovn-kubernetes/ovnkube-node-rldts" Jun 09 08:45:25.102092 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.100956 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ac21d247-409c-489e-8d3a-396c01dee935-run-systemd\") pod \"ovnkube-node-rldts\" (UID: \"ac21d247-409c-489e-8d3a-396c01dee935\") " pod="openshift-ovn-kubernetes/ovnkube-node-rldts" Jun 09 08:45:25.102092 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.100968 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ac21d247-409c-489e-8d3a-396c01dee935-host-cni-netd\") pod \"ovnkube-node-rldts\" (UID: \"ac21d247-409c-489e-8d3a-396c01dee935\") " pod="openshift-ovn-kubernetes/ovnkube-node-rldts" Jun 09 08:45:25.102092 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.100992 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ac21d247-409c-489e-8d3a-396c01dee935-ovnkube-config\") pod \"ovnkube-node-rldts\" (UID: \"ac21d247-409c-489e-8d3a-396c01dee935\") " pod="openshift-ovn-kubernetes/ovnkube-node-rldts" Jun 09 08:45:25.102092 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.101021 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ac21d247-409c-489e-8d3a-396c01dee935-host-cni-netd\") pod \"ovnkube-node-rldts\" (UID: \"ac21d247-409c-489e-8d3a-396c01dee935\") " pod="openshift-ovn-kubernetes/ovnkube-node-rldts" Jun 09 08:45:25.102092 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.100993 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ac21d247-409c-489e-8d3a-396c01dee935-log-socket\") pod \"ovnkube-node-rldts\" (UID: \"ac21d247-409c-489e-8d3a-396c01dee935\") " pod="openshift-ovn-kubernetes/ovnkube-node-rldts" Jun 09 08:45:25.102861 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.101058 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ac21d247-409c-489e-8d3a-396c01dee935-env-overrides\") pod \"ovnkube-node-rldts\" (UID: \"ac21d247-409c-489e-8d3a-396c01dee935\") " pod="openshift-ovn-kubernetes/ovnkube-node-rldts" Jun 09 08:45:25.102861 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.101086 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e-host-var-lib-kubelet\") pod \"multus-fc2mh\" (UID: \"08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e\") " pod="openshift-multus/multus-fc2mh" Jun 09 08:45:25.102861 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.101103 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ac21d247-409c-489e-8d3a-396c01dee935-node-log\") pod \"ovnkube-node-rldts\" (UID: \"ac21d247-409c-489e-8d3a-396c01dee935\") " pod="openshift-ovn-kubernetes/ovnkube-node-rldts" Jun 09 08:45:25.102861 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.101189 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ac799a26-bfc2-45ee-806d-771558fabc2a-tmp\") pod \"tuned-7f5qb\" (UID: \"ac799a26-bfc2-45ee-806d-771558fabc2a\") " pod="openshift-cluster-node-tuning-operator/tuned-7f5qb" Jun 09 08:45:25.102861 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.101215 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ac21d247-409c-489e-8d3a-396c01dee935-host-run-netns\") pod \"ovnkube-node-rldts\" (UID: \"ac21d247-409c-489e-8d3a-396c01dee935\") " pod="openshift-ovn-kubernetes/ovnkube-node-rldts" Jun 09 08:45:25.102861 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.101239 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rp6w\" (UniqueName: \"kubernetes.io/projected/ac21d247-409c-489e-8d3a-396c01dee935-kube-api-access-4rp6w\") pod \"ovnkube-node-rldts\" (UID: \"ac21d247-409c-489e-8d3a-396c01dee935\") " pod="openshift-ovn-kubernetes/ovnkube-node-rldts" Jun 09 08:45:25.102861 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.101265 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvfdw\" (UniqueName: \"kubernetes.io/projected/5c8cf271-8ccb-42a2-abe4-fe6565f5346b-kube-api-access-jvfdw\") pod \"node-resolver-6l4gp\" (UID: \"5c8cf271-8ccb-42a2-abe4-fe6565f5346b\") " pod="openshift-dns/node-resolver-6l4gp" Jun 09 08:45:25.102861 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.101290 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e-multus-cni-dir\") pod \"multus-fc2mh\" (UID: \"08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e\") " pod="openshift-multus/multus-fc2mh" Jun 09 08:45:25.102861 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.101312 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e-host-run-multus-certs\") pod \"multus-fc2mh\" (UID: \"08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e\") " pod="openshift-multus/multus-fc2mh" Jun 09 08:45:25.102861 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.101334 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rs7ll\" (UniqueName: \"kubernetes.io/projected/08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e-kube-api-access-rs7ll\") pod \"multus-fc2mh\" (UID: \"08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e\") " pod="openshift-multus/multus-fc2mh" Jun 09 08:45:25.102861 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.101359 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ac799a26-bfc2-45ee-806d-771558fabc2a-host\") pod \"tuned-7f5qb\" (UID: \"ac799a26-bfc2-45ee-806d-771558fabc2a\") " pod="openshift-cluster-node-tuning-operator/tuned-7f5qb" Jun 09 08:45:25.102861 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.101385 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0ad0de63-3d32-4927-9f79-8f848b6f52f4-sys-fs\") pod \"aws-ebs-csi-driver-node-p6x82\" (UID: \"0ad0de63-3d32-4927-9f79-8f848b6f52f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6x82" Jun 09 08:45:25.102861 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.101411 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e-etc-kubernetes\") pod \"multus-fc2mh\" (UID: \"08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e\") " pod="openshift-multus/multus-fc2mh" Jun 09 08:45:25.102861 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.101434 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2505c746-7f3b-4dcc-a6a1-956885ca7fc3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jf7vr\" (UID: \"2505c746-7f3b-4dcc-a6a1-956885ca7fc3\") " pod="openshift-multus/multus-additional-cni-plugins-jf7vr" Jun 09 08:45:25.102861 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.101478 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e-host-var-lib-cni-multus\") pod \"multus-fc2mh\" (UID: \"08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e\") " pod="openshift-multus/multus-fc2mh" Jun 09 08:45:25.102861 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.101476 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ac21d247-409c-489e-8d3a-396c01dee935-env-overrides\") pod \"ovnkube-node-rldts\" (UID: \"ac21d247-409c-489e-8d3a-396c01dee935\") " pod="openshift-ovn-kubernetes/ovnkube-node-rldts" Jun 09 08:45:25.102861 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.101533 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ac21d247-409c-489e-8d3a-396c01dee935-host-run-netns\") pod \"ovnkube-node-rldts\" (UID: \"ac21d247-409c-489e-8d3a-396c01dee935\") " pod="openshift-ovn-kubernetes/ovnkube-node-rldts" Jun 09 08:45:25.103735 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.101553 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ae90f658-436b-42fc-b170-318cd82d55b1-kubelet-config\") pod \"global-pull-secret-syncer-grvqt\" (UID: \"ae90f658-436b-42fc-b170-318cd82d55b1\") " pod="kube-system/global-pull-secret-syncer-grvqt" Jun 09 08:45:25.103735 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.101595 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ac21d247-409c-489e-8d3a-396c01dee935-ovnkube-script-lib\") pod \"ovnkube-node-rldts\" (UID: \"ac21d247-409c-489e-8d3a-396c01dee935\") " pod="openshift-ovn-kubernetes/ovnkube-node-rldts" Jun 09 08:45:25.103735 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.101615 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ac21d247-409c-489e-8d3a-396c01dee935-ovnkube-config\") pod \"ovnkube-node-rldts\" (UID: \"ac21d247-409c-489e-8d3a-396c01dee935\") " pod="openshift-ovn-kubernetes/ovnkube-node-rldts" Jun 09 08:45:25.103735 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.101599 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ac21d247-409c-489e-8d3a-396c01dee935-host-cni-bin\") pod \"ovnkube-node-rldts\" (UID: \"ac21d247-409c-489e-8d3a-396c01dee935\") " pod="openshift-ovn-kubernetes/ovnkube-node-rldts" Jun 09 08:45:25.103735 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.101668 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ac799a26-bfc2-45ee-806d-771558fabc2a-host\") pod \"tuned-7f5qb\" (UID: \"ac799a26-bfc2-45ee-806d-771558fabc2a\") " pod="openshift-cluster-node-tuning-operator/tuned-7f5qb" Jun 09 08:45:25.103735 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.101681 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ae90f658-436b-42fc-b170-318cd82d55b1-kubelet-config\") pod \"global-pull-secret-syncer-grvqt\" (UID: \"ae90f658-436b-42fc-b170-318cd82d55b1\") " pod="kube-system/global-pull-secret-syncer-grvqt" Jun 09 08:45:25.103735 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.101685 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0ad0de63-3d32-4927-9f79-8f848b6f52f4-sys-fs\") pod \"aws-ebs-csi-driver-node-p6x82\" (UID: \"0ad0de63-3d32-4927-9f79-8f848b6f52f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6x82" Jun 09 08:45:25.103735 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.101699 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c9696892-a39d-47db-9799-69ad596e65b8-iptables-alerter-script\") pod \"iptables-alerter-v6bhs\" (UID: \"c9696892-a39d-47db-9799-69ad596e65b8\") " pod="openshift-network-operator/iptables-alerter-v6bhs" Jun 09 08:45:25.103735 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.101738 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ac21d247-409c-489e-8d3a-396c01dee935-host-cni-bin\") pod \"ovnkube-node-rldts\" (UID: \"ac21d247-409c-489e-8d3a-396c01dee935\") " pod="openshift-ovn-kubernetes/ovnkube-node-rldts" Jun 09 08:45:25.103735 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.101767 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e-cnibin\") pod \"multus-fc2mh\" (UID: \"08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e\") " pod="openshift-multus/multus-fc2mh" Jun 09 08:45:25.103735 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.101793 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/849de24e-c8a4-4afd-a40b-45f1f35290b5-konnectivity-ca\") pod \"konnectivity-agent-cct9r\" (UID: \"849de24e-c8a4-4afd-a40b-45f1f35290b5\") " pod="kube-system/konnectivity-agent-cct9r" Jun 09 08:45:25.103735 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.101817 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ac799a26-bfc2-45ee-806d-771558fabc2a-etc-systemd\") pod \"tuned-7f5qb\" (UID: \"ac799a26-bfc2-45ee-806d-771558fabc2a\") " pod="openshift-cluster-node-tuning-operator/tuned-7f5qb" Jun 09 08:45:25.103735 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.101841 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjp8p\" (UniqueName: \"kubernetes.io/projected/8593ba17-a4fb-4caf-a018-e1e93147ffca-kube-api-access-kjp8p\") pod \"network-check-target-4jvm8\" (UID: \"8593ba17-a4fb-4caf-a018-e1e93147ffca\") " pod="openshift-network-diagnostics/network-check-target-4jvm8" Jun 09 08:45:25.103735 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.101867 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac21d247-409c-489e-8d3a-396c01dee935-host-kubelet\") pod \"ovnkube-node-rldts\" (UID: \"ac21d247-409c-489e-8d3a-396c01dee935\") " pod="openshift-ovn-kubernetes/ovnkube-node-rldts" Jun 09 08:45:25.103735 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.101909 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac21d247-409c-489e-8d3a-396c01dee935-host-kubelet\") pod \"ovnkube-node-rldts\" (UID: \"ac21d247-409c-489e-8d3a-396c01dee935\") " pod="openshift-ovn-kubernetes/ovnkube-node-rldts" Jun 09 08:45:25.103735 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.101916 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ac799a26-bfc2-45ee-806d-771558fabc2a-etc-systemd\") pod \"tuned-7f5qb\" (UID: \"ac799a26-bfc2-45ee-806d-771558fabc2a\") " pod="openshift-cluster-node-tuning-operator/tuned-7f5qb" Jun 09 08:45:25.103735 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.101954 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac21d247-409c-489e-8d3a-396c01dee935-var-lib-openvswitch\") pod \"ovnkube-node-rldts\" (UID: \"ac21d247-409c-489e-8d3a-396c01dee935\") " pod="openshift-ovn-kubernetes/ovnkube-node-rldts" Jun 09 08:45:25.104545 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.101981 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ac21d247-409c-489e-8d3a-396c01dee935-ovn-node-metrics-cert\") pod \"ovnkube-node-rldts\" (UID: \"ac21d247-409c-489e-8d3a-396c01dee935\") " pod="openshift-ovn-kubernetes/ovnkube-node-rldts" Jun 09 08:45:25.104545 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.102004 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac799a26-bfc2-45ee-806d-771558fabc2a-etc-kubernetes\") pod \"tuned-7f5qb\" (UID: \"ac799a26-bfc2-45ee-806d-771558fabc2a\") " pod="openshift-cluster-node-tuning-operator/tuned-7f5qb" Jun 09 08:45:25.104545 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.102030 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0ad0de63-3d32-4927-9f79-8f848b6f52f4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-p6x82\" (UID: \"0ad0de63-3d32-4927-9f79-8f848b6f52f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6x82" Jun 09 08:45:25.104545 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.102059 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2505c746-7f3b-4dcc-a6a1-956885ca7fc3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jf7vr\" (UID: \"2505c746-7f3b-4dcc-a6a1-956885ca7fc3\") " pod="openshift-multus/multus-additional-cni-plugins-jf7vr" Jun 09 08:45:25.104545 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.102085 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c1eca8fd-ed14-4a3b-a17b-bf84f42f7302-serviceca\") pod \"node-ca-ghb2d\" (UID: \"c1eca8fd-ed14-4a3b-a17b-bf84f42f7302\") " pod="openshift-image-registry/node-ca-ghb2d" Jun 09 08:45:25.104545 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.102108 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e-multus-socket-dir-parent\") pod \"multus-fc2mh\" (UID: \"08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e\") " pod="openshift-multus/multus-fc2mh" Jun 09 08:45:25.104545 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.102098 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac21d247-409c-489e-8d3a-396c01dee935-var-lib-openvswitch\") pod \"ovnkube-node-rldts\" (UID: \"ac21d247-409c-489e-8d3a-396c01dee935\") " pod="openshift-ovn-kubernetes/ovnkube-node-rldts" Jun 09 08:45:25.104545 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.102136 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac799a26-bfc2-45ee-806d-771558fabc2a-sys\") pod \"tuned-7f5qb\" (UID: \"ac799a26-bfc2-45ee-806d-771558fabc2a\") " pod="openshift-cluster-node-tuning-operator/tuned-7f5qb" Jun 09 08:45:25.104545 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.102160 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac799a26-bfc2-45ee-806d-771558fabc2a-lib-modules\") pod \"tuned-7f5qb\" (UID: \"ac799a26-bfc2-45ee-806d-771558fabc2a\") " pod="openshift-cluster-node-tuning-operator/tuned-7f5qb" Jun 09 08:45:25.104545 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.102175 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac799a26-bfc2-45ee-806d-771558fabc2a-etc-kubernetes\") pod \"tuned-7f5qb\" (UID: \"ac799a26-bfc2-45ee-806d-771558fabc2a\") " pod="openshift-cluster-node-tuning-operator/tuned-7f5qb" Jun 09 08:45:25.104545 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.102185 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ac799a26-bfc2-45ee-806d-771558fabc2a-etc-tuned\") pod \"tuned-7f5qb\" (UID: \"ac799a26-bfc2-45ee-806d-771558fabc2a\") " pod="openshift-cluster-node-tuning-operator/tuned-7f5qb" Jun 09 08:45:25.104545 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.102208 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ac21d247-409c-489e-8d3a-396c01dee935-systemd-units\") pod \"ovnkube-node-rldts\" (UID: \"ac21d247-409c-489e-8d3a-396c01dee935\") " pod="openshift-ovn-kubernetes/ovnkube-node-rldts" Jun 09 08:45:25.104545 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.102214 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0ad0de63-3d32-4927-9f79-8f848b6f52f4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-p6x82\" (UID: \"0ad0de63-3d32-4927-9f79-8f848b6f52f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6x82" Jun 09 08:45:25.104545 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.102235 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2505c746-7f3b-4dcc-a6a1-956885ca7fc3-system-cni-dir\") pod \"multus-additional-cni-plugins-jf7vr\" (UID: \"2505c746-7f3b-4dcc-a6a1-956885ca7fc3\") " pod="openshift-multus/multus-additional-cni-plugins-jf7vr" Jun 09 08:45:25.104545 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.102259 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c9696892-a39d-47db-9799-69ad596e65b8-host-slash\") pod \"iptables-alerter-v6bhs\" (UID: \"c9696892-a39d-47db-9799-69ad596e65b8\") " pod="openshift-network-operator/iptables-alerter-v6bhs" Jun 09 08:45:25.104545 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.102272 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/849de24e-c8a4-4afd-a40b-45f1f35290b5-konnectivity-ca\") pod \"konnectivity-agent-cct9r\" (UID: \"849de24e-c8a4-4afd-a40b-45f1f35290b5\") " pod="kube-system/konnectivity-agent-cct9r" Jun 09 08:45:25.104545 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.102283 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49g49\" (UniqueName: \"kubernetes.io/projected/c9696892-a39d-47db-9799-69ad596e65b8-kube-api-access-49g49\") pod \"iptables-alerter-v6bhs\" (UID: \"c9696892-a39d-47db-9799-69ad596e65b8\") " pod="openshift-network-operator/iptables-alerter-v6bhs" Jun 09 08:45:25.105359 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.102306 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ac799a26-bfc2-45ee-806d-771558fabc2a-etc-sysconfig\") pod \"tuned-7f5qb\" (UID: \"ac799a26-bfc2-45ee-806d-771558fabc2a\") " pod="openshift-cluster-node-tuning-operator/tuned-7f5qb" Jun 09 08:45:25.105359 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.102330 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjllj\" (UniqueName: \"kubernetes.io/projected/0ad0de63-3d32-4927-9f79-8f848b6f52f4-kube-api-access-kjllj\") pod \"aws-ebs-csi-driver-node-p6x82\" (UID: \"0ad0de63-3d32-4927-9f79-8f848b6f52f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6x82" Jun 09 08:45:25.105359 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.102337 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ac21d247-409c-489e-8d3a-396c01dee935-systemd-units\") pod \"ovnkube-node-rldts\" (UID: \"ac21d247-409c-489e-8d3a-396c01dee935\") " pod="openshift-ovn-kubernetes/ovnkube-node-rldts" Jun 09 08:45:25.105359 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.102355 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/955c937e-7a98-4e3a-b4bb-52e78c5ac289-metrics-certs\") pod \"network-metrics-daemon-qchhg\" (UID: \"955c937e-7a98-4e3a-b4bb-52e78c5ac289\") " pod="openshift-multus/network-metrics-daemon-qchhg" Jun 09 08:45:25.105359 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.102381 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c1eca8fd-ed14-4a3b-a17b-bf84f42f7302-host\") pod \"node-ca-ghb2d\" (UID: \"c1eca8fd-ed14-4a3b-a17b-bf84f42f7302\") " pod="openshift-image-registry/node-ca-ghb2d" Jun 09 08:45:25.105359 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.102382 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac799a26-bfc2-45ee-806d-771558fabc2a-sys\") pod \"tuned-7f5qb\" (UID: \"ac799a26-bfc2-45ee-806d-771558fabc2a\") " pod="openshift-cluster-node-tuning-operator/tuned-7f5qb" Jun 09 08:45:25.105359 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.102469 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac799a26-bfc2-45ee-806d-771558fabc2a-lib-modules\") pod \"tuned-7f5qb\" (UID: \"ac799a26-bfc2-45ee-806d-771558fabc2a\") " pod="openshift-cluster-node-tuning-operator/tuned-7f5qb" Jun 09 08:45:25.105359 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.102498 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e-os-release\") pod \"multus-fc2mh\" (UID: \"08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e\") " pod="openshift-multus/multus-fc2mh" Jun 09 08:45:25.105359 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.102526 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e-host-run-k8s-cni-cncf-io\") pod \"multus-fc2mh\" (UID: \"08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e\") " pod="openshift-multus/multus-fc2mh" Jun 09 08:45:25.105359 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.102553 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0ad0de63-3d32-4927-9f79-8f848b6f52f4-device-dir\") pod \"aws-ebs-csi-driver-node-p6x82\" (UID: \"0ad0de63-3d32-4927-9f79-8f848b6f52f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6x82" Jun 09 08:45:25.105359 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.102577 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ac21d247-409c-489e-8d3a-396c01dee935-host-slash\") pod \"ovnkube-node-rldts\" (UID: \"ac21d247-409c-489e-8d3a-396c01dee935\") " pod="openshift-ovn-kubernetes/ovnkube-node-rldts" Jun 09 08:45:25.105359 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:25.102593 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 08:45:25.105359 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.102600 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2505c746-7f3b-4dcc-a6a1-956885ca7fc3-cni-binary-copy\") pod \"multus-additional-cni-plugins-jf7vr\" (UID: \"2505c746-7f3b-4dcc-a6a1-956885ca7fc3\") " pod="openshift-multus/multus-additional-cni-plugins-jf7vr" Jun 09 08:45:25.105359 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.102499 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ac799a26-bfc2-45ee-806d-771558fabc2a-etc-sysconfig\") pod \"tuned-7f5qb\" (UID: \"ac799a26-bfc2-45ee-806d-771558fabc2a\") " pod="openshift-cluster-node-tuning-operator/tuned-7f5qb" Jun 09 08:45:25.105359 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:25.102670 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/955c937e-7a98-4e3a-b4bb-52e78c5ac289-metrics-certs podName:955c937e-7a98-4e3a-b4bb-52e78c5ac289 nodeName:}" failed. No retries permitted until 2026-06-09 08:45:25.602635251 +0000 UTC m=+3.047582597 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/955c937e-7a98-4e3a-b4bb-52e78c5ac289-metrics-certs") pod "network-metrics-daemon-qchhg" (UID: "955c937e-7a98-4e3a-b4bb-52e78c5ac289") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 08:45:25.105359 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.102694 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e-host-var-lib-cni-bin\") pod \"multus-fc2mh\" (UID: \"08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e\") " pod="openshift-multus/multus-fc2mh" Jun 09 08:45:25.105359 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.102708 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0ad0de63-3d32-4927-9f79-8f848b6f52f4-device-dir\") pod \"aws-ebs-csi-driver-node-p6x82\" (UID: \"0ad0de63-3d32-4927-9f79-8f848b6f52f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6x82" Jun 09 08:45:25.106183 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.102789 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ac21d247-409c-489e-8d3a-396c01dee935-host-slash\") pod \"ovnkube-node-rldts\" (UID: \"ac21d247-409c-489e-8d3a-396c01dee935\") " pod="openshift-ovn-kubernetes/ovnkube-node-rldts" Jun 09 08:45:25.106183 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.104917 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ac799a26-bfc2-45ee-806d-771558fabc2a-etc-tuned\") pod \"tuned-7f5qb\" (UID: \"ac799a26-bfc2-45ee-806d-771558fabc2a\") " pod="openshift-cluster-node-tuning-operator/tuned-7f5qb" Jun 09 08:45:25.106183 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.104983 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ac799a26-bfc2-45ee-806d-771558fabc2a-tmp\") pod \"tuned-7f5qb\" (UID: \"ac799a26-bfc2-45ee-806d-771558fabc2a\") " pod="openshift-cluster-node-tuning-operator/tuned-7f5qb" Jun 09 08:45:25.106183 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.105179 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ac21d247-409c-489e-8d3a-396c01dee935-ovn-node-metrics-cert\") pod \"ovnkube-node-rldts\" (UID: \"ac21d247-409c-489e-8d3a-396c01dee935\") " pod="openshift-ovn-kubernetes/ovnkube-node-rldts" Jun 09 08:45:25.106183 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.105183 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/849de24e-c8a4-4afd-a40b-45f1f35290b5-agent-certs\") pod \"konnectivity-agent-cct9r\" (UID: \"849de24e-c8a4-4afd-a40b-45f1f35290b5\") " pod="kube-system/konnectivity-agent-cct9r" Jun 09 08:45:25.114575 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:25.114552 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 08:45:25.114575 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:25.114576 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 08:45:25.114820 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:25.114588 2567 projected.go:196] Error preparing data for projected volume kube-api-access-kjp8p for pod openshift-network-diagnostics/network-check-target-4jvm8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 08:45:25.114820 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:25.114643 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8593ba17-a4fb-4caf-a018-e1e93147ffca-kube-api-access-kjp8p podName:8593ba17-a4fb-4caf-a018-e1e93147ffca nodeName:}" failed. No retries permitted until 2026-06-09 08:45:25.614629067 +0000 UTC m=+3.059576395 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-kjp8p" (UniqueName: "kubernetes.io/projected/8593ba17-a4fb-4caf-a018-e1e93147ffca-kube-api-access-kjp8p") pod "network-check-target-4jvm8" (UID: "8593ba17-a4fb-4caf-a018-e1e93147ffca") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 08:45:25.114820 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.114746 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj5gh\" (UniqueName: \"kubernetes.io/projected/ac799a26-bfc2-45ee-806d-771558fabc2a-kube-api-access-gj5gh\") pod \"tuned-7f5qb\" (UID: \"ac799a26-bfc2-45ee-806d-771558fabc2a\") " pod="openshift-cluster-node-tuning-operator/tuned-7f5qb" Jun 09 08:45:25.115520 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.115456 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzjbr\" (UniqueName: \"kubernetes.io/projected/955c937e-7a98-4e3a-b4bb-52e78c5ac289-kube-api-access-tzjbr\") pod \"network-metrics-daemon-qchhg\" (UID: \"955c937e-7a98-4e3a-b4bb-52e78c5ac289\") " pod="openshift-multus/network-metrics-daemon-qchhg" Jun 09 08:45:25.116966 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.116931 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rp6w\" (UniqueName: \"kubernetes.io/projected/ac21d247-409c-489e-8d3a-396c01dee935-kube-api-access-4rp6w\") pod \"ovnkube-node-rldts\" (UID: \"ac21d247-409c-489e-8d3a-396c01dee935\") " pod="openshift-ovn-kubernetes/ovnkube-node-rldts" Jun 09 08:45:25.117045 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.116973 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjllj\" (UniqueName: \"kubernetes.io/projected/0ad0de63-3d32-4927-9f79-8f848b6f52f4-kube-api-access-kjllj\") pod \"aws-ebs-csi-driver-node-p6x82\" (UID: \"0ad0de63-3d32-4927-9f79-8f848b6f52f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6x82" Jun 09 08:45:25.203138 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.203098 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5c8cf271-8ccb-42a2-abe4-fe6565f5346b-hosts-file\") pod \"node-resolver-6l4gp\" (UID: \"5c8cf271-8ccb-42a2-abe4-fe6565f5346b\") " pod="openshift-dns/node-resolver-6l4gp" Jun 09 08:45:25.203138 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.203145 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c8cf271-8ccb-42a2-abe4-fe6565f5346b-tmp-dir\") pod \"node-resolver-6l4gp\" (UID: \"5c8cf271-8ccb-42a2-abe4-fe6565f5346b\") " pod="openshift-dns/node-resolver-6l4gp" Jun 09 08:45:25.203391 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.203173 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e-system-cni-dir\") pod \"multus-fc2mh\" (UID: \"08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e\") " pod="openshift-multus/multus-fc2mh" Jun 09 08:45:25.203391 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.203197 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e-multus-conf-dir\") pod \"multus-fc2mh\" (UID: \"08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e\") " pod="openshift-multus/multus-fc2mh" Jun 09 08:45:25.203391 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.203221 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e-multus-daemon-config\") pod \"multus-fc2mh\" (UID: \"08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e\") " pod="openshift-multus/multus-fc2mh" Jun 09 08:45:25.203391 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.203253 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e-host-var-lib-kubelet\") pod \"multus-fc2mh\" (UID: \"08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e\") " pod="openshift-multus/multus-fc2mh" Jun 09 08:45:25.203391 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.203279 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvfdw\" (UniqueName: \"kubernetes.io/projected/5c8cf271-8ccb-42a2-abe4-fe6565f5346b-kube-api-access-jvfdw\") pod \"node-resolver-6l4gp\" (UID: \"5c8cf271-8ccb-42a2-abe4-fe6565f5346b\") " pod="openshift-dns/node-resolver-6l4gp" Jun 09 08:45:25.203391 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.203302 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e-multus-cni-dir\") pod \"multus-fc2mh\" (UID: \"08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e\") " pod="openshift-multus/multus-fc2mh" Jun 09 08:45:25.203391 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.203299 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e-multus-conf-dir\") pod \"multus-fc2mh\" (UID: \"08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e\") " pod="openshift-multus/multus-fc2mh" Jun 09 08:45:25.203391 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.203313 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e-system-cni-dir\") pod \"multus-fc2mh\" (UID: \"08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e\") " pod="openshift-multus/multus-fc2mh" Jun 09 08:45:25.203391 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.203342 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e-host-var-lib-kubelet\") pod \"multus-fc2mh\" (UID: \"08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e\") " pod="openshift-multus/multus-fc2mh" Jun 09 08:45:25.203391 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.203370 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e-multus-cni-dir\") pod \"multus-fc2mh\" (UID: \"08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e\") " pod="openshift-multus/multus-fc2mh" Jun 09 08:45:25.203391 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.203390 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e-host-run-multus-certs\") pod \"multus-fc2mh\" (UID: \"08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e\") " pod="openshift-multus/multus-fc2mh" Jun 09 08:45:25.203985 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.203421 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rs7ll\" (UniqueName: \"kubernetes.io/projected/08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e-kube-api-access-rs7ll\") pod \"multus-fc2mh\" (UID: \"08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e\") " pod="openshift-multus/multus-fc2mh" Jun 09 08:45:25.203985 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.203441 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e-etc-kubernetes\") pod \"multus-fc2mh\" (UID: \"08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e\") " pod="openshift-multus/multus-fc2mh" Jun 09 08:45:25.203985 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.203446 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e-host-run-multus-certs\") pod \"multus-fc2mh\" (UID: \"08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e\") " pod="openshift-multus/multus-fc2mh" Jun 09 08:45:25.203985 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.203421 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5c8cf271-8ccb-42a2-abe4-fe6565f5346b-hosts-file\") pod \"node-resolver-6l4gp\" (UID: \"5c8cf271-8ccb-42a2-abe4-fe6565f5346b\") " pod="openshift-dns/node-resolver-6l4gp" Jun 09 08:45:25.203985 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.203459 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2505c746-7f3b-4dcc-a6a1-956885ca7fc3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jf7vr\" (UID: \"2505c746-7f3b-4dcc-a6a1-956885ca7fc3\") " pod="openshift-multus/multus-additional-cni-plugins-jf7vr" Jun 09 08:45:25.203985 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.203480 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e-host-var-lib-cni-multus\") pod \"multus-fc2mh\" (UID: \"08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e\") " pod="openshift-multus/multus-fc2mh" Jun 09 08:45:25.203985 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.203497 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c9696892-a39d-47db-9799-69ad596e65b8-iptables-alerter-script\") pod \"iptables-alerter-v6bhs\" (UID: \"c9696892-a39d-47db-9799-69ad596e65b8\") " pod="openshift-network-operator/iptables-alerter-v6bhs" Jun 09 08:45:25.203985 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.203512 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e-cnibin\") pod \"multus-fc2mh\" (UID: \"08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e\") " pod="openshift-multus/multus-fc2mh" Jun 09 08:45:25.203985 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.203518 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c8cf271-8ccb-42a2-abe4-fe6565f5346b-tmp-dir\") pod \"node-resolver-6l4gp\" (UID: \"5c8cf271-8ccb-42a2-abe4-fe6565f5346b\") " pod="openshift-dns/node-resolver-6l4gp" Jun 09 08:45:25.203985 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.203566 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2505c746-7f3b-4dcc-a6a1-956885ca7fc3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jf7vr\" (UID: \"2505c746-7f3b-4dcc-a6a1-956885ca7fc3\") " pod="openshift-multus/multus-additional-cni-plugins-jf7vr" Jun 09 08:45:25.203985 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.203581 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e-cnibin\") pod \"multus-fc2mh\" (UID: \"08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e\") " pod="openshift-multus/multus-fc2mh" Jun 09 08:45:25.203985 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.203597 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c1eca8fd-ed14-4a3b-a17b-bf84f42f7302-serviceca\") pod \"node-ca-ghb2d\" (UID: \"c1eca8fd-ed14-4a3b-a17b-bf84f42f7302\") " pod="openshift-image-registry/node-ca-ghb2d" Jun 09 08:45:25.203985 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.203609 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e-host-var-lib-cni-multus\") pod \"multus-fc2mh\" (UID: \"08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e\") " pod="openshift-multus/multus-fc2mh" Jun 09 08:45:25.203985 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.203662 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e-etc-kubernetes\") pod \"multus-fc2mh\" (UID: \"08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e\") " pod="openshift-multus/multus-fc2mh" Jun 09 08:45:25.203985 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.203639 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e-multus-socket-dir-parent\") pod \"multus-fc2mh\" (UID: \"08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e\") " pod="openshift-multus/multus-fc2mh" Jun 09 08:45:25.203985 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.203681 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2505c746-7f3b-4dcc-a6a1-956885ca7fc3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jf7vr\" (UID: \"2505c746-7f3b-4dcc-a6a1-956885ca7fc3\") " pod="openshift-multus/multus-additional-cni-plugins-jf7vr" Jun 09 08:45:25.203985 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.203715 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e-multus-socket-dir-parent\") pod \"multus-fc2mh\" (UID: \"08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e\") " pod="openshift-multus/multus-fc2mh" Jun 09 08:45:25.203985 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.203766 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2505c746-7f3b-4dcc-a6a1-956885ca7fc3-system-cni-dir\") pod \"multus-additional-cni-plugins-jf7vr\" (UID: \"2505c746-7f3b-4dcc-a6a1-956885ca7fc3\") " pod="openshift-multus/multus-additional-cni-plugins-jf7vr" Jun 09 08:45:25.204828 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.203793 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c9696892-a39d-47db-9799-69ad596e65b8-host-slash\") pod \"iptables-alerter-v6bhs\" (UID: \"c9696892-a39d-47db-9799-69ad596e65b8\") " pod="openshift-network-operator/iptables-alerter-v6bhs" Jun 09 08:45:25.204828 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.203817 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49g49\" (UniqueName: \"kubernetes.io/projected/c9696892-a39d-47db-9799-69ad596e65b8-kube-api-access-49g49\") pod \"iptables-alerter-v6bhs\" (UID: \"c9696892-a39d-47db-9799-69ad596e65b8\") " pod="openshift-network-operator/iptables-alerter-v6bhs" Jun 09 08:45:25.204828 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.203842 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c9696892-a39d-47db-9799-69ad596e65b8-host-slash\") pod \"iptables-alerter-v6bhs\" (UID: \"c9696892-a39d-47db-9799-69ad596e65b8\") " pod="openshift-network-operator/iptables-alerter-v6bhs" Jun 09 08:45:25.204828 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.203856 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c1eca8fd-ed14-4a3b-a17b-bf84f42f7302-host\") pod \"node-ca-ghb2d\" (UID: \"c1eca8fd-ed14-4a3b-a17b-bf84f42f7302\") " pod="openshift-image-registry/node-ca-ghb2d" Jun 09 08:45:25.204828 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.203890 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e-multus-daemon-config\") pod \"multus-fc2mh\" (UID: \"08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e\") " pod="openshift-multus/multus-fc2mh" Jun 09 08:45:25.204828 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.203900 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c1eca8fd-ed14-4a3b-a17b-bf84f42f7302-host\") pod \"node-ca-ghb2d\" (UID: \"c1eca8fd-ed14-4a3b-a17b-bf84f42f7302\") " pod="openshift-image-registry/node-ca-ghb2d" Jun 09 08:45:25.204828 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.203817 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2505c746-7f3b-4dcc-a6a1-956885ca7fc3-system-cni-dir\") pod \"multus-additional-cni-plugins-jf7vr\" (UID: \"2505c746-7f3b-4dcc-a6a1-956885ca7fc3\") " pod="openshift-multus/multus-additional-cni-plugins-jf7vr" Jun 09 08:45:25.204828 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.204006 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e-os-release\") pod \"multus-fc2mh\" (UID: \"08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e\") " pod="openshift-multus/multus-fc2mh" Jun 09 08:45:25.204828 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.204030 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e-host-run-k8s-cni-cncf-io\") pod \"multus-fc2mh\" (UID: \"08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e\") " pod="openshift-multus/multus-fc2mh" Jun 09 08:45:25.204828 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.204048 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2505c746-7f3b-4dcc-a6a1-956885ca7fc3-cni-binary-copy\") pod \"multus-additional-cni-plugins-jf7vr\" (UID: \"2505c746-7f3b-4dcc-a6a1-956885ca7fc3\") " pod="openshift-multus/multus-additional-cni-plugins-jf7vr" Jun 09 08:45:25.204828 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.204074 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e-host-var-lib-cni-bin\") pod \"multus-fc2mh\" (UID: \"08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e\") " pod="openshift-multus/multus-fc2mh" Jun 09 08:45:25.204828 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.204101 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2505c746-7f3b-4dcc-a6a1-956885ca7fc3-os-release\") pod \"multus-additional-cni-plugins-jf7vr\" (UID: \"2505c746-7f3b-4dcc-a6a1-956885ca7fc3\") " pod="openshift-multus/multus-additional-cni-plugins-jf7vr" Jun 09 08:45:25.204828 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.204102 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e-host-run-k8s-cni-cncf-io\") pod \"multus-fc2mh\" (UID: \"08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e\") " pod="openshift-multus/multus-fc2mh" Jun 09 08:45:25.204828 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.204117 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e-os-release\") pod \"multus-fc2mh\" (UID: \"08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e\") " pod="openshift-multus/multus-fc2mh" Jun 09 08:45:25.204828 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.204117 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2505c746-7f3b-4dcc-a6a1-956885ca7fc3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jf7vr\" (UID: \"2505c746-7f3b-4dcc-a6a1-956885ca7fc3\") " pod="openshift-multus/multus-additional-cni-plugins-jf7vr" Jun 09 08:45:25.204828 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.204125 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jr4q\" (UniqueName: \"kubernetes.io/projected/c1eca8fd-ed14-4a3b-a17b-bf84f42f7302-kube-api-access-2jr4q\") pod \"node-ca-ghb2d\" (UID: \"c1eca8fd-ed14-4a3b-a17b-bf84f42f7302\") " pod="openshift-image-registry/node-ca-ghb2d" Jun 09 08:45:25.204828 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.204161 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e-host-var-lib-cni-bin\") pod \"multus-fc2mh\" (UID: \"08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e\") " pod="openshift-multus/multus-fc2mh" Jun 09 08:45:25.204828 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.204162 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e-cni-binary-copy\") pod \"multus-fc2mh\" (UID: \"08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e\") " pod="openshift-multus/multus-fc2mh" Jun 09 08:45:25.205499 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.204177 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c1eca8fd-ed14-4a3b-a17b-bf84f42f7302-serviceca\") pod \"node-ca-ghb2d\" (UID: \"c1eca8fd-ed14-4a3b-a17b-bf84f42f7302\") " pod="openshift-image-registry/node-ca-ghb2d" Jun 09 08:45:25.205499 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.204184 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2505c746-7f3b-4dcc-a6a1-956885ca7fc3-os-release\") pod \"multus-additional-cni-plugins-jf7vr\" (UID: \"2505c746-7f3b-4dcc-a6a1-956885ca7fc3\") " pod="openshift-multus/multus-additional-cni-plugins-jf7vr" Jun 09 08:45:25.205499 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.204198 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e-hostroot\") pod \"multus-fc2mh\" (UID: \"08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e\") " pod="openshift-multus/multus-fc2mh" Jun 09 08:45:25.205499 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.204225 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2505c746-7f3b-4dcc-a6a1-956885ca7fc3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jf7vr\" (UID: \"2505c746-7f3b-4dcc-a6a1-956885ca7fc3\") " pod="openshift-multus/multus-additional-cni-plugins-jf7vr" Jun 09 08:45:25.205499 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.204252 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g76fh\" (UniqueName: \"kubernetes.io/projected/2505c746-7f3b-4dcc-a6a1-956885ca7fc3-kube-api-access-g76fh\") pod \"multus-additional-cni-plugins-jf7vr\" (UID: \"2505c746-7f3b-4dcc-a6a1-956885ca7fc3\") " pod="openshift-multus/multus-additional-cni-plugins-jf7vr" Jun 09 08:45:25.205499 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.204254 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c9696892-a39d-47db-9799-69ad596e65b8-iptables-alerter-script\") pod \"iptables-alerter-v6bhs\" (UID: \"c9696892-a39d-47db-9799-69ad596e65b8\") " pod="openshift-network-operator/iptables-alerter-v6bhs" Jun 09 08:45:25.205499 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.204276 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e-host-run-netns\") pod \"multus-fc2mh\" (UID: \"08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e\") " pod="openshift-multus/multus-fc2mh" Jun 09 08:45:25.205499 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.204302 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2505c746-7f3b-4dcc-a6a1-956885ca7fc3-cnibin\") pod \"multus-additional-cni-plugins-jf7vr\" (UID: \"2505c746-7f3b-4dcc-a6a1-956885ca7fc3\") " pod="openshift-multus/multus-additional-cni-plugins-jf7vr" Jun 09 08:45:25.205499 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.204314 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e-hostroot\") pod \"multus-fc2mh\" (UID: \"08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e\") " pod="openshift-multus/multus-fc2mh" Jun 09 08:45:25.205499 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.204333 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e-host-run-netns\") pod \"multus-fc2mh\" (UID: \"08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e\") " pod="openshift-multus/multus-fc2mh" Jun 09 08:45:25.205499 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.204364 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2505c746-7f3b-4dcc-a6a1-956885ca7fc3-cnibin\") pod \"multus-additional-cni-plugins-jf7vr\" (UID: \"2505c746-7f3b-4dcc-a6a1-956885ca7fc3\") " pod="openshift-multus/multus-additional-cni-plugins-jf7vr" Jun 09 08:45:25.205499 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.204521 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2505c746-7f3b-4dcc-a6a1-956885ca7fc3-cni-binary-copy\") pod \"multus-additional-cni-plugins-jf7vr\" (UID: \"2505c746-7f3b-4dcc-a6a1-956885ca7fc3\") " pod="openshift-multus/multus-additional-cni-plugins-jf7vr" Jun 09 08:45:25.205499 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.204610 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e-cni-binary-copy\") pod \"multus-fc2mh\" (UID: \"08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e\") " pod="openshift-multus/multus-fc2mh" Jun 09 08:45:25.205499 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.204740 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2505c746-7f3b-4dcc-a6a1-956885ca7fc3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jf7vr\" (UID: \"2505c746-7f3b-4dcc-a6a1-956885ca7fc3\") " pod="openshift-multus/multus-additional-cni-plugins-jf7vr" Jun 09 08:45:25.212363 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.212339 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvfdw\" (UniqueName: \"kubernetes.io/projected/5c8cf271-8ccb-42a2-abe4-fe6565f5346b-kube-api-access-jvfdw\") pod \"node-resolver-6l4gp\" (UID: \"5c8cf271-8ccb-42a2-abe4-fe6565f5346b\") " pod="openshift-dns/node-resolver-6l4gp" Jun 09 08:45:25.212522 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.212496 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rs7ll\" (UniqueName: \"kubernetes.io/projected/08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e-kube-api-access-rs7ll\") pod \"multus-fc2mh\" (UID: \"08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e\") " pod="openshift-multus/multus-fc2mh" Jun 09 08:45:25.212959 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.212935 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jr4q\" (UniqueName: \"kubernetes.io/projected/c1eca8fd-ed14-4a3b-a17b-bf84f42f7302-kube-api-access-2jr4q\") pod \"node-ca-ghb2d\" (UID: \"c1eca8fd-ed14-4a3b-a17b-bf84f42f7302\") " pod="openshift-image-registry/node-ca-ghb2d" Jun 09 08:45:25.213049 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.213022 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g76fh\" (UniqueName: \"kubernetes.io/projected/2505c746-7f3b-4dcc-a6a1-956885ca7fc3-kube-api-access-g76fh\") pod \"multus-additional-cni-plugins-jf7vr\" (UID: \"2505c746-7f3b-4dcc-a6a1-956885ca7fc3\") " pod="openshift-multus/multus-additional-cni-plugins-jf7vr" Jun 09 08:45:25.214320 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.214299 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49g49\" (UniqueName: \"kubernetes.io/projected/c9696892-a39d-47db-9799-69ad596e65b8-kube-api-access-49g49\") pod \"iptables-alerter-v6bhs\" (UID: \"c9696892-a39d-47db-9799-69ad596e65b8\") " pod="openshift-network-operator/iptables-alerter-v6bhs" Jun 09 08:45:25.287257 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.287177 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7f5qb" Jun 09 08:45:25.298010 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.297980 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rldts" Jun 09 08:45:25.318233 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.318202 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cct9r" Jun 09 08:45:25.329911 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.329884 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6x82" Jun 09 08:45:25.337725 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.337705 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6l4gp" Jun 09 08:45:25.345330 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.345307 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jf7vr" Jun 09 08:45:25.353987 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.353965 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fc2mh" Jun 09 08:45:25.361512 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.361486 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ghb2d" Jun 09 08:45:25.369130 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.369110 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-v6bhs" Jun 09 08:45:25.457083 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:25.457056 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c8cf271_8ccb_42a2_abe4_fe6565f5346b.slice/crio-32e9175463b672e578aa0570ea06e93c7477f3534ba8492984bc7a16a29302c4 WatchSource:0}: Error finding container 32e9175463b672e578aa0570ea06e93c7477f3534ba8492984bc7a16a29302c4: Status 404 returned error can't find the container with id 32e9175463b672e578aa0570ea06e93c7477f3534ba8492984bc7a16a29302c4 Jun 09 08:45:25.457793 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:25.457773 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2505c746_7f3b_4dcc_a6a1_956885ca7fc3.slice/crio-a6518ad03d801561bd05cf2f0a90c126fb7b4a16daf3eaca195add7b04c91cb8 WatchSource:0}: Error finding container a6518ad03d801561bd05cf2f0a90c126fb7b4a16daf3eaca195add7b04c91cb8: Status 404 returned error can't find the container with id a6518ad03d801561bd05cf2f0a90c126fb7b4a16daf3eaca195add7b04c91cb8 Jun 09 08:45:25.460383 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:25.460361 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac21d247_409c_489e_8d3a_396c01dee935.slice/crio-5ee15d47623f8112246aafbedaf794123608a870de1c4587ab5e83e4ce68b4f2 WatchSource:0}: Error finding container 5ee15d47623f8112246aafbedaf794123608a870de1c4587ab5e83e4ce68b4f2: Status 404 returned error can't find the container with id 5ee15d47623f8112246aafbedaf794123608a870de1c4587ab5e83e4ce68b4f2 Jun 09 08:45:25.483368 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:25.483338 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod849de24e_c8a4_4afd_a40b_45f1f35290b5.slice/crio-5b9b38caf4fba150191872a8c3afc59553b6355e86690fb3b0d5e5cde9a6c914 WatchSource:0}: Error finding container 5b9b38caf4fba150191872a8c3afc59553b6355e86690fb3b0d5e5cde9a6c914: Status 404 returned error can't find the container with id 5b9b38caf4fba150191872a8c3afc59553b6355e86690fb3b0d5e5cde9a6c914 Jun 09 08:45:25.484235 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:25.484214 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1eca8fd_ed14_4a3b_a17b_bf84f42f7302.slice/crio-b27aa6a45c51e4217ce41756c33714eb8df95c731bfb9a0e78062834c645472b WatchSource:0}: Error finding container b27aa6a45c51e4217ce41756c33714eb8df95c731bfb9a0e78062834c645472b: Status 404 returned error can't find the container with id b27aa6a45c51e4217ce41756c33714eb8df95c731bfb9a0e78062834c645472b Jun 09 08:45:25.485269 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:25.485246 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08a58dd1_4ebb_4a3f_a35a_24c6a035ca2e.slice/crio-b97bed3dc17cdf193b1ac8264b0d60336b872f1f23505f61efad31c9f54fc225 WatchSource:0}: Error finding container b97bed3dc17cdf193b1ac8264b0d60336b872f1f23505f61efad31c9f54fc225: Status 404 returned error can't find the container with id b97bed3dc17cdf193b1ac8264b0d60336b872f1f23505f61efad31c9f54fc225 Jun 09 08:45:25.486102 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:25.486081 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ad0de63_3d32_4927_9f79_8f848b6f52f4.slice/crio-b40c819c8d4b767bfb0b9f496dd6b99d76e28e667e9dfbe2fc2fb392c03a8bda WatchSource:0}: Error finding container b40c819c8d4b767bfb0b9f496dd6b99d76e28e667e9dfbe2fc2fb392c03a8bda: Status 404 returned error can't find the container with id b40c819c8d4b767bfb0b9f496dd6b99d76e28e667e9dfbe2fc2fb392c03a8bda Jun 09 08:45:25.487302 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:25.487281 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9696892_a39d_47db_9799_69ad596e65b8.slice/crio-840d9340bb92a08b6d58afcacb7b211f6ac467f42a194deb021314dd4de31bbc WatchSource:0}: Error finding container 840d9340bb92a08b6d58afcacb7b211f6ac467f42a194deb021314dd4de31bbc: Status 404 returned error can't find the container with id 840d9340bb92a08b6d58afcacb7b211f6ac467f42a194deb021314dd4de31bbc Jun 09 08:45:25.606938 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.606903 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/955c937e-7a98-4e3a-b4bb-52e78c5ac289-metrics-certs\") pod \"network-metrics-daemon-qchhg\" (UID: \"955c937e-7a98-4e3a-b4bb-52e78c5ac289\") " pod="openshift-multus/network-metrics-daemon-qchhg" Jun 09 08:45:25.607143 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.606959 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae90f658-436b-42fc-b170-318cd82d55b1-original-pull-secret\") pod \"global-pull-secret-syncer-grvqt\" (UID: \"ae90f658-436b-42fc-b170-318cd82d55b1\") " pod="kube-system/global-pull-secret-syncer-grvqt" Jun 09 08:45:25.607143 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:25.607065 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 08:45:25.607143 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:25.607065 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 08:45:25.607143 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:25.607125 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae90f658-436b-42fc-b170-318cd82d55b1-original-pull-secret podName:ae90f658-436b-42fc-b170-318cd82d55b1 nodeName:}" failed. No retries permitted until 2026-06-09 08:45:26.607107597 +0000 UTC m=+4.052054932 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ae90f658-436b-42fc-b170-318cd82d55b1-original-pull-secret") pod "global-pull-secret-syncer-grvqt" (UID: "ae90f658-436b-42fc-b170-318cd82d55b1") : object "kube-system"/"original-pull-secret" not registered Jun 09 08:45:25.607143 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:25.607144 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/955c937e-7a98-4e3a-b4bb-52e78c5ac289-metrics-certs podName:955c937e-7a98-4e3a-b4bb-52e78c5ac289 nodeName:}" failed. No retries permitted until 2026-06-09 08:45:26.607135401 +0000 UTC m=+4.052082730 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/955c937e-7a98-4e3a-b4bb-52e78c5ac289-metrics-certs") pod "network-metrics-daemon-qchhg" (UID: "955c937e-7a98-4e3a-b4bb-52e78c5ac289") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 08:45:25.707832 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:25.707797 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjp8p\" (UniqueName: \"kubernetes.io/projected/8593ba17-a4fb-4caf-a018-e1e93147ffca-kube-api-access-kjp8p\") pod \"network-check-target-4jvm8\" (UID: \"8593ba17-a4fb-4caf-a018-e1e93147ffca\") " pod="openshift-network-diagnostics/network-check-target-4jvm8" Jun 09 08:45:25.708015 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:25.707990 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 08:45:25.708015 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:25.708015 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 08:45:25.708117 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:25.708029 2567 projected.go:196] Error preparing data for projected volume kube-api-access-kjp8p for pod openshift-network-diagnostics/network-check-target-4jvm8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 08:45:25.708117 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:25.708093 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8593ba17-a4fb-4caf-a018-e1e93147ffca-kube-api-access-kjp8p podName:8593ba17-a4fb-4caf-a018-e1e93147ffca nodeName:}" failed. No retries permitted until 2026-06-09 08:45:26.7080735 +0000 UTC m=+4.153020843 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-kjp8p" (UniqueName: "kubernetes.io/projected/8593ba17-a4fb-4caf-a018-e1e93147ffca-kube-api-access-kjp8p") pod "network-check-target-4jvm8" (UID: "8593ba17-a4fb-4caf-a018-e1e93147ffca") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 08:45:25.818146 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:25.818115 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac799a26_bfc2_45ee_806d_771558fabc2a.slice/crio-0eb7fb13272a445825a1c6a75c8fc6890b101a93fbabc293322d4dd9a06bb4ab WatchSource:0}: Error finding container 0eb7fb13272a445825a1c6a75c8fc6890b101a93fbabc293322d4dd9a06bb4ab: Status 404 returned error can't find the container with id 0eb7fb13272a445825a1c6a75c8fc6890b101a93fbabc293322d4dd9a06bb4ab Jun 09 08:45:26.040517 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:26.040418 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 08:40:25 +0000 UTC" deadline="2027-12-03 05:11:10.119758663 +0000 UTC" Jun 09 08:45:26.040517 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:26.040459 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13004h25m44.079303942s" Jun 09 08:45:26.068514 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:26.068481 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-grvqt" Jun 09 08:45:26.068694 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:26.068618 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-grvqt" podUID="ae90f658-436b-42fc-b170-318cd82d55b1" Jun 09 08:45:26.081780 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:26.081694 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7f5qb" event={"ID":"ac799a26-bfc2-45ee-806d-771558fabc2a","Type":"ContainerStarted","Data":"0eb7fb13272a445825a1c6a75c8fc6890b101a93fbabc293322d4dd9a06bb4ab"} Jun 09 08:45:26.083405 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:26.083374 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-v6bhs" event={"ID":"c9696892-a39d-47db-9799-69ad596e65b8","Type":"ContainerStarted","Data":"840d9340bb92a08b6d58afcacb7b211f6ac467f42a194deb021314dd4de31bbc"} Jun 09 08:45:26.084867 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:26.084804 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ghb2d" event={"ID":"c1eca8fd-ed14-4a3b-a17b-bf84f42f7302","Type":"ContainerStarted","Data":"b27aa6a45c51e4217ce41756c33714eb8df95c731bfb9a0e78062834c645472b"} Jun 09 08:45:26.086206 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:26.086169 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cct9r" event={"ID":"849de24e-c8a4-4afd-a40b-45f1f35290b5","Type":"ContainerStarted","Data":"5b9b38caf4fba150191872a8c3afc59553b6355e86690fb3b0d5e5cde9a6c914"} Jun 09 08:45:26.087765 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:26.087714 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jf7vr" event={"ID":"2505c746-7f3b-4dcc-a6a1-956885ca7fc3","Type":"ContainerStarted","Data":"a6518ad03d801561bd05cf2f0a90c126fb7b4a16daf3eaca195add7b04c91cb8"} Jun 09 08:45:26.089159 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:26.089135 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6l4gp" event={"ID":"5c8cf271-8ccb-42a2-abe4-fe6565f5346b","Type":"ContainerStarted","Data":"32e9175463b672e578aa0570ea06e93c7477f3534ba8492984bc7a16a29302c4"} Jun 09 08:45:26.090572 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:26.090524 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6x82" event={"ID":"0ad0de63-3d32-4927-9f79-8f848b6f52f4","Type":"ContainerStarted","Data":"b40c819c8d4b767bfb0b9f496dd6b99d76e28e667e9dfbe2fc2fb392c03a8bda"} Jun 09 08:45:26.091842 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:26.091818 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fc2mh" event={"ID":"08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e","Type":"ContainerStarted","Data":"b97bed3dc17cdf193b1ac8264b0d60336b872f1f23505f61efad31c9f54fc225"} Jun 09 08:45:26.093443 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:26.093353 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rldts" event={"ID":"ac21d247-409c-489e-8d3a-396c01dee935","Type":"ContainerStarted","Data":"5ee15d47623f8112246aafbedaf794123608a870de1c4587ab5e83e4ce68b4f2"} Jun 09 08:45:26.615756 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:26.613151 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae90f658-436b-42fc-b170-318cd82d55b1-original-pull-secret\") pod \"global-pull-secret-syncer-grvqt\" (UID: \"ae90f658-436b-42fc-b170-318cd82d55b1\") " pod="kube-system/global-pull-secret-syncer-grvqt" Jun 09 08:45:26.615756 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:26.613461 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/955c937e-7a98-4e3a-b4bb-52e78c5ac289-metrics-certs\") pod \"network-metrics-daemon-qchhg\" (UID: \"955c937e-7a98-4e3a-b4bb-52e78c5ac289\") " pod="openshift-multus/network-metrics-daemon-qchhg" Jun 09 08:45:26.615756 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:26.613595 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 08:45:26.615756 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:26.613675 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/955c937e-7a98-4e3a-b4bb-52e78c5ac289-metrics-certs podName:955c937e-7a98-4e3a-b4bb-52e78c5ac289 nodeName:}" failed. No retries permitted until 2026-06-09 08:45:28.61364008 +0000 UTC m=+6.058587424 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/955c937e-7a98-4e3a-b4bb-52e78c5ac289-metrics-certs") pod "network-metrics-daemon-qchhg" (UID: "955c937e-7a98-4e3a-b4bb-52e78c5ac289") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 08:45:26.615756 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:26.614076 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 08:45:26.615756 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:26.614151 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae90f658-436b-42fc-b170-318cd82d55b1-original-pull-secret podName:ae90f658-436b-42fc-b170-318cd82d55b1 nodeName:}" failed. No retries permitted until 2026-06-09 08:45:28.614110149 +0000 UTC m=+6.059057482 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ae90f658-436b-42fc-b170-318cd82d55b1-original-pull-secret") pod "global-pull-secret-syncer-grvqt" (UID: "ae90f658-436b-42fc-b170-318cd82d55b1") : object "kube-system"/"original-pull-secret" not registered Jun 09 08:45:26.717011 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:26.716973 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjp8p\" (UniqueName: \"kubernetes.io/projected/8593ba17-a4fb-4caf-a018-e1e93147ffca-kube-api-access-kjp8p\") pod \"network-check-target-4jvm8\" (UID: \"8593ba17-a4fb-4caf-a018-e1e93147ffca\") " pod="openshift-network-diagnostics/network-check-target-4jvm8" Jun 09 08:45:26.717186 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:26.717170 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 08:45:26.717245 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:26.717189 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 08:45:26.717245 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:26.717202 2567 projected.go:196] Error preparing data for projected volume kube-api-access-kjp8p for pod openshift-network-diagnostics/network-check-target-4jvm8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 08:45:26.717344 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:26.717261 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8593ba17-a4fb-4caf-a018-e1e93147ffca-kube-api-access-kjp8p podName:8593ba17-a4fb-4caf-a018-e1e93147ffca nodeName:}" failed. No retries permitted until 2026-06-09 08:45:28.717242441 +0000 UTC m=+6.162189774 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-kjp8p" (UniqueName: "kubernetes.io/projected/8593ba17-a4fb-4caf-a018-e1e93147ffca-kube-api-access-kjp8p") pod "network-check-target-4jvm8" (UID: "8593ba17-a4fb-4caf-a018-e1e93147ffca") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 08:45:26.805122 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:26.804893 2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 08:45:27.041347 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:27.041256 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 08:40:25 +0000 UTC" deadline="2028-03-08 07:14:59.632124626 +0000 UTC" Jun 09 08:45:27.041347 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:27.041323 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15310h29m32.590806863s" Jun 09 08:45:27.069860 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:27.069767 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4jvm8" Jun 09 08:45:27.070019 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:27.069902 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4jvm8" podUID="8593ba17-a4fb-4caf-a018-e1e93147ffca" Jun 09 08:45:27.070363 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:27.070147 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qchhg" Jun 09 08:45:27.070363 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:27.070284 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qchhg" podUID="955c937e-7a98-4e3a-b4bb-52e78c5ac289" Jun 09 08:45:27.133056 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:27.132964 2567 generic.go:356] "Generic (PLEG): container finished" podID="b19be8fb830e82b1a846fc0a2b66a0b3" containerID="024671d506f9da4cca66d4c6090b6cb9d99046ce5bdf14f8f60454b7d22f627f" exitCode=0 Jun 09 08:45:27.133216 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:27.133064 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-114.ec2.internal" event={"ID":"b19be8fb830e82b1a846fc0a2b66a0b3","Type":"ContainerDied","Data":"024671d506f9da4cca66d4c6090b6cb9d99046ce5bdf14f8f60454b7d22f627f"} Jun 09 08:45:27.138871 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:27.138702 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-114.ec2.internal" event={"ID":"2b5ea2489658268516287fa452cb2cb5","Type":"ContainerStarted","Data":"0e9069edfc6c216ab9ca7161aab7ef41942b454e8ee628ceabc74366ac42b5e4"} Jun 09 08:45:27.166727 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:27.166670 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-114.ec2.internal" podStartSLOduration=3.166631822 podStartE2EDuration="3.166631822s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 08:45:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:45:27.165784347 +0000 UTC m=+4.610731697" watchObservedRunningTime="2026-06-09 08:45:27.166631822 +0000 UTC m=+4.611579174" Jun 09 08:45:28.069307 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:28.068814 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-grvqt" Jun 09 08:45:28.069307 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:28.068939 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-grvqt" podUID="ae90f658-436b-42fc-b170-318cd82d55b1" Jun 09 08:45:28.153797 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:28.153722 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-114.ec2.internal" event={"ID":"b19be8fb830e82b1a846fc0a2b66a0b3","Type":"ContainerStarted","Data":"a3270f5e2b119a68e007cb11911d42820c873397fadfa5d6105559d34a2eb0a3"} Jun 09 08:45:28.170307 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:28.170243 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-114.ec2.internal" podStartSLOduration=4.1702216 podStartE2EDuration="4.1702216s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 08:45:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:45:28.169932034 +0000 UTC m=+5.614879385" watchObservedRunningTime="2026-06-09 08:45:28.1702216 +0000 UTC m=+5.615168952" Jun 09 08:45:28.634632 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:28.634591 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/955c937e-7a98-4e3a-b4bb-52e78c5ac289-metrics-certs\") pod \"network-metrics-daemon-qchhg\" (UID: \"955c937e-7a98-4e3a-b4bb-52e78c5ac289\") " pod="openshift-multus/network-metrics-daemon-qchhg" Jun 09 08:45:28.634836 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:28.634678 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae90f658-436b-42fc-b170-318cd82d55b1-original-pull-secret\") pod \"global-pull-secret-syncer-grvqt\" (UID: \"ae90f658-436b-42fc-b170-318cd82d55b1\") " pod="kube-system/global-pull-secret-syncer-grvqt" Jun 09 08:45:28.634836 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:28.634806 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 08:45:28.634942 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:28.634878 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae90f658-436b-42fc-b170-318cd82d55b1-original-pull-secret podName:ae90f658-436b-42fc-b170-318cd82d55b1 nodeName:}" failed. No retries permitted until 2026-06-09 08:45:32.634858962 +0000 UTC m=+10.079806298 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ae90f658-436b-42fc-b170-318cd82d55b1-original-pull-secret") pod "global-pull-secret-syncer-grvqt" (UID: "ae90f658-436b-42fc-b170-318cd82d55b1") : object "kube-system"/"original-pull-secret" not registered Jun 09 08:45:28.635010 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:28.634948 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 08:45:28.635010 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:28.634982 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/955c937e-7a98-4e3a-b4bb-52e78c5ac289-metrics-certs podName:955c937e-7a98-4e3a-b4bb-52e78c5ac289 nodeName:}" failed. No retries permitted until 2026-06-09 08:45:32.634970476 +0000 UTC m=+10.079917808 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/955c937e-7a98-4e3a-b4bb-52e78c5ac289-metrics-certs") pod "network-metrics-daemon-qchhg" (UID: "955c937e-7a98-4e3a-b4bb-52e78c5ac289") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 08:45:28.735978 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:28.735938 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjp8p\" (UniqueName: \"kubernetes.io/projected/8593ba17-a4fb-4caf-a018-e1e93147ffca-kube-api-access-kjp8p\") pod \"network-check-target-4jvm8\" (UID: \"8593ba17-a4fb-4caf-a018-e1e93147ffca\") " pod="openshift-network-diagnostics/network-check-target-4jvm8" Jun 09 08:45:28.736146 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:28.736131 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 08:45:28.736213 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:28.736156 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 08:45:28.736213 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:28.736169 2567 projected.go:196] Error preparing data for projected volume kube-api-access-kjp8p for pod openshift-network-diagnostics/network-check-target-4jvm8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 08:45:28.736319 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:28.736232 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8593ba17-a4fb-4caf-a018-e1e93147ffca-kube-api-access-kjp8p podName:8593ba17-a4fb-4caf-a018-e1e93147ffca nodeName:}" failed. No retries permitted until 2026-06-09 08:45:32.736212356 +0000 UTC m=+10.181159688 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-kjp8p" (UniqueName: "kubernetes.io/projected/8593ba17-a4fb-4caf-a018-e1e93147ffca-kube-api-access-kjp8p") pod "network-check-target-4jvm8" (UID: "8593ba17-a4fb-4caf-a018-e1e93147ffca") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 08:45:29.068809 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:29.068775 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qchhg" Jun 09 08:45:29.069000 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:29.068960 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qchhg" podUID="955c937e-7a98-4e3a-b4bb-52e78c5ac289" Jun 09 08:45:29.069091 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:29.069023 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4jvm8" Jun 09 08:45:29.069150 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:29.069099 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4jvm8" podUID="8593ba17-a4fb-4caf-a018-e1e93147ffca" Jun 09 08:45:30.069474 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:30.068961 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-grvqt" Jun 09 08:45:30.069474 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:30.069104 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-grvqt" podUID="ae90f658-436b-42fc-b170-318cd82d55b1" Jun 09 08:45:31.068884 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:31.068852 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qchhg" Jun 09 08:45:31.069059 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:31.068989 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qchhg" podUID="955c937e-7a98-4e3a-b4bb-52e78c5ac289" Jun 09 08:45:31.069230 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:31.069123 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4jvm8" Jun 09 08:45:31.069349 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:31.069239 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4jvm8" podUID="8593ba17-a4fb-4caf-a018-e1e93147ffca" Jun 09 08:45:32.068947 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:32.068906 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-grvqt" Jun 09 08:45:32.069384 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:32.069081 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-grvqt" podUID="ae90f658-436b-42fc-b170-318cd82d55b1" Jun 09 08:45:32.669623 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:32.669265 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae90f658-436b-42fc-b170-318cd82d55b1-original-pull-secret\") pod \"global-pull-secret-syncer-grvqt\" (UID: \"ae90f658-436b-42fc-b170-318cd82d55b1\") " pod="kube-system/global-pull-secret-syncer-grvqt" Jun 09 08:45:32.669623 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:32.669378 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/955c937e-7a98-4e3a-b4bb-52e78c5ac289-metrics-certs\") pod \"network-metrics-daemon-qchhg\" (UID: \"955c937e-7a98-4e3a-b4bb-52e78c5ac289\") " pod="openshift-multus/network-metrics-daemon-qchhg" Jun 09 08:45:32.669623 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:32.669434 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 08:45:32.669623 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:32.669506 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae90f658-436b-42fc-b170-318cd82d55b1-original-pull-secret podName:ae90f658-436b-42fc-b170-318cd82d55b1 nodeName:}" failed. No retries permitted until 2026-06-09 08:45:40.669486809 +0000 UTC m=+18.114434153 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ae90f658-436b-42fc-b170-318cd82d55b1-original-pull-secret") pod "global-pull-secret-syncer-grvqt" (UID: "ae90f658-436b-42fc-b170-318cd82d55b1") : object "kube-system"/"original-pull-secret" not registered Jun 09 08:45:32.669623 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:32.669527 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 08:45:32.669623 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:32.669589 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/955c937e-7a98-4e3a-b4bb-52e78c5ac289-metrics-certs podName:955c937e-7a98-4e3a-b4bb-52e78c5ac289 nodeName:}" failed. No retries permitted until 2026-06-09 08:45:40.669564339 +0000 UTC m=+18.114511669 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/955c937e-7a98-4e3a-b4bb-52e78c5ac289-metrics-certs") pod "network-metrics-daemon-qchhg" (UID: "955c937e-7a98-4e3a-b4bb-52e78c5ac289") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 08:45:32.770205 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:32.770167 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjp8p\" (UniqueName: \"kubernetes.io/projected/8593ba17-a4fb-4caf-a018-e1e93147ffca-kube-api-access-kjp8p\") pod \"network-check-target-4jvm8\" (UID: \"8593ba17-a4fb-4caf-a018-e1e93147ffca\") " pod="openshift-network-diagnostics/network-check-target-4jvm8" Jun 09 08:45:32.770389 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:32.770360 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 08:45:32.770389 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:32.770383 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 08:45:32.770493 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:32.770397 2567 projected.go:196] Error preparing data for projected volume kube-api-access-kjp8p for pod openshift-network-diagnostics/network-check-target-4jvm8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 08:45:32.770493 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:32.770451 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8593ba17-a4fb-4caf-a018-e1e93147ffca-kube-api-access-kjp8p podName:8593ba17-a4fb-4caf-a018-e1e93147ffca nodeName:}" failed. No retries permitted until 2026-06-09 08:45:40.770432768 +0000 UTC m=+18.215380099 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-kjp8p" (UniqueName: "kubernetes.io/projected/8593ba17-a4fb-4caf-a018-e1e93147ffca-kube-api-access-kjp8p") pod "network-check-target-4jvm8" (UID: "8593ba17-a4fb-4caf-a018-e1e93147ffca") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 08:45:33.069009 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:33.068978 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4jvm8" Jun 09 08:45:33.069432 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:33.069092 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4jvm8" podUID="8593ba17-a4fb-4caf-a018-e1e93147ffca" Jun 09 08:45:33.069432 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:33.069141 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qchhg" Jun 09 08:45:33.069432 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:33.069268 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qchhg" podUID="955c937e-7a98-4e3a-b4bb-52e78c5ac289" Jun 09 08:45:34.068481 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:34.068447 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-grvqt" Jun 09 08:45:34.068693 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:34.068576 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-grvqt" podUID="ae90f658-436b-42fc-b170-318cd82d55b1" Jun 09 08:45:35.071807 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:35.071779 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qchhg" Jun 09 08:45:35.072256 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:35.071907 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qchhg" podUID="955c937e-7a98-4e3a-b4bb-52e78c5ac289" Jun 09 08:45:35.072256 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:35.071971 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4jvm8" Jun 09 08:45:35.072256 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:35.072058 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4jvm8" podUID="8593ba17-a4fb-4caf-a018-e1e93147ffca" Jun 09 08:45:36.068532 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:36.068496 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-grvqt" Jun 09 08:45:36.068704 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:36.068602 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-grvqt" podUID="ae90f658-436b-42fc-b170-318cd82d55b1" Jun 09 08:45:37.068488 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:37.068450 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4jvm8" Jun 09 08:45:37.068951 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:37.068593 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qchhg" Jun 09 08:45:37.068951 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:37.068730 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qchhg" podUID="955c937e-7a98-4e3a-b4bb-52e78c5ac289" Jun 09 08:45:37.068951 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:37.068587 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4jvm8" podUID="8593ba17-a4fb-4caf-a018-e1e93147ffca" Jun 09 08:45:38.068405 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:38.068373 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-grvqt" Jun 09 08:45:38.068570 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:38.068485 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-grvqt" podUID="ae90f658-436b-42fc-b170-318cd82d55b1" Jun 09 08:45:39.068742 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:39.068705 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4jvm8" Jun 09 08:45:39.069196 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:39.068706 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qchhg" Jun 09 08:45:39.069196 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:39.068830 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4jvm8" podUID="8593ba17-a4fb-4caf-a018-e1e93147ffca" Jun 09 08:45:39.069196 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:39.068939 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qchhg" podUID="955c937e-7a98-4e3a-b4bb-52e78c5ac289" Jun 09 08:45:40.068836 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:40.068798 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-grvqt" Jun 09 08:45:40.069299 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:40.068929 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-grvqt" podUID="ae90f658-436b-42fc-b170-318cd82d55b1" Jun 09 08:45:40.724883 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:40.724845 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/955c937e-7a98-4e3a-b4bb-52e78c5ac289-metrics-certs\") pod \"network-metrics-daemon-qchhg\" (UID: \"955c937e-7a98-4e3a-b4bb-52e78c5ac289\") " pod="openshift-multus/network-metrics-daemon-qchhg" Jun 09 08:45:40.725116 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:40.724897 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae90f658-436b-42fc-b170-318cd82d55b1-original-pull-secret\") pod \"global-pull-secret-syncer-grvqt\" (UID: \"ae90f658-436b-42fc-b170-318cd82d55b1\") " pod="kube-system/global-pull-secret-syncer-grvqt" Jun 09 08:45:40.725116 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:40.725017 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 08:45:40.725116 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:40.725019 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 08:45:40.725116 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:40.725072 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae90f658-436b-42fc-b170-318cd82d55b1-original-pull-secret podName:ae90f658-436b-42fc-b170-318cd82d55b1 nodeName:}" failed. No retries permitted until 2026-06-09 08:45:56.725057607 +0000 UTC m=+34.170004935 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ae90f658-436b-42fc-b170-318cd82d55b1-original-pull-secret") pod "global-pull-secret-syncer-grvqt" (UID: "ae90f658-436b-42fc-b170-318cd82d55b1") : object "kube-system"/"original-pull-secret" not registered Jun 09 08:45:40.725116 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:40.725087 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/955c937e-7a98-4e3a-b4bb-52e78c5ac289-metrics-certs podName:955c937e-7a98-4e3a-b4bb-52e78c5ac289 nodeName:}" failed. No retries permitted until 2026-06-09 08:45:56.7250806 +0000 UTC m=+34.170027928 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/955c937e-7a98-4e3a-b4bb-52e78c5ac289-metrics-certs") pod "network-metrics-daemon-qchhg" (UID: "955c937e-7a98-4e3a-b4bb-52e78c5ac289") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 08:45:40.826278 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:40.826238 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjp8p\" (UniqueName: \"kubernetes.io/projected/8593ba17-a4fb-4caf-a018-e1e93147ffca-kube-api-access-kjp8p\") pod \"network-check-target-4jvm8\" (UID: \"8593ba17-a4fb-4caf-a018-e1e93147ffca\") " pod="openshift-network-diagnostics/network-check-target-4jvm8" Jun 09 08:45:40.826436 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:40.826377 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 08:45:40.826436 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:40.826399 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 08:45:40.826436 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:40.826412 2567 projected.go:196] Error preparing data for projected volume kube-api-access-kjp8p for pod openshift-network-diagnostics/network-check-target-4jvm8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 08:45:40.826578 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:40.826466 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8593ba17-a4fb-4caf-a018-e1e93147ffca-kube-api-access-kjp8p podName:8593ba17-a4fb-4caf-a018-e1e93147ffca nodeName:}" failed. No retries permitted until 2026-06-09 08:45:56.826452817 +0000 UTC m=+34.271400145 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-kjp8p" (UniqueName: "kubernetes.io/projected/8593ba17-a4fb-4caf-a018-e1e93147ffca-kube-api-access-kjp8p") pod "network-check-target-4jvm8" (UID: "8593ba17-a4fb-4caf-a018-e1e93147ffca") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 08:45:41.068747 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:41.068709 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4jvm8" Jun 09 08:45:41.068747 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:41.068745 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qchhg" Jun 09 08:45:41.069215 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:41.068854 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4jvm8" podUID="8593ba17-a4fb-4caf-a018-e1e93147ffca" Jun 09 08:45:41.069215 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:41.068997 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qchhg" podUID="955c937e-7a98-4e3a-b4bb-52e78c5ac289" Jun 09 08:45:42.068542 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:42.068505 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-grvqt" Jun 09 08:45:42.068732 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:42.068636 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-grvqt" podUID="ae90f658-436b-42fc-b170-318cd82d55b1" Jun 09 08:45:43.068959 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:43.068933 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4jvm8" Jun 09 08:45:43.069499 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:43.069036 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4jvm8" podUID="8593ba17-a4fb-4caf-a018-e1e93147ffca" Jun 09 08:45:43.069499 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:43.069122 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qchhg" Jun 09 08:45:43.069499 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:43.069248 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qchhg" podUID="955c937e-7a98-4e3a-b4bb-52e78c5ac289" Jun 09 08:45:44.068194 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:44.068144 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-grvqt" Jun 09 08:45:44.068358 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:44.068259 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-grvqt" podUID="ae90f658-436b-42fc-b170-318cd82d55b1" Jun 09 08:45:45.068617 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:45.068589 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4jvm8" Jun 09 08:45:45.069003 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:45.068593 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qchhg" Jun 09 08:45:45.069003 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:45.068710 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4jvm8" podUID="8593ba17-a4fb-4caf-a018-e1e93147ffca" Jun 09 08:45:45.069003 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:45.068780 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qchhg" podUID="955c937e-7a98-4e3a-b4bb-52e78c5ac289" Jun 09 08:45:45.189835 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:45.189809 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7f5qb" event={"ID":"ac799a26-bfc2-45ee-806d-771558fabc2a","Type":"ContainerStarted","Data":"fef832bf912d0c9382a79c3cada940ae8135798f26841c664320783918302a6e"} Jun 09 08:45:45.191275 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:45.191246 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ghb2d" event={"ID":"c1eca8fd-ed14-4a3b-a17b-bf84f42f7302","Type":"ContainerStarted","Data":"b5114b4bdf2c257bb499dc3bc20ba1cec157d58fdc7bce9e410c79b6fcfd792a"} Jun 09 08:45:45.192516 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:45.192491 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cct9r" event={"ID":"849de24e-c8a4-4afd-a40b-45f1f35290b5","Type":"ContainerStarted","Data":"43592652f37747323fc3aa2acf69e3975754585f31fc0870d7a845082d01e88e"} Jun 09 08:45:45.194080 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:45.194057 2567 generic.go:356] "Generic (PLEG): container finished" podID="2505c746-7f3b-4dcc-a6a1-956885ca7fc3" containerID="3ba2a7122db40d2035c198c6cd20a4dde44927dab0e9a230fa1ed487d22779c4" exitCode=0 Jun 09 08:45:45.194151 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:45.194128 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jf7vr" event={"ID":"2505c746-7f3b-4dcc-a6a1-956885ca7fc3","Type":"ContainerDied","Data":"3ba2a7122db40d2035c198c6cd20a4dde44927dab0e9a230fa1ed487d22779c4"} Jun 09 08:45:45.195508 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:45.195486 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6l4gp" event={"ID":"5c8cf271-8ccb-42a2-abe4-fe6565f5346b","Type":"ContainerStarted","Data":"42d7d93e24c798abd16ebed0ae2f1dcca4da380ed2a39194714f351c83ce38ba"} Jun 09 08:45:45.197056 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:45.197041 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6x82" event={"ID":"0ad0de63-3d32-4927-9f79-8f848b6f52f4","Type":"ContainerStarted","Data":"39f2500ebf3a684f2108357f2b0e17f55d0dc1f62744a7371c1e2756f8f71302"} Jun 09 08:45:45.198590 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:45.198570 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fc2mh" event={"ID":"08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e","Type":"ContainerStarted","Data":"7ef47f93eef04721d978cd27b9b36cee7574285d45ce1a5d02072f386cf10215"} Jun 09 08:45:45.204524 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:45.204484 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7f5qb" podStartSLOduration=3.489266265 podStartE2EDuration="22.204458256s" totalImagesPullingTime="18.715191991s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 08:45:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:45:45.204362303 +0000 UTC m=+22.649309653" watchObservedRunningTime="2026-06-09 08:45:45.204458256 +0000 UTC m=+22.649405590" Jun 09 08:45:45.217028 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:45.216988 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-cct9r" podStartSLOduration=3.5751139849999998 podStartE2EDuration="22.216974686s" totalImagesPullingTime="18.641860701s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 08:45:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:45:45.216777291 +0000 UTC m=+22.661724641" watchObservedRunningTime="2026-06-09 08:45:45.216974686 +0000 UTC m=+22.661922036" Jun 09 08:45:45.260440 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:45.260392 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-ghb2d" podStartSLOduration=3.216762359 podStartE2EDuration="22.260376624s" totalImagesPullingTime="19.043614265s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 08:45:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:45:45.259796524 +0000 UTC m=+22.704743884" watchObservedRunningTime="2026-06-09 08:45:45.260376624 +0000 UTC m=+22.705323974" Jun 09 08:45:45.273817 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:45.273772 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-6l4gp" podStartSLOduration=7.89887107 podStartE2EDuration="22.273753115s" totalImagesPullingTime="14.374882045s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 08:45:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:45:45.273431938 +0000 UTC m=+22.718379288" watchObservedRunningTime="2026-06-09 08:45:45.273753115 +0000 UTC m=+22.718700466" Jun 09 08:45:45.289959 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:45.289920 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-fc2mh" podStartSLOduration=3.23437807 podStartE2EDuration="22.289905328s" totalImagesPullingTime="19.055527258s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 08:45:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:45:45.289435757 +0000 UTC m=+22.734383107" watchObservedRunningTime="2026-06-09 08:45:45.289905328 +0000 UTC m=+22.734852678" Jun 09 08:45:46.068981 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:46.068776 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-grvqt" Jun 09 08:45:46.069696 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:46.069094 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-grvqt" podUID="ae90f658-436b-42fc-b170-318cd82d55b1" Jun 09 08:45:46.204942 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:46.204900 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rldts" event={"ID":"ac21d247-409c-489e-8d3a-396c01dee935","Type":"ContainerStarted","Data":"522ec631940538bc8e5572cbcfed066184177c4813f310c16bf064e8c16aee19"} Jun 09 08:45:46.205097 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:46.205001 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rldts" event={"ID":"ac21d247-409c-489e-8d3a-396c01dee935","Type":"ContainerStarted","Data":"f89e9cfa19293783595e217814d5d8a6650337e958ea6e6633d62fef876a27b7"} Jun 09 08:45:46.205097 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:46.205052 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rldts" event={"ID":"ac21d247-409c-489e-8d3a-396c01dee935","Type":"ContainerStarted","Data":"6764b7fd34e4fa30c36fd56ba39da9994d4b25f6099954a6550e9cd4167ff326"} Jun 09 08:45:46.205206 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:46.205098 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rldts" event={"ID":"ac21d247-409c-489e-8d3a-396c01dee935","Type":"ContainerStarted","Data":"edde8fc97bccc3a985ca1b048391a464ccb61e1be42cf7ab17d526540c2a9a74"} Jun 09 08:45:46.205206 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:46.205143 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rldts" event={"ID":"ac21d247-409c-489e-8d3a-396c01dee935","Type":"ContainerStarted","Data":"d78af6248b2359825c58d602758ce5eb18b27433000caf49c378d3c37c9031ae"} Jun 09 08:45:46.205206 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:46.205192 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rldts" event={"ID":"ac21d247-409c-489e-8d3a-396c01dee935","Type":"ContainerStarted","Data":"b41e3ae59234fdf0d0decc145c8d92916e0e464a647e19bf58cb354d4506eac1"} Jun 09 08:45:46.206755 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:46.206724 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-v6bhs" event={"ID":"c9696892-a39d-47db-9799-69ad596e65b8","Type":"ContainerStarted","Data":"9d37b6ba5ab12054795ece8183cd3faf374775e2bc49fed7400fec845eb1a0a4"} Jun 09 08:45:46.221637 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:46.221403 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-v6bhs" podStartSLOduration=8.876436805 podStartE2EDuration="23.221382104s" totalImagesPullingTime="14.344945299s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 08:45:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:45:46.220603476 +0000 UTC m=+23.665550830" watchObservedRunningTime="2026-06-09 08:45:46.221382104 +0000 UTC m=+23.666329455" Jun 09 08:45:46.289478 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:46.289452 2567 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 09 08:45:46.441310 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:46.441278 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-cct9r" Jun 09 08:45:46.441997 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:46.441972 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-cct9r" Jun 09 08:45:47.068213 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:47.068096 2567 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-09T08:45:46.289473244Z","UUID":"63cfb5e6-afcd-4349-be04-d4db4936b083","Handler":null,"Name":"","Endpoint":""} Jun 09 08:45:47.068489 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:47.068275 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qchhg" Jun 09 08:45:47.068489 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:47.068277 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4jvm8" Jun 09 08:45:47.068489 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:47.068401 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qchhg" podUID="955c937e-7a98-4e3a-b4bb-52e78c5ac289" Jun 09 08:45:47.068668 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:47.068518 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4jvm8" podUID="8593ba17-a4fb-4caf-a018-e1e93147ffca" Jun 09 08:45:47.069623 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:47.069592 2567 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 09 08:45:47.070031 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:47.069636 2567 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 09 08:45:47.211065 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:47.211023 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6x82" event={"ID":"0ad0de63-3d32-4927-9f79-8f848b6f52f4","Type":"ContainerStarted","Data":"5f34f701805f725106fb77251b54f1ffbbaf6e4ead9cb8f363cbe789ef06f6a0"} Jun 09 08:45:48.068101 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:48.068068 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-grvqt" Jun 09 08:45:48.068265 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:48.068203 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-grvqt" podUID="ae90f658-436b-42fc-b170-318cd82d55b1" Jun 09 08:45:48.216065 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:48.215991 2567 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 09 08:45:48.216065 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:48.216026 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6x82" event={"ID":"0ad0de63-3d32-4927-9f79-8f848b6f52f4","Type":"ContainerStarted","Data":"ce9c9d1a33706107b028edd24a7b2b0c61882c8633a522563b7509b8e6aedbc8"} Jun 09 08:45:48.235307 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:48.235260 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6x82" podStartSLOduration=3.828455175 podStartE2EDuration="25.23524393s" totalImagesPullingTime="21.406788755s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 08:45:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:45:48.234462396 +0000 UTC m=+25.679409749" watchObservedRunningTime="2026-06-09 08:45:48.23524393 +0000 UTC m=+25.680191298" Jun 09 08:45:49.068872 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:49.068839 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4jvm8" Jun 09 08:45:49.069073 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:49.068839 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qchhg" Jun 09 08:45:49.069073 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:49.068993 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4jvm8" podUID="8593ba17-a4fb-4caf-a018-e1e93147ffca" Jun 09 08:45:49.069189 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:49.069080 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qchhg" podUID="955c937e-7a98-4e3a-b4bb-52e78c5ac289" Jun 09 08:45:49.385763 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:49.385735 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-cct9r" Jun 09 08:45:49.386131 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:49.385860 2567 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 09 08:45:49.386285 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:49.386268 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-cct9r" Jun 09 08:45:50.068087 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:50.068059 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-grvqt" Jun 09 08:45:50.068235 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:50.068159 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-grvqt" podUID="ae90f658-436b-42fc-b170-318cd82d55b1" Jun 09 08:45:50.222437 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:50.222398 2567 generic.go:356] "Generic (PLEG): container finished" podID="2505c746-7f3b-4dcc-a6a1-956885ca7fc3" containerID="f882df2ce6371960ccccf331208d01676f891330ed1a7146677ae0f56ea39d1b" exitCode=0 Jun 09 08:45:50.222604 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:50.222481 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jf7vr" event={"ID":"2505c746-7f3b-4dcc-a6a1-956885ca7fc3","Type":"ContainerDied","Data":"f882df2ce6371960ccccf331208d01676f891330ed1a7146677ae0f56ea39d1b"} Jun 09 08:45:50.226127 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:50.226103 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rldts" event={"ID":"ac21d247-409c-489e-8d3a-396c01dee935","Type":"ContainerStarted","Data":"52f67d596156165d84a6b8aba67519538dd2e550ce55bded37b726747686e7c2"} Jun 09 08:45:51.068804 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:51.068770 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4jvm8" Jun 09 08:45:51.069385 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:51.068888 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4jvm8" podUID="8593ba17-a4fb-4caf-a018-e1e93147ffca" Jun 09 08:45:51.069385 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:51.068940 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qchhg" Jun 09 08:45:51.069385 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:51.069066 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qchhg" podUID="955c937e-7a98-4e3a-b4bb-52e78c5ac289" Jun 09 08:45:52.068813 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:52.068630 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-grvqt" Jun 09 08:45:52.069249 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:52.068890 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-grvqt" podUID="ae90f658-436b-42fc-b170-318cd82d55b1" Jun 09 08:45:52.233831 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:52.233793 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rldts" event={"ID":"ac21d247-409c-489e-8d3a-396c01dee935","Type":"ContainerStarted","Data":"a6ad67c43d4b5d663caf450f8d175059521b0d687d85877fd103c216a49f1ace"} Jun 09 08:45:52.234057 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:52.234039 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rldts" Jun 09 08:45:52.234162 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:52.234100 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rldts" Jun 09 08:45:52.235859 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:52.235834 2567 generic.go:356] "Generic (PLEG): container finished" podID="2505c746-7f3b-4dcc-a6a1-956885ca7fc3" containerID="cf02a9c325e7b2499863a0a37e5cbacb78a45e416e1b5bf133efc9500188068d" exitCode=0 Jun 09 08:45:52.235957 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:52.235866 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jf7vr" event={"ID":"2505c746-7f3b-4dcc-a6a1-956885ca7fc3","Type":"ContainerDied","Data":"cf02a9c325e7b2499863a0a37e5cbacb78a45e416e1b5bf133efc9500188068d"} Jun 09 08:45:52.249853 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:52.249833 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rldts" Jun 09 08:45:52.257807 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:52.257773 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-rldts" podStartSLOduration=9.573948323 podStartE2EDuration="29.257759551s" totalImagesPullingTime="19.683811228s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 08:45:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:45:52.257127577 +0000 UTC m=+29.702074924" watchObservedRunningTime="2026-06-09 08:45:52.257759551 +0000 UTC m=+29.702706898" Jun 09 08:45:53.069702 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:53.069671 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4jvm8" Jun 09 08:45:53.070151 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:53.069711 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qchhg" Jun 09 08:45:53.070151 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:53.069796 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4jvm8" podUID="8593ba17-a4fb-4caf-a018-e1e93147ffca" Jun 09 08:45:53.070151 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:53.069912 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qchhg" podUID="955c937e-7a98-4e3a-b4bb-52e78c5ac289" Jun 09 08:45:53.239362 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:53.239334 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rldts" Jun 09 08:45:53.258364 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:53.258330 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rldts" Jun 09 08:45:53.529844 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:53.529815 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4jvm8"] Jun 09 08:45:53.529999 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:53.529924 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4jvm8" Jun 09 08:45:53.530069 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:53.530027 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4jvm8" podUID="8593ba17-a4fb-4caf-a018-e1e93147ffca" Jun 09 08:45:53.533312 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:53.533281 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-grvqt"] Jun 09 08:45:53.533449 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:53.533435 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-grvqt" Jun 09 08:45:53.533581 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:53.533544 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-grvqt" podUID="ae90f658-436b-42fc-b170-318cd82d55b1" Jun 09 08:45:53.533991 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:53.533956 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qchhg"] Jun 09 08:45:53.534097 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:53.534065 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qchhg" Jun 09 08:45:53.534199 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:53.534174 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qchhg" podUID="955c937e-7a98-4e3a-b4bb-52e78c5ac289" Jun 09 08:45:54.243242 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:54.243085 2567 generic.go:356] "Generic (PLEG): container finished" podID="2505c746-7f3b-4dcc-a6a1-956885ca7fc3" containerID="aa4c1850b5eae4d38d2093990e66ce676b894fe8f7e10bcb03fa17bd3b03515f" exitCode=0 Jun 09 08:45:54.243591 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:54.243161 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jf7vr" event={"ID":"2505c746-7f3b-4dcc-a6a1-956885ca7fc3","Type":"ContainerDied","Data":"aa4c1850b5eae4d38d2093990e66ce676b894fe8f7e10bcb03fa17bd3b03515f"} Jun 09 08:45:55.068991 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:55.068957 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4jvm8" Jun 09 08:45:55.069188 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:55.068960 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-grvqt" Jun 09 08:45:55.069188 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:55.069090 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qchhg" Jun 09 08:45:55.069188 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:55.069088 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4jvm8" podUID="8593ba17-a4fb-4caf-a018-e1e93147ffca" Jun 09 08:45:55.069352 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:55.069193 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-grvqt" podUID="ae90f658-436b-42fc-b170-318cd82d55b1" Jun 09 08:45:55.069352 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:55.069298 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qchhg" podUID="955c937e-7a98-4e3a-b4bb-52e78c5ac289" Jun 09 08:45:56.746373 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:56.746338 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/955c937e-7a98-4e3a-b4bb-52e78c5ac289-metrics-certs\") pod \"network-metrics-daemon-qchhg\" (UID: \"955c937e-7a98-4e3a-b4bb-52e78c5ac289\") " pod="openshift-multus/network-metrics-daemon-qchhg" Jun 09 08:45:56.746839 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:56.746389 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae90f658-436b-42fc-b170-318cd82d55b1-original-pull-secret\") pod \"global-pull-secret-syncer-grvqt\" (UID: \"ae90f658-436b-42fc-b170-318cd82d55b1\") " pod="kube-system/global-pull-secret-syncer-grvqt" Jun 09 08:45:56.746839 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:56.746519 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 08:45:56.746839 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:56.746533 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 08:45:56.746839 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:56.746587 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae90f658-436b-42fc-b170-318cd82d55b1-original-pull-secret podName:ae90f658-436b-42fc-b170-318cd82d55b1 nodeName:}" failed. No retries permitted until 2026-06-09 08:46:28.746568995 +0000 UTC m=+66.191516325 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ae90f658-436b-42fc-b170-318cd82d55b1-original-pull-secret") pod "global-pull-secret-syncer-grvqt" (UID: "ae90f658-436b-42fc-b170-318cd82d55b1") : object "kube-system"/"original-pull-secret" not registered Jun 09 08:45:56.746839 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:56.746605 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/955c937e-7a98-4e3a-b4bb-52e78c5ac289-metrics-certs podName:955c937e-7a98-4e3a-b4bb-52e78c5ac289 nodeName:}" failed. No retries permitted until 2026-06-09 08:46:28.746597252 +0000 UTC m=+66.191544579 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/955c937e-7a98-4e3a-b4bb-52e78c5ac289-metrics-certs") pod "network-metrics-daemon-qchhg" (UID: "955c937e-7a98-4e3a-b4bb-52e78c5ac289") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 08:45:56.846960 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:56.846919 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjp8p\" (UniqueName: \"kubernetes.io/projected/8593ba17-a4fb-4caf-a018-e1e93147ffca-kube-api-access-kjp8p\") pod \"network-check-target-4jvm8\" (UID: \"8593ba17-a4fb-4caf-a018-e1e93147ffca\") " pod="openshift-network-diagnostics/network-check-target-4jvm8" Jun 09 08:45:56.847112 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:56.847082 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 08:45:56.847112 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:56.847103 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 08:45:56.847208 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:56.847116 2567 projected.go:196] Error preparing data for projected volume kube-api-access-kjp8p for pod openshift-network-diagnostics/network-check-target-4jvm8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 08:45:56.847208 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:56.847176 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8593ba17-a4fb-4caf-a018-e1e93147ffca-kube-api-access-kjp8p podName:8593ba17-a4fb-4caf-a018-e1e93147ffca nodeName:}" failed. No retries permitted until 2026-06-09 08:46:28.847162121 +0000 UTC m=+66.292109452 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-kjp8p" (UniqueName: "kubernetes.io/projected/8593ba17-a4fb-4caf-a018-e1e93147ffca-kube-api-access-kjp8p") pod "network-check-target-4jvm8" (UID: "8593ba17-a4fb-4caf-a018-e1e93147ffca") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 08:45:57.068916 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:57.068887 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4jvm8" Jun 09 08:45:57.069088 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:57.068892 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-grvqt" Jun 09 08:45:57.069088 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:57.068997 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4jvm8" podUID="8593ba17-a4fb-4caf-a018-e1e93147ffca" Jun 09 08:45:57.069200 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:57.069111 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-grvqt" podUID="ae90f658-436b-42fc-b170-318cd82d55b1" Jun 09 08:45:57.069200 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:57.069188 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qchhg" Jun 09 08:45:57.069298 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:57.069274 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qchhg" podUID="955c937e-7a98-4e3a-b4bb-52e78c5ac289" Jun 09 08:45:58.376896 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:58.376867 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-114.ec2.internal" event="NodeReady" Jun 09 08:45:58.377488 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:58.377014 2567 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 09 08:45:58.413637 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:58.413560 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-c97c5c49c-fn4jw"] Jun 09 08:45:58.417275 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:58.417250 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c97c5c49c-fn4jw" Jun 09 08:45:58.419471 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:58.419450 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 09 08:45:58.419596 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:58.419450 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 09 08:45:58.419718 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:58.419702 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ltbzg\"" Jun 09 08:45:58.419790 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:58.419724 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 09 08:45:58.424922 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:58.424885 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-nsxkc"] Jun 09 08:45:58.425461 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:58.425437 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 09 08:45:58.428352 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:58.428329 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-zmgdk"] Jun 09 08:45:58.428467 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:58.428451 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nsxkc" Jun 09 08:45:58.430968 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:58.430872 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pvjgz\"" Jun 09 08:45:58.430968 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:58.430907 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 09 08:45:58.431145 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:58.431069 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 09 08:45:58.431782 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:58.431665 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c97c5c49c-fn4jw"] Jun 09 08:45:58.431782 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:58.431763 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zmgdk" Jun 09 08:45:58.433702 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:58.433683 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 09 08:45:58.433810 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:58.433686 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ktf9f\"" Jun 09 08:45:58.433978 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:58.433961 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 09 08:45:58.434282 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:58.434260 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 09 08:45:58.438745 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:58.438680 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nsxkc"] Jun 09 08:45:58.445925 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:58.443547 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zmgdk"] Jun 09 08:45:58.558884 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:58.558856 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhhdq\" (UniqueName: \"kubernetes.io/projected/e28b9904-750f-489c-b660-e6b1f6a5848b-kube-api-access-jhhdq\") pod \"image-registry-c97c5c49c-fn4jw\" (UID: \"e28b9904-750f-489c-b660-e6b1f6a5848b\") " pod="openshift-image-registry/image-registry-c97c5c49c-fn4jw" Jun 09 08:45:58.559008 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:58.558915 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e28b9904-750f-489c-b660-e6b1f6a5848b-image-registry-private-configuration\") pod \"image-registry-c97c5c49c-fn4jw\" (UID: \"e28b9904-750f-489c-b660-e6b1f6a5848b\") " pod="openshift-image-registry/image-registry-c97c5c49c-fn4jw" Jun 09 08:45:58.559008 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:58.558948 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/16df8afb-8164-41fd-9d0d-005830dda96c-config-volume\") pod \"dns-default-nsxkc\" (UID: \"16df8afb-8164-41fd-9d0d-005830dda96c\") " pod="openshift-dns/dns-default-nsxkc" Jun 09 08:45:58.559008 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:58.558975 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16df8afb-8164-41fd-9d0d-005830dda96c-tmp-dir\") pod \"dns-default-nsxkc\" (UID: \"16df8afb-8164-41fd-9d0d-005830dda96c\") " pod="openshift-dns/dns-default-nsxkc" Jun 09 08:45:58.559008 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:58.558998 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e28b9904-750f-489c-b660-e6b1f6a5848b-registry-tls\") pod \"image-registry-c97c5c49c-fn4jw\" (UID: \"e28b9904-750f-489c-b660-e6b1f6a5848b\") " pod="openshift-image-registry/image-registry-c97c5c49c-fn4jw" Jun 09 08:45:58.559255 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:58.559021 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e28b9904-750f-489c-b660-e6b1f6a5848b-ca-trust-extracted\") pod \"image-registry-c97c5c49c-fn4jw\" (UID: \"e28b9904-750f-489c-b660-e6b1f6a5848b\") " pod="openshift-image-registry/image-registry-c97c5c49c-fn4jw" Jun 09 08:45:58.559255 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:58.559046 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e28b9904-750f-489c-b660-e6b1f6a5848b-installation-pull-secrets\") pod \"image-registry-c97c5c49c-fn4jw\" (UID: \"e28b9904-750f-489c-b660-e6b1f6a5848b\") " pod="openshift-image-registry/image-registry-c97c5c49c-fn4jw" Jun 09 08:45:58.559255 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:58.559097 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68gsm\" (UniqueName: \"kubernetes.io/projected/16df8afb-8164-41fd-9d0d-005830dda96c-kube-api-access-68gsm\") pod \"dns-default-nsxkc\" (UID: \"16df8afb-8164-41fd-9d0d-005830dda96c\") " pod="openshift-dns/dns-default-nsxkc" Jun 09 08:45:58.559255 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:58.559125 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/434a609b-dd30-4747-96b8-ce766267866d-cert\") pod \"ingress-canary-zmgdk\" (UID: \"434a609b-dd30-4747-96b8-ce766267866d\") " pod="openshift-ingress-canary/ingress-canary-zmgdk" Jun 09 08:45:58.559255 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:58.559148 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e28b9904-750f-489c-b660-e6b1f6a5848b-registry-certificates\") pod \"image-registry-c97c5c49c-fn4jw\" (UID: \"e28b9904-750f-489c-b660-e6b1f6a5848b\") " pod="openshift-image-registry/image-registry-c97c5c49c-fn4jw" Jun 09 08:45:58.559255 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:58.559173 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e28b9904-750f-489c-b660-e6b1f6a5848b-trusted-ca\") pod \"image-registry-c97c5c49c-fn4jw\" (UID: \"e28b9904-750f-489c-b660-e6b1f6a5848b\") " pod="openshift-image-registry/image-registry-c97c5c49c-fn4jw" Jun 09 08:45:58.559255 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:58.559223 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16df8afb-8164-41fd-9d0d-005830dda96c-metrics-tls\") pod \"dns-default-nsxkc\" (UID: \"16df8afb-8164-41fd-9d0d-005830dda96c\") " pod="openshift-dns/dns-default-nsxkc" Jun 09 08:45:58.559593 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:58.559258 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e28b9904-750f-489c-b660-e6b1f6a5848b-bound-sa-token\") pod \"image-registry-c97c5c49c-fn4jw\" (UID: \"e28b9904-750f-489c-b660-e6b1f6a5848b\") " pod="openshift-image-registry/image-registry-c97c5c49c-fn4jw" Jun 09 08:45:58.559593 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:58.559284 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5t4q7\" (UniqueName: \"kubernetes.io/projected/434a609b-dd30-4747-96b8-ce766267866d-kube-api-access-5t4q7\") pod \"ingress-canary-zmgdk\" (UID: \"434a609b-dd30-4747-96b8-ce766267866d\") " pod="openshift-ingress-canary/ingress-canary-zmgdk" Jun 09 08:45:58.660274 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:58.660246 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhhdq\" (UniqueName: \"kubernetes.io/projected/e28b9904-750f-489c-b660-e6b1f6a5848b-kube-api-access-jhhdq\") pod \"image-registry-c97c5c49c-fn4jw\" (UID: \"e28b9904-750f-489c-b660-e6b1f6a5848b\") " pod="openshift-image-registry/image-registry-c97c5c49c-fn4jw" Jun 09 08:45:58.660421 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:58.660290 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e28b9904-750f-489c-b660-e6b1f6a5848b-image-registry-private-configuration\") pod \"image-registry-c97c5c49c-fn4jw\" (UID: \"e28b9904-750f-489c-b660-e6b1f6a5848b\") " pod="openshift-image-registry/image-registry-c97c5c49c-fn4jw" Jun 09 08:45:58.660421 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:58.660308 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/16df8afb-8164-41fd-9d0d-005830dda96c-config-volume\") pod \"dns-default-nsxkc\" (UID: \"16df8afb-8164-41fd-9d0d-005830dda96c\") " pod="openshift-dns/dns-default-nsxkc" Jun 09 08:45:58.660421 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:58.660323 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16df8afb-8164-41fd-9d0d-005830dda96c-tmp-dir\") pod \"dns-default-nsxkc\" (UID: \"16df8afb-8164-41fd-9d0d-005830dda96c\") " pod="openshift-dns/dns-default-nsxkc" Jun 09 08:45:58.660421 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:58.660340 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e28b9904-750f-489c-b660-e6b1f6a5848b-registry-tls\") pod \"image-registry-c97c5c49c-fn4jw\" (UID: \"e28b9904-750f-489c-b660-e6b1f6a5848b\") " pod="openshift-image-registry/image-registry-c97c5c49c-fn4jw" Jun 09 08:45:58.660421 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:58.660359 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e28b9904-750f-489c-b660-e6b1f6a5848b-ca-trust-extracted\") pod \"image-registry-c97c5c49c-fn4jw\" (UID: \"e28b9904-750f-489c-b660-e6b1f6a5848b\") " pod="openshift-image-registry/image-registry-c97c5c49c-fn4jw" Jun 09 08:45:58.660421 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:58.660386 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e28b9904-750f-489c-b660-e6b1f6a5848b-installation-pull-secrets\") pod \"image-registry-c97c5c49c-fn4jw\" (UID: \"e28b9904-750f-489c-b660-e6b1f6a5848b\") " pod="openshift-image-registry/image-registry-c97c5c49c-fn4jw" Jun 09 08:45:58.660716 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:58.660427 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68gsm\" (UniqueName: \"kubernetes.io/projected/16df8afb-8164-41fd-9d0d-005830dda96c-kube-api-access-68gsm\") pod \"dns-default-nsxkc\" (UID: \"16df8afb-8164-41fd-9d0d-005830dda96c\") " pod="openshift-dns/dns-default-nsxkc" Jun 09 08:45:58.660716 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:58.660455 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/434a609b-dd30-4747-96b8-ce766267866d-cert\") pod \"ingress-canary-zmgdk\" (UID: \"434a609b-dd30-4747-96b8-ce766267866d\") " pod="openshift-ingress-canary/ingress-canary-zmgdk" Jun 09 08:45:58.660716 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:58.660475 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e28b9904-750f-489c-b660-e6b1f6a5848b-registry-certificates\") pod \"image-registry-c97c5c49c-fn4jw\" (UID: \"e28b9904-750f-489c-b660-e6b1f6a5848b\") " pod="openshift-image-registry/image-registry-c97c5c49c-fn4jw" Jun 09 08:45:58.660716 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:58.660495 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e28b9904-750f-489c-b660-e6b1f6a5848b-trusted-ca\") pod \"image-registry-c97c5c49c-fn4jw\" (UID: \"e28b9904-750f-489c-b660-e6b1f6a5848b\") " pod="openshift-image-registry/image-registry-c97c5c49c-fn4jw" Jun 09 08:45:58.660716 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:58.660538 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16df8afb-8164-41fd-9d0d-005830dda96c-metrics-tls\") pod \"dns-default-nsxkc\" (UID: \"16df8afb-8164-41fd-9d0d-005830dda96c\") " pod="openshift-dns/dns-default-nsxkc" Jun 09 08:45:58.660716 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:58.660572 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e28b9904-750f-489c-b660-e6b1f6a5848b-bound-sa-token\") pod \"image-registry-c97c5c49c-fn4jw\" (UID: \"e28b9904-750f-489c-b660-e6b1f6a5848b\") " pod="openshift-image-registry/image-registry-c97c5c49c-fn4jw" Jun 09 08:45:58.660716 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:58.660602 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5t4q7\" (UniqueName: \"kubernetes.io/projected/434a609b-dd30-4747-96b8-ce766267866d-kube-api-access-5t4q7\") pod \"ingress-canary-zmgdk\" (UID: \"434a609b-dd30-4747-96b8-ce766267866d\") " pod="openshift-ingress-canary/ingress-canary-zmgdk" Jun 09 08:45:58.661048 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:58.660937 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 08:45:58.661048 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:58.660946 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/16df8afb-8164-41fd-9d0d-005830dda96c-config-volume\") pod \"dns-default-nsxkc\" (UID: \"16df8afb-8164-41fd-9d0d-005830dda96c\") " pod="openshift-dns/dns-default-nsxkc" Jun 09 08:45:58.661048 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:58.660995 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e28b9904-750f-489c-b660-e6b1f6a5848b-ca-trust-extracted\") pod \"image-registry-c97c5c49c-fn4jw\" (UID: \"e28b9904-750f-489c-b660-e6b1f6a5848b\") " pod="openshift-image-registry/image-registry-c97c5c49c-fn4jw" Jun 09 08:45:58.661048 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:58.661020 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16df8afb-8164-41fd-9d0d-005830dda96c-metrics-tls podName:16df8afb-8164-41fd-9d0d-005830dda96c nodeName:}" failed. No retries permitted until 2026-06-09 08:45:59.161000811 +0000 UTC m=+36.605948158 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/16df8afb-8164-41fd-9d0d-005830dda96c-metrics-tls") pod "dns-default-nsxkc" (UID: "16df8afb-8164-41fd-9d0d-005830dda96c") : secret "dns-default-metrics-tls" not found Jun 09 08:45:58.661248 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:58.661077 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 08:45:58.661248 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:58.661089 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c97c5c49c-fn4jw: secret "image-registry-tls" not found Jun 09 08:45:58.661248 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:58.661129 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e28b9904-750f-489c-b660-e6b1f6a5848b-registry-tls podName:e28b9904-750f-489c-b660-e6b1f6a5848b nodeName:}" failed. No retries permitted until 2026-06-09 08:45:59.161116284 +0000 UTC m=+36.606063642 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e28b9904-750f-489c-b660-e6b1f6a5848b-registry-tls") pod "image-registry-c97c5c49c-fn4jw" (UID: "e28b9904-750f-489c-b660-e6b1f6a5848b") : secret "image-registry-tls" not found Jun 09 08:45:58.661248 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:58.661155 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16df8afb-8164-41fd-9d0d-005830dda96c-tmp-dir\") pod \"dns-default-nsxkc\" (UID: \"16df8afb-8164-41fd-9d0d-005830dda96c\") " pod="openshift-dns/dns-default-nsxkc" Jun 09 08:45:58.661607 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:58.661584 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e28b9904-750f-489c-b660-e6b1f6a5848b-trusted-ca\") pod \"image-registry-c97c5c49c-fn4jw\" (UID: \"e28b9904-750f-489c-b660-e6b1f6a5848b\") " pod="openshift-image-registry/image-registry-c97c5c49c-fn4jw" Jun 09 08:45:58.661747 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:58.661573 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e28b9904-750f-489c-b660-e6b1f6a5848b-registry-certificates\") pod \"image-registry-c97c5c49c-fn4jw\" (UID: \"e28b9904-750f-489c-b660-e6b1f6a5848b\") " pod="openshift-image-registry/image-registry-c97c5c49c-fn4jw" Jun 09 08:45:58.664929 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:58.664871 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e28b9904-750f-489c-b660-e6b1f6a5848b-image-registry-private-configuration\") pod \"image-registry-c97c5c49c-fn4jw\" (UID: \"e28b9904-750f-489c-b660-e6b1f6a5848b\") " pod="openshift-image-registry/image-registry-c97c5c49c-fn4jw" Jun 09 08:45:58.664929 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:58.664884 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/434a609b-dd30-4747-96b8-ce766267866d-cert\") pod \"ingress-canary-zmgdk\" (UID: \"434a609b-dd30-4747-96b8-ce766267866d\") " pod="openshift-ingress-canary/ingress-canary-zmgdk" Jun 09 08:45:58.664929 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:58.664886 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e28b9904-750f-489c-b660-e6b1f6a5848b-installation-pull-secrets\") pod \"image-registry-c97c5c49c-fn4jw\" (UID: \"e28b9904-750f-489c-b660-e6b1f6a5848b\") " pod="openshift-image-registry/image-registry-c97c5c49c-fn4jw" Jun 09 08:45:58.668951 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:58.668920 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e28b9904-750f-489c-b660-e6b1f6a5848b-bound-sa-token\") pod \"image-registry-c97c5c49c-fn4jw\" (UID: \"e28b9904-750f-489c-b660-e6b1f6a5848b\") " pod="openshift-image-registry/image-registry-c97c5c49c-fn4jw" Jun 09 08:45:58.669440 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:58.669422 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhhdq\" (UniqueName: \"kubernetes.io/projected/e28b9904-750f-489c-b660-e6b1f6a5848b-kube-api-access-jhhdq\") pod \"image-registry-c97c5c49c-fn4jw\" (UID: \"e28b9904-750f-489c-b660-e6b1f6a5848b\") " pod="openshift-image-registry/image-registry-c97c5c49c-fn4jw" Jun 09 08:45:58.669597 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:58.669574 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5t4q7\" (UniqueName: \"kubernetes.io/projected/434a609b-dd30-4747-96b8-ce766267866d-kube-api-access-5t4q7\") pod \"ingress-canary-zmgdk\" (UID: \"434a609b-dd30-4747-96b8-ce766267866d\") " pod="openshift-ingress-canary/ingress-canary-zmgdk" Jun 09 08:45:58.670209 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:58.670186 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68gsm\" (UniqueName: \"kubernetes.io/projected/16df8afb-8164-41fd-9d0d-005830dda96c-kube-api-access-68gsm\") pod \"dns-default-nsxkc\" (UID: \"16df8afb-8164-41fd-9d0d-005830dda96c\") " pod="openshift-dns/dns-default-nsxkc" Jun 09 08:45:58.752117 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:58.752088 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zmgdk" Jun 09 08:45:58.917041 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:58.916837 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zmgdk"] Jun 09 08:45:58.920840 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:45:58.920814 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod434a609b_dd30_4747_96b8_ce766267866d.slice/crio-d7151a545369a779c7f3a5e9a4440e3fda32e5cf217a9506f27cf99d4d7214f7 WatchSource:0}: Error finding container d7151a545369a779c7f3a5e9a4440e3fda32e5cf217a9506f27cf99d4d7214f7: Status 404 returned error can't find the container with id d7151a545369a779c7f3a5e9a4440e3fda32e5cf217a9506f27cf99d4d7214f7 Jun 09 08:45:59.068383 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:59.068348 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-grvqt" Jun 09 08:45:59.068383 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:59.068370 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qchhg" Jun 09 08:45:59.068594 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:59.068476 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4jvm8" Jun 09 08:45:59.071304 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:59.070988 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 08:45:59.071304 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:59.071057 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 08:45:59.071304 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:59.071081 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-h9vt6\"" Jun 09 08:45:59.071304 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:59.071156 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2sxlq\"" Jun 09 08:45:59.071304 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:59.071261 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 08:45:59.071620 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:59.071322 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 08:45:59.164425 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:59.164390 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e28b9904-750f-489c-b660-e6b1f6a5848b-registry-tls\") pod \"image-registry-c97c5c49c-fn4jw\" (UID: \"e28b9904-750f-489c-b660-e6b1f6a5848b\") " pod="openshift-image-registry/image-registry-c97c5c49c-fn4jw" Jun 09 08:45:59.164607 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:59.164456 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16df8afb-8164-41fd-9d0d-005830dda96c-metrics-tls\") pod \"dns-default-nsxkc\" (UID: \"16df8afb-8164-41fd-9d0d-005830dda96c\") " pod="openshift-dns/dns-default-nsxkc" Jun 09 08:45:59.164607 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:59.164551 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 08:45:59.164607 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:59.164568 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c97c5c49c-fn4jw: secret "image-registry-tls" not found Jun 09 08:45:59.164607 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:59.164603 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 08:45:59.164783 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:59.164623 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e28b9904-750f-489c-b660-e6b1f6a5848b-registry-tls podName:e28b9904-750f-489c-b660-e6b1f6a5848b nodeName:}" failed. No retries permitted until 2026-06-09 08:46:00.164607533 +0000 UTC m=+37.609554865 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e28b9904-750f-489c-b660-e6b1f6a5848b-registry-tls") pod "image-registry-c97c5c49c-fn4jw" (UID: "e28b9904-750f-489c-b660-e6b1f6a5848b") : secret "image-registry-tls" not found Jun 09 08:45:59.164783 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:45:59.164666 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16df8afb-8164-41fd-9d0d-005830dda96c-metrics-tls podName:16df8afb-8164-41fd-9d0d-005830dda96c nodeName:}" failed. No retries permitted until 2026-06-09 08:46:00.164636538 +0000 UTC m=+37.609583869 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/16df8afb-8164-41fd-9d0d-005830dda96c-metrics-tls") pod "dns-default-nsxkc" (UID: "16df8afb-8164-41fd-9d0d-005830dda96c") : secret "dns-default-metrics-tls" not found Jun 09 08:45:59.256684 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:59.256563 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zmgdk" event={"ID":"434a609b-dd30-4747-96b8-ce766267866d","Type":"ContainerStarted","Data":"d7151a545369a779c7f3a5e9a4440e3fda32e5cf217a9506f27cf99d4d7214f7"} Jun 09 08:45:59.259110 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:59.259081 2567 generic.go:356] "Generic (PLEG): container finished" podID="2505c746-7f3b-4dcc-a6a1-956885ca7fc3" containerID="f8ca717e7e5df983663b8d1eeb13da3bb878c43fc9c85e976d34281ffc9e019e" exitCode=0 Jun 09 08:45:59.259232 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:45:59.259118 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jf7vr" event={"ID":"2505c746-7f3b-4dcc-a6a1-956885ca7fc3","Type":"ContainerDied","Data":"f8ca717e7e5df983663b8d1eeb13da3bb878c43fc9c85e976d34281ffc9e019e"} Jun 09 08:46:00.171174 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:46:00.171134 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16df8afb-8164-41fd-9d0d-005830dda96c-metrics-tls\") pod \"dns-default-nsxkc\" (UID: \"16df8afb-8164-41fd-9d0d-005830dda96c\") " pod="openshift-dns/dns-default-nsxkc" Jun 09 08:46:00.171956 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:46:00.171215 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e28b9904-750f-489c-b660-e6b1f6a5848b-registry-tls\") pod \"image-registry-c97c5c49c-fn4jw\" (UID: \"e28b9904-750f-489c-b660-e6b1f6a5848b\") " pod="openshift-image-registry/image-registry-c97c5c49c-fn4jw" Jun 09 08:46:00.171956 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:46:00.171298 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 08:46:00.171956 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:46:00.171321 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 08:46:00.171956 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:46:00.171334 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c97c5c49c-fn4jw: secret "image-registry-tls" not found Jun 09 08:46:00.171956 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:46:00.171367 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16df8afb-8164-41fd-9d0d-005830dda96c-metrics-tls podName:16df8afb-8164-41fd-9d0d-005830dda96c nodeName:}" failed. No retries permitted until 2026-06-09 08:46:02.171348043 +0000 UTC m=+39.616295389 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/16df8afb-8164-41fd-9d0d-005830dda96c-metrics-tls") pod "dns-default-nsxkc" (UID: "16df8afb-8164-41fd-9d0d-005830dda96c") : secret "dns-default-metrics-tls" not found Jun 09 08:46:00.171956 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:46:00.171383 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e28b9904-750f-489c-b660-e6b1f6a5848b-registry-tls podName:e28b9904-750f-489c-b660-e6b1f6a5848b nodeName:}" failed. No retries permitted until 2026-06-09 08:46:02.171376918 +0000 UTC m=+39.616324245 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e28b9904-750f-489c-b660-e6b1f6a5848b-registry-tls") pod "image-registry-c97c5c49c-fn4jw" (UID: "e28b9904-750f-489c-b660-e6b1f6a5848b") : secret "image-registry-tls" not found Jun 09 08:46:00.264456 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:46:00.264428 2567 generic.go:356] "Generic (PLEG): container finished" podID="2505c746-7f3b-4dcc-a6a1-956885ca7fc3" containerID="e0c11f939f8609ffd8181121ea6225d08452d4162d2a4e65fa9cfabeeea756bf" exitCode=0 Jun 09 08:46:00.264603 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:46:00.264468 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jf7vr" event={"ID":"2505c746-7f3b-4dcc-a6a1-956885ca7fc3","Type":"ContainerDied","Data":"e0c11f939f8609ffd8181121ea6225d08452d4162d2a4e65fa9cfabeeea756bf"} Jun 09 08:46:01.269822 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:46:01.269792 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jf7vr" event={"ID":"2505c746-7f3b-4dcc-a6a1-956885ca7fc3","Type":"ContainerStarted","Data":"069ff55a35fb2bd7ca5c0544adea15d7858563cce4ff7926d4189ce0178e6227"} Jun 09 08:46:01.290087 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:46:01.290040 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-jf7vr" podStartSLOduration=8.864229628 podStartE2EDuration="38.29002436s" totalImagesPullingTime="29.425794732s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 08:45:23 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:46:01.28957595 +0000 UTC m=+38.734523302" watchObservedRunningTime="2026-06-09 08:46:01.29002436 +0000 UTC m=+38.734971709" Jun 09 08:46:02.188863 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:46:02.188683 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e28b9904-750f-489c-b660-e6b1f6a5848b-registry-tls\") pod \"image-registry-c97c5c49c-fn4jw\" (UID: \"e28b9904-750f-489c-b660-e6b1f6a5848b\") " pod="openshift-image-registry/image-registry-c97c5c49c-fn4jw" Jun 09 08:46:02.189070 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:46:02.188893 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16df8afb-8164-41fd-9d0d-005830dda96c-metrics-tls\") pod \"dns-default-nsxkc\" (UID: \"16df8afb-8164-41fd-9d0d-005830dda96c\") " pod="openshift-dns/dns-default-nsxkc" Jun 09 08:46:02.189070 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:46:02.188823 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 08:46:02.189070 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:46:02.188944 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c97c5c49c-fn4jw: secret "image-registry-tls" not found Jun 09 08:46:02.189070 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:46:02.188976 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 08:46:02.189070 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:46:02.189011 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e28b9904-750f-489c-b660-e6b1f6a5848b-registry-tls podName:e28b9904-750f-489c-b660-e6b1f6a5848b nodeName:}" failed. No retries permitted until 2026-06-09 08:46:06.188991147 +0000 UTC m=+43.633938492 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e28b9904-750f-489c-b660-e6b1f6a5848b-registry-tls") pod "image-registry-c97c5c49c-fn4jw" (UID: "e28b9904-750f-489c-b660-e6b1f6a5848b") : secret "image-registry-tls" not found Jun 09 08:46:02.189070 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:46:02.189029 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16df8afb-8164-41fd-9d0d-005830dda96c-metrics-tls podName:16df8afb-8164-41fd-9d0d-005830dda96c nodeName:}" failed. No retries permitted until 2026-06-09 08:46:06.189021295 +0000 UTC m=+43.633968629 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/16df8afb-8164-41fd-9d0d-005830dda96c-metrics-tls") pod "dns-default-nsxkc" (UID: "16df8afb-8164-41fd-9d0d-005830dda96c") : secret "dns-default-metrics-tls" not found Jun 09 08:46:02.273308 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:46:02.273274 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zmgdk" event={"ID":"434a609b-dd30-4747-96b8-ce766267866d","Type":"ContainerStarted","Data":"3ac770e76c8ab81b53e4d475445a01859d49e31c336282dcaf215eada93414de"} Jun 09 08:46:02.289914 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:46:02.289860 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-zmgdk" podStartSLOduration=1.796344913 podStartE2EDuration="4.289844124s" totalImagesPullingTime="2.493499211s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 08:45:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:46:02.288724591 +0000 UTC m=+39.733671933" watchObservedRunningTime="2026-06-09 08:46:02.289844124 +0000 UTC m=+39.734791473" Jun 09 08:46:06.219628 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:46:06.219584 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e28b9904-750f-489c-b660-e6b1f6a5848b-registry-tls\") pod \"image-registry-c97c5c49c-fn4jw\" (UID: \"e28b9904-750f-489c-b660-e6b1f6a5848b\") " pod="openshift-image-registry/image-registry-c97c5c49c-fn4jw" Jun 09 08:46:06.220132 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:46:06.219697 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16df8afb-8164-41fd-9d0d-005830dda96c-metrics-tls\") pod \"dns-default-nsxkc\" (UID: \"16df8afb-8164-41fd-9d0d-005830dda96c\") " pod="openshift-dns/dns-default-nsxkc" Jun 09 08:46:06.220132 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:46:06.219767 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 08:46:06.220132 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:46:06.219794 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c97c5c49c-fn4jw: secret "image-registry-tls" not found Jun 09 08:46:06.220132 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:46:06.219851 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 08:46:06.220132 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:46:06.219863 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e28b9904-750f-489c-b660-e6b1f6a5848b-registry-tls podName:e28b9904-750f-489c-b660-e6b1f6a5848b nodeName:}" failed. No retries permitted until 2026-06-09 08:46:14.2198434 +0000 UTC m=+51.664790743 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e28b9904-750f-489c-b660-e6b1f6a5848b-registry-tls") pod "image-registry-c97c5c49c-fn4jw" (UID: "e28b9904-750f-489c-b660-e6b1f6a5848b") : secret "image-registry-tls" not found Jun 09 08:46:06.220132 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:46:06.219919 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16df8afb-8164-41fd-9d0d-005830dda96c-metrics-tls podName:16df8afb-8164-41fd-9d0d-005830dda96c nodeName:}" failed. No retries permitted until 2026-06-09 08:46:14.219906965 +0000 UTC m=+51.664854416 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/16df8afb-8164-41fd-9d0d-005830dda96c-metrics-tls") pod "dns-default-nsxkc" (UID: "16df8afb-8164-41fd-9d0d-005830dda96c") : secret "dns-default-metrics-tls" not found Jun 09 08:46:14.274767 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:46:14.274725 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16df8afb-8164-41fd-9d0d-005830dda96c-metrics-tls\") pod \"dns-default-nsxkc\" (UID: \"16df8afb-8164-41fd-9d0d-005830dda96c\") " pod="openshift-dns/dns-default-nsxkc" Jun 09 08:46:14.275342 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:46:14.274791 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e28b9904-750f-489c-b660-e6b1f6a5848b-registry-tls\") pod \"image-registry-c97c5c49c-fn4jw\" (UID: \"e28b9904-750f-489c-b660-e6b1f6a5848b\") " pod="openshift-image-registry/image-registry-c97c5c49c-fn4jw" Jun 09 08:46:14.275342 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:46:14.274888 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 08:46:14.275342 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:46:14.274915 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c97c5c49c-fn4jw: secret "image-registry-tls" not found Jun 09 08:46:14.275342 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:46:14.274964 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e28b9904-750f-489c-b660-e6b1f6a5848b-registry-tls podName:e28b9904-750f-489c-b660-e6b1f6a5848b nodeName:}" failed. No retries permitted until 2026-06-09 08:46:30.274950438 +0000 UTC m=+67.719897767 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e28b9904-750f-489c-b660-e6b1f6a5848b-registry-tls") pod "image-registry-c97c5c49c-fn4jw" (UID: "e28b9904-750f-489c-b660-e6b1f6a5848b") : secret "image-registry-tls" not found Jun 09 08:46:14.275342 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:46:14.274889 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 08:46:14.275342 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:46:14.274995 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16df8afb-8164-41fd-9d0d-005830dda96c-metrics-tls podName:16df8afb-8164-41fd-9d0d-005830dda96c nodeName:}" failed. No retries permitted until 2026-06-09 08:46:30.27498953 +0000 UTC m=+67.719936858 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/16df8afb-8164-41fd-9d0d-005830dda96c-metrics-tls") pod "dns-default-nsxkc" (UID: "16df8afb-8164-41fd-9d0d-005830dda96c") : secret "dns-default-metrics-tls" not found Jun 09 08:46:25.256500 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:46:25.256473 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rldts" Jun 09 08:46:28.773611 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:46:28.773573 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/955c937e-7a98-4e3a-b4bb-52e78c5ac289-metrics-certs\") pod \"network-metrics-daemon-qchhg\" (UID: \"955c937e-7a98-4e3a-b4bb-52e78c5ac289\") " pod="openshift-multus/network-metrics-daemon-qchhg" Jun 09 08:46:28.774085 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:46:28.773627 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae90f658-436b-42fc-b170-318cd82d55b1-original-pull-secret\") pod \"global-pull-secret-syncer-grvqt\" (UID: \"ae90f658-436b-42fc-b170-318cd82d55b1\") " pod="kube-system/global-pull-secret-syncer-grvqt" Jun 09 08:46:28.776032 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:46:28.775995 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 08:46:28.776162 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:46:28.776035 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 08:46:28.784778 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:46:28.784755 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 08:46:28.784861 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:46:28.784843 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/955c937e-7a98-4e3a-b4bb-52e78c5ac289-metrics-certs podName:955c937e-7a98-4e3a-b4bb-52e78c5ac289 nodeName:}" failed. No retries permitted until 2026-06-09 08:47:32.784821507 +0000 UTC m=+130.229768835 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/955c937e-7a98-4e3a-b4bb-52e78c5ac289-metrics-certs") pod "network-metrics-daemon-qchhg" (UID: "955c937e-7a98-4e3a-b4bb-52e78c5ac289") : secret "metrics-daemon-secret" not found Jun 09 08:46:28.788355 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:46:28.788336 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae90f658-436b-42fc-b170-318cd82d55b1-original-pull-secret\") pod \"global-pull-secret-syncer-grvqt\" (UID: \"ae90f658-436b-42fc-b170-318cd82d55b1\") " pod="kube-system/global-pull-secret-syncer-grvqt" Jun 09 08:46:28.874398 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:46:28.874358 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjp8p\" (UniqueName: \"kubernetes.io/projected/8593ba17-a4fb-4caf-a018-e1e93147ffca-kube-api-access-kjp8p\") pod \"network-check-target-4jvm8\" (UID: \"8593ba17-a4fb-4caf-a018-e1e93147ffca\") " pod="openshift-network-diagnostics/network-check-target-4jvm8" Jun 09 08:46:28.876861 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:46:28.876842 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 08:46:28.886468 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:46:28.886445 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 08:46:28.897500 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:46:28.897474 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjp8p\" (UniqueName: \"kubernetes.io/projected/8593ba17-a4fb-4caf-a018-e1e93147ffca-kube-api-access-kjp8p\") pod \"network-check-target-4jvm8\" (UID: \"8593ba17-a4fb-4caf-a018-e1e93147ffca\") " pod="openshift-network-diagnostics/network-check-target-4jvm8" Jun 09 08:46:29.079412 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:46:29.079384 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-grvqt" Jun 09 08:46:29.086603 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:46:29.086584 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-h9vt6\"" Jun 09 08:46:29.095321 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:46:29.095304 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4jvm8" Jun 09 08:46:29.254515 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:46:29.254486 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-grvqt"] Jun 09 08:46:29.257785 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:46:29.257758 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae90f658_436b_42fc_b170_318cd82d55b1.slice/crio-b74d84e01f98e592666d3dda96445c9308f96136fdb1c60f4d2fbdf1aadd6a4a WatchSource:0}: Error finding container b74d84e01f98e592666d3dda96445c9308f96136fdb1c60f4d2fbdf1aadd6a4a: Status 404 returned error can't find the container with id b74d84e01f98e592666d3dda96445c9308f96136fdb1c60f4d2fbdf1aadd6a4a Jun 09 08:46:29.275698 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:46:29.275351 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4jvm8"] Jun 09 08:46:29.279219 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:46:29.279199 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8593ba17_a4fb_4caf_a018_e1e93147ffca.slice/crio-d2347d4f80c0463f1900f184d8cc096bf428352ce67b090773bef52d17471ffc WatchSource:0}: Error finding container d2347d4f80c0463f1900f184d8cc096bf428352ce67b090773bef52d17471ffc: Status 404 returned error can't find the container with id d2347d4f80c0463f1900f184d8cc096bf428352ce67b090773bef52d17471ffc Jun 09 08:46:29.334574 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:46:29.334502 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4jvm8" event={"ID":"8593ba17-a4fb-4caf-a018-e1e93147ffca","Type":"ContainerStarted","Data":"d2347d4f80c0463f1900f184d8cc096bf428352ce67b090773bef52d17471ffc"} Jun 09 08:46:29.335618 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:46:29.335595 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-grvqt" event={"ID":"ae90f658-436b-42fc-b170-318cd82d55b1","Type":"ContainerStarted","Data":"b74d84e01f98e592666d3dda96445c9308f96136fdb1c60f4d2fbdf1aadd6a4a"} Jun 09 08:46:30.285123 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:46:30.285080 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16df8afb-8164-41fd-9d0d-005830dda96c-metrics-tls\") pod \"dns-default-nsxkc\" (UID: \"16df8afb-8164-41fd-9d0d-005830dda96c\") " pod="openshift-dns/dns-default-nsxkc" Jun 09 08:46:30.285602 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:46:30.285139 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e28b9904-750f-489c-b660-e6b1f6a5848b-registry-tls\") pod \"image-registry-c97c5c49c-fn4jw\" (UID: \"e28b9904-750f-489c-b660-e6b1f6a5848b\") " pod="openshift-image-registry/image-registry-c97c5c49c-fn4jw" Jun 09 08:46:30.285602 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:46:30.285252 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 08:46:30.285602 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:46:30.285333 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16df8afb-8164-41fd-9d0d-005830dda96c-metrics-tls podName:16df8afb-8164-41fd-9d0d-005830dda96c nodeName:}" failed. No retries permitted until 2026-06-09 08:47:02.285313124 +0000 UTC m=+99.730260469 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/16df8afb-8164-41fd-9d0d-005830dda96c-metrics-tls") pod "dns-default-nsxkc" (UID: "16df8afb-8164-41fd-9d0d-005830dda96c") : secret "dns-default-metrics-tls" not found Jun 09 08:46:30.285602 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:46:30.285265 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 08:46:30.285602 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:46:30.285366 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c97c5c49c-fn4jw: secret "image-registry-tls" not found Jun 09 08:46:30.285602 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:46:30.285417 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e28b9904-750f-489c-b660-e6b1f6a5848b-registry-tls podName:e28b9904-750f-489c-b660-e6b1f6a5848b nodeName:}" failed. No retries permitted until 2026-06-09 08:47:02.285401814 +0000 UTC m=+99.730349142 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e28b9904-750f-489c-b660-e6b1f6a5848b-registry-tls") pod "image-registry-c97c5c49c-fn4jw" (UID: "e28b9904-750f-489c-b660-e6b1f6a5848b") : secret "image-registry-tls" not found Jun 09 08:46:32.345624 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:46:32.345587 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4jvm8" event={"ID":"8593ba17-a4fb-4caf-a018-e1e93147ffca","Type":"ContainerStarted","Data":"f3e573bb55a155d39364e2fa83086a188e9dc15035a6e93e861642b454ba0e40"} Jun 09 08:46:32.346079 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:46:32.345682 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-4jvm8" Jun 09 08:46:32.364693 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:46:32.363310 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-4jvm8" podStartSLOduration=66.417819883 podStartE2EDuration="1m9.363290463s" totalImagesPullingTime="2.94547058s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 08:45:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:46:32.361151279 +0000 UTC m=+69.806098630" watchObservedRunningTime="2026-06-09 08:46:32.363290463 +0000 UTC m=+69.808237814" Jun 09 08:46:35.354061 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:46:35.354027 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-grvqt" event={"ID":"ae90f658-436b-42fc-b170-318cd82d55b1","Type":"ContainerStarted","Data":"4566f7fca49e1c31726802688ad7f7495effb3bfd718418c14b172ccdad0c9cd"} Jun 09 08:46:35.368949 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:46:35.368902 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-grvqt" podStartSLOduration=66.801638958 podStartE2EDuration="1m12.368887121s" totalImagesPullingTime="5.567248163s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 08:45:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:46:35.368137201 +0000 UTC m=+72.813084774" watchObservedRunningTime="2026-06-09 08:46:35.368887121 +0000 UTC m=+72.813834471" Jun 09 08:47:02.311669 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:47:02.311522 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e28b9904-750f-489c-b660-e6b1f6a5848b-registry-tls\") pod \"image-registry-c97c5c49c-fn4jw\" (UID: \"e28b9904-750f-489c-b660-e6b1f6a5848b\") " pod="openshift-image-registry/image-registry-c97c5c49c-fn4jw" Jun 09 08:47:02.311669 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:47:02.311589 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16df8afb-8164-41fd-9d0d-005830dda96c-metrics-tls\") pod \"dns-default-nsxkc\" (UID: \"16df8afb-8164-41fd-9d0d-005830dda96c\") " pod="openshift-dns/dns-default-nsxkc" Jun 09 08:47:02.312187 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:47:02.311707 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 08:47:02.312187 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:47:02.311792 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16df8afb-8164-41fd-9d0d-005830dda96c-metrics-tls podName:16df8afb-8164-41fd-9d0d-005830dda96c nodeName:}" failed. No retries permitted until 2026-06-09 08:48:06.311771819 +0000 UTC m=+163.756719146 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/16df8afb-8164-41fd-9d0d-005830dda96c-metrics-tls") pod "dns-default-nsxkc" (UID: "16df8afb-8164-41fd-9d0d-005830dda96c") : secret "dns-default-metrics-tls" not found Jun 09 08:47:02.312187 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:47:02.311709 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 08:47:02.312187 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:47:02.311818 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c97c5c49c-fn4jw: secret "image-registry-tls" not found Jun 09 08:47:02.312187 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:47:02.311915 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e28b9904-750f-489c-b660-e6b1f6a5848b-registry-tls podName:e28b9904-750f-489c-b660-e6b1f6a5848b nodeName:}" failed. No retries permitted until 2026-06-09 08:48:06.311896961 +0000 UTC m=+163.756844304 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e28b9904-750f-489c-b660-e6b1f6a5848b-registry-tls") pod "image-registry-c97c5c49c-fn4jw" (UID: "e28b9904-750f-489c-b660-e6b1f6a5848b") : secret "image-registry-tls" not found Jun 09 08:47:03.350854 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:47:03.350774 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-4jvm8" Jun 09 08:47:32.826259 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:47:32.826199 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/955c937e-7a98-4e3a-b4bb-52e78c5ac289-metrics-certs\") pod \"network-metrics-daemon-qchhg\" (UID: \"955c937e-7a98-4e3a-b4bb-52e78c5ac289\") " pod="openshift-multus/network-metrics-daemon-qchhg" Jun 09 08:47:32.826788 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:47:32.826361 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 08:47:32.826788 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:47:32.826435 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/955c937e-7a98-4e3a-b4bb-52e78c5ac289-metrics-certs podName:955c937e-7a98-4e3a-b4bb-52e78c5ac289 nodeName:}" failed. No retries permitted until 2026-06-09 08:49:34.826417382 +0000 UTC m=+252.271364729 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/955c937e-7a98-4e3a-b4bb-52e78c5ac289-metrics-certs") pod "network-metrics-daemon-qchhg" (UID: "955c937e-7a98-4e3a-b4bb-52e78c5ac289") : secret "metrics-daemon-secret" not found Jun 09 08:48:01.429228 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:48:01.429184 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-c97c5c49c-fn4jw" podUID="e28b9904-750f-489c-b660-e6b1f6a5848b" Jun 09 08:48:01.443495 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:48:01.443468 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-nsxkc" podUID="16df8afb-8164-41fd-9d0d-005830dda96c" Jun 09 08:48:01.550591 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:01.550564 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c97c5c49c-fn4jw" Jun 09 08:48:01.550736 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:01.550564 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nsxkc" Jun 09 08:48:02.089340 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:48:02.089298 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-qchhg" podUID="955c937e-7a98-4e3a-b4bb-52e78c5ac289" Jun 09 08:48:06.354464 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:06.354417 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e28b9904-750f-489c-b660-e6b1f6a5848b-registry-tls\") pod \"image-registry-c97c5c49c-fn4jw\" (UID: \"e28b9904-750f-489c-b660-e6b1f6a5848b\") " pod="openshift-image-registry/image-registry-c97c5c49c-fn4jw" Jun 09 08:48:06.354887 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:06.354476 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16df8afb-8164-41fd-9d0d-005830dda96c-metrics-tls\") pod \"dns-default-nsxkc\" (UID: \"16df8afb-8164-41fd-9d0d-005830dda96c\") " pod="openshift-dns/dns-default-nsxkc" Jun 09 08:48:06.354887 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:48:06.354567 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 08:48:06.354887 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:48:06.354569 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 08:48:06.354887 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:48:06.354589 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c97c5c49c-fn4jw: secret "image-registry-tls" not found Jun 09 08:48:06.354887 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:48:06.354627 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16df8afb-8164-41fd-9d0d-005830dda96c-metrics-tls podName:16df8afb-8164-41fd-9d0d-005830dda96c nodeName:}" failed. No retries permitted until 2026-06-09 08:50:08.354612592 +0000 UTC m=+285.799559920 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/16df8afb-8164-41fd-9d0d-005830dda96c-metrics-tls") pod "dns-default-nsxkc" (UID: "16df8afb-8164-41fd-9d0d-005830dda96c") : secret "dns-default-metrics-tls" not found Jun 09 08:48:06.354887 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:48:06.354640 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e28b9904-750f-489c-b660-e6b1f6a5848b-registry-tls podName:e28b9904-750f-489c-b660-e6b1f6a5848b nodeName:}" failed. No retries permitted until 2026-06-09 08:50:08.354633713 +0000 UTC m=+285.799581041 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e28b9904-750f-489c-b660-e6b1f6a5848b-registry-tls") pod "image-registry-c97c5c49c-fn4jw" (UID: "e28b9904-750f-489c-b660-e6b1f6a5848b") : secret "image-registry-tls" not found Jun 09 08:48:13.069143 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:13.069053 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qchhg" Jun 09 08:48:43.406583 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.406547 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-pbsns"] Jun 09 08:48:43.424743 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.423674 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-pbsns" Jun 09 08:48:43.424743 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.424081 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-bdkvt"] Jun 09 08:48:43.427084 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.426388 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 09 08:48:43.427084 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.426399 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 09 08:48:43.427084 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.426688 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-s6dtk\"" Jun 09 08:48:43.427084 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.426827 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 09 08:48:43.427084 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.426915 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 09 08:48:43.427625 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.427343 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-tr52t"] Jun 09 08:48:43.427625 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.427467 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-bdkvt" Jun 09 08:48:43.429318 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.429301 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-54klp\"" Jun 09 08:48:43.430224 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.430203 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vzzjj"] Jun 09 08:48:43.430336 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.430317 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-tr52t" Jun 09 08:48:43.432302 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.432283 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 09 08:48:43.432461 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.432438 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-jkc62\"" Jun 09 08:48:43.432585 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.432568 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 09 08:48:43.433421 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.433085 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-x2fqm"] Jun 09 08:48:43.433421 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.433256 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vzzjj" Jun 09 08:48:43.436028 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.435662 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 09 08:48:43.436028 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.435786 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 09 08:48:43.436028 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.435894 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-ssflj\"" Jun 09 08:48:43.436028 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.435873 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 09 08:48:43.436284 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.436062 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-pbsns"] Jun 09 08:48:43.436284 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.436094 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-bdkvt"] Jun 09 08:48:43.436284 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.436117 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-x2fqm"] Jun 09 08:48:43.436284 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.436135 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vzzjj"] Jun 09 08:48:43.436284 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.436166 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-tr52t"] Jun 09 08:48:43.436284 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.436235 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-x2fqm" Jun 09 08:48:43.438588 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.438272 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 09 08:48:43.438588 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.438559 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-f8d95\"" Jun 09 08:48:43.439340 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.439324 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 09 08:48:43.439422 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.439324 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 09 08:48:43.439422 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.439391 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 09 08:48:43.523325 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.523295 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/28bee076-40fc-40d5-a80c-1b9867359d6c-config\") pod \"service-ca-operator-6bc5ff68f5-pbsns\" (UID: \"28bee076-40fc-40d5-a80c-1b9867359d6c\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-pbsns" Jun 09 08:48:43.523325 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.523332 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mzr6\" (UniqueName: \"kubernetes.io/projected/28bee076-40fc-40d5-a80c-1b9867359d6c-kube-api-access-5mzr6\") pod \"service-ca-operator-6bc5ff68f5-pbsns\" (UID: \"28bee076-40fc-40d5-a80c-1b9867359d6c\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-pbsns" Jun 09 08:48:43.523554 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.523359 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f0b23720-7d48-4020-a608-c0348551c543-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-vzzjj\" (UID: \"f0b23720-7d48-4020-a608-c0348551c543\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vzzjj" Jun 09 08:48:43.523554 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.523376 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/28bee076-40fc-40d5-a80c-1b9867359d6c-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-pbsns\" (UID: \"28bee076-40fc-40d5-a80c-1b9867359d6c\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-pbsns" Jun 09 08:48:43.523554 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.523430 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qn8m\" (UniqueName: \"kubernetes.io/projected/07afa869-7b21-4f9d-a861-2ff5757149f3-kube-api-access-7qn8m\") pod \"network-check-source-dbd9cf844-bdkvt\" (UID: \"07afa869-7b21-4f9d-a861-2ff5757149f3\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-bdkvt" Jun 09 08:48:43.523554 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.523475 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wj7j2\" (UniqueName: \"kubernetes.io/projected/a6855c96-c4f2-4650-bda3-95ce7db1d9da-kube-api-access-wj7j2\") pod \"cluster-monitoring-operator-74bbf69bbb-x2fqm\" (UID: \"a6855c96-c4f2-4650-bda3-95ce7db1d9da\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-x2fqm" Jun 09 08:48:43.523554 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.523510 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lt9mp\" (UniqueName: \"kubernetes.io/projected/bc7c68b8-62b9-47b5-a562-f9baf876d223-kube-api-access-lt9mp\") pod \"volume-data-source-validator-78dd696465-tr52t\" (UID: \"bc7c68b8-62b9-47b5-a562-f9baf876d223\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-tr52t" Jun 09 08:48:43.523554 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.523549 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a6855c96-c4f2-4650-bda3-95ce7db1d9da-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-x2fqm\" (UID: \"a6855c96-c4f2-4650-bda3-95ce7db1d9da\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-x2fqm" Jun 09 08:48:43.523806 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.523565 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a6855c96-c4f2-4650-bda3-95ce7db1d9da-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-x2fqm\" (UID: \"a6855c96-c4f2-4650-bda3-95ce7db1d9da\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-x2fqm" Jun 09 08:48:43.523806 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.523590 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjpbg\" (UniqueName: \"kubernetes.io/projected/f0b23720-7d48-4020-a608-c0348551c543-kube-api-access-hjpbg\") pod \"cluster-samples-operator-854f8b96b6-vzzjj\" (UID: \"f0b23720-7d48-4020-a608-c0348551c543\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vzzjj" Jun 09 08:48:43.602197 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.602159 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-pdvps"] Jun 09 08:48:43.605101 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.605086 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-pdvps" Jun 09 08:48:43.607788 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.607759 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 09 08:48:43.608495 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.608043 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-sjf8b\"" Jun 09 08:48:43.608495 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.608315 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 09 08:48:43.608495 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.608419 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 09 08:48:43.609787 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.609706 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 09 08:48:43.613489 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.613469 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 09 08:48:43.615139 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.615118 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-pdvps"] Jun 09 08:48:43.624848 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.624828 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f0b23720-7d48-4020-a608-c0348551c543-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-vzzjj\" (UID: \"f0b23720-7d48-4020-a608-c0348551c543\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vzzjj" Jun 09 08:48:43.624960 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.624864 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/28bee076-40fc-40d5-a80c-1b9867359d6c-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-pbsns\" (UID: \"28bee076-40fc-40d5-a80c-1b9867359d6c\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-pbsns" Jun 09 08:48:43.624960 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.624904 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qn8m\" (UniqueName: \"kubernetes.io/projected/07afa869-7b21-4f9d-a861-2ff5757149f3-kube-api-access-7qn8m\") pod \"network-check-source-dbd9cf844-bdkvt\" (UID: \"07afa869-7b21-4f9d-a861-2ff5757149f3\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-bdkvt" Jun 09 08:48:43.624960 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.624929 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wj7j2\" (UniqueName: \"kubernetes.io/projected/a6855c96-c4f2-4650-bda3-95ce7db1d9da-kube-api-access-wj7j2\") pod \"cluster-monitoring-operator-74bbf69bbb-x2fqm\" (UID: \"a6855c96-c4f2-4650-bda3-95ce7db1d9da\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-x2fqm" Jun 09 08:48:43.625121 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.624970 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lt9mp\" (UniqueName: \"kubernetes.io/projected/bc7c68b8-62b9-47b5-a562-f9baf876d223-kube-api-access-lt9mp\") pod \"volume-data-source-validator-78dd696465-tr52t\" (UID: \"bc7c68b8-62b9-47b5-a562-f9baf876d223\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-tr52t" Jun 09 08:48:43.625121 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:48:43.624987 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 08:48:43.625121 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.625031 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a6855c96-c4f2-4650-bda3-95ce7db1d9da-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-x2fqm\" (UID: \"a6855c96-c4f2-4650-bda3-95ce7db1d9da\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-x2fqm" Jun 09 08:48:43.625121 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:48:43.625053 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0b23720-7d48-4020-a608-c0348551c543-samples-operator-tls podName:f0b23720-7d48-4020-a608-c0348551c543 nodeName:}" failed. No retries permitted until 2026-06-09 08:48:44.125034036 +0000 UTC m=+201.569981378 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f0b23720-7d48-4020-a608-c0348551c543-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-vzzjj" (UID: "f0b23720-7d48-4020-a608-c0348551c543") : secret "samples-operator-tls" not found Jun 09 08:48:43.625121 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.625089 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a6855c96-c4f2-4650-bda3-95ce7db1d9da-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-x2fqm\" (UID: \"a6855c96-c4f2-4650-bda3-95ce7db1d9da\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-x2fqm" Jun 09 08:48:43.625373 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.625135 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjpbg\" (UniqueName: \"kubernetes.io/projected/f0b23720-7d48-4020-a608-c0348551c543-kube-api-access-hjpbg\") pod \"cluster-samples-operator-854f8b96b6-vzzjj\" (UID: \"f0b23720-7d48-4020-a608-c0348551c543\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vzzjj" Jun 09 08:48:43.625373 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.625167 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/28bee076-40fc-40d5-a80c-1b9867359d6c-config\") pod \"service-ca-operator-6bc5ff68f5-pbsns\" (UID: \"28bee076-40fc-40d5-a80c-1b9867359d6c\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-pbsns" Jun 09 08:48:43.625373 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:48:43.625208 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 08:48:43.625373 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:48:43.625273 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6855c96-c4f2-4650-bda3-95ce7db1d9da-cluster-monitoring-operator-tls podName:a6855c96-c4f2-4650-bda3-95ce7db1d9da nodeName:}" failed. No retries permitted until 2026-06-09 08:48:44.125255557 +0000 UTC m=+201.570202900 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a6855c96-c4f2-4650-bda3-95ce7db1d9da-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-x2fqm" (UID: "a6855c96-c4f2-4650-bda3-95ce7db1d9da") : secret "cluster-monitoring-operator-tls" not found Jun 09 08:48:43.625373 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.625210 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mzr6\" (UniqueName: \"kubernetes.io/projected/28bee076-40fc-40d5-a80c-1b9867359d6c-kube-api-access-5mzr6\") pod \"service-ca-operator-6bc5ff68f5-pbsns\" (UID: \"28bee076-40fc-40d5-a80c-1b9867359d6c\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-pbsns" Jun 09 08:48:43.625690 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.625672 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/28bee076-40fc-40d5-a80c-1b9867359d6c-config\") pod \"service-ca-operator-6bc5ff68f5-pbsns\" (UID: \"28bee076-40fc-40d5-a80c-1b9867359d6c\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-pbsns" Jun 09 08:48:43.625790 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.625772 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a6855c96-c4f2-4650-bda3-95ce7db1d9da-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-x2fqm\" (UID: \"a6855c96-c4f2-4650-bda3-95ce7db1d9da\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-x2fqm" Jun 09 08:48:43.627153 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.627135 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/28bee076-40fc-40d5-a80c-1b9867359d6c-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-pbsns\" (UID: \"28bee076-40fc-40d5-a80c-1b9867359d6c\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-pbsns" Jun 09 08:48:43.638357 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.638331 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mzr6\" (UniqueName: \"kubernetes.io/projected/28bee076-40fc-40d5-a80c-1b9867359d6c-kube-api-access-5mzr6\") pod \"service-ca-operator-6bc5ff68f5-pbsns\" (UID: \"28bee076-40fc-40d5-a80c-1b9867359d6c\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-pbsns" Jun 09 08:48:43.639744 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.639708 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjpbg\" (UniqueName: \"kubernetes.io/projected/f0b23720-7d48-4020-a608-c0348551c543-kube-api-access-hjpbg\") pod \"cluster-samples-operator-854f8b96b6-vzzjj\" (UID: \"f0b23720-7d48-4020-a608-c0348551c543\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vzzjj" Jun 09 08:48:43.639938 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.639917 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qn8m\" (UniqueName: \"kubernetes.io/projected/07afa869-7b21-4f9d-a861-2ff5757149f3-kube-api-access-7qn8m\") pod \"network-check-source-dbd9cf844-bdkvt\" (UID: \"07afa869-7b21-4f9d-a861-2ff5757149f3\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-bdkvt" Jun 09 08:48:43.640060 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.640045 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lt9mp\" (UniqueName: \"kubernetes.io/projected/bc7c68b8-62b9-47b5-a562-f9baf876d223-kube-api-access-lt9mp\") pod \"volume-data-source-validator-78dd696465-tr52t\" (UID: \"bc7c68b8-62b9-47b5-a562-f9baf876d223\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-tr52t" Jun 09 08:48:43.640122 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.640076 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wj7j2\" (UniqueName: \"kubernetes.io/projected/a6855c96-c4f2-4650-bda3-95ce7db1d9da-kube-api-access-wj7j2\") pod \"cluster-monitoring-operator-74bbf69bbb-x2fqm\" (UID: \"a6855c96-c4f2-4650-bda3-95ce7db1d9da\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-x2fqm" Jun 09 08:48:43.725987 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.725902 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f3bf0a1a-491b-4abe-bb6f-7064fe8ac166-serving-cert\") pod \"insights-operator-896549976-pdvps\" (UID: \"f3bf0a1a-491b-4abe-bb6f-7064fe8ac166\") " pod="openshift-insights/insights-operator-896549976-pdvps" Jun 09 08:48:43.725987 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.725945 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f3bf0a1a-491b-4abe-bb6f-7064fe8ac166-snapshots\") pod \"insights-operator-896549976-pdvps\" (UID: \"f3bf0a1a-491b-4abe-bb6f-7064fe8ac166\") " pod="openshift-insights/insights-operator-896549976-pdvps" Jun 09 08:48:43.725987 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.725977 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3bf0a1a-491b-4abe-bb6f-7064fe8ac166-trusted-ca-bundle\") pod \"insights-operator-896549976-pdvps\" (UID: \"f3bf0a1a-491b-4abe-bb6f-7064fe8ac166\") " pod="openshift-insights/insights-operator-896549976-pdvps" Jun 09 08:48:43.726183 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.726037 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3bf0a1a-491b-4abe-bb6f-7064fe8ac166-service-ca-bundle\") pod \"insights-operator-896549976-pdvps\" (UID: \"f3bf0a1a-491b-4abe-bb6f-7064fe8ac166\") " pod="openshift-insights/insights-operator-896549976-pdvps" Jun 09 08:48:43.726183 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.726109 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f3bf0a1a-491b-4abe-bb6f-7064fe8ac166-tmp\") pod \"insights-operator-896549976-pdvps\" (UID: \"f3bf0a1a-491b-4abe-bb6f-7064fe8ac166\") " pod="openshift-insights/insights-operator-896549976-pdvps" Jun 09 08:48:43.726183 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.726145 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nf6j\" (UniqueName: \"kubernetes.io/projected/f3bf0a1a-491b-4abe-bb6f-7064fe8ac166-kube-api-access-8nf6j\") pod \"insights-operator-896549976-pdvps\" (UID: \"f3bf0a1a-491b-4abe-bb6f-7064fe8ac166\") " pod="openshift-insights/insights-operator-896549976-pdvps" Jun 09 08:48:43.738893 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.738854 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-pbsns" Jun 09 08:48:43.745943 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.745925 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-bdkvt" Jun 09 08:48:43.752795 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.752773 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-tr52t" Jun 09 08:48:43.829230 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.827045 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3bf0a1a-491b-4abe-bb6f-7064fe8ac166-service-ca-bundle\") pod \"insights-operator-896549976-pdvps\" (UID: \"f3bf0a1a-491b-4abe-bb6f-7064fe8ac166\") " pod="openshift-insights/insights-operator-896549976-pdvps" Jun 09 08:48:43.829230 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.827168 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f3bf0a1a-491b-4abe-bb6f-7064fe8ac166-tmp\") pod \"insights-operator-896549976-pdvps\" (UID: \"f3bf0a1a-491b-4abe-bb6f-7064fe8ac166\") " pod="openshift-insights/insights-operator-896549976-pdvps" Jun 09 08:48:43.829230 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.827205 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nf6j\" (UniqueName: \"kubernetes.io/projected/f3bf0a1a-491b-4abe-bb6f-7064fe8ac166-kube-api-access-8nf6j\") pod \"insights-operator-896549976-pdvps\" (UID: \"f3bf0a1a-491b-4abe-bb6f-7064fe8ac166\") " pod="openshift-insights/insights-operator-896549976-pdvps" Jun 09 08:48:43.829230 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.827248 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f3bf0a1a-491b-4abe-bb6f-7064fe8ac166-serving-cert\") pod \"insights-operator-896549976-pdvps\" (UID: \"f3bf0a1a-491b-4abe-bb6f-7064fe8ac166\") " pod="openshift-insights/insights-operator-896549976-pdvps" Jun 09 08:48:43.829230 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.827286 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f3bf0a1a-491b-4abe-bb6f-7064fe8ac166-snapshots\") pod \"insights-operator-896549976-pdvps\" (UID: \"f3bf0a1a-491b-4abe-bb6f-7064fe8ac166\") " pod="openshift-insights/insights-operator-896549976-pdvps" Jun 09 08:48:43.829230 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.827319 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3bf0a1a-491b-4abe-bb6f-7064fe8ac166-trusted-ca-bundle\") pod \"insights-operator-896549976-pdvps\" (UID: \"f3bf0a1a-491b-4abe-bb6f-7064fe8ac166\") " pod="openshift-insights/insights-operator-896549976-pdvps" Jun 09 08:48:43.829230 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.827701 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3bf0a1a-491b-4abe-bb6f-7064fe8ac166-service-ca-bundle\") pod \"insights-operator-896549976-pdvps\" (UID: \"f3bf0a1a-491b-4abe-bb6f-7064fe8ac166\") " pod="openshift-insights/insights-operator-896549976-pdvps" Jun 09 08:48:43.829230 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.827971 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f3bf0a1a-491b-4abe-bb6f-7064fe8ac166-tmp\") pod \"insights-operator-896549976-pdvps\" (UID: \"f3bf0a1a-491b-4abe-bb6f-7064fe8ac166\") " pod="openshift-insights/insights-operator-896549976-pdvps" Jun 09 08:48:43.829230 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.829077 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3bf0a1a-491b-4abe-bb6f-7064fe8ac166-trusted-ca-bundle\") pod \"insights-operator-896549976-pdvps\" (UID: \"f3bf0a1a-491b-4abe-bb6f-7064fe8ac166\") " pod="openshift-insights/insights-operator-896549976-pdvps" Jun 09 08:48:43.829230 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.829179 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f3bf0a1a-491b-4abe-bb6f-7064fe8ac166-snapshots\") pod \"insights-operator-896549976-pdvps\" (UID: \"f3bf0a1a-491b-4abe-bb6f-7064fe8ac166\") " pod="openshift-insights/insights-operator-896549976-pdvps" Jun 09 08:48:43.831473 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.831442 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f3bf0a1a-491b-4abe-bb6f-7064fe8ac166-serving-cert\") pod \"insights-operator-896549976-pdvps\" (UID: \"f3bf0a1a-491b-4abe-bb6f-7064fe8ac166\") " pod="openshift-insights/insights-operator-896549976-pdvps" Jun 09 08:48:43.837298 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.837279 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nf6j\" (UniqueName: \"kubernetes.io/projected/f3bf0a1a-491b-4abe-bb6f-7064fe8ac166-kube-api-access-8nf6j\") pod \"insights-operator-896549976-pdvps\" (UID: \"f3bf0a1a-491b-4abe-bb6f-7064fe8ac166\") " pod="openshift-insights/insights-operator-896549976-pdvps" Jun 09 08:48:43.883174 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.883143 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-bdkvt"] Jun 09 08:48:43.883355 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:48:43.883327 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07afa869_7b21_4f9d_a861_2ff5757149f3.slice/crio-c30458b9c4edc32f73cb9d1722ad3bfe7c2f857eb913bece923e373a41da9df1 WatchSource:0}: Error finding container c30458b9c4edc32f73cb9d1722ad3bfe7c2f857eb913bece923e373a41da9df1: Status 404 returned error can't find the container with id c30458b9c4edc32f73cb9d1722ad3bfe7c2f857eb913bece923e373a41da9df1 Jun 09 08:48:43.894576 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.894549 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-pbsns"] Jun 09 08:48:43.897502 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:48:43.897474 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28bee076_40fc_40d5_a80c_1b9867359d6c.slice/crio-ed2313287d0d096255cfbeb1d8338856ef9881d2c3e891de5a7cc06bca0987da WatchSource:0}: Error finding container ed2313287d0d096255cfbeb1d8338856ef9881d2c3e891de5a7cc06bca0987da: Status 404 returned error can't find the container with id ed2313287d0d096255cfbeb1d8338856ef9881d2c3e891de5a7cc06bca0987da Jun 09 08:48:43.912034 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.912005 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-tr52t"] Jun 09 08:48:43.915581 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:48:43.915554 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc7c68b8_62b9_47b5_a562_f9baf876d223.slice/crio-acdd659d3fc65306bb5db8294c16c4f1745c06210170fbcbea196dce2c2079a9 WatchSource:0}: Error finding container acdd659d3fc65306bb5db8294c16c4f1745c06210170fbcbea196dce2c2079a9: Status 404 returned error can't find the container with id acdd659d3fc65306bb5db8294c16c4f1745c06210170fbcbea196dce2c2079a9 Jun 09 08:48:43.916244 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:43.916227 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-pdvps" Jun 09 08:48:44.043052 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:44.043009 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-pdvps"] Jun 09 08:48:44.045832 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:48:44.045808 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3bf0a1a_491b_4abe_bb6f_7064fe8ac166.slice/crio-cbde9748863c70b0a2c316fb96c9972eec7aa383671177327540c85dbeadb67a WatchSource:0}: Error finding container cbde9748863c70b0a2c316fb96c9972eec7aa383671177327540c85dbeadb67a: Status 404 returned error can't find the container with id cbde9748863c70b0a2c316fb96c9972eec7aa383671177327540c85dbeadb67a Jun 09 08:48:44.129931 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:44.129898 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a6855c96-c4f2-4650-bda3-95ce7db1d9da-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-x2fqm\" (UID: \"a6855c96-c4f2-4650-bda3-95ce7db1d9da\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-x2fqm" Jun 09 08:48:44.130052 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:44.129953 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f0b23720-7d48-4020-a608-c0348551c543-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-vzzjj\" (UID: \"f0b23720-7d48-4020-a608-c0348551c543\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vzzjj" Jun 09 08:48:44.130089 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:48:44.130057 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 08:48:44.130129 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:48:44.130115 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6855c96-c4f2-4650-bda3-95ce7db1d9da-cluster-monitoring-operator-tls podName:a6855c96-c4f2-4650-bda3-95ce7db1d9da nodeName:}" failed. No retries permitted until 2026-06-09 08:48:45.130101972 +0000 UTC m=+202.575049300 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a6855c96-c4f2-4650-bda3-95ce7db1d9da-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-x2fqm" (UID: "a6855c96-c4f2-4650-bda3-95ce7db1d9da") : secret "cluster-monitoring-operator-tls" not found Jun 09 08:48:44.130180 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:48:44.130057 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 08:48:44.130220 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:48:44.130193 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0b23720-7d48-4020-a608-c0348551c543-samples-operator-tls podName:f0b23720-7d48-4020-a608-c0348551c543 nodeName:}" failed. No retries permitted until 2026-06-09 08:48:45.130177901 +0000 UTC m=+202.575125240 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f0b23720-7d48-4020-a608-c0348551c543-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-vzzjj" (UID: "f0b23720-7d48-4020-a608-c0348551c543") : secret "samples-operator-tls" not found Jun 09 08:48:44.646199 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:44.646080 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-pdvps" event={"ID":"f3bf0a1a-491b-4abe-bb6f-7064fe8ac166","Type":"ContainerStarted","Data":"cbde9748863c70b0a2c316fb96c9972eec7aa383671177327540c85dbeadb67a"} Jun 09 08:48:44.647937 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:44.647908 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-pbsns" event={"ID":"28bee076-40fc-40d5-a80c-1b9867359d6c","Type":"ContainerStarted","Data":"ed2313287d0d096255cfbeb1d8338856ef9881d2c3e891de5a7cc06bca0987da"} Jun 09 08:48:44.649134 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:44.649105 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-tr52t" event={"ID":"bc7c68b8-62b9-47b5-a562-f9baf876d223","Type":"ContainerStarted","Data":"acdd659d3fc65306bb5db8294c16c4f1745c06210170fbcbea196dce2c2079a9"} Jun 09 08:48:44.650878 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:44.650804 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-bdkvt" event={"ID":"07afa869-7b21-4f9d-a861-2ff5757149f3","Type":"ContainerStarted","Data":"bc06b5b693b53f9d32384fa42175a55a0fb0b354c5b09ac9ac140b87972e757e"} Jun 09 08:48:44.650878 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:44.650848 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-bdkvt" event={"ID":"07afa869-7b21-4f9d-a861-2ff5757149f3","Type":"ContainerStarted","Data":"c30458b9c4edc32f73cb9d1722ad3bfe7c2f857eb913bece923e373a41da9df1"} Jun 09 08:48:44.667133 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:44.667082 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-bdkvt" podStartSLOduration=1.667065513 podStartE2EDuration="1.667065513s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 08:48:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:48:44.665251477 +0000 UTC m=+202.110198840" watchObservedRunningTime="2026-06-09 08:48:44.667065513 +0000 UTC m=+202.112012866" Jun 09 08:48:45.139883 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:45.139838 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a6855c96-c4f2-4650-bda3-95ce7db1d9da-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-x2fqm\" (UID: \"a6855c96-c4f2-4650-bda3-95ce7db1d9da\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-x2fqm" Jun 09 08:48:45.140068 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:45.139917 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f0b23720-7d48-4020-a608-c0348551c543-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-vzzjj\" (UID: \"f0b23720-7d48-4020-a608-c0348551c543\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vzzjj" Jun 09 08:48:45.140068 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:48:45.140045 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 08:48:45.140173 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:48:45.140107 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0b23720-7d48-4020-a608-c0348551c543-samples-operator-tls podName:f0b23720-7d48-4020-a608-c0348551c543 nodeName:}" failed. No retries permitted until 2026-06-09 08:48:47.140088002 +0000 UTC m=+204.585035348 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f0b23720-7d48-4020-a608-c0348551c543-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-vzzjj" (UID: "f0b23720-7d48-4020-a608-c0348551c543") : secret "samples-operator-tls" not found Jun 09 08:48:45.140662 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:48:45.140564 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 08:48:45.140662 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:48:45.140621 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6855c96-c4f2-4650-bda3-95ce7db1d9da-cluster-monitoring-operator-tls podName:a6855c96-c4f2-4650-bda3-95ce7db1d9da nodeName:}" failed. No retries permitted until 2026-06-09 08:48:47.140604229 +0000 UTC m=+204.585551557 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a6855c96-c4f2-4650-bda3-95ce7db1d9da-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-x2fqm" (UID: "a6855c96-c4f2-4650-bda3-95ce7db1d9da") : secret "cluster-monitoring-operator-tls" not found Jun 09 08:48:45.656238 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:45.656185 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-tr52t" event={"ID":"bc7c68b8-62b9-47b5-a562-f9baf876d223","Type":"ContainerStarted","Data":"9e0e38126a0704c4d91b2aae6d64f8c880dbe5308a6fd282c80bc56d7300e98b"} Jun 09 08:48:45.671952 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:45.671900 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-tr52t" podStartSLOduration=1.288245176 podStartE2EDuration="2.67188417s" totalImagesPullingTime="1.383638994s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 08:48:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:48:45.670483939 +0000 UTC m=+203.115431289" watchObservedRunningTime="2026-06-09 08:48:45.67188417 +0000 UTC m=+203.116831519" Jun 09 08:48:47.158027 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:47.157979 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a6855c96-c4f2-4650-bda3-95ce7db1d9da-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-x2fqm\" (UID: \"a6855c96-c4f2-4650-bda3-95ce7db1d9da\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-x2fqm" Jun 09 08:48:47.158432 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:47.158061 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f0b23720-7d48-4020-a608-c0348551c543-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-vzzjj\" (UID: \"f0b23720-7d48-4020-a608-c0348551c543\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vzzjj" Jun 09 08:48:47.158432 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:48:47.158107 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 08:48:47.158432 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:48:47.158173 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6855c96-c4f2-4650-bda3-95ce7db1d9da-cluster-monitoring-operator-tls podName:a6855c96-c4f2-4650-bda3-95ce7db1d9da nodeName:}" failed. No retries permitted until 2026-06-09 08:48:51.158158303 +0000 UTC m=+208.603105632 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a6855c96-c4f2-4650-bda3-95ce7db1d9da-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-x2fqm" (UID: "a6855c96-c4f2-4650-bda3-95ce7db1d9da") : secret "cluster-monitoring-operator-tls" not found Jun 09 08:48:47.158432 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:48:47.158220 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 08:48:47.158432 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:48:47.158284 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0b23720-7d48-4020-a608-c0348551c543-samples-operator-tls podName:f0b23720-7d48-4020-a608-c0348551c543 nodeName:}" failed. No retries permitted until 2026-06-09 08:48:51.15826718 +0000 UTC m=+208.603214511 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f0b23720-7d48-4020-a608-c0348551c543-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-vzzjj" (UID: "f0b23720-7d48-4020-a608-c0348551c543") : secret "samples-operator-tls" not found Jun 09 08:48:47.662285 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:47.662248 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-pbsns" event={"ID":"28bee076-40fc-40d5-a80c-1b9867359d6c","Type":"ContainerStarted","Data":"4a5fcf12c39270d05d7fc152ea6cec822911fd8496733c72bab7342aec117343"} Jun 09 08:48:47.663727 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:47.663700 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-pdvps" event={"ID":"f3bf0a1a-491b-4abe-bb6f-7064fe8ac166","Type":"ContainerStarted","Data":"f910213e6c538e40e05edda1a2da08b245faf42976766e9707de4cff3372fe64"} Jun 09 08:48:47.678121 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:47.678065 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-pbsns" podStartSLOduration=1.892295023 podStartE2EDuration="4.678047061s" totalImagesPullingTime="2.785752038s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 08:48:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:48:47.677848317 +0000 UTC m=+205.122795679" watchObservedRunningTime="2026-06-09 08:48:47.678047061 +0000 UTC m=+205.122994410" Jun 09 08:48:47.694947 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:47.694898 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-pdvps" podStartSLOduration=2.056187875 podStartE2EDuration="4.694880081s" totalImagesPullingTime="2.638692206s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 08:48:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:48:47.693937854 +0000 UTC m=+205.138885207" watchObservedRunningTime="2026-06-09 08:48:47.694880081 +0000 UTC m=+205.139827430" Jun 09 08:48:49.413315 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:49.413285 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6l4gp_5c8cf271-8ccb-42a2-abe4-fe6565f5346b/dns-node-resolver/0.log" Jun 09 08:48:49.869027 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:49.868991 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-kszsj"] Jun 09 08:48:49.873019 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:49.873001 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-kszsj" Jun 09 08:48:49.875384 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:49.875360 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 09 08:48:49.876031 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:49.876011 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-vxzpw\"" Jun 09 08:48:49.876031 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:49.876028 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 09 08:48:49.876164 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:49.876038 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 09 08:48:49.876164 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:49.876011 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 09 08:48:49.881525 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:49.881505 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-kszsj"] Jun 09 08:48:49.978436 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:49.978383 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j476m\" (UniqueName: \"kubernetes.io/projected/ce9c041a-8702-4ea3-b5b8-48dced93bbd4-kube-api-access-j476m\") pod \"service-ca-7d74d578b8-kszsj\" (UID: \"ce9c041a-8702-4ea3-b5b8-48dced93bbd4\") " pod="openshift-service-ca/service-ca-7d74d578b8-kszsj" Jun 09 08:48:49.978633 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:49.978482 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ce9c041a-8702-4ea3-b5b8-48dced93bbd4-signing-key\") pod \"service-ca-7d74d578b8-kszsj\" (UID: \"ce9c041a-8702-4ea3-b5b8-48dced93bbd4\") " pod="openshift-service-ca/service-ca-7d74d578b8-kszsj" Jun 09 08:48:49.978633 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:49.978545 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ce9c041a-8702-4ea3-b5b8-48dced93bbd4-signing-cabundle\") pod \"service-ca-7d74d578b8-kszsj\" (UID: \"ce9c041a-8702-4ea3-b5b8-48dced93bbd4\") " pod="openshift-service-ca/service-ca-7d74d578b8-kszsj" Jun 09 08:48:50.079230 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:50.079179 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j476m\" (UniqueName: \"kubernetes.io/projected/ce9c041a-8702-4ea3-b5b8-48dced93bbd4-kube-api-access-j476m\") pod \"service-ca-7d74d578b8-kszsj\" (UID: \"ce9c041a-8702-4ea3-b5b8-48dced93bbd4\") " pod="openshift-service-ca/service-ca-7d74d578b8-kszsj" Jun 09 08:48:50.079407 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:50.079272 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ce9c041a-8702-4ea3-b5b8-48dced93bbd4-signing-key\") pod \"service-ca-7d74d578b8-kszsj\" (UID: \"ce9c041a-8702-4ea3-b5b8-48dced93bbd4\") " pod="openshift-service-ca/service-ca-7d74d578b8-kszsj" Jun 09 08:48:50.079407 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:50.079313 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ce9c041a-8702-4ea3-b5b8-48dced93bbd4-signing-cabundle\") pod \"service-ca-7d74d578b8-kszsj\" (UID: \"ce9c041a-8702-4ea3-b5b8-48dced93bbd4\") " pod="openshift-service-ca/service-ca-7d74d578b8-kszsj" Jun 09 08:48:50.080038 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:50.080020 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ce9c041a-8702-4ea3-b5b8-48dced93bbd4-signing-cabundle\") pod \"service-ca-7d74d578b8-kszsj\" (UID: \"ce9c041a-8702-4ea3-b5b8-48dced93bbd4\") " pod="openshift-service-ca/service-ca-7d74d578b8-kszsj" Jun 09 08:48:50.081686 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:50.081665 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ce9c041a-8702-4ea3-b5b8-48dced93bbd4-signing-key\") pod \"service-ca-7d74d578b8-kszsj\" (UID: \"ce9c041a-8702-4ea3-b5b8-48dced93bbd4\") " pod="openshift-service-ca/service-ca-7d74d578b8-kszsj" Jun 09 08:48:50.088939 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:50.088912 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j476m\" (UniqueName: \"kubernetes.io/projected/ce9c041a-8702-4ea3-b5b8-48dced93bbd4-kube-api-access-j476m\") pod \"service-ca-7d74d578b8-kszsj\" (UID: \"ce9c041a-8702-4ea3-b5b8-48dced93bbd4\") " pod="openshift-service-ca/service-ca-7d74d578b8-kszsj" Jun 09 08:48:50.182962 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:50.182858 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-kszsj" Jun 09 08:48:50.300692 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:50.300645 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-kszsj"] Jun 09 08:48:50.304163 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:48:50.304135 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce9c041a_8702_4ea3_b5b8_48dced93bbd4.slice/crio-c728ca1b6c1ab50da7d5ac70baee1bc9fd2f7c6d76d63fac9098ba67e9dd1854 WatchSource:0}: Error finding container c728ca1b6c1ab50da7d5ac70baee1bc9fd2f7c6d76d63fac9098ba67e9dd1854: Status 404 returned error can't find the container with id c728ca1b6c1ab50da7d5ac70baee1bc9fd2f7c6d76d63fac9098ba67e9dd1854 Jun 09 08:48:50.610537 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:50.610506 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ghb2d_c1eca8fd-ed14-4a3b-a17b-bf84f42f7302/node-ca/0.log" Jun 09 08:48:50.675119 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:50.675083 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-kszsj" event={"ID":"ce9c041a-8702-4ea3-b5b8-48dced93bbd4","Type":"ContainerStarted","Data":"2cf6928ce97c87cc1e152d54f2dd62a683081660611527a81c7b9d6459f052f0"} Jun 09 08:48:50.675285 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:50.675162 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-kszsj" event={"ID":"ce9c041a-8702-4ea3-b5b8-48dced93bbd4","Type":"ContainerStarted","Data":"c728ca1b6c1ab50da7d5ac70baee1bc9fd2f7c6d76d63fac9098ba67e9dd1854"} Jun 09 08:48:50.695692 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:50.695627 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-kszsj" podStartSLOduration=1.695610865 podStartE2EDuration="1.695610865s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 08:48:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:48:50.693884743 +0000 UTC m=+208.138832092" watchObservedRunningTime="2026-06-09 08:48:50.695610865 +0000 UTC m=+208.140558215" Jun 09 08:48:51.188351 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:51.188309 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a6855c96-c4f2-4650-bda3-95ce7db1d9da-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-x2fqm\" (UID: \"a6855c96-c4f2-4650-bda3-95ce7db1d9da\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-x2fqm" Jun 09 08:48:51.188529 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:51.188375 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f0b23720-7d48-4020-a608-c0348551c543-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-vzzjj\" (UID: \"f0b23720-7d48-4020-a608-c0348551c543\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vzzjj" Jun 09 08:48:51.188529 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:48:51.188454 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 08:48:51.188529 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:48:51.188509 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 08:48:51.188529 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:48:51.188523 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6855c96-c4f2-4650-bda3-95ce7db1d9da-cluster-monitoring-operator-tls podName:a6855c96-c4f2-4650-bda3-95ce7db1d9da nodeName:}" failed. No retries permitted until 2026-06-09 08:48:59.188508645 +0000 UTC m=+216.633455978 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a6855c96-c4f2-4650-bda3-95ce7db1d9da-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-x2fqm" (UID: "a6855c96-c4f2-4650-bda3-95ce7db1d9da") : secret "cluster-monitoring-operator-tls" not found Jun 09 08:48:51.188705 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:48:51.188566 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0b23720-7d48-4020-a608-c0348551c543-samples-operator-tls podName:f0b23720-7d48-4020-a608-c0348551c543 nodeName:}" failed. No retries permitted until 2026-06-09 08:48:59.188548936 +0000 UTC m=+216.633496289 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f0b23720-7d48-4020-a608-c0348551c543-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-vzzjj" (UID: "f0b23720-7d48-4020-a608-c0348551c543") : secret "samples-operator-tls" not found Jun 09 08:48:51.610633 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:51.610602 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zmgdk_434a609b-dd30-4747-96b8-ce766267866d/serve-healthcheck-canary/0.log" Jun 09 08:48:59.254066 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:59.254023 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a6855c96-c4f2-4650-bda3-95ce7db1d9da-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-x2fqm\" (UID: \"a6855c96-c4f2-4650-bda3-95ce7db1d9da\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-x2fqm" Jun 09 08:48:59.254550 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:59.254088 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f0b23720-7d48-4020-a608-c0348551c543-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-vzzjj\" (UID: \"f0b23720-7d48-4020-a608-c0348551c543\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vzzjj" Jun 09 08:48:59.256543 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:59.256520 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f0b23720-7d48-4020-a608-c0348551c543-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-vzzjj\" (UID: \"f0b23720-7d48-4020-a608-c0348551c543\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vzzjj" Jun 09 08:48:59.256615 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:59.256543 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a6855c96-c4f2-4650-bda3-95ce7db1d9da-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-x2fqm\" (UID: \"a6855c96-c4f2-4650-bda3-95ce7db1d9da\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-x2fqm" Jun 09 08:48:59.358414 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:59.358377 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vzzjj" Jun 09 08:48:59.363416 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:59.363396 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-x2fqm" Jun 09 08:48:59.502771 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:59.502620 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vzzjj"] Jun 09 08:48:59.519124 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:59.519097 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-x2fqm"] Jun 09 08:48:59.522276 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:48:59.522248 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6855c96_c4f2_4650_bda3_95ce7db1d9da.slice/crio-2d8c90fc55815a89d9caee22708a2da711eb45ffef5b99dd32503ff069eff87a WatchSource:0}: Error finding container 2d8c90fc55815a89d9caee22708a2da711eb45ffef5b99dd32503ff069eff87a: Status 404 returned error can't find the container with id 2d8c90fc55815a89d9caee22708a2da711eb45ffef5b99dd32503ff069eff87a Jun 09 08:48:59.708072 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:59.708033 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vzzjj" event={"ID":"f0b23720-7d48-4020-a608-c0348551c543","Type":"ContainerStarted","Data":"810c02d1685acb80b4b03c47ab3a1244b54e0bd5e62853c9d2072c51444ee094"} Jun 09 08:48:59.709150 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:48:59.709123 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-x2fqm" event={"ID":"a6855c96-c4f2-4650-bda3-95ce7db1d9da","Type":"ContainerStarted","Data":"2d8c90fc55815a89d9caee22708a2da711eb45ffef5b99dd32503ff069eff87a"} Jun 09 08:49:02.725371 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:02.725328 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vzzjj" event={"ID":"f0b23720-7d48-4020-a608-c0348551c543","Type":"ContainerStarted","Data":"1ef6362dfe78c52ac6798e884fb150763efa02b9b2a8e20ecb302036aa6ad671"} Jun 09 08:49:02.725853 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:02.725419 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vzzjj" event={"ID":"f0b23720-7d48-4020-a608-c0348551c543","Type":"ContainerStarted","Data":"890c0b78e8c5422bd372fa34c110485f24042724d4f073e788c32a83c45f1d67"} Jun 09 08:49:02.726790 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:02.726766 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-x2fqm" event={"ID":"a6855c96-c4f2-4650-bda3-95ce7db1d9da","Type":"ContainerStarted","Data":"5ea02967e9d233893fc463c517e39f58dff8828b2d252adc713fd2b6640eeb8a"} Jun 09 08:49:02.741899 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:02.741858 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vzzjj" podStartSLOduration=17.440329502 podStartE2EDuration="19.741846688s" totalImagesPullingTime="2.301517186s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 08:48:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:49:02.741104591 +0000 UTC m=+220.186051940" watchObservedRunningTime="2026-06-09 08:49:02.741846688 +0000 UTC m=+220.186794037" Jun 09 08:49:02.757087 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:02.757047 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-x2fqm" podStartSLOduration=17.438672082 podStartE2EDuration="19.757034983s" totalImagesPullingTime="2.318362901s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 08:48:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:49:02.75623148 +0000 UTC m=+220.201179100" watchObservedRunningTime="2026-06-09 08:49:02.757034983 +0000 UTC m=+220.201982330" Jun 09 08:49:10.682408 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:10.682375 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6mxzw"] Jun 09 08:49:10.685694 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:10.685672 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6mxzw" Jun 09 08:49:10.688406 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:10.688387 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 09 08:49:10.688522 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:10.688388 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 09 08:49:10.688522 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:10.688388 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-d2psc\"" Jun 09 08:49:10.710142 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:10.710113 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6mxzw"] Jun 09 08:49:10.744878 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:10.744848 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-85png"] Jun 09 08:49:10.748016 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:10.747995 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-85png" Jun 09 08:49:10.750318 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:10.750296 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 09 08:49:10.750420 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:10.750354 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-tp5s7\"" Jun 09 08:49:10.766029 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:10.766006 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-85png"] Jun 09 08:49:10.766871 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:10.766851 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-qxtw7"] Jun 09 08:49:10.769624 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:10.769605 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-qxtw7" Jun 09 08:49:10.771709 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:10.771690 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 09 08:49:10.771780 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:10.771739 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-2v9pj\"" Jun 09 08:49:10.771824 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:10.771795 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 09 08:49:10.786842 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:10.786819 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-qxtw7"] Jun 09 08:49:10.840923 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:10.840888 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1067dd40-c47a-489f-b027-34b793b71c40-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6mxzw\" (UID: \"1067dd40-c47a-489f-b027-34b793b71c40\") " pod="openshift-insights/insights-runtime-extractor-6mxzw" Jun 09 08:49:10.841069 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:10.841010 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1067dd40-c47a-489f-b027-34b793b71c40-data-volume\") pod \"insights-runtime-extractor-6mxzw\" (UID: \"1067dd40-c47a-489f-b027-34b793b71c40\") " pod="openshift-insights/insights-runtime-extractor-6mxzw" Jun 09 08:49:10.841069 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:10.841043 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1067dd40-c47a-489f-b027-34b793b71c40-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6mxzw\" (UID: \"1067dd40-c47a-489f-b027-34b793b71c40\") " pod="openshift-insights/insights-runtime-extractor-6mxzw" Jun 09 08:49:10.841069 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:10.841061 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjgh8\" (UniqueName: \"kubernetes.io/projected/1067dd40-c47a-489f-b027-34b793b71c40-kube-api-access-pjgh8\") pod \"insights-runtime-extractor-6mxzw\" (UID: \"1067dd40-c47a-489f-b027-34b793b71c40\") " pod="openshift-insights/insights-runtime-extractor-6mxzw" Jun 09 08:49:10.841196 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:10.841118 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1067dd40-c47a-489f-b027-34b793b71c40-crio-socket\") pod \"insights-runtime-extractor-6mxzw\" (UID: \"1067dd40-c47a-489f-b027-34b793b71c40\") " pod="openshift-insights/insights-runtime-extractor-6mxzw" Jun 09 08:49:10.942185 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:10.942100 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1067dd40-c47a-489f-b027-34b793b71c40-crio-socket\") pod \"insights-runtime-extractor-6mxzw\" (UID: \"1067dd40-c47a-489f-b027-34b793b71c40\") " pod="openshift-insights/insights-runtime-extractor-6mxzw" Jun 09 08:49:10.942185 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:10.942158 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1067dd40-c47a-489f-b027-34b793b71c40-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6mxzw\" (UID: \"1067dd40-c47a-489f-b027-34b793b71c40\") " pod="openshift-insights/insights-runtime-extractor-6mxzw" Jun 09 08:49:10.942372 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:10.942191 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1067dd40-c47a-489f-b027-34b793b71c40-crio-socket\") pod \"insights-runtime-extractor-6mxzw\" (UID: \"1067dd40-c47a-489f-b027-34b793b71c40\") " pod="openshift-insights/insights-runtime-extractor-6mxzw" Jun 09 08:49:10.942372 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:10.942203 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnd6f\" (UniqueName: \"kubernetes.io/projected/64cc3732-bece-4942-a855-126c460e9d38-kube-api-access-gnd6f\") pod \"downloads-6657875f97-qxtw7\" (UID: \"64cc3732-bece-4942-a855-126c460e9d38\") " pod="openshift-console/downloads-6657875f97-qxtw7" Jun 09 08:49:10.942449 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:10.942384 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1067dd40-c47a-489f-b027-34b793b71c40-data-volume\") pod \"insights-runtime-extractor-6mxzw\" (UID: \"1067dd40-c47a-489f-b027-34b793b71c40\") " pod="openshift-insights/insights-runtime-extractor-6mxzw" Jun 09 08:49:10.942449 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:10.942425 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1067dd40-c47a-489f-b027-34b793b71c40-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6mxzw\" (UID: \"1067dd40-c47a-489f-b027-34b793b71c40\") " pod="openshift-insights/insights-runtime-extractor-6mxzw" Jun 09 08:49:10.942520 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:10.942453 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9a484e5e-e35f-49e5-917d-14725c068d43-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-85png\" (UID: \"9a484e5e-e35f-49e5-917d-14725c068d43\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-85png" Jun 09 08:49:10.942520 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:10.942482 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjgh8\" (UniqueName: \"kubernetes.io/projected/1067dd40-c47a-489f-b027-34b793b71c40-kube-api-access-pjgh8\") pod \"insights-runtime-extractor-6mxzw\" (UID: \"1067dd40-c47a-489f-b027-34b793b71c40\") " pod="openshift-insights/insights-runtime-extractor-6mxzw" Jun 09 08:49:10.942747 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:10.942730 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1067dd40-c47a-489f-b027-34b793b71c40-data-volume\") pod \"insights-runtime-extractor-6mxzw\" (UID: \"1067dd40-c47a-489f-b027-34b793b71c40\") " pod="openshift-insights/insights-runtime-extractor-6mxzw" Jun 09 08:49:10.942838 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:10.942819 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1067dd40-c47a-489f-b027-34b793b71c40-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6mxzw\" (UID: \"1067dd40-c47a-489f-b027-34b793b71c40\") " pod="openshift-insights/insights-runtime-extractor-6mxzw" Jun 09 08:49:10.944716 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:10.944699 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1067dd40-c47a-489f-b027-34b793b71c40-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6mxzw\" (UID: \"1067dd40-c47a-489f-b027-34b793b71c40\") " pod="openshift-insights/insights-runtime-extractor-6mxzw" Jun 09 08:49:10.950709 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:10.950679 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjgh8\" (UniqueName: \"kubernetes.io/projected/1067dd40-c47a-489f-b027-34b793b71c40-kube-api-access-pjgh8\") pod \"insights-runtime-extractor-6mxzw\" (UID: \"1067dd40-c47a-489f-b027-34b793b71c40\") " pod="openshift-insights/insights-runtime-extractor-6mxzw" Jun 09 08:49:10.994558 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:10.994523 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6mxzw" Jun 09 08:49:11.043932 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:11.043897 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnd6f\" (UniqueName: \"kubernetes.io/projected/64cc3732-bece-4942-a855-126c460e9d38-kube-api-access-gnd6f\") pod \"downloads-6657875f97-qxtw7\" (UID: \"64cc3732-bece-4942-a855-126c460e9d38\") " pod="openshift-console/downloads-6657875f97-qxtw7" Jun 09 08:49:11.044052 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:11.043984 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9a484e5e-e35f-49e5-917d-14725c068d43-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-85png\" (UID: \"9a484e5e-e35f-49e5-917d-14725c068d43\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-85png" Jun 09 08:49:11.046614 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:11.046587 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9a484e5e-e35f-49e5-917d-14725c068d43-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-85png\" (UID: \"9a484e5e-e35f-49e5-917d-14725c068d43\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-85png" Jun 09 08:49:11.056886 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:11.056854 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-85png" Jun 09 08:49:11.063026 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:11.062997 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnd6f\" (UniqueName: \"kubernetes.io/projected/64cc3732-bece-4942-a855-126c460e9d38-kube-api-access-gnd6f\") pod \"downloads-6657875f97-qxtw7\" (UID: \"64cc3732-bece-4942-a855-126c460e9d38\") " pod="openshift-console/downloads-6657875f97-qxtw7" Jun 09 08:49:11.078175 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:11.078008 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-qxtw7" Jun 09 08:49:11.145635 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:11.145509 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6mxzw"] Jun 09 08:49:11.148882 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:49:11.148850 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1067dd40_c47a_489f_b027_34b793b71c40.slice/crio-6249470b2ef39f15b4ab67de64c7b1e563271b1aefa9a6e3c508deb0b3728a21 WatchSource:0}: Error finding container 6249470b2ef39f15b4ab67de64c7b1e563271b1aefa9a6e3c508deb0b3728a21: Status 404 returned error can't find the container with id 6249470b2ef39f15b4ab67de64c7b1e563271b1aefa9a6e3c508deb0b3728a21 Jun 09 08:49:11.199430 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:11.199405 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-85png"] Jun 09 08:49:11.202077 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:49:11.202051 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a484e5e_e35f_49e5_917d_14725c068d43.slice/crio-afc37c90165789394db2ecb668b3b45442917e18ffb6f27a28d9ff314f8c7047 WatchSource:0}: Error finding container afc37c90165789394db2ecb668b3b45442917e18ffb6f27a28d9ff314f8c7047: Status 404 returned error can't find the container with id afc37c90165789394db2ecb668b3b45442917e18ffb6f27a28d9ff314f8c7047 Jun 09 08:49:11.223805 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:11.223778 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-qxtw7"] Jun 09 08:49:11.226146 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:49:11.226119 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64cc3732_bece_4942_a855_126c460e9d38.slice/crio-5a9de6afa80798a38a7240df47d6260beca208650a6c5ce4bc3622601dab34ed WatchSource:0}: Error finding container 5a9de6afa80798a38a7240df47d6260beca208650a6c5ce4bc3622601dab34ed: Status 404 returned error can't find the container with id 5a9de6afa80798a38a7240df47d6260beca208650a6c5ce4bc3622601dab34ed Jun 09 08:49:11.758577 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:11.758532 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-85png" event={"ID":"9a484e5e-e35f-49e5-917d-14725c068d43","Type":"ContainerStarted","Data":"afc37c90165789394db2ecb668b3b45442917e18ffb6f27a28d9ff314f8c7047"} Jun 09 08:49:11.760626 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:11.760513 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6mxzw" event={"ID":"1067dd40-c47a-489f-b027-34b793b71c40","Type":"ContainerStarted","Data":"5c09b27092f5a16951fc8d825715194fef376eff4d72f37851b4e10a6785bac3"} Jun 09 08:49:11.760626 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:11.760576 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6mxzw" event={"ID":"1067dd40-c47a-489f-b027-34b793b71c40","Type":"ContainerStarted","Data":"6249470b2ef39f15b4ab67de64c7b1e563271b1aefa9a6e3c508deb0b3728a21"} Jun 09 08:49:11.762991 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:11.762962 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-qxtw7" event={"ID":"64cc3732-bece-4942-a855-126c460e9d38","Type":"ContainerStarted","Data":"5a9de6afa80798a38a7240df47d6260beca208650a6c5ce4bc3622601dab34ed"} Jun 09 08:49:12.768410 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:12.768374 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-85png" event={"ID":"9a484e5e-e35f-49e5-917d-14725c068d43","Type":"ContainerStarted","Data":"f2467fabcef01f0be40f4568cbbf461623871f5768c539ce1669c1387278d21e"} Jun 09 08:49:12.768899 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:12.768475 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-85png" Jun 09 08:49:12.770351 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:12.770326 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6mxzw" event={"ID":"1067dd40-c47a-489f-b027-34b793b71c40","Type":"ContainerStarted","Data":"0a47558c288b4d6c5b6d1bc2449a7d2374867887bf59ce5c5765fde5bb55292f"} Jun 09 08:49:12.774209 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:12.774187 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-85png" Jun 09 08:49:12.783203 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:12.783154 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-85png" podStartSLOduration=1.705881014 podStartE2EDuration="2.783138949s" totalImagesPullingTime="1.077257935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 08:49:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:49:12.782369099 +0000 UTC m=+230.227316449" watchObservedRunningTime="2026-06-09 08:49:12.783138949 +0000 UTC m=+230.228086300" Jun 09 08:49:13.410474 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:13.410436 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-6zxrs"] Jun 09 08:49:13.413966 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:13.413934 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-6zxrs" Jun 09 08:49:13.416389 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:13.416356 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 09 08:49:13.417047 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:13.417026 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-648c4\"" Jun 09 08:49:13.417190 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:13.417166 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 09 08:49:13.417262 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:13.417244 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 09 08:49:13.421304 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:13.421281 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-6zxrs"] Jun 09 08:49:13.465139 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:13.464928 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ef91a01e-4bac-4f0e-abd0-b6e19b454dcc-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-6zxrs\" (UID: \"ef91a01e-4bac-4f0e-abd0-b6e19b454dcc\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-6zxrs" Jun 09 08:49:13.465139 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:13.464974 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ef91a01e-4bac-4f0e-abd0-b6e19b454dcc-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-6zxrs\" (UID: \"ef91a01e-4bac-4f0e-abd0-b6e19b454dcc\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-6zxrs" Jun 09 08:49:13.465139 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:13.465018 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef91a01e-4bac-4f0e-abd0-b6e19b454dcc-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-6zxrs\" (UID: \"ef91a01e-4bac-4f0e-abd0-b6e19b454dcc\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-6zxrs" Jun 09 08:49:13.465139 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:13.465046 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7kh8\" (UniqueName: \"kubernetes.io/projected/ef91a01e-4bac-4f0e-abd0-b6e19b454dcc-kube-api-access-s7kh8\") pod \"prometheus-operator-7f7d445d84-6zxrs\" (UID: \"ef91a01e-4bac-4f0e-abd0-b6e19b454dcc\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-6zxrs" Jun 09 08:49:13.566022 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:13.565989 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ef91a01e-4bac-4f0e-abd0-b6e19b454dcc-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-6zxrs\" (UID: \"ef91a01e-4bac-4f0e-abd0-b6e19b454dcc\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-6zxrs" Jun 09 08:49:13.566210 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:13.566036 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ef91a01e-4bac-4f0e-abd0-b6e19b454dcc-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-6zxrs\" (UID: \"ef91a01e-4bac-4f0e-abd0-b6e19b454dcc\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-6zxrs" Jun 09 08:49:13.566210 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:13.566083 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef91a01e-4bac-4f0e-abd0-b6e19b454dcc-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-6zxrs\" (UID: \"ef91a01e-4bac-4f0e-abd0-b6e19b454dcc\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-6zxrs" Jun 09 08:49:13.566210 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:49:13.566190 2567 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 09 08:49:13.566365 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:49:13.566266 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef91a01e-4bac-4f0e-abd0-b6e19b454dcc-prometheus-operator-tls podName:ef91a01e-4bac-4f0e-abd0-b6e19b454dcc nodeName:}" failed. No retries permitted until 2026-06-09 08:49:14.066242863 +0000 UTC m=+231.511190213 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/ef91a01e-4bac-4f0e-abd0-b6e19b454dcc-prometheus-operator-tls") pod "prometheus-operator-7f7d445d84-6zxrs" (UID: "ef91a01e-4bac-4f0e-abd0-b6e19b454dcc") : secret "prometheus-operator-tls" not found Jun 09 08:49:13.566365 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:13.566293 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7kh8\" (UniqueName: \"kubernetes.io/projected/ef91a01e-4bac-4f0e-abd0-b6e19b454dcc-kube-api-access-s7kh8\") pod \"prometheus-operator-7f7d445d84-6zxrs\" (UID: \"ef91a01e-4bac-4f0e-abd0-b6e19b454dcc\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-6zxrs" Jun 09 08:49:13.566968 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:13.566936 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef91a01e-4bac-4f0e-abd0-b6e19b454dcc-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-6zxrs\" (UID: \"ef91a01e-4bac-4f0e-abd0-b6e19b454dcc\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-6zxrs" Jun 09 08:49:13.569375 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:13.569348 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ef91a01e-4bac-4f0e-abd0-b6e19b454dcc-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-6zxrs\" (UID: \"ef91a01e-4bac-4f0e-abd0-b6e19b454dcc\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-6zxrs" Jun 09 08:49:13.574969 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:13.574910 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7kh8\" (UniqueName: \"kubernetes.io/projected/ef91a01e-4bac-4f0e-abd0-b6e19b454dcc-kube-api-access-s7kh8\") pod \"prometheus-operator-7f7d445d84-6zxrs\" (UID: \"ef91a01e-4bac-4f0e-abd0-b6e19b454dcc\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-6zxrs" Jun 09 08:49:14.069386 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:14.069356 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ef91a01e-4bac-4f0e-abd0-b6e19b454dcc-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-6zxrs\" (UID: \"ef91a01e-4bac-4f0e-abd0-b6e19b454dcc\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-6zxrs" Jun 09 08:49:14.072126 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:14.072099 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ef91a01e-4bac-4f0e-abd0-b6e19b454dcc-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-6zxrs\" (UID: \"ef91a01e-4bac-4f0e-abd0-b6e19b454dcc\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-6zxrs" Jun 09 08:49:14.327446 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:14.327375 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-6zxrs" Jun 09 08:49:14.468337 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:14.468299 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-6zxrs"] Jun 09 08:49:14.472686 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:49:14.472641 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef91a01e_4bac_4f0e_abd0_b6e19b454dcc.slice/crio-afb4ac235f2915bdae63cbf86ada9df5beac5c8a45842ac67e83f599ba1d6319 WatchSource:0}: Error finding container afb4ac235f2915bdae63cbf86ada9df5beac5c8a45842ac67e83f599ba1d6319: Status 404 returned error can't find the container with id afb4ac235f2915bdae63cbf86ada9df5beac5c8a45842ac67e83f599ba1d6319 Jun 09 08:49:14.778695 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:14.778578 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-6zxrs" event={"ID":"ef91a01e-4bac-4f0e-abd0-b6e19b454dcc","Type":"ContainerStarted","Data":"afb4ac235f2915bdae63cbf86ada9df5beac5c8a45842ac67e83f599ba1d6319"} Jun 09 08:49:14.780515 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:14.780484 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6mxzw" event={"ID":"1067dd40-c47a-489f-b027-34b793b71c40","Type":"ContainerStarted","Data":"8c5ca09633e27724df6005a4afb936e40024ea6fecf23f1b7ddfee6c71474f8f"} Jun 09 08:49:14.813526 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:14.813463 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6mxzw" podStartSLOduration=2.015901322 podStartE2EDuration="4.813447027s" totalImagesPullingTime="2.797545705s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 08:49:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:49:14.812565673 +0000 UTC m=+232.257513029" watchObservedRunningTime="2026-06-09 08:49:14.813447027 +0000 UTC m=+232.258394376" Jun 09 08:49:16.788768 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:16.788723 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-6zxrs" event={"ID":"ef91a01e-4bac-4f0e-abd0-b6e19b454dcc","Type":"ContainerStarted","Data":"130d4a4d04b7ba6ba296ef1823d5dffa64283c0ae3e58704f10238a0f4a6a84e"} Jun 09 08:49:16.789201 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:16.788828 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-6zxrs" event={"ID":"ef91a01e-4bac-4f0e-abd0-b6e19b454dcc","Type":"ContainerStarted","Data":"2cde603ad4d54f84b174e32e9d18053f6079ac240a55531f25fe3ed1a23188f3"} Jun 09 08:49:16.805915 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:16.805863 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-6zxrs" podStartSLOduration=2.072314904 podStartE2EDuration="3.805844882s" totalImagesPullingTime="1.733529978s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 08:49:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:49:16.804966553 +0000 UTC m=+234.249913914" watchObservedRunningTime="2026-06-09 08:49:16.805844882 +0000 UTC m=+234.250792227" Jun 09 08:49:18.792067 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:18.792025 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-zq2zq"] Jun 09 08:49:18.795390 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:18.795368 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zq2zq" Jun 09 08:49:18.797771 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:18.797718 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 09 08:49:18.797771 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:18.797763 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 09 08:49:18.797963 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:18.797808 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-qtnrf\"" Jun 09 08:49:18.808713 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:18.808622 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-zq2zq"] Jun 09 08:49:18.811521 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:18.811498 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwh6j\" (UniqueName: \"kubernetes.io/projected/a69dbc83-8dbf-41fb-8089-cc84b3d14f3c-kube-api-access-pwh6j\") pod \"openshift-state-metrics-65f78d5c66-zq2zq\" (UID: \"a69dbc83-8dbf-41fb-8089-cc84b3d14f3c\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zq2zq" Jun 09 08:49:18.811716 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:18.811545 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a69dbc83-8dbf-41fb-8089-cc84b3d14f3c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-zq2zq\" (UID: \"a69dbc83-8dbf-41fb-8089-cc84b3d14f3c\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zq2zq" Jun 09 08:49:18.811716 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:18.811583 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a69dbc83-8dbf-41fb-8089-cc84b3d14f3c-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-zq2zq\" (UID: \"a69dbc83-8dbf-41fb-8089-cc84b3d14f3c\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zq2zq" Jun 09 08:49:18.811716 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:18.811635 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a69dbc83-8dbf-41fb-8089-cc84b3d14f3c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-zq2zq\" (UID: \"a69dbc83-8dbf-41fb-8089-cc84b3d14f3c\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zq2zq" Jun 09 08:49:18.821754 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:18.821720 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-tz7sc"] Jun 09 08:49:18.827375 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:18.827356 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-tz7sc" Jun 09 08:49:18.830015 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:18.829976 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 09 08:49:18.830224 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:18.830208 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-x2hkw\"" Jun 09 08:49:18.830496 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:18.830376 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 09 08:49:18.830911 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:18.830724 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 09 08:49:18.835390 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:18.835176 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-tz7sc"] Jun 09 08:49:18.844244 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:18.842803 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-nfgmq"] Jun 09 08:49:18.846407 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:18.846386 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nfgmq" Jun 09 08:49:18.849970 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:18.849527 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 09 08:49:18.849970 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:18.849540 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9qbdj\"" Jun 09 08:49:18.849970 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:18.849812 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 09 08:49:18.851019 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:18.850853 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 09 08:49:18.912944 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:18.912800 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/55c367b2-677c-43bd-b3c2-78a08c0276bd-node-exporter-wtmp\") pod \"node-exporter-nfgmq\" (UID: \"55c367b2-677c-43bd-b3c2-78a08c0276bd\") " pod="openshift-monitoring/node-exporter-nfgmq" Jun 09 08:49:18.912944 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:18.912848 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gktxl\" (UniqueName: \"kubernetes.io/projected/a33e2374-26ae-4bee-890f-b8fe15b36547-kube-api-access-gktxl\") pod \"kube-state-metrics-57bbf8bfb5-tz7sc\" (UID: \"a33e2374-26ae-4bee-890f-b8fe15b36547\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-tz7sc" Jun 09 08:49:18.912944 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:18.912886 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/55c367b2-677c-43bd-b3c2-78a08c0276bd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nfgmq\" (UID: \"55c367b2-677c-43bd-b3c2-78a08c0276bd\") " pod="openshift-monitoring/node-exporter-nfgmq" Jun 09 08:49:18.913709 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:18.912912 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/55c367b2-677c-43bd-b3c2-78a08c0276bd-node-exporter-tls\") pod \"node-exporter-nfgmq\" (UID: \"55c367b2-677c-43bd-b3c2-78a08c0276bd\") " pod="openshift-monitoring/node-exporter-nfgmq" Jun 09 08:49:18.913709 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:18.913262 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a33e2374-26ae-4bee-890f-b8fe15b36547-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-tz7sc\" (UID: \"a33e2374-26ae-4bee-890f-b8fe15b36547\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-tz7sc" Jun 09 08:49:18.913709 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:18.913309 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwh6j\" (UniqueName: \"kubernetes.io/projected/a69dbc83-8dbf-41fb-8089-cc84b3d14f3c-kube-api-access-pwh6j\") pod \"openshift-state-metrics-65f78d5c66-zq2zq\" (UID: \"a69dbc83-8dbf-41fb-8089-cc84b3d14f3c\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zq2zq" Jun 09 08:49:18.913709 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:18.913356 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwd58\" (UniqueName: \"kubernetes.io/projected/55c367b2-677c-43bd-b3c2-78a08c0276bd-kube-api-access-mwd58\") pod \"node-exporter-nfgmq\" (UID: \"55c367b2-677c-43bd-b3c2-78a08c0276bd\") " pod="openshift-monitoring/node-exporter-nfgmq" Jun 09 08:49:18.913709 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:18.913382 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a33e2374-26ae-4bee-890f-b8fe15b36547-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-tz7sc\" (UID: \"a33e2374-26ae-4bee-890f-b8fe15b36547\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-tz7sc" Jun 09 08:49:18.913709 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:18.913401 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/55c367b2-677c-43bd-b3c2-78a08c0276bd-root\") pod \"node-exporter-nfgmq\" (UID: \"55c367b2-677c-43bd-b3c2-78a08c0276bd\") " pod="openshift-monitoring/node-exporter-nfgmq" Jun 09 08:49:18.913709 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:18.913419 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a33e2374-26ae-4bee-890f-b8fe15b36547-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-tz7sc\" (UID: \"a33e2374-26ae-4bee-890f-b8fe15b36547\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-tz7sc" Jun 09 08:49:18.913709 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:18.913475 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a69dbc83-8dbf-41fb-8089-cc84b3d14f3c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-zq2zq\" (UID: \"a69dbc83-8dbf-41fb-8089-cc84b3d14f3c\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zq2zq" Jun 09 08:49:18.913709 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:18.913508 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/55c367b2-677c-43bd-b3c2-78a08c0276bd-node-exporter-textfile\") pod \"node-exporter-nfgmq\" (UID: \"55c367b2-677c-43bd-b3c2-78a08c0276bd\") " pod="openshift-monitoring/node-exporter-nfgmq" Jun 09 08:49:18.913709 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:18.913540 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a69dbc83-8dbf-41fb-8089-cc84b3d14f3c-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-zq2zq\" (UID: \"a69dbc83-8dbf-41fb-8089-cc84b3d14f3c\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zq2zq" Jun 09 08:49:18.913709 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:18.913562 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/55c367b2-677c-43bd-b3c2-78a08c0276bd-sys\") pod \"node-exporter-nfgmq\" (UID: \"55c367b2-677c-43bd-b3c2-78a08c0276bd\") " pod="openshift-monitoring/node-exporter-nfgmq" Jun 09 08:49:18.913709 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:18.913587 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a33e2374-26ae-4bee-890f-b8fe15b36547-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-tz7sc\" (UID: \"a33e2374-26ae-4bee-890f-b8fe15b36547\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-tz7sc" Jun 09 08:49:18.913709 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:18.913611 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a33e2374-26ae-4bee-890f-b8fe15b36547-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-tz7sc\" (UID: \"a33e2374-26ae-4bee-890f-b8fe15b36547\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-tz7sc" Jun 09 08:49:18.913709 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:18.913694 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a69dbc83-8dbf-41fb-8089-cc84b3d14f3c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-zq2zq\" (UID: \"a69dbc83-8dbf-41fb-8089-cc84b3d14f3c\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zq2zq" Jun 09 08:49:18.914465 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:18.913751 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55c367b2-677c-43bd-b3c2-78a08c0276bd-metrics-client-ca\") pod \"node-exporter-nfgmq\" (UID: \"55c367b2-677c-43bd-b3c2-78a08c0276bd\") " pod="openshift-monitoring/node-exporter-nfgmq" Jun 09 08:49:18.914465 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:18.913788 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/55c367b2-677c-43bd-b3c2-78a08c0276bd-node-exporter-accelerators-collector-config\") pod \"node-exporter-nfgmq\" (UID: \"55c367b2-677c-43bd-b3c2-78a08c0276bd\") " pod="openshift-monitoring/node-exporter-nfgmq" Jun 09 08:49:18.914562 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:18.914479 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a69dbc83-8dbf-41fb-8089-cc84b3d14f3c-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-zq2zq\" (UID: \"a69dbc83-8dbf-41fb-8089-cc84b3d14f3c\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zq2zq" Jun 09 08:49:18.914932 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:49:18.914672 2567 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 09 08:49:18.914932 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:49:18.914738 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a69dbc83-8dbf-41fb-8089-cc84b3d14f3c-openshift-state-metrics-tls podName:a69dbc83-8dbf-41fb-8089-cc84b3d14f3c nodeName:}" failed. No retries permitted until 2026-06-09 08:49:19.414718492 +0000 UTC m=+236.859665827 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/a69dbc83-8dbf-41fb-8089-cc84b3d14f3c-openshift-state-metrics-tls") pod "openshift-state-metrics-65f78d5c66-zq2zq" (UID: "a69dbc83-8dbf-41fb-8089-cc84b3d14f3c") : secret "openshift-state-metrics-tls" not found Jun 09 08:49:18.916331 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:18.916311 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a69dbc83-8dbf-41fb-8089-cc84b3d14f3c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-zq2zq\" (UID: \"a69dbc83-8dbf-41fb-8089-cc84b3d14f3c\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zq2zq" Jun 09 08:49:18.922094 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:18.922070 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwh6j\" (UniqueName: \"kubernetes.io/projected/a69dbc83-8dbf-41fb-8089-cc84b3d14f3c-kube-api-access-pwh6j\") pod \"openshift-state-metrics-65f78d5c66-zq2zq\" (UID: \"a69dbc83-8dbf-41fb-8089-cc84b3d14f3c\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zq2zq" Jun 09 08:49:19.014612 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:19.014567 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwd58\" (UniqueName: \"kubernetes.io/projected/55c367b2-677c-43bd-b3c2-78a08c0276bd-kube-api-access-mwd58\") pod \"node-exporter-nfgmq\" (UID: \"55c367b2-677c-43bd-b3c2-78a08c0276bd\") " pod="openshift-monitoring/node-exporter-nfgmq" Jun 09 08:49:19.014612 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:19.014615 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a33e2374-26ae-4bee-890f-b8fe15b36547-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-tz7sc\" (UID: \"a33e2374-26ae-4bee-890f-b8fe15b36547\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-tz7sc" Jun 09 08:49:19.014827 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:19.014640 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/55c367b2-677c-43bd-b3c2-78a08c0276bd-root\") pod \"node-exporter-nfgmq\" (UID: \"55c367b2-677c-43bd-b3c2-78a08c0276bd\") " pod="openshift-monitoring/node-exporter-nfgmq" Jun 09 08:49:19.014827 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:19.014683 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a33e2374-26ae-4bee-890f-b8fe15b36547-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-tz7sc\" (UID: \"a33e2374-26ae-4bee-890f-b8fe15b36547\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-tz7sc" Jun 09 08:49:19.014827 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:19.014720 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/55c367b2-677c-43bd-b3c2-78a08c0276bd-node-exporter-textfile\") pod \"node-exporter-nfgmq\" (UID: \"55c367b2-677c-43bd-b3c2-78a08c0276bd\") " pod="openshift-monitoring/node-exporter-nfgmq" Jun 09 08:49:19.014827 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:19.014745 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/55c367b2-677c-43bd-b3c2-78a08c0276bd-sys\") pod \"node-exporter-nfgmq\" (UID: \"55c367b2-677c-43bd-b3c2-78a08c0276bd\") " pod="openshift-monitoring/node-exporter-nfgmq" Jun 09 08:49:19.014827 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:19.014766 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a33e2374-26ae-4bee-890f-b8fe15b36547-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-tz7sc\" (UID: \"a33e2374-26ae-4bee-890f-b8fe15b36547\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-tz7sc" Jun 09 08:49:19.014827 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:19.014790 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a33e2374-26ae-4bee-890f-b8fe15b36547-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-tz7sc\" (UID: \"a33e2374-26ae-4bee-890f-b8fe15b36547\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-tz7sc" Jun 09 08:49:19.015135 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:19.014867 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55c367b2-677c-43bd-b3c2-78a08c0276bd-metrics-client-ca\") pod \"node-exporter-nfgmq\" (UID: \"55c367b2-677c-43bd-b3c2-78a08c0276bd\") " pod="openshift-monitoring/node-exporter-nfgmq" Jun 09 08:49:19.015135 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:19.014903 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/55c367b2-677c-43bd-b3c2-78a08c0276bd-node-exporter-accelerators-collector-config\") pod \"node-exporter-nfgmq\" (UID: \"55c367b2-677c-43bd-b3c2-78a08c0276bd\") " pod="openshift-monitoring/node-exporter-nfgmq" Jun 09 08:49:19.015135 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:19.014940 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/55c367b2-677c-43bd-b3c2-78a08c0276bd-node-exporter-wtmp\") pod \"node-exporter-nfgmq\" (UID: \"55c367b2-677c-43bd-b3c2-78a08c0276bd\") " pod="openshift-monitoring/node-exporter-nfgmq" Jun 09 08:49:19.015135 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:19.014975 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gktxl\" (UniqueName: \"kubernetes.io/projected/a33e2374-26ae-4bee-890f-b8fe15b36547-kube-api-access-gktxl\") pod \"kube-state-metrics-57bbf8bfb5-tz7sc\" (UID: \"a33e2374-26ae-4bee-890f-b8fe15b36547\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-tz7sc" Jun 09 08:49:19.015135 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:19.015012 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/55c367b2-677c-43bd-b3c2-78a08c0276bd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nfgmq\" (UID: \"55c367b2-677c-43bd-b3c2-78a08c0276bd\") " pod="openshift-monitoring/node-exporter-nfgmq" Jun 09 08:49:19.015135 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:19.015039 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/55c367b2-677c-43bd-b3c2-78a08c0276bd-node-exporter-tls\") pod \"node-exporter-nfgmq\" (UID: \"55c367b2-677c-43bd-b3c2-78a08c0276bd\") " pod="openshift-monitoring/node-exporter-nfgmq" Jun 09 08:49:19.015135 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:19.015080 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a33e2374-26ae-4bee-890f-b8fe15b36547-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-tz7sc\" (UID: \"a33e2374-26ae-4bee-890f-b8fe15b36547\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-tz7sc" Jun 09 08:49:19.016083 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:19.015678 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/55c367b2-677c-43bd-b3c2-78a08c0276bd-node-exporter-wtmp\") pod \"node-exporter-nfgmq\" (UID: \"55c367b2-677c-43bd-b3c2-78a08c0276bd\") " pod="openshift-monitoring/node-exporter-nfgmq" Jun 09 08:49:19.017187 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:19.016339 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a33e2374-26ae-4bee-890f-b8fe15b36547-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-tz7sc\" (UID: \"a33e2374-26ae-4bee-890f-b8fe15b36547\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-tz7sc" Jun 09 08:49:19.017187 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:19.016483 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a33e2374-26ae-4bee-890f-b8fe15b36547-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-tz7sc\" (UID: \"a33e2374-26ae-4bee-890f-b8fe15b36547\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-tz7sc" Jun 09 08:49:19.017187 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:49:19.016859 2567 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 09 08:49:19.017187 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:19.016876 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55c367b2-677c-43bd-b3c2-78a08c0276bd-metrics-client-ca\") pod \"node-exporter-nfgmq\" (UID: \"55c367b2-677c-43bd-b3c2-78a08c0276bd\") " pod="openshift-monitoring/node-exporter-nfgmq" Jun 09 08:49:19.017187 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:49:19.016918 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a33e2374-26ae-4bee-890f-b8fe15b36547-kube-state-metrics-tls podName:a33e2374-26ae-4bee-890f-b8fe15b36547 nodeName:}" failed. No retries permitted until 2026-06-09 08:49:19.516899131 +0000 UTC m=+236.961846477 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/a33e2374-26ae-4bee-890f-b8fe15b36547-kube-state-metrics-tls") pod "kube-state-metrics-57bbf8bfb5-tz7sc" (UID: "a33e2374-26ae-4bee-890f-b8fe15b36547") : secret "kube-state-metrics-tls" not found Jun 09 08:49:19.017187 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:19.017016 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/55c367b2-677c-43bd-b3c2-78a08c0276bd-sys\") pod \"node-exporter-nfgmq\" (UID: \"55c367b2-677c-43bd-b3c2-78a08c0276bd\") " pod="openshift-monitoring/node-exporter-nfgmq" Jun 09 08:49:19.017187 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:19.017101 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/55c367b2-677c-43bd-b3c2-78a08c0276bd-root\") pod \"node-exporter-nfgmq\" (UID: \"55c367b2-677c-43bd-b3c2-78a08c0276bd\") " pod="openshift-monitoring/node-exporter-nfgmq" Jun 09 08:49:19.017187 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:19.017150 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/55c367b2-677c-43bd-b3c2-78a08c0276bd-node-exporter-accelerators-collector-config\") pod \"node-exporter-nfgmq\" (UID: \"55c367b2-677c-43bd-b3c2-78a08c0276bd\") " pod="openshift-monitoring/node-exporter-nfgmq" Jun 09 08:49:19.017187 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:19.017155 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a33e2374-26ae-4bee-890f-b8fe15b36547-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-tz7sc\" (UID: \"a33e2374-26ae-4bee-890f-b8fe15b36547\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-tz7sc" Jun 09 08:49:19.017739 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:19.017284 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/55c367b2-677c-43bd-b3c2-78a08c0276bd-node-exporter-textfile\") pod \"node-exporter-nfgmq\" (UID: \"55c367b2-677c-43bd-b3c2-78a08c0276bd\") " pod="openshift-monitoring/node-exporter-nfgmq" Jun 09 08:49:19.019435 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:19.019392 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/55c367b2-677c-43bd-b3c2-78a08c0276bd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nfgmq\" (UID: \"55c367b2-677c-43bd-b3c2-78a08c0276bd\") " pod="openshift-monitoring/node-exporter-nfgmq" Jun 09 08:49:19.020907 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:19.020885 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/55c367b2-677c-43bd-b3c2-78a08c0276bd-node-exporter-tls\") pod \"node-exporter-nfgmq\" (UID: \"55c367b2-677c-43bd-b3c2-78a08c0276bd\") " pod="openshift-monitoring/node-exporter-nfgmq" Jun 09 08:49:19.021049 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:19.021028 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a33e2374-26ae-4bee-890f-b8fe15b36547-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-tz7sc\" (UID: \"a33e2374-26ae-4bee-890f-b8fe15b36547\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-tz7sc" Jun 09 08:49:19.028132 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:19.028108 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gktxl\" (UniqueName: \"kubernetes.io/projected/a33e2374-26ae-4bee-890f-b8fe15b36547-kube-api-access-gktxl\") pod \"kube-state-metrics-57bbf8bfb5-tz7sc\" (UID: \"a33e2374-26ae-4bee-890f-b8fe15b36547\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-tz7sc" Jun 09 08:49:19.028786 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:19.028746 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwd58\" (UniqueName: \"kubernetes.io/projected/55c367b2-677c-43bd-b3c2-78a08c0276bd-kube-api-access-mwd58\") pod \"node-exporter-nfgmq\" (UID: \"55c367b2-677c-43bd-b3c2-78a08c0276bd\") " pod="openshift-monitoring/node-exporter-nfgmq" Jun 09 08:49:19.159965 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:19.159931 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nfgmq" Jun 09 08:49:19.174606 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:49:19.174571 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55c367b2_677c_43bd_b3c2_78a08c0276bd.slice/crio-4ee8c21f9ec5b8f2d17be1862d937b1273f3fc3868cdd348b689cee26ced5c57 WatchSource:0}: Error finding container 4ee8c21f9ec5b8f2d17be1862d937b1273f3fc3868cdd348b689cee26ced5c57: Status 404 returned error can't find the container with id 4ee8c21f9ec5b8f2d17be1862d937b1273f3fc3868cdd348b689cee26ced5c57 Jun 09 08:49:19.418912 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:19.418826 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a69dbc83-8dbf-41fb-8089-cc84b3d14f3c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-zq2zq\" (UID: \"a69dbc83-8dbf-41fb-8089-cc84b3d14f3c\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zq2zq" Jun 09 08:49:19.421745 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:19.421715 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a69dbc83-8dbf-41fb-8089-cc84b3d14f3c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-zq2zq\" (UID: \"a69dbc83-8dbf-41fb-8089-cc84b3d14f3c\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zq2zq" Jun 09 08:49:19.520260 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:19.520220 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a33e2374-26ae-4bee-890f-b8fe15b36547-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-tz7sc\" (UID: \"a33e2374-26ae-4bee-890f-b8fe15b36547\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-tz7sc" Jun 09 08:49:19.522531 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:19.522501 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a33e2374-26ae-4bee-890f-b8fe15b36547-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-tz7sc\" (UID: \"a33e2374-26ae-4bee-890f-b8fe15b36547\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-tz7sc" Jun 09 08:49:19.707016 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:19.706936 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zq2zq" Jun 09 08:49:19.745452 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:19.745187 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-tz7sc" Jun 09 08:49:19.807473 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:19.807348 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nfgmq" event={"ID":"55c367b2-677c-43bd-b3c2-78a08c0276bd","Type":"ContainerStarted","Data":"4ee8c21f9ec5b8f2d17be1862d937b1273f3fc3868cdd348b689cee26ced5c57"} Jun 09 08:49:19.824762 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:19.823211 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 08:49:19.836362 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:19.836319 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 08:49:19.836501 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:19.836481 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:49:19.851924 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:19.847508 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 09 08:49:19.851924 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:19.847783 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 09 08:49:19.851924 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:19.848058 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 09 08:49:19.851924 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:19.848271 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-ppzb7\"" Jun 09 08:49:19.851924 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:19.848449 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 09 08:49:19.851924 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:19.848729 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 09 08:49:19.851924 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:19.848944 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 09 08:49:19.851924 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:19.849197 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 09 08:49:19.851924 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:19.849482 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 09 08:49:19.854045 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:19.853930 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 09 08:49:19.914113 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:19.914085 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-zq2zq"] Jun 09 08:49:19.929189 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:19.928538 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a79c3538-06d1-49f8-8aba-036d2c54a189-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a79c3538-06d1-49f8-8aba-036d2c54a189\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:49:19.929189 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:19.928592 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jxzm\" (UniqueName: \"kubernetes.io/projected/a79c3538-06d1-49f8-8aba-036d2c54a189-kube-api-access-8jxzm\") pod \"alertmanager-main-0\" (UID: \"a79c3538-06d1-49f8-8aba-036d2c54a189\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:49:19.929189 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:19.928623 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a79c3538-06d1-49f8-8aba-036d2c54a189-config-out\") pod \"alertmanager-main-0\" (UID: \"a79c3538-06d1-49f8-8aba-036d2c54a189\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:49:19.929189 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:19.928714 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a79c3538-06d1-49f8-8aba-036d2c54a189-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a79c3538-06d1-49f8-8aba-036d2c54a189\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:49:19.929189 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:19.928744 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a79c3538-06d1-49f8-8aba-036d2c54a189-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a79c3538-06d1-49f8-8aba-036d2c54a189\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:49:19.929189 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:19.928768 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a79c3538-06d1-49f8-8aba-036d2c54a189-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a79c3538-06d1-49f8-8aba-036d2c54a189\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:49:19.929189 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:19.928799 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a79c3538-06d1-49f8-8aba-036d2c54a189-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a79c3538-06d1-49f8-8aba-036d2c54a189\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:49:19.929189 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:19.928844 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a79c3538-06d1-49f8-8aba-036d2c54a189-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a79c3538-06d1-49f8-8aba-036d2c54a189\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:49:19.929189 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:19.928866 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a79c3538-06d1-49f8-8aba-036d2c54a189-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a79c3538-06d1-49f8-8aba-036d2c54a189\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:49:19.929189 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:19.928894 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a79c3538-06d1-49f8-8aba-036d2c54a189-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a79c3538-06d1-49f8-8aba-036d2c54a189\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:49:19.929189 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:19.928919 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a79c3538-06d1-49f8-8aba-036d2c54a189-web-config\") pod \"alertmanager-main-0\" (UID: \"a79c3538-06d1-49f8-8aba-036d2c54a189\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:49:19.929189 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:19.928951 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a79c3538-06d1-49f8-8aba-036d2c54a189-config-volume\") pod \"alertmanager-main-0\" (UID: \"a79c3538-06d1-49f8-8aba-036d2c54a189\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:49:19.929189 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:19.928973 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a79c3538-06d1-49f8-8aba-036d2c54a189-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a79c3538-06d1-49f8-8aba-036d2c54a189\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:49:19.949835 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:19.949751 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-tz7sc"] Jun 09 08:49:19.959424 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:49:19.959326 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda33e2374_26ae_4bee_890f_b8fe15b36547.slice/crio-dbc6c04a9ac2a0b9b68f52f3c858ac4ab1da22a07803c224959fd82d4a306d5d WatchSource:0}: Error finding container dbc6c04a9ac2a0b9b68f52f3c858ac4ab1da22a07803c224959fd82d4a306d5d: Status 404 returned error can't find the container with id dbc6c04a9ac2a0b9b68f52f3c858ac4ab1da22a07803c224959fd82d4a306d5d Jun 09 08:49:20.029930 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:20.029888 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a79c3538-06d1-49f8-8aba-036d2c54a189-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a79c3538-06d1-49f8-8aba-036d2c54a189\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:49:20.030047 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:20.029936 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a79c3538-06d1-49f8-8aba-036d2c54a189-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a79c3538-06d1-49f8-8aba-036d2c54a189\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:49:20.030104 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:49:20.030087 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a79c3538-06d1-49f8-8aba-036d2c54a189-alertmanager-trusted-ca-bundle podName:a79c3538-06d1-49f8-8aba-036d2c54a189 nodeName:}" failed. No retries permitted until 2026-06-09 08:49:20.530062057 +0000 UTC m=+237.975009389 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/a79c3538-06d1-49f8-8aba-036d2c54a189-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "a79c3538-06d1-49f8-8aba-036d2c54a189") : configmap references non-existent config key: ca-bundle.crt Jun 09 08:49:20.030193 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:20.030173 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a79c3538-06d1-49f8-8aba-036d2c54a189-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a79c3538-06d1-49f8-8aba-036d2c54a189\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:49:20.030247 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:20.030225 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a79c3538-06d1-49f8-8aba-036d2c54a189-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a79c3538-06d1-49f8-8aba-036d2c54a189\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:49:20.030302 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:20.030283 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a79c3538-06d1-49f8-8aba-036d2c54a189-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a79c3538-06d1-49f8-8aba-036d2c54a189\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:49:20.031856 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:20.031356 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a79c3538-06d1-49f8-8aba-036d2c54a189-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a79c3538-06d1-49f8-8aba-036d2c54a189\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:49:20.032216 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:20.032066 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a79c3538-06d1-49f8-8aba-036d2c54a189-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a79c3538-06d1-49f8-8aba-036d2c54a189\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:49:20.033521 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:20.033224 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a79c3538-06d1-49f8-8aba-036d2c54a189-web-config\") pod \"alertmanager-main-0\" (UID: \"a79c3538-06d1-49f8-8aba-036d2c54a189\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:49:20.033521 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:20.033407 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a79c3538-06d1-49f8-8aba-036d2c54a189-config-volume\") pod \"alertmanager-main-0\" (UID: \"a79c3538-06d1-49f8-8aba-036d2c54a189\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:49:20.033521 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:20.033435 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a79c3538-06d1-49f8-8aba-036d2c54a189-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a79c3538-06d1-49f8-8aba-036d2c54a189\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:49:20.033728 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:20.033518 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a79c3538-06d1-49f8-8aba-036d2c54a189-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a79c3538-06d1-49f8-8aba-036d2c54a189\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:49:20.035443 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:20.035220 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a79c3538-06d1-49f8-8aba-036d2c54a189-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a79c3538-06d1-49f8-8aba-036d2c54a189\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:49:20.035443 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:20.035277 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jxzm\" (UniqueName: \"kubernetes.io/projected/a79c3538-06d1-49f8-8aba-036d2c54a189-kube-api-access-8jxzm\") pod \"alertmanager-main-0\" (UID: \"a79c3538-06d1-49f8-8aba-036d2c54a189\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:49:20.035443 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:20.035320 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a79c3538-06d1-49f8-8aba-036d2c54a189-config-out\") pod \"alertmanager-main-0\" (UID: \"a79c3538-06d1-49f8-8aba-036d2c54a189\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:49:20.036726 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:20.036035 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a79c3538-06d1-49f8-8aba-036d2c54a189-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a79c3538-06d1-49f8-8aba-036d2c54a189\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:49:20.038616 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:20.038571 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a79c3538-06d1-49f8-8aba-036d2c54a189-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a79c3538-06d1-49f8-8aba-036d2c54a189\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:49:20.038808 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:20.038782 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a79c3538-06d1-49f8-8aba-036d2c54a189-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a79c3538-06d1-49f8-8aba-036d2c54a189\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:49:20.038993 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:20.038928 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a79c3538-06d1-49f8-8aba-036d2c54a189-config-out\") pod \"alertmanager-main-0\" (UID: \"a79c3538-06d1-49f8-8aba-036d2c54a189\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:49:20.040214 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:20.040175 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a79c3538-06d1-49f8-8aba-036d2c54a189-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a79c3538-06d1-49f8-8aba-036d2c54a189\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:49:20.040835 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:20.040789 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a79c3538-06d1-49f8-8aba-036d2c54a189-web-config\") pod \"alertmanager-main-0\" (UID: \"a79c3538-06d1-49f8-8aba-036d2c54a189\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:49:20.041012 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:20.040965 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a79c3538-06d1-49f8-8aba-036d2c54a189-config-volume\") pod \"alertmanager-main-0\" (UID: \"a79c3538-06d1-49f8-8aba-036d2c54a189\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:49:20.042091 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:20.042055 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a79c3538-06d1-49f8-8aba-036d2c54a189-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a79c3538-06d1-49f8-8aba-036d2c54a189\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:49:20.045519 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:20.045496 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a79c3538-06d1-49f8-8aba-036d2c54a189-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a79c3538-06d1-49f8-8aba-036d2c54a189\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:49:20.046122 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:20.046104 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a79c3538-06d1-49f8-8aba-036d2c54a189-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a79c3538-06d1-49f8-8aba-036d2c54a189\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:49:20.046728 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:20.046618 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jxzm\" (UniqueName: \"kubernetes.io/projected/a79c3538-06d1-49f8-8aba-036d2c54a189-kube-api-access-8jxzm\") pod \"alertmanager-main-0\" (UID: \"a79c3538-06d1-49f8-8aba-036d2c54a189\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:49:20.540623 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:20.540583 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a79c3538-06d1-49f8-8aba-036d2c54a189-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a79c3538-06d1-49f8-8aba-036d2c54a189\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:49:20.541457 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:20.541436 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a79c3538-06d1-49f8-8aba-036d2c54a189-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a79c3538-06d1-49f8-8aba-036d2c54a189\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:49:20.767957 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:20.767932 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:49:20.817101 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:20.816998 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-tz7sc" event={"ID":"a33e2374-26ae-4bee-890f-b8fe15b36547","Type":"ContainerStarted","Data":"dbc6c04a9ac2a0b9b68f52f3c858ac4ab1da22a07803c224959fd82d4a306d5d"} Jun 09 08:49:20.821389 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:20.821242 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zq2zq" event={"ID":"a69dbc83-8dbf-41fb-8089-cc84b3d14f3c","Type":"ContainerStarted","Data":"f3c9b9bce35723f8f6285cd68b48098bfcad24b9c136d1fdfde39d36d33311a6"} Jun 09 08:49:20.821389 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:20.821304 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zq2zq" event={"ID":"a69dbc83-8dbf-41fb-8089-cc84b3d14f3c","Type":"ContainerStarted","Data":"5ca0681cb47932219ad20beaa6d1b305e294097bbd3fab5d2371a7a8265dbfb3"} Jun 09 08:49:20.821389 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:20.821334 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zq2zq" event={"ID":"a69dbc83-8dbf-41fb-8089-cc84b3d14f3c","Type":"ContainerStarted","Data":"31f01d07c15c5b24169fbdf346a1678c348f991e034e0297dc458db74b1135d7"} Jun 09 08:49:20.824161 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:20.824134 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nfgmq" event={"ID":"55c367b2-677c-43bd-b3c2-78a08c0276bd","Type":"ContainerStarted","Data":"3c8edeeec04e7ddcc23729cff899addb3ae809282a4b02e4bf4364ab7d0609a9"} Jun 09 08:49:20.954912 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:20.954805 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 08:49:20.960843 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:49:20.960805 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda79c3538_06d1_49f8_8aba_036d2c54a189.slice/crio-6dc88da1abaa9cd16bb8a3ae5728421bfbd86edbd02c4a7e93e164915619eefc WatchSource:0}: Error finding container 6dc88da1abaa9cd16bb8a3ae5728421bfbd86edbd02c4a7e93e164915619eefc: Status 404 returned error can't find the container with id 6dc88da1abaa9cd16bb8a3ae5728421bfbd86edbd02c4a7e93e164915619eefc Jun 09 08:49:21.737819 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:21.737781 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-db779c74f-bkk6m"] Jun 09 08:49:21.741905 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:21.741866 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-db779c74f-bkk6m" Jun 09 08:49:21.744426 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:21.744402 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 09 08:49:21.744636 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:21.744618 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 09 08:49:21.745736 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:21.744881 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-pmrw2\"" Jun 09 08:49:21.745736 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:21.745098 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 09 08:49:21.745736 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:21.745261 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 09 08:49:21.745736 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:21.745479 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 09 08:49:21.745997 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:21.745803 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-7d62qr703adp4\"" Jun 09 08:49:21.754847 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:21.754698 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-db779c74f-bkk6m"] Jun 09 08:49:21.830366 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:21.830333 2567 generic.go:356] "Generic (PLEG): container finished" podID="55c367b2-677c-43bd-b3c2-78a08c0276bd" containerID="3c8edeeec04e7ddcc23729cff899addb3ae809282a4b02e4bf4364ab7d0609a9" exitCode=0 Jun 09 08:49:21.830814 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:21.830427 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nfgmq" event={"ID":"55c367b2-677c-43bd-b3c2-78a08c0276bd","Type":"ContainerDied","Data":"3c8edeeec04e7ddcc23729cff899addb3ae809282a4b02e4bf4364ab7d0609a9"} Jun 09 08:49:21.832530 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:21.832508 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a79c3538-06d1-49f8-8aba-036d2c54a189","Type":"ContainerStarted","Data":"6dc88da1abaa9cd16bb8a3ae5728421bfbd86edbd02c4a7e93e164915619eefc"} Jun 09 08:49:21.854942 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:21.854905 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6vgx\" (UniqueName: \"kubernetes.io/projected/d83de3c6-c5e2-4e91-a8e2-0e347568ea69-kube-api-access-f6vgx\") pod \"thanos-querier-db779c74f-bkk6m\" (UID: \"d83de3c6-c5e2-4e91-a8e2-0e347568ea69\") " pod="openshift-monitoring/thanos-querier-db779c74f-bkk6m" Jun 09 08:49:21.855100 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:21.854970 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d83de3c6-c5e2-4e91-a8e2-0e347568ea69-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-db779c74f-bkk6m\" (UID: \"d83de3c6-c5e2-4e91-a8e2-0e347568ea69\") " pod="openshift-monitoring/thanos-querier-db779c74f-bkk6m" Jun 09 08:49:21.855100 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:21.855012 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d83de3c6-c5e2-4e91-a8e2-0e347568ea69-secret-thanos-querier-tls\") pod \"thanos-querier-db779c74f-bkk6m\" (UID: \"d83de3c6-c5e2-4e91-a8e2-0e347568ea69\") " pod="openshift-monitoring/thanos-querier-db779c74f-bkk6m" Jun 09 08:49:21.855100 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:21.855043 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d83de3c6-c5e2-4e91-a8e2-0e347568ea69-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-db779c74f-bkk6m\" (UID: \"d83de3c6-c5e2-4e91-a8e2-0e347568ea69\") " pod="openshift-monitoring/thanos-querier-db779c74f-bkk6m" Jun 09 08:49:21.855267 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:21.855117 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d83de3c6-c5e2-4e91-a8e2-0e347568ea69-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-db779c74f-bkk6m\" (UID: \"d83de3c6-c5e2-4e91-a8e2-0e347568ea69\") " pod="openshift-monitoring/thanos-querier-db779c74f-bkk6m" Jun 09 08:49:21.855267 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:21.855160 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d83de3c6-c5e2-4e91-a8e2-0e347568ea69-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-db779c74f-bkk6m\" (UID: \"d83de3c6-c5e2-4e91-a8e2-0e347568ea69\") " pod="openshift-monitoring/thanos-querier-db779c74f-bkk6m" Jun 09 08:49:21.855267 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:21.855191 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d83de3c6-c5e2-4e91-a8e2-0e347568ea69-secret-grpc-tls\") pod \"thanos-querier-db779c74f-bkk6m\" (UID: \"d83de3c6-c5e2-4e91-a8e2-0e347568ea69\") " pod="openshift-monitoring/thanos-querier-db779c74f-bkk6m" Jun 09 08:49:21.855267 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:21.855257 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d83de3c6-c5e2-4e91-a8e2-0e347568ea69-metrics-client-ca\") pod \"thanos-querier-db779c74f-bkk6m\" (UID: \"d83de3c6-c5e2-4e91-a8e2-0e347568ea69\") " pod="openshift-monitoring/thanos-querier-db779c74f-bkk6m" Jun 09 08:49:21.960274 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:21.957854 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6vgx\" (UniqueName: \"kubernetes.io/projected/d83de3c6-c5e2-4e91-a8e2-0e347568ea69-kube-api-access-f6vgx\") pod \"thanos-querier-db779c74f-bkk6m\" (UID: \"d83de3c6-c5e2-4e91-a8e2-0e347568ea69\") " pod="openshift-monitoring/thanos-querier-db779c74f-bkk6m" Jun 09 08:49:21.960274 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:21.957944 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d83de3c6-c5e2-4e91-a8e2-0e347568ea69-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-db779c74f-bkk6m\" (UID: \"d83de3c6-c5e2-4e91-a8e2-0e347568ea69\") " pod="openshift-monitoring/thanos-querier-db779c74f-bkk6m" Jun 09 08:49:21.960274 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:21.957995 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d83de3c6-c5e2-4e91-a8e2-0e347568ea69-secret-thanos-querier-tls\") pod \"thanos-querier-db779c74f-bkk6m\" (UID: \"d83de3c6-c5e2-4e91-a8e2-0e347568ea69\") " pod="openshift-monitoring/thanos-querier-db779c74f-bkk6m" Jun 09 08:49:21.960274 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:21.958022 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d83de3c6-c5e2-4e91-a8e2-0e347568ea69-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-db779c74f-bkk6m\" (UID: \"d83de3c6-c5e2-4e91-a8e2-0e347568ea69\") " pod="openshift-monitoring/thanos-querier-db779c74f-bkk6m" Jun 09 08:49:21.960274 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:21.958061 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d83de3c6-c5e2-4e91-a8e2-0e347568ea69-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-db779c74f-bkk6m\" (UID: \"d83de3c6-c5e2-4e91-a8e2-0e347568ea69\") " pod="openshift-monitoring/thanos-querier-db779c74f-bkk6m" Jun 09 08:49:21.960274 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:21.958112 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d83de3c6-c5e2-4e91-a8e2-0e347568ea69-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-db779c74f-bkk6m\" (UID: \"d83de3c6-c5e2-4e91-a8e2-0e347568ea69\") " pod="openshift-monitoring/thanos-querier-db779c74f-bkk6m" Jun 09 08:49:21.960274 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:21.958139 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d83de3c6-c5e2-4e91-a8e2-0e347568ea69-secret-grpc-tls\") pod \"thanos-querier-db779c74f-bkk6m\" (UID: \"d83de3c6-c5e2-4e91-a8e2-0e347568ea69\") " pod="openshift-monitoring/thanos-querier-db779c74f-bkk6m" Jun 09 08:49:21.960274 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:21.958209 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d83de3c6-c5e2-4e91-a8e2-0e347568ea69-metrics-client-ca\") pod \"thanos-querier-db779c74f-bkk6m\" (UID: \"d83de3c6-c5e2-4e91-a8e2-0e347568ea69\") " pod="openshift-monitoring/thanos-querier-db779c74f-bkk6m" Jun 09 08:49:21.960274 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:21.958933 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d83de3c6-c5e2-4e91-a8e2-0e347568ea69-metrics-client-ca\") pod \"thanos-querier-db779c74f-bkk6m\" (UID: \"d83de3c6-c5e2-4e91-a8e2-0e347568ea69\") " pod="openshift-monitoring/thanos-querier-db779c74f-bkk6m" Jun 09 08:49:21.963927 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:21.963898 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d83de3c6-c5e2-4e91-a8e2-0e347568ea69-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-db779c74f-bkk6m\" (UID: \"d83de3c6-c5e2-4e91-a8e2-0e347568ea69\") " pod="openshift-monitoring/thanos-querier-db779c74f-bkk6m" Jun 09 08:49:21.973410 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:21.971814 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d83de3c6-c5e2-4e91-a8e2-0e347568ea69-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-db779c74f-bkk6m\" (UID: \"d83de3c6-c5e2-4e91-a8e2-0e347568ea69\") " pod="openshift-monitoring/thanos-querier-db779c74f-bkk6m" Jun 09 08:49:21.973410 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:21.972228 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d83de3c6-c5e2-4e91-a8e2-0e347568ea69-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-db779c74f-bkk6m\" (UID: \"d83de3c6-c5e2-4e91-a8e2-0e347568ea69\") " pod="openshift-monitoring/thanos-querier-db779c74f-bkk6m" Jun 09 08:49:21.973410 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:21.972237 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d83de3c6-c5e2-4e91-a8e2-0e347568ea69-secret-grpc-tls\") pod \"thanos-querier-db779c74f-bkk6m\" (UID: \"d83de3c6-c5e2-4e91-a8e2-0e347568ea69\") " pod="openshift-monitoring/thanos-querier-db779c74f-bkk6m" Jun 09 08:49:21.973410 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:21.972560 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d83de3c6-c5e2-4e91-a8e2-0e347568ea69-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-db779c74f-bkk6m\" (UID: \"d83de3c6-c5e2-4e91-a8e2-0e347568ea69\") " pod="openshift-monitoring/thanos-querier-db779c74f-bkk6m" Jun 09 08:49:21.973410 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:21.972786 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d83de3c6-c5e2-4e91-a8e2-0e347568ea69-secret-thanos-querier-tls\") pod \"thanos-querier-db779c74f-bkk6m\" (UID: \"d83de3c6-c5e2-4e91-a8e2-0e347568ea69\") " pod="openshift-monitoring/thanos-querier-db779c74f-bkk6m" Jun 09 08:49:21.975799 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:21.974758 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6vgx\" (UniqueName: \"kubernetes.io/projected/d83de3c6-c5e2-4e91-a8e2-0e347568ea69-kube-api-access-f6vgx\") pod \"thanos-querier-db779c74f-bkk6m\" (UID: \"d83de3c6-c5e2-4e91-a8e2-0e347568ea69\") " pod="openshift-monitoring/thanos-querier-db779c74f-bkk6m" Jun 09 08:49:22.056720 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:22.056199 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-db779c74f-bkk6m" Jun 09 08:49:22.278488 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:22.278381 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-db779c74f-bkk6m"] Jun 09 08:49:22.282189 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:49:22.281828 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd83de3c6_c5e2_4e91_a8e2_0e347568ea69.slice/crio-65a98f4ab381d44c72a3465105621a647a3510baf94a064adac963029987b26c WatchSource:0}: Error finding container 65a98f4ab381d44c72a3465105621a647a3510baf94a064adac963029987b26c: Status 404 returned error can't find the container with id 65a98f4ab381d44c72a3465105621a647a3510baf94a064adac963029987b26c Jun 09 08:49:22.840136 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:22.840102 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zq2zq" event={"ID":"a69dbc83-8dbf-41fb-8089-cc84b3d14f3c","Type":"ContainerStarted","Data":"eb6202dd32cbc75bfea57c63ee93e18f7b8bde9a5c44b4c39ee37e36b99cf2e7"} Jun 09 08:49:22.841397 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:22.841360 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-db779c74f-bkk6m" event={"ID":"d83de3c6-c5e2-4e91-a8e2-0e347568ea69","Type":"ContainerStarted","Data":"65a98f4ab381d44c72a3465105621a647a3510baf94a064adac963029987b26c"} Jun 09 08:49:22.844159 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:22.844022 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nfgmq" event={"ID":"55c367b2-677c-43bd-b3c2-78a08c0276bd","Type":"ContainerStarted","Data":"fc15dada27ef63000ae6a5d1fee411c37785c857485b5d178fc68fe0fd4d5f9f"} Jun 09 08:49:22.844159 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:22.844066 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nfgmq" event={"ID":"55c367b2-677c-43bd-b3c2-78a08c0276bd","Type":"ContainerStarted","Data":"e5a41112b156b146d2cb952288f88323f4de7e7dc749a03c65a70d471883ea97"} Jun 09 08:49:22.846692 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:22.846668 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-tz7sc" event={"ID":"a33e2374-26ae-4bee-890f-b8fe15b36547","Type":"ContainerStarted","Data":"5894a2a57bddddc8690e7d5b2f0518b0a3e72266861fdd8032ccd9b4365dd940"} Jun 09 08:49:22.846809 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:22.846712 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-tz7sc" event={"ID":"a33e2374-26ae-4bee-890f-b8fe15b36547","Type":"ContainerStarted","Data":"fa1c201adcb7c9a236a8787d605f6fa63ebd1f85a8b14b83c3d46ac7bebef371"} Jun 09 08:49:22.846809 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:22.846730 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-tz7sc" event={"ID":"a33e2374-26ae-4bee-890f-b8fe15b36547","Type":"ContainerStarted","Data":"3134628c87d09638a1e8e50484890882c11dbad0a89e27b30ea14407f6d0b561"} Jun 09 08:49:22.858421 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:22.858375 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zq2zq" podStartSLOduration=3.123318941 podStartE2EDuration="4.858358031s" totalImagesPullingTime="1.73503909s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 08:49:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:49:22.856760976 +0000 UTC m=+240.301708327" watchObservedRunningTime="2026-06-09 08:49:22.858358031 +0000 UTC m=+240.303305382" Jun 09 08:49:22.875565 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:22.875509 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-tz7sc" podStartSLOduration=2.991806615 podStartE2EDuration="4.875489709s" totalImagesPullingTime="1.883683094s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 08:49:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:49:22.87407534 +0000 UTC m=+240.319022700" watchObservedRunningTime="2026-06-09 08:49:22.875489709 +0000 UTC m=+240.320437060" Jun 09 08:49:22.893091 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:22.893043 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-nfgmq" podStartSLOduration=3.273075951 podStartE2EDuration="4.893028058s" totalImagesPullingTime="1.5006094s" totalInitContainerRuntime="119.342707ms" isStatefulPod=true podCreationTimestamp="2026-06-09 08:49:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:49:22.891192955 +0000 UTC m=+240.336140304" watchObservedRunningTime="2026-06-09 08:49:22.893028058 +0000 UTC m=+240.337975407" Jun 09 08:49:23.527138 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:23.527099 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-rls65"] Jun 09 08:49:23.530997 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:23.530975 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-rls65" Jun 09 08:49:23.533686 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:23.533425 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-2lpxq\"" Jun 09 08:49:23.533686 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:23.533449 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 09 08:49:23.550870 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:23.550844 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-rls65"] Jun 09 08:49:23.576812 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:23.576742 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4595z\" (UniqueName: \"kubernetes.io/projected/32722df9-425b-407a-bbf7-e15e1abb9252-kube-api-access-4595z\") pod \"monitoring-plugin-76b68cc874-rls65\" (UID: \"32722df9-425b-407a-bbf7-e15e1abb9252\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-rls65" Jun 09 08:49:23.576983 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:23.576899 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/32722df9-425b-407a-bbf7-e15e1abb9252-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-rls65\" (UID: \"32722df9-425b-407a-bbf7-e15e1abb9252\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-rls65" Jun 09 08:49:23.678103 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:23.678062 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4595z\" (UniqueName: \"kubernetes.io/projected/32722df9-425b-407a-bbf7-e15e1abb9252-kube-api-access-4595z\") pod \"monitoring-plugin-76b68cc874-rls65\" (UID: \"32722df9-425b-407a-bbf7-e15e1abb9252\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-rls65" Jun 09 08:49:23.678289 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:23.678177 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/32722df9-425b-407a-bbf7-e15e1abb9252-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-rls65\" (UID: \"32722df9-425b-407a-bbf7-e15e1abb9252\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-rls65" Jun 09 08:49:23.678375 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:49:23.678354 2567 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 09 08:49:23.678445 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:49:23.678433 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32722df9-425b-407a-bbf7-e15e1abb9252-monitoring-plugin-cert podName:32722df9-425b-407a-bbf7-e15e1abb9252 nodeName:}" failed. No retries permitted until 2026-06-09 08:49:24.178410584 +0000 UTC m=+241.623357922 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/32722df9-425b-407a-bbf7-e15e1abb9252-monitoring-plugin-cert") pod "monitoring-plugin-76b68cc874-rls65" (UID: "32722df9-425b-407a-bbf7-e15e1abb9252") : secret "monitoring-plugin-cert" not found Jun 09 08:49:23.688970 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:23.688937 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4595z\" (UniqueName: \"kubernetes.io/projected/32722df9-425b-407a-bbf7-e15e1abb9252-kube-api-access-4595z\") pod \"monitoring-plugin-76b68cc874-rls65\" (UID: \"32722df9-425b-407a-bbf7-e15e1abb9252\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-rls65" Jun 09 08:49:23.854081 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:23.854033 2567 generic.go:356] "Generic (PLEG): container finished" podID="a79c3538-06d1-49f8-8aba-036d2c54a189" containerID="b96046ec4ce36c4ca54532bd10bc902a77c31b8a4484af8bba203945e1476088" exitCode=0 Jun 09 08:49:23.855131 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:23.854841 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a79c3538-06d1-49f8-8aba-036d2c54a189","Type":"ContainerDied","Data":"b96046ec4ce36c4ca54532bd10bc902a77c31b8a4484af8bba203945e1476088"} Jun 09 08:49:24.186260 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:24.186172 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/32722df9-425b-407a-bbf7-e15e1abb9252-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-rls65\" (UID: \"32722df9-425b-407a-bbf7-e15e1abb9252\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-rls65" Jun 09 08:49:24.189214 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:24.189181 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/32722df9-425b-407a-bbf7-e15e1abb9252-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-rls65\" (UID: \"32722df9-425b-407a-bbf7-e15e1abb9252\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-rls65" Jun 09 08:49:24.448449 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:24.448358 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-rls65" Jun 09 08:49:24.977511 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:24.977475 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 08:49:24.982881 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:24.982851 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:49:24.985737 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:24.985714 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4igulr3rts5g7\"" Jun 09 08:49:24.985902 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:24.985854 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 09 08:49:24.985902 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:24.985860 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 09 08:49:24.986086 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:24.986066 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 09 08:49:24.986171 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:24.986125 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 09 08:49:24.986400 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:24.986310 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 09 08:49:24.986400 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:24.986325 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 09 08:49:24.986855 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:24.986732 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 09 08:49:24.986855 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:24.986744 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 09 08:49:24.986855 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:24.986848 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-br5z9\"" Jun 09 08:49:24.987154 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:24.986950 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 09 08:49:24.987154 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:24.986998 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 09 08:49:24.987154 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:24.987073 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 09 08:49:24.987316 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:24.987281 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 09 08:49:24.987316 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:24.987307 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 09 08:49:24.987791 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:24.987771 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 09 08:49:24.989361 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:24.989339 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 09 08:49:24.999294 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:24.999270 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 08:49:25.097427 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:25.097131 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9bc08187-f796-411d-8c53-a92d0cac4d6f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:49:25.097427 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:25.097192 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bc08187-f796-411d-8c53-a92d0cac4d6f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:49:25.097427 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:25.097251 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9bc08187-f796-411d-8c53-a92d0cac4d6f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:49:25.097427 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:25.097329 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9bc08187-f796-411d-8c53-a92d0cac4d6f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:49:25.097427 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:25.097374 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9bc08187-f796-411d-8c53-a92d0cac4d6f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:49:25.097924 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:25.097469 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9bc08187-f796-411d-8c53-a92d0cac4d6f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:49:25.097924 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:25.097505 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9bc08187-f796-411d-8c53-a92d0cac4d6f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:49:25.097924 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:25.097534 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9bc08187-f796-411d-8c53-a92d0cac4d6f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:49:25.097924 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:25.097563 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2bc2\" (UniqueName: \"kubernetes.io/projected/9bc08187-f796-411d-8c53-a92d0cac4d6f-kube-api-access-b2bc2\") pod \"prometheus-k8s-0\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:49:25.097924 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:25.097595 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bc08187-f796-411d-8c53-a92d0cac4d6f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:49:25.097924 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:25.097619 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9bc08187-f796-411d-8c53-a92d0cac4d6f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:49:25.097924 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:25.097688 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9bc08187-f796-411d-8c53-a92d0cac4d6f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:49:25.097924 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:25.097733 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9bc08187-f796-411d-8c53-a92d0cac4d6f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:49:25.097924 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:25.097762 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9bc08187-f796-411d-8c53-a92d0cac4d6f-config\") pod \"prometheus-k8s-0\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:49:25.097924 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:25.097789 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9bc08187-f796-411d-8c53-a92d0cac4d6f-config-out\") pod \"prometheus-k8s-0\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:49:25.097924 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:25.097813 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bc08187-f796-411d-8c53-a92d0cac4d6f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:49:25.097924 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:25.097860 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9bc08187-f796-411d-8c53-a92d0cac4d6f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:49:25.097924 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:25.097899 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9bc08187-f796-411d-8c53-a92d0cac4d6f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:49:25.097924 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:25.097925 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9bc08187-f796-411d-8c53-a92d0cac4d6f-web-config\") pod \"prometheus-k8s-0\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:49:25.098703 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:25.097948 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9bc08187-f796-411d-8c53-a92d0cac4d6f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:49:25.200351 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:25.200307 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9bc08187-f796-411d-8c53-a92d0cac4d6f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:49:25.200539 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:25.200362 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bc08187-f796-411d-8c53-a92d0cac4d6f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:49:25.200539 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:25.200407 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9bc08187-f796-411d-8c53-a92d0cac4d6f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:49:25.200539 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:25.200464 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9bc08187-f796-411d-8c53-a92d0cac4d6f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:49:25.200539 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:25.200492 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9bc08187-f796-411d-8c53-a92d0cac4d6f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:49:25.200539 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:25.200537 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9bc08187-f796-411d-8c53-a92d0cac4d6f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:49:25.200763 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:25.200561 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9bc08187-f796-411d-8c53-a92d0cac4d6f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:49:25.200763 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:25.200586 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9bc08187-f796-411d-8c53-a92d0cac4d6f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:49:25.200763 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:25.200624 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2bc2\" (UniqueName: \"kubernetes.io/projected/9bc08187-f796-411d-8c53-a92d0cac4d6f-kube-api-access-b2bc2\") pod \"prometheus-k8s-0\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:49:25.200763 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:25.200668 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bc08187-f796-411d-8c53-a92d0cac4d6f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:49:25.200763 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:25.200693 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9bc08187-f796-411d-8c53-a92d0cac4d6f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:49:25.200763 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:25.200723 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9bc08187-f796-411d-8c53-a92d0cac4d6f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:49:25.200763 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:25.200750 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9bc08187-f796-411d-8c53-a92d0cac4d6f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:49:25.201017 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:25.200779 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9bc08187-f796-411d-8c53-a92d0cac4d6f-config\") pod \"prometheus-k8s-0\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:49:25.201017 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:25.200808 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9bc08187-f796-411d-8c53-a92d0cac4d6f-config-out\") pod \"prometheus-k8s-0\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:49:25.201017 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:25.200835 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bc08187-f796-411d-8c53-a92d0cac4d6f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:49:25.201017 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:25.200888 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9bc08187-f796-411d-8c53-a92d0cac4d6f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:49:25.201017 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:25.200930 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9bc08187-f796-411d-8c53-a92d0cac4d6f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:49:25.201017 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:25.200954 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9bc08187-f796-411d-8c53-a92d0cac4d6f-web-config\") pod \"prometheus-k8s-0\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:49:25.201017 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:25.200978 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9bc08187-f796-411d-8c53-a92d0cac4d6f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:49:25.202389 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:25.202326 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9bc08187-f796-411d-8c53-a92d0cac4d6f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:49:25.203919 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:25.202609 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9bc08187-f796-411d-8c53-a92d0cac4d6f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:49:25.205374 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:25.204325 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bc08187-f796-411d-8c53-a92d0cac4d6f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:49:25.205374 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:25.204618 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9bc08187-f796-411d-8c53-a92d0cac4d6f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:49:25.205374 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:25.205021 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bc08187-f796-411d-8c53-a92d0cac4d6f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:49:25.205624 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:25.205593 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9bc08187-f796-411d-8c53-a92d0cac4d6f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:49:25.206186 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:25.205785 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9bc08187-f796-411d-8c53-a92d0cac4d6f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:49:25.206186 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:25.206144 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bc08187-f796-411d-8c53-a92d0cac4d6f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:49:25.206956 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:25.206902 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9bc08187-f796-411d-8c53-a92d0cac4d6f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:49:25.209081 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:25.208568 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9bc08187-f796-411d-8c53-a92d0cac4d6f-config-out\") pod \"prometheus-k8s-0\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:49:25.209081 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:25.208569 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9bc08187-f796-411d-8c53-a92d0cac4d6f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:49:25.209081 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:25.208768 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9bc08187-f796-411d-8c53-a92d0cac4d6f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:49:25.209081 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:25.208887 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9bc08187-f796-411d-8c53-a92d0cac4d6f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:49:25.209081 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:25.209039 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9bc08187-f796-411d-8c53-a92d0cac4d6f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:49:25.209385 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:25.209319 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9bc08187-f796-411d-8c53-a92d0cac4d6f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:49:25.209896 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:25.209851 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9bc08187-f796-411d-8c53-a92d0cac4d6f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:49:25.210745 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:25.210335 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9bc08187-f796-411d-8c53-a92d0cac4d6f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:49:25.211094 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:25.211056 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2bc2\" (UniqueName: \"kubernetes.io/projected/9bc08187-f796-411d-8c53-a92d0cac4d6f-kube-api-access-b2bc2\") pod \"prometheus-k8s-0\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:49:25.212454 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:25.212402 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9bc08187-f796-411d-8c53-a92d0cac4d6f-web-config\") pod \"prometheus-k8s-0\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:49:25.213697 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:25.213670 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/9bc08187-f796-411d-8c53-a92d0cac4d6f-config\") pod \"prometheus-k8s-0\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:49:25.300808 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:25.300666 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:49:32.692756 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:32.692725 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 08:49:32.697696 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:49:32.697635 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bc08187_f796_411d_8c53_a92d0cac4d6f.slice/crio-c81eef02a093c6c19f110bc0cbaec819c1d8bc1e2ed2923b69ff1e5758d6a590 WatchSource:0}: Error finding container c81eef02a093c6c19f110bc0cbaec819c1d8bc1e2ed2923b69ff1e5758d6a590: Status 404 returned error can't find the container with id c81eef02a093c6c19f110bc0cbaec819c1d8bc1e2ed2923b69ff1e5758d6a590 Jun 09 08:49:32.703404 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:32.703371 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-rls65"] Jun 09 08:49:32.708165 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:49:32.708113 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32722df9_425b_407a_bbf7_e15e1abb9252.slice/crio-dcb60725d16ae94cd430e8529115d0a7ec4c835f2e8fcbe32a6c51f0254f0038 WatchSource:0}: Error finding container dcb60725d16ae94cd430e8529115d0a7ec4c835f2e8fcbe32a6c51f0254f0038: Status 404 returned error can't find the container with id dcb60725d16ae94cd430e8529115d0a7ec4c835f2e8fcbe32a6c51f0254f0038 Jun 09 08:49:32.895079 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:32.895035 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a79c3538-06d1-49f8-8aba-036d2c54a189","Type":"ContainerStarted","Data":"9c0548a1568b934228a42c0bf0f1e560b9a4b294838598b47b45c159da937528"} Jun 09 08:49:32.895214 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:32.895107 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a79c3538-06d1-49f8-8aba-036d2c54a189","Type":"ContainerStarted","Data":"f0ece9819d05ca2d46f7f3d01bacde531ee9156e1ddb3e7720aa813806923ca9"} Jun 09 08:49:32.895214 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:32.895133 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a79c3538-06d1-49f8-8aba-036d2c54a189","Type":"ContainerStarted","Data":"6685f7cc08fb331e6d1a3790f8f0a4894e847d8226acf6e9b438d0a86480aab2"} Jun 09 08:49:32.895214 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:32.895157 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a79c3538-06d1-49f8-8aba-036d2c54a189","Type":"ContainerStarted","Data":"63498772265ee2d17fbd970b65a2dca49688a138cc43336321def5aec6d22541"} Jun 09 08:49:32.896899 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:32.896865 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-qxtw7" event={"ID":"64cc3732-bece-4942-a855-126c460e9d38","Type":"ContainerStarted","Data":"948fea93f2be86e4f7908579acb26a54524b150d6138617cb8dd60df93dbc689"} Jun 09 08:49:32.897054 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:32.897028 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-qxtw7" Jun 09 08:49:32.899738 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:32.899718 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-db779c74f-bkk6m" event={"ID":"d83de3c6-c5e2-4e91-a8e2-0e347568ea69","Type":"ContainerStarted","Data":"69b6c09881e6d7d35e0ca52d9055f6b17928ffdb759829c30051377b027b9b2e"} Jun 09 08:49:32.899872 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:32.899859 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-db779c74f-bkk6m" event={"ID":"d83de3c6-c5e2-4e91-a8e2-0e347568ea69","Type":"ContainerStarted","Data":"4adf8925f4ea2a2fbe156a630192480beccd1fa360a8f99b7420efcc10ff0661"} Jun 09 08:49:32.900036 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:32.900010 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-db779c74f-bkk6m" event={"ID":"d83de3c6-c5e2-4e91-a8e2-0e347568ea69","Type":"ContainerStarted","Data":"f771e2268088f2c29dcb01896f433128259e83a4e53597e01b6a3501395073ce"} Jun 09 08:49:32.901575 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:32.901555 2567 generic.go:356] "Generic (PLEG): container finished" podID="9bc08187-f796-411d-8c53-a92d0cac4d6f" containerID="1a81e32250cc10da2dee6a9cc3055ee48b768a1a9404ab69dc6e4a78533aa8a0" exitCode=0 Jun 09 08:49:32.901779 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:32.901684 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9bc08187-f796-411d-8c53-a92d0cac4d6f","Type":"ContainerDied","Data":"1a81e32250cc10da2dee6a9cc3055ee48b768a1a9404ab69dc6e4a78533aa8a0"} Jun 09 08:49:32.901870 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:32.901829 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9bc08187-f796-411d-8c53-a92d0cac4d6f","Type":"ContainerStarted","Data":"c81eef02a093c6c19f110bc0cbaec819c1d8bc1e2ed2923b69ff1e5758d6a590"} Jun 09 08:49:32.903372 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:32.903290 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-rls65" event={"ID":"32722df9-425b-407a-bbf7-e15e1abb9252","Type":"ContainerStarted","Data":"dcb60725d16ae94cd430e8529115d0a7ec4c835f2e8fcbe32a6c51f0254f0038"} Jun 09 08:49:32.906126 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:32.906104 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-qxtw7" Jun 09 08:49:32.913622 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:32.913571 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-qxtw7" podStartSLOduration=1.5821433539999998 podStartE2EDuration="22.913552857s" totalImagesPullingTime="21.331409503s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 08:49:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:49:32.91262258 +0000 UTC m=+250.357569931" watchObservedRunningTime="2026-06-09 08:49:32.913552857 +0000 UTC m=+250.358500211" Jun 09 08:49:33.934297 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:33.934089 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a79c3538-06d1-49f8-8aba-036d2c54a189","Type":"ContainerStarted","Data":"a943a5edf4a4211d53a06487fc9ee6050724d973b02a4bf1fad31270a47e98fa"} Jun 09 08:49:34.911674 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:34.911434 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/955c937e-7a98-4e3a-b4bb-52e78c5ac289-metrics-certs\") pod \"network-metrics-daemon-qchhg\" (UID: \"955c937e-7a98-4e3a-b4bb-52e78c5ac289\") " pod="openshift-multus/network-metrics-daemon-qchhg" Jun 09 08:49:34.915200 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:34.915169 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/955c937e-7a98-4e3a-b4bb-52e78c5ac289-metrics-certs\") pod \"network-metrics-daemon-qchhg\" (UID: \"955c937e-7a98-4e3a-b4bb-52e78c5ac289\") " pod="openshift-multus/network-metrics-daemon-qchhg" Jun 09 08:49:34.946363 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:34.946285 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a79c3538-06d1-49f8-8aba-036d2c54a189","Type":"ContainerStarted","Data":"b5c6257c20e22dd99613d21411e9df24a78a3fbedb72e5c7c7ae667f7e2463be"} Jun 09 08:49:34.956321 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:34.956284 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-db779c74f-bkk6m" event={"ID":"d83de3c6-c5e2-4e91-a8e2-0e347568ea69","Type":"ContainerStarted","Data":"99f842d4d873dd49f1f3b6db0d6f7e06ef1407bef4f2f82deabd9990ed167efa"} Jun 09 08:49:34.956576 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:34.956540 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-db779c74f-bkk6m" event={"ID":"d83de3c6-c5e2-4e91-a8e2-0e347568ea69","Type":"ContainerStarted","Data":"44c0969d85c936f4aa9ccdc21571fbb10dd63cd1c58c659682b6153ee384cce1"} Jun 09 08:49:34.956773 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:34.956756 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-db779c74f-bkk6m" event={"ID":"d83de3c6-c5e2-4e91-a8e2-0e347568ea69","Type":"ContainerStarted","Data":"cabf0e6ca336e2e605cedbf9a03d13833a77b88b614dd3ef25757d33597a1983"} Jun 09 08:49:34.956905 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:34.956893 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-db779c74f-bkk6m" Jun 09 08:49:34.973172 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:34.973146 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2sxlq\"" Jun 09 08:49:34.981368 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:34.981339 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qchhg" Jun 09 08:49:34.998329 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:34.998258 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.536961523 podStartE2EDuration="15.998237559s" totalImagesPullingTime="11.443406721s" totalInitContainerRuntime="17.869315ms" isStatefulPod=false podCreationTimestamp="2026-06-09 08:49:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:49:34.995409564 +0000 UTC m=+252.440356928" watchObservedRunningTime="2026-06-09 08:49:34.998237559 +0000 UTC m=+252.443184911" Jun 09 08:49:35.029556 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:35.029500 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-db779c74f-bkk6m" podStartSLOduration=2.744849936 podStartE2EDuration="14.02947967s" totalImagesPullingTime="11.284629734s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 08:49:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:49:35.028439476 +0000 UTC m=+252.473386847" watchObservedRunningTime="2026-06-09 08:49:35.02947967 +0000 UTC m=+252.474427022" Jun 09 08:49:35.223300 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:35.223217 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qchhg"] Jun 09 08:49:35.226538 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:49:35.226500 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod955c937e_7a98_4e3a_b4bb_52e78c5ac289.slice/crio-b5650aa6e20dba3b329c1a71b5d022642ed0e811da9c0a17fe64e3f124a40ba4 WatchSource:0}: Error finding container b5650aa6e20dba3b329c1a71b5d022642ed0e811da9c0a17fe64e3f124a40ba4: Status 404 returned error can't find the container with id b5650aa6e20dba3b329c1a71b5d022642ed0e811da9c0a17fe64e3f124a40ba4 Jun 09 08:49:35.964748 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:35.964705 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-rls65" event={"ID":"32722df9-425b-407a-bbf7-e15e1abb9252","Type":"ContainerStarted","Data":"5a72b6ef25a055502196575b985358979e14e2fc90e3f0f6fb7610a6856f43ca"} Jun 09 08:49:35.965962 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:35.965172 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-rls65" Jun 09 08:49:35.969517 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:35.968832 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qchhg" event={"ID":"955c937e-7a98-4e3a-b4bb-52e78c5ac289","Type":"ContainerStarted","Data":"b5650aa6e20dba3b329c1a71b5d022642ed0e811da9c0a17fe64e3f124a40ba4"} Jun 09 08:49:35.975131 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:35.975109 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-rls65" Jun 09 08:49:35.987566 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:35.986942 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-rls65" podStartSLOduration=10.28661166 podStartE2EDuration="12.986922809s" totalImagesPullingTime="2.700311149s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 08:49:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:49:35.985006842 +0000 UTC m=+253.429954192" watchObservedRunningTime="2026-06-09 08:49:35.986922809 +0000 UTC m=+253.431870161" Jun 09 08:49:38.986948 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:38.986855 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qchhg" event={"ID":"955c937e-7a98-4e3a-b4bb-52e78c5ac289","Type":"ContainerStarted","Data":"8ca058adcbe29568429d7616767d6e115b81a1787ca300df9d950e5cc0276a47"} Jun 09 08:49:38.986948 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:38.986943 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qchhg" event={"ID":"955c937e-7a98-4e3a-b4bb-52e78c5ac289","Type":"ContainerStarted","Data":"7cbd486efb80842ec454f11cf71a5927e91c908f4dc8dbb6dc192fe4d9695517"} Jun 09 08:49:38.991537 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:38.991510 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9bc08187-f796-411d-8c53-a92d0cac4d6f","Type":"ContainerStarted","Data":"a610c97f04a55f044d24c41e86aebce7e212dec4c63940e5777df2ff39017558"} Jun 09 08:49:38.991700 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:38.991575 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9bc08187-f796-411d-8c53-a92d0cac4d6f","Type":"ContainerStarted","Data":"de7586291ba5e982ba169be45551691c8bc4d8a9efc8662ceeaa256802fe8c28"} Jun 09 08:49:38.991700 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:38.991624 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9bc08187-f796-411d-8c53-a92d0cac4d6f","Type":"ContainerStarted","Data":"1b36a047cb293c78e86db77e55af73a39b63138f2cf86179d734baa5bcae299d"} Jun 09 08:49:38.991700 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:38.991677 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9bc08187-f796-411d-8c53-a92d0cac4d6f","Type":"ContainerStarted","Data":"5356f19249aa38a4b8c9dff260de4d55cd8fec39b2957350a937844ce331f40e"} Jun 09 08:49:38.991859 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:38.991725 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9bc08187-f796-411d-8c53-a92d0cac4d6f","Type":"ContainerStarted","Data":"8cb2f2fe6f2b6ed30c39c15a19c12b10b8cb942d4fa5da163cd7e51c0908af7d"} Jun 09 08:49:38.991859 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:38.991766 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9bc08187-f796-411d-8c53-a92d0cac4d6f","Type":"ContainerStarted","Data":"cb1fd687b8a4eeea8d3234ee836f934b575db01139bed2124c2ca7295ff78b97"} Jun 09 08:49:39.004048 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:39.003995 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-qchhg" podStartSLOduration=253.298420651 podStartE2EDuration="4m16.003976377s" totalImagesPullingTime="2.705555726s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 08:45:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:49:39.002365882 +0000 UTC m=+256.447313235" watchObservedRunningTime="2026-06-09 08:49:39.003976377 +0000 UTC m=+256.448923725" Jun 09 08:49:39.031456 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:39.031384 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=9.967020269 podStartE2EDuration="15.031361188s" totalImagesPullingTime="5.02930136s" totalInitContainerRuntime="35.039559ms" isStatefulPod=false podCreationTimestamp="2026-06-09 08:49:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:49:39.028695817 +0000 UTC m=+256.473643168" watchObservedRunningTime="2026-06-09 08:49:39.031361188 +0000 UTC m=+256.476308535" Jun 09 08:49:40.301476 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:40.301437 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:49:41.978739 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:49:41.978666 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-db779c74f-bkk6m" Jun 09 08:50:04.551389 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:50:04.551343 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-c97c5c49c-fn4jw" podUID="e28b9904-750f-489c-b660-e6b1f6a5848b" Jun 09 08:50:04.551389 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:50:04.551355 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-nsxkc" podUID="16df8afb-8164-41fd-9d0d-005830dda96c" Jun 09 08:50:05.106794 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:05.106759 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c97c5c49c-fn4jw" Jun 09 08:50:05.106794 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:05.106780 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nsxkc" Jun 09 08:50:07.116204 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:07.116171 2567 generic.go:356] "Generic (PLEG): container finished" podID="28bee076-40fc-40d5-a80c-1b9867359d6c" containerID="4a5fcf12c39270d05d7fc152ea6cec822911fd8496733c72bab7342aec117343" exitCode=0 Jun 09 08:50:07.116551 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:07.116223 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-pbsns" event={"ID":"28bee076-40fc-40d5-a80c-1b9867359d6c","Type":"ContainerDied","Data":"4a5fcf12c39270d05d7fc152ea6cec822911fd8496733c72bab7342aec117343"} Jun 09 08:50:07.116551 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:07.116538 2567 scope.go:117] "RemoveContainer" containerID="4a5fcf12c39270d05d7fc152ea6cec822911fd8496733c72bab7342aec117343" Jun 09 08:50:08.122428 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:08.122394 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-pbsns" event={"ID":"28bee076-40fc-40d5-a80c-1b9867359d6c","Type":"ContainerStarted","Data":"643a227b18d5b013a39f5b6d85839743f03c8db07bc8035b2b66acdc2da77562"} Jun 09 08:50:08.450974 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:08.450894 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e28b9904-750f-489c-b660-e6b1f6a5848b-registry-tls\") pod \"image-registry-c97c5c49c-fn4jw\" (UID: \"e28b9904-750f-489c-b660-e6b1f6a5848b\") " pod="openshift-image-registry/image-registry-c97c5c49c-fn4jw" Jun 09 08:50:08.450974 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:08.450965 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16df8afb-8164-41fd-9d0d-005830dda96c-metrics-tls\") pod \"dns-default-nsxkc\" (UID: \"16df8afb-8164-41fd-9d0d-005830dda96c\") " pod="openshift-dns/dns-default-nsxkc" Jun 09 08:50:08.453302 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:08.453265 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16df8afb-8164-41fd-9d0d-005830dda96c-metrics-tls\") pod \"dns-default-nsxkc\" (UID: \"16df8afb-8164-41fd-9d0d-005830dda96c\") " pod="openshift-dns/dns-default-nsxkc" Jun 09 08:50:08.453302 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:08.453267 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e28b9904-750f-489c-b660-e6b1f6a5848b-registry-tls\") pod \"image-registry-c97c5c49c-fn4jw\" (UID: \"e28b9904-750f-489c-b660-e6b1f6a5848b\") " pod="openshift-image-registry/image-registry-c97c5c49c-fn4jw" Jun 09 08:50:08.710732 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:08.710634 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ltbzg\"" Jun 09 08:50:08.710732 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:08.710637 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pvjgz\"" Jun 09 08:50:08.718601 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:08.718578 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c97c5c49c-fn4jw" Jun 09 08:50:08.718725 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:08.718703 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nsxkc" Jun 09 08:50:08.885504 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:08.885477 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c97c5c49c-fn4jw"] Jun 09 08:50:08.887573 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:50:08.887543 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode28b9904_750f_489c_b660_e6b1f6a5848b.slice/crio-6b8e1b76386d2c0deaa961b32cf859b1d3a1db2a4548fb5ecd27ad4fe918e5ab WatchSource:0}: Error finding container 6b8e1b76386d2c0deaa961b32cf859b1d3a1db2a4548fb5ecd27ad4fe918e5ab: Status 404 returned error can't find the container with id 6b8e1b76386d2c0deaa961b32cf859b1d3a1db2a4548fb5ecd27ad4fe918e5ab Jun 09 08:50:08.906015 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:08.905994 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nsxkc"] Jun 09 08:50:08.907571 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:50:08.907547 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16df8afb_8164_41fd_9d0d_005830dda96c.slice/crio-ced8c713ca87b335ad73030a70a84f4230174099d12df80eff04c426cd0c0034 WatchSource:0}: Error finding container ced8c713ca87b335ad73030a70a84f4230174099d12df80eff04c426cd0c0034: Status 404 returned error can't find the container with id ced8c713ca87b335ad73030a70a84f4230174099d12df80eff04c426cd0c0034 Jun 09 08:50:09.130539 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:09.130500 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c97c5c49c-fn4jw" event={"ID":"e28b9904-750f-489c-b660-e6b1f6a5848b","Type":"ContainerStarted","Data":"7a40be77e081f1605755f71b12626bdc40de1aa31045df71daa9ed5ec2bffb3c"} Jun 09 08:50:09.130983 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:09.130554 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c97c5c49c-fn4jw" event={"ID":"e28b9904-750f-489c-b660-e6b1f6a5848b","Type":"ContainerStarted","Data":"6b8e1b76386d2c0deaa961b32cf859b1d3a1db2a4548fb5ecd27ad4fe918e5ab"} Jun 09 08:50:09.130983 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:09.130632 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-c97c5c49c-fn4jw" Jun 09 08:50:09.131800 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:09.131781 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nsxkc" event={"ID":"16df8afb-8164-41fd-9d0d-005830dda96c","Type":"ContainerStarted","Data":"ced8c713ca87b335ad73030a70a84f4230174099d12df80eff04c426cd0c0034"} Jun 09 08:50:09.148752 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:09.148701 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-c97c5c49c-fn4jw" podStartSLOduration=264.148687779 podStartE2EDuration="4m24.148687779s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 08:45:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:50:09.147326005 +0000 UTC m=+286.592273358" watchObservedRunningTime="2026-06-09 08:50:09.148687779 +0000 UTC m=+286.593635129" Jun 09 08:50:12.147201 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:12.147159 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nsxkc" event={"ID":"16df8afb-8164-41fd-9d0d-005830dda96c","Type":"ContainerStarted","Data":"11522e522e1d3265e4a83808e7a25e621c614d69f7a4df7309287ff03535cfd9"} Jun 09 08:50:12.147603 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:12.147327 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-nsxkc" Jun 09 08:50:12.147603 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:12.147360 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nsxkc" event={"ID":"16df8afb-8164-41fd-9d0d-005830dda96c","Type":"ContainerStarted","Data":"ef9f21bdb6f81711bc5032dfedbe8eecbd252b58412b219ab2bcf52e1a2be311"} Jun 09 08:50:12.165172 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:12.165126 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-nsxkc" podStartSLOduration=251.987886034 podStartE2EDuration="4m14.165112926s" totalImagesPullingTime="2.177226892s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 08:45:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:50:12.16358359 +0000 UTC m=+289.608530941" watchObservedRunningTime="2026-06-09 08:50:12.165112926 +0000 UTC m=+289.610060285" Jun 09 08:50:13.153201 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:13.153164 2567 generic.go:356] "Generic (PLEG): container finished" podID="f3bf0a1a-491b-4abe-bb6f-7064fe8ac166" containerID="f910213e6c538e40e05edda1a2da08b245faf42976766e9707de4cff3372fe64" exitCode=0 Jun 09 08:50:13.153629 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:13.153221 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-pdvps" event={"ID":"f3bf0a1a-491b-4abe-bb6f-7064fe8ac166","Type":"ContainerDied","Data":"f910213e6c538e40e05edda1a2da08b245faf42976766e9707de4cff3372fe64"} Jun 09 08:50:13.153629 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:13.153624 2567 scope.go:117] "RemoveContainer" containerID="f910213e6c538e40e05edda1a2da08b245faf42976766e9707de4cff3372fe64" Jun 09 08:50:14.172823 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:14.172776 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-pdvps" event={"ID":"f3bf0a1a-491b-4abe-bb6f-7064fe8ac166","Type":"ContainerStarted","Data":"6802efe83adbbd8a9c52bd914ad275aa03a527fc51d7c06124ce5a97f775fe42"} Jun 09 08:50:22.155338 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:22.155308 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-nsxkc" Jun 09 08:50:23.015860 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:23.015830 2567 kubelet.go:1648] "Image garbage collection succeeded" Jun 09 08:50:25.301875 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:25.301840 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:50:25.321901 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:25.321875 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:50:26.246157 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:26.246124 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:50:28.722801 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:28.722760 2567 patch_prober.go:28] interesting pod/image-registry-c97c5c49c-fn4jw container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 08:50:28.723170 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:28.722817 2567 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-c97c5c49c-fn4jw" podUID="e28b9904-750f-489c-b660-e6b1f6a5848b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 08:50:30.140687 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:30.140641 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-c97c5c49c-fn4jw" Jun 09 08:50:38.656737 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:38.656696 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-c97c5c49c-fn4jw"] Jun 09 08:50:39.120055 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:39.120021 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 08:50:39.120412 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:39.120383 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a79c3538-06d1-49f8-8aba-036d2c54a189" containerName="alertmanager" containerID="cri-o://63498772265ee2d17fbd970b65a2dca49688a138cc43336321def5aec6d22541" gracePeriod=120 Jun 09 08:50:39.120521 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:39.120458 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a79c3538-06d1-49f8-8aba-036d2c54a189" containerName="kube-rbac-proxy-web" containerID="cri-o://f0ece9819d05ca2d46f7f3d01bacde531ee9156e1ddb3e7720aa813806923ca9" gracePeriod=120 Jun 09 08:50:39.120521 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:39.120481 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a79c3538-06d1-49f8-8aba-036d2c54a189" containerName="kube-rbac-proxy" containerID="cri-o://9c0548a1568b934228a42c0bf0f1e560b9a4b294838598b47b45c159da937528" gracePeriod=120 Jun 09 08:50:39.120692 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:39.120507 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a79c3538-06d1-49f8-8aba-036d2c54a189" containerName="config-reloader" containerID="cri-o://6685f7cc08fb331e6d1a3790f8f0a4894e847d8226acf6e9b438d0a86480aab2" gracePeriod=120 Jun 09 08:50:39.120692 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:39.120542 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a79c3538-06d1-49f8-8aba-036d2c54a189" containerName="prom-label-proxy" containerID="cri-o://b5c6257c20e22dd99613d21411e9df24a78a3fbedb72e5c7c7ae667f7e2463be" gracePeriod=120 Jun 09 08:50:39.120692 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:39.120443 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a79c3538-06d1-49f8-8aba-036d2c54a189" containerName="kube-rbac-proxy-metric" containerID="cri-o://a943a5edf4a4211d53a06487fc9ee6050724d973b02a4bf1fad31270a47e98fa" gracePeriod=120 Jun 09 08:50:39.296385 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:39.296354 2567 generic.go:356] "Generic (PLEG): container finished" podID="a79c3538-06d1-49f8-8aba-036d2c54a189" containerID="b5c6257c20e22dd99613d21411e9df24a78a3fbedb72e5c7c7ae667f7e2463be" exitCode=0 Jun 09 08:50:39.296385 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:39.296379 2567 generic.go:356] "Generic (PLEG): container finished" podID="a79c3538-06d1-49f8-8aba-036d2c54a189" containerID="9c0548a1568b934228a42c0bf0f1e560b9a4b294838598b47b45c159da937528" exitCode=0 Jun 09 08:50:39.296385 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:39.296386 2567 generic.go:356] "Generic (PLEG): container finished" podID="a79c3538-06d1-49f8-8aba-036d2c54a189" containerID="6685f7cc08fb331e6d1a3790f8f0a4894e847d8226acf6e9b438d0a86480aab2" exitCode=0 Jun 09 08:50:39.296385 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:39.296393 2567 generic.go:356] "Generic (PLEG): container finished" podID="a79c3538-06d1-49f8-8aba-036d2c54a189" containerID="63498772265ee2d17fbd970b65a2dca49688a138cc43336321def5aec6d22541" exitCode=0 Jun 09 08:50:39.296636 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:39.296429 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a79c3538-06d1-49f8-8aba-036d2c54a189","Type":"ContainerDied","Data":"b5c6257c20e22dd99613d21411e9df24a78a3fbedb72e5c7c7ae667f7e2463be"} Jun 09 08:50:39.296636 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:39.296511 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a79c3538-06d1-49f8-8aba-036d2c54a189","Type":"ContainerDied","Data":"9c0548a1568b934228a42c0bf0f1e560b9a4b294838598b47b45c159da937528"} Jun 09 08:50:39.296636 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:39.296538 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a79c3538-06d1-49f8-8aba-036d2c54a189","Type":"ContainerDied","Data":"6685f7cc08fb331e6d1a3790f8f0a4894e847d8226acf6e9b438d0a86480aab2"} Jun 09 08:50:39.296636 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:39.296562 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a79c3538-06d1-49f8-8aba-036d2c54a189","Type":"ContainerDied","Data":"63498772265ee2d17fbd970b65a2dca49688a138cc43336321def5aec6d22541"} Jun 09 08:50:40.310361 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:40.310327 2567 generic.go:356] "Generic (PLEG): container finished" podID="a79c3538-06d1-49f8-8aba-036d2c54a189" containerID="a943a5edf4a4211d53a06487fc9ee6050724d973b02a4bf1fad31270a47e98fa" exitCode=0 Jun 09 08:50:40.310361 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:40.310359 2567 generic.go:356] "Generic (PLEG): container finished" podID="a79c3538-06d1-49f8-8aba-036d2c54a189" containerID="f0ece9819d05ca2d46f7f3d01bacde531ee9156e1ddb3e7720aa813806923ca9" exitCode=0 Jun 09 08:50:40.310803 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:40.310491 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a79c3538-06d1-49f8-8aba-036d2c54a189","Type":"ContainerDied","Data":"a943a5edf4a4211d53a06487fc9ee6050724d973b02a4bf1fad31270a47e98fa"} Jun 09 08:50:40.310803 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:40.310567 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a79c3538-06d1-49f8-8aba-036d2c54a189","Type":"ContainerDied","Data":"f0ece9819d05ca2d46f7f3d01bacde531ee9156e1ddb3e7720aa813806923ca9"} Jun 09 08:50:40.369175 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:40.369150 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:50:40.418904 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:40.418874 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a79c3538-06d1-49f8-8aba-036d2c54a189-secret-alertmanager-kube-rbac-proxy\") pod \"a79c3538-06d1-49f8-8aba-036d2c54a189\" (UID: \"a79c3538-06d1-49f8-8aba-036d2c54a189\") " Jun 09 08:50:40.419073 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:40.418923 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a79c3538-06d1-49f8-8aba-036d2c54a189-secret-alertmanager-main-tls\") pod \"a79c3538-06d1-49f8-8aba-036d2c54a189\" (UID: \"a79c3538-06d1-49f8-8aba-036d2c54a189\") " Jun 09 08:50:40.419073 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:40.418969 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a79c3538-06d1-49f8-8aba-036d2c54a189-cluster-tls-config\") pod \"a79c3538-06d1-49f8-8aba-036d2c54a189\" (UID: \"a79c3538-06d1-49f8-8aba-036d2c54a189\") " Jun 09 08:50:40.419073 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:40.419008 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a79c3538-06d1-49f8-8aba-036d2c54a189-alertmanager-main-db\") pod \"a79c3538-06d1-49f8-8aba-036d2c54a189\" (UID: \"a79c3538-06d1-49f8-8aba-036d2c54a189\") " Jun 09 08:50:40.419073 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:40.419042 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8jxzm\" (UniqueName: \"kubernetes.io/projected/a79c3538-06d1-49f8-8aba-036d2c54a189-kube-api-access-8jxzm\") pod \"a79c3538-06d1-49f8-8aba-036d2c54a189\" (UID: \"a79c3538-06d1-49f8-8aba-036d2c54a189\") " Jun 09 08:50:40.419073 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:40.419066 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a79c3538-06d1-49f8-8aba-036d2c54a189-config-out\") pod \"a79c3538-06d1-49f8-8aba-036d2c54a189\" (UID: \"a79c3538-06d1-49f8-8aba-036d2c54a189\") " Jun 09 08:50:40.419347 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:40.419103 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a79c3538-06d1-49f8-8aba-036d2c54a189-web-config\") pod \"a79c3538-06d1-49f8-8aba-036d2c54a189\" (UID: \"a79c3538-06d1-49f8-8aba-036d2c54a189\") " Jun 09 08:50:40.419347 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:40.419148 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a79c3538-06d1-49f8-8aba-036d2c54a189-alertmanager-trusted-ca-bundle\") pod \"a79c3538-06d1-49f8-8aba-036d2c54a189\" (UID: \"a79c3538-06d1-49f8-8aba-036d2c54a189\") " Jun 09 08:50:40.419347 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:40.419186 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a79c3538-06d1-49f8-8aba-036d2c54a189-secret-alertmanager-kube-rbac-proxy-web\") pod \"a79c3538-06d1-49f8-8aba-036d2c54a189\" (UID: \"a79c3538-06d1-49f8-8aba-036d2c54a189\") " Jun 09 08:50:40.419347 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:40.419212 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a79c3538-06d1-49f8-8aba-036d2c54a189-config-volume\") pod \"a79c3538-06d1-49f8-8aba-036d2c54a189\" (UID: \"a79c3538-06d1-49f8-8aba-036d2c54a189\") " Jun 09 08:50:40.419347 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:40.419249 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a79c3538-06d1-49f8-8aba-036d2c54a189-tls-assets\") pod \"a79c3538-06d1-49f8-8aba-036d2c54a189\" (UID: \"a79c3538-06d1-49f8-8aba-036d2c54a189\") " Jun 09 08:50:40.419347 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:40.419294 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a79c3538-06d1-49f8-8aba-036d2c54a189-secret-alertmanager-kube-rbac-proxy-metric\") pod \"a79c3538-06d1-49f8-8aba-036d2c54a189\" (UID: \"a79c3538-06d1-49f8-8aba-036d2c54a189\") " Jun 09 08:50:40.419347 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:40.419325 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a79c3538-06d1-49f8-8aba-036d2c54a189-metrics-client-ca\") pod \"a79c3538-06d1-49f8-8aba-036d2c54a189\" (UID: \"a79c3538-06d1-49f8-8aba-036d2c54a189\") " Jun 09 08:50:40.420283 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:40.420036 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a79c3538-06d1-49f8-8aba-036d2c54a189-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "a79c3538-06d1-49f8-8aba-036d2c54a189" (UID: "a79c3538-06d1-49f8-8aba-036d2c54a189"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 08:50:40.420556 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:40.420519 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a79c3538-06d1-49f8-8aba-036d2c54a189-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "a79c3538-06d1-49f8-8aba-036d2c54a189" (UID: "a79c3538-06d1-49f8-8aba-036d2c54a189"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 08:50:40.420791 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:40.420762 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a79c3538-06d1-49f8-8aba-036d2c54a189-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "a79c3538-06d1-49f8-8aba-036d2c54a189" (UID: "a79c3538-06d1-49f8-8aba-036d2c54a189"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 08:50:40.424294 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:40.424239 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a79c3538-06d1-49f8-8aba-036d2c54a189-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "a79c3538-06d1-49f8-8aba-036d2c54a189" (UID: "a79c3538-06d1-49f8-8aba-036d2c54a189"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 08:50:40.424294 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:40.424250 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a79c3538-06d1-49f8-8aba-036d2c54a189-config-out" (OuterVolumeSpecName: "config-out") pod "a79c3538-06d1-49f8-8aba-036d2c54a189" (UID: "a79c3538-06d1-49f8-8aba-036d2c54a189"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 08:50:40.424601 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:40.424558 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a79c3538-06d1-49f8-8aba-036d2c54a189-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "a79c3538-06d1-49f8-8aba-036d2c54a189" (UID: "a79c3538-06d1-49f8-8aba-036d2c54a189"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 08:50:40.424601 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:40.424585 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a79c3538-06d1-49f8-8aba-036d2c54a189-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "a79c3538-06d1-49f8-8aba-036d2c54a189" (UID: "a79c3538-06d1-49f8-8aba-036d2c54a189"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 08:50:40.425265 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:40.425238 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a79c3538-06d1-49f8-8aba-036d2c54a189-config-volume" (OuterVolumeSpecName: "config-volume") pod "a79c3538-06d1-49f8-8aba-036d2c54a189" (UID: "a79c3538-06d1-49f8-8aba-036d2c54a189"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 08:50:40.425442 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:40.425414 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a79c3538-06d1-49f8-8aba-036d2c54a189-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "a79c3538-06d1-49f8-8aba-036d2c54a189" (UID: "a79c3538-06d1-49f8-8aba-036d2c54a189"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 08:50:40.425586 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:40.425564 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a79c3538-06d1-49f8-8aba-036d2c54a189-kube-api-access-8jxzm" (OuterVolumeSpecName: "kube-api-access-8jxzm") pod "a79c3538-06d1-49f8-8aba-036d2c54a189" (UID: "a79c3538-06d1-49f8-8aba-036d2c54a189"). InnerVolumeSpecName "kube-api-access-8jxzm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 08:50:40.426044 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:40.426014 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a79c3538-06d1-49f8-8aba-036d2c54a189-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "a79c3538-06d1-49f8-8aba-036d2c54a189" (UID: "a79c3538-06d1-49f8-8aba-036d2c54a189"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 08:50:40.429586 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:40.429558 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a79c3538-06d1-49f8-8aba-036d2c54a189-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "a79c3538-06d1-49f8-8aba-036d2c54a189" (UID: "a79c3538-06d1-49f8-8aba-036d2c54a189"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 08:50:40.436949 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:40.436920 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a79c3538-06d1-49f8-8aba-036d2c54a189-web-config" (OuterVolumeSpecName: "web-config") pod "a79c3538-06d1-49f8-8aba-036d2c54a189" (UID: "a79c3538-06d1-49f8-8aba-036d2c54a189"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 08:50:40.520765 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:40.520673 2567 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a79c3538-06d1-49f8-8aba-036d2c54a189-cluster-tls-config\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\"" Jun 09 08:50:40.520765 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:40.520708 2567 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a79c3538-06d1-49f8-8aba-036d2c54a189-alertmanager-main-db\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\"" Jun 09 08:50:40.520765 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:40.520719 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8jxzm\" (UniqueName: \"kubernetes.io/projected/a79c3538-06d1-49f8-8aba-036d2c54a189-kube-api-access-8jxzm\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\"" Jun 09 08:50:40.520765 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:40.520728 2567 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a79c3538-06d1-49f8-8aba-036d2c54a189-config-out\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\"" Jun 09 08:50:40.520765 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:40.520736 2567 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a79c3538-06d1-49f8-8aba-036d2c54a189-web-config\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\"" Jun 09 08:50:40.520765 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:40.520744 2567 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a79c3538-06d1-49f8-8aba-036d2c54a189-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\"" Jun 09 08:50:40.520765 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:40.520752 2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a79c3538-06d1-49f8-8aba-036d2c54a189-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\"" Jun 09 08:50:40.520765 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:40.520761 2567 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a79c3538-06d1-49f8-8aba-036d2c54a189-config-volume\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\"" Jun 09 08:50:40.520765 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:40.520769 2567 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a79c3538-06d1-49f8-8aba-036d2c54a189-tls-assets\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\"" Jun 09 08:50:40.521150 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:40.520778 2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a79c3538-06d1-49f8-8aba-036d2c54a189-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\"" Jun 09 08:50:40.521150 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:40.520786 2567 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a79c3538-06d1-49f8-8aba-036d2c54a189-metrics-client-ca\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\"" Jun 09 08:50:40.521150 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:40.520794 2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a79c3538-06d1-49f8-8aba-036d2c54a189-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\"" Jun 09 08:50:40.521150 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:40.520804 2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a79c3538-06d1-49f8-8aba-036d2c54a189-secret-alertmanager-main-tls\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\"" Jun 09 08:50:41.318380 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:41.318352 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:50:41.318840 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:41.318349 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a79c3538-06d1-49f8-8aba-036d2c54a189","Type":"ContainerDied","Data":"6dc88da1abaa9cd16bb8a3ae5728421bfbd86edbd02c4a7e93e164915619eefc"} Jun 09 08:50:41.318840 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:41.318527 2567 scope.go:117] "RemoveContainer" containerID="b5c6257c20e22dd99613d21411e9df24a78a3fbedb72e5c7c7ae667f7e2463be" Jun 09 08:50:41.326796 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:41.326777 2567 scope.go:117] "RemoveContainer" containerID="a943a5edf4a4211d53a06487fc9ee6050724d973b02a4bf1fad31270a47e98fa" Jun 09 08:50:41.334436 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:41.334416 2567 scope.go:117] "RemoveContainer" containerID="9c0548a1568b934228a42c0bf0f1e560b9a4b294838598b47b45c159da937528" Jun 09 08:50:41.340126 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:41.340102 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 08:50:41.343035 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:41.342963 2567 scope.go:117] "RemoveContainer" containerID="f0ece9819d05ca2d46f7f3d01bacde531ee9156e1ddb3e7720aa813806923ca9" Jun 09 08:50:41.344596 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:41.344576 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 08:50:41.351374 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:41.351350 2567 scope.go:117] "RemoveContainer" containerID="6685f7cc08fb331e6d1a3790f8f0a4894e847d8226acf6e9b438d0a86480aab2" Jun 09 08:50:41.358992 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:41.358971 2567 scope.go:117] "RemoveContainer" containerID="63498772265ee2d17fbd970b65a2dca49688a138cc43336321def5aec6d22541" Jun 09 08:50:41.367178 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:41.367155 2567 scope.go:117] "RemoveContainer" containerID="b96046ec4ce36c4ca54532bd10bc902a77c31b8a4484af8bba203945e1476088" Jun 09 08:50:43.074134 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:43.074099 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a79c3538-06d1-49f8-8aba-036d2c54a189" path="/var/lib/kubelet/pods/a79c3538-06d1-49f8-8aba-036d2c54a189/volumes" Jun 09 08:50:43.361269 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:43.361180 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 08:50:43.361533 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:43.361474 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9bc08187-f796-411d-8c53-a92d0cac4d6f" containerName="prometheus" containerID="cri-o://cb1fd687b8a4eeea8d3234ee836f934b575db01139bed2124c2ca7295ff78b97" gracePeriod=600 Jun 09 08:50:43.361825 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:43.361523 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9bc08187-f796-411d-8c53-a92d0cac4d6f" containerName="kube-rbac-proxy-thanos" containerID="cri-o://a610c97f04a55f044d24c41e86aebce7e212dec4c63940e5777df2ff39017558" gracePeriod=600 Jun 09 08:50:43.361982 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:43.361561 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9bc08187-f796-411d-8c53-a92d0cac4d6f" containerName="kube-rbac-proxy" containerID="cri-o://de7586291ba5e982ba169be45551691c8bc4d8a9efc8662ceeaa256802fe8c28" gracePeriod=600 Jun 09 08:50:43.361982 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:43.361564 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9bc08187-f796-411d-8c53-a92d0cac4d6f" containerName="kube-rbac-proxy-web" containerID="cri-o://1b36a047cb293c78e86db77e55af73a39b63138f2cf86179d734baa5bcae299d" gracePeriod=600 Jun 09 08:50:43.362115 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:43.361591 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9bc08187-f796-411d-8c53-a92d0cac4d6f" containerName="thanos-sidecar" containerID="cri-o://5356f19249aa38a4b8c9dff260de4d55cd8fec39b2957350a937844ce331f40e" gracePeriod=600 Jun 09 08:50:43.362179 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:43.361615 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9bc08187-f796-411d-8c53-a92d0cac4d6f" containerName="config-reloader" containerID="cri-o://8cb2f2fe6f2b6ed30c39c15a19c12b10b8cb942d4fa5da163cd7e51c0908af7d" gracePeriod=600 Jun 09 08:50:43.603965 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:43.603940 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:50:43.748916 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:43.748815 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9bc08187-f796-411d-8c53-a92d0cac4d6f-tls-assets\") pod \"9bc08187-f796-411d-8c53-a92d0cac4d6f\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " Jun 09 08:50:43.748916 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:43.748888 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bc08187-f796-411d-8c53-a92d0cac4d6f-prometheus-trusted-ca-bundle\") pod \"9bc08187-f796-411d-8c53-a92d0cac4d6f\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " Jun 09 08:50:43.749119 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:43.748932 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9bc08187-f796-411d-8c53-a92d0cac4d6f-secret-grpc-tls\") pod \"9bc08187-f796-411d-8c53-a92d0cac4d6f\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " Jun 09 08:50:43.749119 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:43.748962 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9bc08187-f796-411d-8c53-a92d0cac4d6f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"9bc08187-f796-411d-8c53-a92d0cac4d6f\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " Jun 09 08:50:43.749119 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:43.748988 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bc08187-f796-411d-8c53-a92d0cac4d6f-configmap-serving-certs-ca-bundle\") pod \"9bc08187-f796-411d-8c53-a92d0cac4d6f\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " Jun 09 08:50:43.749119 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:43.749022 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9bc08187-f796-411d-8c53-a92d0cac4d6f-prometheus-k8s-rulefiles-2\") pod \"9bc08187-f796-411d-8c53-a92d0cac4d6f\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " Jun 09 08:50:43.749119 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:43.749045 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9bc08187-f796-411d-8c53-a92d0cac4d6f-prometheus-k8s-rulefiles-1\") pod \"9bc08187-f796-411d-8c53-a92d0cac4d6f\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " Jun 09 08:50:43.749119 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:43.749075 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bc08187-f796-411d-8c53-a92d0cac4d6f-configmap-kubelet-serving-ca-bundle\") pod \"9bc08187-f796-411d-8c53-a92d0cac4d6f\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " Jun 09 08:50:43.749119 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:43.749099 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9bc08187-f796-411d-8c53-a92d0cac4d6f-secret-metrics-client-certs\") pod \"9bc08187-f796-411d-8c53-a92d0cac4d6f\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " Jun 09 08:50:43.749119 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:43.749122 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9bc08187-f796-411d-8c53-a92d0cac4d6f-config\") pod \"9bc08187-f796-411d-8c53-a92d0cac4d6f\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " Jun 09 08:50:43.749557 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:43.749348 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9bc08187-f796-411d-8c53-a92d0cac4d6f-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "9bc08187-f796-411d-8c53-a92d0cac4d6f" (UID: "9bc08187-f796-411d-8c53-a92d0cac4d6f"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 08:50:43.749557 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:43.749386 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9bc08187-f796-411d-8c53-a92d0cac4d6f-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "9bc08187-f796-411d-8c53-a92d0cac4d6f" (UID: "9bc08187-f796-411d-8c53-a92d0cac4d6f"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 08:50:43.749557 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:43.749396 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9bc08187-f796-411d-8c53-a92d0cac4d6f-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "9bc08187-f796-411d-8c53-a92d0cac4d6f" (UID: "9bc08187-f796-411d-8c53-a92d0cac4d6f"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 08:50:43.749557 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:43.749450 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9bc08187-f796-411d-8c53-a92d0cac4d6f-web-config\") pod \"9bc08187-f796-411d-8c53-a92d0cac4d6f\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " Jun 09 08:50:43.749557 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:43.749521 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9bc08187-f796-411d-8c53-a92d0cac4d6f-secret-kube-rbac-proxy\") pod \"9bc08187-f796-411d-8c53-a92d0cac4d6f\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " Jun 09 08:50:43.749847 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:43.749577 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9bc08187-f796-411d-8c53-a92d0cac4d6f-configmap-metrics-client-ca\") pod \"9bc08187-f796-411d-8c53-a92d0cac4d6f\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " Jun 09 08:50:43.749847 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:43.749621 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9bc08187-f796-411d-8c53-a92d0cac4d6f-config-out\") pod \"9bc08187-f796-411d-8c53-a92d0cac4d6f\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " Jun 09 08:50:43.749847 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:43.749633 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9bc08187-f796-411d-8c53-a92d0cac4d6f-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "9bc08187-f796-411d-8c53-a92d0cac4d6f" (UID: "9bc08187-f796-411d-8c53-a92d0cac4d6f"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 08:50:43.749847 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:43.749692 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b2bc2\" (UniqueName: \"kubernetes.io/projected/9bc08187-f796-411d-8c53-a92d0cac4d6f-kube-api-access-b2bc2\") pod \"9bc08187-f796-411d-8c53-a92d0cac4d6f\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " Jun 09 08:50:43.749847 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:43.749719 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9bc08187-f796-411d-8c53-a92d0cac4d6f-prometheus-k8s-db\") pod \"9bc08187-f796-411d-8c53-a92d0cac4d6f\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " Jun 09 08:50:43.749847 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:43.749758 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9bc08187-f796-411d-8c53-a92d0cac4d6f-prometheus-k8s-rulefiles-0\") pod \"9bc08187-f796-411d-8c53-a92d0cac4d6f\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " Jun 09 08:50:43.749847 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:43.749803 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9bc08187-f796-411d-8c53-a92d0cac4d6f-secret-prometheus-k8s-tls\") pod \"9bc08187-f796-411d-8c53-a92d0cac4d6f\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " Jun 09 08:50:43.749847 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:43.749830 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9bc08187-f796-411d-8c53-a92d0cac4d6f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"9bc08187-f796-411d-8c53-a92d0cac4d6f\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " Jun 09 08:50:43.750219 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:43.749854 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9bc08187-f796-411d-8c53-a92d0cac4d6f-thanos-prometheus-http-client-file\") pod \"9bc08187-f796-411d-8c53-a92d0cac4d6f\" (UID: \"9bc08187-f796-411d-8c53-a92d0cac4d6f\") " Jun 09 08:50:43.750219 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:43.749924 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9bc08187-f796-411d-8c53-a92d0cac4d6f-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "9bc08187-f796-411d-8c53-a92d0cac4d6f" (UID: "9bc08187-f796-411d-8c53-a92d0cac4d6f"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 08:50:43.750219 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:43.750135 2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bc08187-f796-411d-8c53-a92d0cac4d6f-prometheus-trusted-ca-bundle\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\"" Jun 09 08:50:43.750219 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:43.750154 2567 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bc08187-f796-411d-8c53-a92d0cac4d6f-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\"" Jun 09 08:50:43.750219 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:43.750169 2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9bc08187-f796-411d-8c53-a92d0cac4d6f-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\"" Jun 09 08:50:43.750219 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:43.750182 2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9bc08187-f796-411d-8c53-a92d0cac4d6f-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\"" Jun 09 08:50:43.750219 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:43.750208 2567 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bc08187-f796-411d-8c53-a92d0cac4d6f-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\"" Jun 09 08:50:43.751794 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:43.751316 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bc08187-f796-411d-8c53-a92d0cac4d6f-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "9bc08187-f796-411d-8c53-a92d0cac4d6f" (UID: "9bc08187-f796-411d-8c53-a92d0cac4d6f"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 08:50:43.751794 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:43.751537 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9bc08187-f796-411d-8c53-a92d0cac4d6f-config" (OuterVolumeSpecName: "config") pod "9bc08187-f796-411d-8c53-a92d0cac4d6f" (UID: "9bc08187-f796-411d-8c53-a92d0cac4d6f"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 08:50:43.751794 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:43.751543 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bc08187-f796-411d-8c53-a92d0cac4d6f-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "9bc08187-f796-411d-8c53-a92d0cac4d6f" (UID: "9bc08187-f796-411d-8c53-a92d0cac4d6f"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 08:50:43.751794 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:43.751690 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9bc08187-f796-411d-8c53-a92d0cac4d6f-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "9bc08187-f796-411d-8c53-a92d0cac4d6f" (UID: "9bc08187-f796-411d-8c53-a92d0cac4d6f"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 08:50:43.751794 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:43.751705 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9bc08187-f796-411d-8c53-a92d0cac4d6f-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "9bc08187-f796-411d-8c53-a92d0cac4d6f" (UID: "9bc08187-f796-411d-8c53-a92d0cac4d6f"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 08:50:43.751794 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:43.751751 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9bc08187-f796-411d-8c53-a92d0cac4d6f-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "9bc08187-f796-411d-8c53-a92d0cac4d6f" (UID: "9bc08187-f796-411d-8c53-a92d0cac4d6f"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 08:50:43.752498 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:43.752143 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9bc08187-f796-411d-8c53-a92d0cac4d6f-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "9bc08187-f796-411d-8c53-a92d0cac4d6f" (UID: "9bc08187-f796-411d-8c53-a92d0cac4d6f"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 08:50:43.752498 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:43.752374 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bc08187-f796-411d-8c53-a92d0cac4d6f-kube-api-access-b2bc2" (OuterVolumeSpecName: "kube-api-access-b2bc2") pod "9bc08187-f796-411d-8c53-a92d0cac4d6f" (UID: "9bc08187-f796-411d-8c53-a92d0cac4d6f"). InnerVolumeSpecName "kube-api-access-b2bc2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 08:50:43.752986 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:43.752953 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9bc08187-f796-411d-8c53-a92d0cac4d6f-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "9bc08187-f796-411d-8c53-a92d0cac4d6f" (UID: "9bc08187-f796-411d-8c53-a92d0cac4d6f"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 08:50:43.753627 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:43.753600 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9bc08187-f796-411d-8c53-a92d0cac4d6f-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "9bc08187-f796-411d-8c53-a92d0cac4d6f" (UID: "9bc08187-f796-411d-8c53-a92d0cac4d6f"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 08:50:43.753864 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:43.753842 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9bc08187-f796-411d-8c53-a92d0cac4d6f-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "9bc08187-f796-411d-8c53-a92d0cac4d6f" (UID: "9bc08187-f796-411d-8c53-a92d0cac4d6f"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 08:50:43.753938 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:43.753893 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bc08187-f796-411d-8c53-a92d0cac4d6f-config-out" (OuterVolumeSpecName: "config-out") pod "9bc08187-f796-411d-8c53-a92d0cac4d6f" (UID: "9bc08187-f796-411d-8c53-a92d0cac4d6f"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 08:50:43.753938 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:43.753903 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9bc08187-f796-411d-8c53-a92d0cac4d6f-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "9bc08187-f796-411d-8c53-a92d0cac4d6f" (UID: "9bc08187-f796-411d-8c53-a92d0cac4d6f"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 08:50:43.754319 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:43.754298 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9bc08187-f796-411d-8c53-a92d0cac4d6f-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "9bc08187-f796-411d-8c53-a92d0cac4d6f" (UID: "9bc08187-f796-411d-8c53-a92d0cac4d6f"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 08:50:43.764238 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:43.764218 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9bc08187-f796-411d-8c53-a92d0cac4d6f-web-config" (OuterVolumeSpecName: "web-config") pod "9bc08187-f796-411d-8c53-a92d0cac4d6f" (UID: "9bc08187-f796-411d-8c53-a92d0cac4d6f"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 08:50:43.850735 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:43.850702 2567 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9bc08187-f796-411d-8c53-a92d0cac4d6f-configmap-metrics-client-ca\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\"" Jun 09 08:50:43.850864 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:43.850740 2567 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9bc08187-f796-411d-8c53-a92d0cac4d6f-config-out\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\"" Jun 09 08:50:43.850864 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:43.850758 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b2bc2\" (UniqueName: \"kubernetes.io/projected/9bc08187-f796-411d-8c53-a92d0cac4d6f-kube-api-access-b2bc2\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\"" Jun 09 08:50:43.850864 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:43.850773 2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9bc08187-f796-411d-8c53-a92d0cac4d6f-prometheus-k8s-db\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\"" Jun 09 08:50:43.850864 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:43.850788 2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9bc08187-f796-411d-8c53-a92d0cac4d6f-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\"" Jun 09 08:50:43.850864 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:43.850802 2567 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9bc08187-f796-411d-8c53-a92d0cac4d6f-secret-prometheus-k8s-tls\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\"" Jun 09 08:50:43.850864 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:43.850820 2567 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9bc08187-f796-411d-8c53-a92d0cac4d6f-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\"" Jun 09 08:50:43.850864 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:43.850836 2567 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9bc08187-f796-411d-8c53-a92d0cac4d6f-thanos-prometheus-http-client-file\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\"" Jun 09 08:50:43.850864 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:43.850852 2567 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9bc08187-f796-411d-8c53-a92d0cac4d6f-tls-assets\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\"" Jun 09 08:50:43.850864 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:43.850865 2567 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9bc08187-f796-411d-8c53-a92d0cac4d6f-secret-grpc-tls\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\"" Jun 09 08:50:43.851146 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:43.850880 2567 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9bc08187-f796-411d-8c53-a92d0cac4d6f-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\"" Jun 09 08:50:43.851146 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:43.850896 2567 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9bc08187-f796-411d-8c53-a92d0cac4d6f-secret-metrics-client-certs\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\"" Jun 09 08:50:43.851146 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:43.850910 2567 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/9bc08187-f796-411d-8c53-a92d0cac4d6f-config\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\"" Jun 09 08:50:43.851146 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:43.850924 2567 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9bc08187-f796-411d-8c53-a92d0cac4d6f-web-config\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\"" Jun 09 08:50:43.851146 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:43.850937 2567 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9bc08187-f796-411d-8c53-a92d0cac4d6f-secret-kube-rbac-proxy\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\"" Jun 09 08:50:44.336847 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.336804 2567 generic.go:356] "Generic (PLEG): container finished" podID="9bc08187-f796-411d-8c53-a92d0cac4d6f" containerID="a610c97f04a55f044d24c41e86aebce7e212dec4c63940e5777df2ff39017558" exitCode=0 Jun 09 08:50:44.336847 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.336834 2567 generic.go:356] "Generic (PLEG): container finished" podID="9bc08187-f796-411d-8c53-a92d0cac4d6f" containerID="de7586291ba5e982ba169be45551691c8bc4d8a9efc8662ceeaa256802fe8c28" exitCode=0 Jun 09 08:50:44.336847 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.336840 2567 generic.go:356] "Generic (PLEG): container finished" podID="9bc08187-f796-411d-8c53-a92d0cac4d6f" containerID="1b36a047cb293c78e86db77e55af73a39b63138f2cf86179d734baa5bcae299d" exitCode=0 Jun 09 08:50:44.336847 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.336846 2567 generic.go:356] "Generic (PLEG): container finished" podID="9bc08187-f796-411d-8c53-a92d0cac4d6f" containerID="5356f19249aa38a4b8c9dff260de4d55cd8fec39b2957350a937844ce331f40e" exitCode=0 Jun 09 08:50:44.336847 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.336851 2567 generic.go:356] "Generic (PLEG): container finished" podID="9bc08187-f796-411d-8c53-a92d0cac4d6f" containerID="8cb2f2fe6f2b6ed30c39c15a19c12b10b8cb942d4fa5da163cd7e51c0908af7d" exitCode=0 Jun 09 08:50:44.336847 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.336856 2567 generic.go:356] "Generic (PLEG): container finished" podID="9bc08187-f796-411d-8c53-a92d0cac4d6f" containerID="cb1fd687b8a4eeea8d3234ee836f934b575db01139bed2124c2ca7295ff78b97" exitCode=0 Jun 09 08:50:44.337630 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.336878 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:50:44.337630 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.336889 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9bc08187-f796-411d-8c53-a92d0cac4d6f","Type":"ContainerDied","Data":"a610c97f04a55f044d24c41e86aebce7e212dec4c63940e5777df2ff39017558"} Jun 09 08:50:44.337630 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.336967 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9bc08187-f796-411d-8c53-a92d0cac4d6f","Type":"ContainerDied","Data":"de7586291ba5e982ba169be45551691c8bc4d8a9efc8662ceeaa256802fe8c28"} Jun 09 08:50:44.337630 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.336995 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9bc08187-f796-411d-8c53-a92d0cac4d6f","Type":"ContainerDied","Data":"1b36a047cb293c78e86db77e55af73a39b63138f2cf86179d734baa5bcae299d"} Jun 09 08:50:44.337630 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.337022 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9bc08187-f796-411d-8c53-a92d0cac4d6f","Type":"ContainerDied","Data":"5356f19249aa38a4b8c9dff260de4d55cd8fec39b2957350a937844ce331f40e"} Jun 09 08:50:44.337630 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.337035 2567 scope.go:117] "RemoveContainer" containerID="a610c97f04a55f044d24c41e86aebce7e212dec4c63940e5777df2ff39017558" Jun 09 08:50:44.337630 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.337060 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9bc08187-f796-411d-8c53-a92d0cac4d6f","Type":"ContainerDied","Data":"8cb2f2fe6f2b6ed30c39c15a19c12b10b8cb942d4fa5da163cd7e51c0908af7d"} Jun 09 08:50:44.337630 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.337099 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9bc08187-f796-411d-8c53-a92d0cac4d6f","Type":"ContainerDied","Data":"cb1fd687b8a4eeea8d3234ee836f934b575db01139bed2124c2ca7295ff78b97"} Jun 09 08:50:44.337630 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.337138 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9bc08187-f796-411d-8c53-a92d0cac4d6f","Type":"ContainerDied","Data":"c81eef02a093c6c19f110bc0cbaec819c1d8bc1e2ed2923b69ff1e5758d6a590"} Jun 09 08:50:44.347620 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.347453 2567 scope.go:117] "RemoveContainer" containerID="de7586291ba5e982ba169be45551691c8bc4d8a9efc8662ceeaa256802fe8c28" Jun 09 08:50:44.355109 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.355092 2567 scope.go:117] "RemoveContainer" containerID="1b36a047cb293c78e86db77e55af73a39b63138f2cf86179d734baa5bcae299d" Jun 09 08:50:44.361861 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.361842 2567 scope.go:117] "RemoveContainer" containerID="5356f19249aa38a4b8c9dff260de4d55cd8fec39b2957350a937844ce331f40e" Jun 09 08:50:44.367495 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.367474 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 08:50:44.369703 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.369673 2567 scope.go:117] "RemoveContainer" containerID="8cb2f2fe6f2b6ed30c39c15a19c12b10b8cb942d4fa5da163cd7e51c0908af7d" Jun 09 08:50:44.371172 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.371150 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 08:50:44.376541 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.376524 2567 scope.go:117] "RemoveContainer" containerID="cb1fd687b8a4eeea8d3234ee836f934b575db01139bed2124c2ca7295ff78b97" Jun 09 08:50:44.395984 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.395962 2567 scope.go:117] "RemoveContainer" containerID="1a81e32250cc10da2dee6a9cc3055ee48b768a1a9404ab69dc6e4a78533aa8a0" Jun 09 08:50:44.403711 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.403687 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 08:50:44.404019 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.404006 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bc08187-f796-411d-8c53-a92d0cac4d6f" containerName="kube-rbac-proxy" Jun 09 08:50:44.404066 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.404022 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bc08187-f796-411d-8c53-a92d0cac4d6f" containerName="kube-rbac-proxy" Jun 09 08:50:44.404066 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.404034 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a79c3538-06d1-49f8-8aba-036d2c54a189" containerName="prom-label-proxy" Jun 09 08:50:44.404066 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.404040 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a79c3538-06d1-49f8-8aba-036d2c54a189" containerName="prom-label-proxy" Jun 09 08:50:44.404066 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.404048 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bc08187-f796-411d-8c53-a92d0cac4d6f" containerName="kube-rbac-proxy-web" Jun 09 08:50:44.404066 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.404055 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bc08187-f796-411d-8c53-a92d0cac4d6f" containerName="kube-rbac-proxy-web" Jun 09 08:50:44.404066 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.404062 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a79c3538-06d1-49f8-8aba-036d2c54a189" containerName="kube-rbac-proxy-web" Jun 09 08:50:44.404066 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.404068 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a79c3538-06d1-49f8-8aba-036d2c54a189" containerName="kube-rbac-proxy-web" Jun 09 08:50:44.404270 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.404073 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a79c3538-06d1-49f8-8aba-036d2c54a189" containerName="kube-rbac-proxy" Jun 09 08:50:44.404270 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.404079 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a79c3538-06d1-49f8-8aba-036d2c54a189" containerName="kube-rbac-proxy" Jun 09 08:50:44.404270 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.404087 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bc08187-f796-411d-8c53-a92d0cac4d6f" containerName="thanos-sidecar" Jun 09 08:50:44.404270 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.404092 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bc08187-f796-411d-8c53-a92d0cac4d6f" containerName="thanos-sidecar" Jun 09 08:50:44.404270 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.404101 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a79c3538-06d1-49f8-8aba-036d2c54a189" containerName="config-reloader" Jun 09 08:50:44.404270 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.404106 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a79c3538-06d1-49f8-8aba-036d2c54a189" containerName="config-reloader" Jun 09 08:50:44.404270 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.404112 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a79c3538-06d1-49f8-8aba-036d2c54a189" containerName="kube-rbac-proxy-metric" Jun 09 08:50:44.404270 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.404118 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a79c3538-06d1-49f8-8aba-036d2c54a189" containerName="kube-rbac-proxy-metric" Jun 09 08:50:44.404270 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.404125 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a79c3538-06d1-49f8-8aba-036d2c54a189" containerName="init-config-reloader" Jun 09 08:50:44.404270 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.404131 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a79c3538-06d1-49f8-8aba-036d2c54a189" containerName="init-config-reloader" Jun 09 08:50:44.404270 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.404138 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bc08187-f796-411d-8c53-a92d0cac4d6f" containerName="init-config-reloader" Jun 09 08:50:44.404270 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.404143 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bc08187-f796-411d-8c53-a92d0cac4d6f" containerName="init-config-reloader" Jun 09 08:50:44.404270 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.404149 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bc08187-f796-411d-8c53-a92d0cac4d6f" containerName="prometheus" Jun 09 08:50:44.404270 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.404154 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bc08187-f796-411d-8c53-a92d0cac4d6f" containerName="prometheus" Jun 09 08:50:44.404270 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.404161 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a79c3538-06d1-49f8-8aba-036d2c54a189" containerName="alertmanager" Jun 09 08:50:44.404270 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.404165 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a79c3538-06d1-49f8-8aba-036d2c54a189" containerName="alertmanager" Jun 09 08:50:44.404270 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.404173 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bc08187-f796-411d-8c53-a92d0cac4d6f" containerName="config-reloader" Jun 09 08:50:44.404270 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.404177 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bc08187-f796-411d-8c53-a92d0cac4d6f" containerName="config-reloader" Jun 09 08:50:44.404270 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.404182 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bc08187-f796-411d-8c53-a92d0cac4d6f" containerName="kube-rbac-proxy-thanos" Jun 09 08:50:44.404270 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.404187 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bc08187-f796-411d-8c53-a92d0cac4d6f" containerName="kube-rbac-proxy-thanos" Jun 09 08:50:44.404270 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.404234 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a79c3538-06d1-49f8-8aba-036d2c54a189" containerName="alertmanager" Jun 09 08:50:44.404270 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.404240 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a79c3538-06d1-49f8-8aba-036d2c54a189" containerName="config-reloader" Jun 09 08:50:44.404270 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.404245 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a79c3538-06d1-49f8-8aba-036d2c54a189" containerName="kube-rbac-proxy-web" Jun 09 08:50:44.404270 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.404251 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bc08187-f796-411d-8c53-a92d0cac4d6f" containerName="thanos-sidecar" Jun 09 08:50:44.404270 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.404257 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a79c3538-06d1-49f8-8aba-036d2c54a189" containerName="prom-label-proxy" Jun 09 08:50:44.404270 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.404266 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a79c3538-06d1-49f8-8aba-036d2c54a189" containerName="kube-rbac-proxy" Jun 09 08:50:44.404270 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.404271 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bc08187-f796-411d-8c53-a92d0cac4d6f" containerName="config-reloader" Jun 09 08:50:44.404270 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.404278 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bc08187-f796-411d-8c53-a92d0cac4d6f" containerName="kube-rbac-proxy-thanos" Jun 09 08:50:44.404270 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.404284 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bc08187-f796-411d-8c53-a92d0cac4d6f" containerName="prometheus" Jun 09 08:50:44.404270 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.404289 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bc08187-f796-411d-8c53-a92d0cac4d6f" containerName="kube-rbac-proxy-web" Jun 09 08:50:44.406340 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.404295 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a79c3538-06d1-49f8-8aba-036d2c54a189" containerName="kube-rbac-proxy-metric" Jun 09 08:50:44.406340 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.404302 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bc08187-f796-411d-8c53-a92d0cac4d6f" containerName="kube-rbac-proxy" Jun 09 08:50:44.406340 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.404403 2567 scope.go:117] "RemoveContainer" containerID="a610c97f04a55f044d24c41e86aebce7e212dec4c63940e5777df2ff39017558" Jun 09 08:50:44.406340 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:50:44.404830 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a610c97f04a55f044d24c41e86aebce7e212dec4c63940e5777df2ff39017558\": container with ID starting with a610c97f04a55f044d24c41e86aebce7e212dec4c63940e5777df2ff39017558 not found: ID does not exist" containerID="a610c97f04a55f044d24c41e86aebce7e212dec4c63940e5777df2ff39017558" Jun 09 08:50:44.406340 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.404864 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a610c97f04a55f044d24c41e86aebce7e212dec4c63940e5777df2ff39017558"} err="failed to get container status \"a610c97f04a55f044d24c41e86aebce7e212dec4c63940e5777df2ff39017558\": rpc error: code = NotFound desc = could not find container \"a610c97f04a55f044d24c41e86aebce7e212dec4c63940e5777df2ff39017558\": container with ID starting with a610c97f04a55f044d24c41e86aebce7e212dec4c63940e5777df2ff39017558 not found: ID does not exist" Jun 09 08:50:44.406340 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.404912 2567 scope.go:117] "RemoveContainer" containerID="de7586291ba5e982ba169be45551691c8bc4d8a9efc8662ceeaa256802fe8c28" Jun 09 08:50:44.406340 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:50:44.405240 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de7586291ba5e982ba169be45551691c8bc4d8a9efc8662ceeaa256802fe8c28\": container with ID starting with de7586291ba5e982ba169be45551691c8bc4d8a9efc8662ceeaa256802fe8c28 not found: ID does not exist" containerID="de7586291ba5e982ba169be45551691c8bc4d8a9efc8662ceeaa256802fe8c28" Jun 09 08:50:44.406340 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.405273 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de7586291ba5e982ba169be45551691c8bc4d8a9efc8662ceeaa256802fe8c28"} err="failed to get container status \"de7586291ba5e982ba169be45551691c8bc4d8a9efc8662ceeaa256802fe8c28\": rpc error: code = NotFound desc = could not find container \"de7586291ba5e982ba169be45551691c8bc4d8a9efc8662ceeaa256802fe8c28\": container with ID starting with de7586291ba5e982ba169be45551691c8bc4d8a9efc8662ceeaa256802fe8c28 not found: ID does not exist" Jun 09 08:50:44.406340 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.405297 2567 scope.go:117] "RemoveContainer" containerID="1b36a047cb293c78e86db77e55af73a39b63138f2cf86179d734baa5bcae299d" Jun 09 08:50:44.406340 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:50:44.405587 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b36a047cb293c78e86db77e55af73a39b63138f2cf86179d734baa5bcae299d\": container with ID starting with 1b36a047cb293c78e86db77e55af73a39b63138f2cf86179d734baa5bcae299d not found: ID does not exist" containerID="1b36a047cb293c78e86db77e55af73a39b63138f2cf86179d734baa5bcae299d" Jun 09 08:50:44.406340 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.405615 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b36a047cb293c78e86db77e55af73a39b63138f2cf86179d734baa5bcae299d"} err="failed to get container status \"1b36a047cb293c78e86db77e55af73a39b63138f2cf86179d734baa5bcae299d\": rpc error: code = NotFound desc = could not find container \"1b36a047cb293c78e86db77e55af73a39b63138f2cf86179d734baa5bcae299d\": container with ID starting with 1b36a047cb293c78e86db77e55af73a39b63138f2cf86179d734baa5bcae299d not found: ID does not exist" Jun 09 08:50:44.406340 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.405668 2567 scope.go:117] "RemoveContainer" containerID="5356f19249aa38a4b8c9dff260de4d55cd8fec39b2957350a937844ce331f40e" Jun 09 08:50:44.406340 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:50:44.406034 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5356f19249aa38a4b8c9dff260de4d55cd8fec39b2957350a937844ce331f40e\": container with ID starting with 5356f19249aa38a4b8c9dff260de4d55cd8fec39b2957350a937844ce331f40e not found: ID does not exist" containerID="5356f19249aa38a4b8c9dff260de4d55cd8fec39b2957350a937844ce331f40e" Jun 09 08:50:44.406340 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.406062 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5356f19249aa38a4b8c9dff260de4d55cd8fec39b2957350a937844ce331f40e"} err="failed to get container status \"5356f19249aa38a4b8c9dff260de4d55cd8fec39b2957350a937844ce331f40e\": rpc error: code = NotFound desc = could not find container \"5356f19249aa38a4b8c9dff260de4d55cd8fec39b2957350a937844ce331f40e\": container with ID starting with 5356f19249aa38a4b8c9dff260de4d55cd8fec39b2957350a937844ce331f40e not found: ID does not exist" Jun 09 08:50:44.406340 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.406081 2567 scope.go:117] "RemoveContainer" containerID="8cb2f2fe6f2b6ed30c39c15a19c12b10b8cb942d4fa5da163cd7e51c0908af7d" Jun 09 08:50:44.407062 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:50:44.406462 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8cb2f2fe6f2b6ed30c39c15a19c12b10b8cb942d4fa5da163cd7e51c0908af7d\": container with ID starting with 8cb2f2fe6f2b6ed30c39c15a19c12b10b8cb942d4fa5da163cd7e51c0908af7d not found: ID does not exist" containerID="8cb2f2fe6f2b6ed30c39c15a19c12b10b8cb942d4fa5da163cd7e51c0908af7d" Jun 09 08:50:44.407062 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.406489 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8cb2f2fe6f2b6ed30c39c15a19c12b10b8cb942d4fa5da163cd7e51c0908af7d"} err="failed to get container status \"8cb2f2fe6f2b6ed30c39c15a19c12b10b8cb942d4fa5da163cd7e51c0908af7d\": rpc error: code = NotFound desc = could not find container \"8cb2f2fe6f2b6ed30c39c15a19c12b10b8cb942d4fa5da163cd7e51c0908af7d\": container with ID starting with 8cb2f2fe6f2b6ed30c39c15a19c12b10b8cb942d4fa5da163cd7e51c0908af7d not found: ID does not exist" Jun 09 08:50:44.407062 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.406512 2567 scope.go:117] "RemoveContainer" containerID="cb1fd687b8a4eeea8d3234ee836f934b575db01139bed2124c2ca7295ff78b97" Jun 09 08:50:44.407062 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:50:44.406882 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb1fd687b8a4eeea8d3234ee836f934b575db01139bed2124c2ca7295ff78b97\": container with ID starting with cb1fd687b8a4eeea8d3234ee836f934b575db01139bed2124c2ca7295ff78b97 not found: ID does not exist" containerID="cb1fd687b8a4eeea8d3234ee836f934b575db01139bed2124c2ca7295ff78b97" Jun 09 08:50:44.407062 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.406907 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb1fd687b8a4eeea8d3234ee836f934b575db01139bed2124c2ca7295ff78b97"} err="failed to get container status \"cb1fd687b8a4eeea8d3234ee836f934b575db01139bed2124c2ca7295ff78b97\": rpc error: code = NotFound desc = could not find container \"cb1fd687b8a4eeea8d3234ee836f934b575db01139bed2124c2ca7295ff78b97\": container with ID starting with cb1fd687b8a4eeea8d3234ee836f934b575db01139bed2124c2ca7295ff78b97 not found: ID does not exist" Jun 09 08:50:44.407062 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.406927 2567 scope.go:117] "RemoveContainer" containerID="1a81e32250cc10da2dee6a9cc3055ee48b768a1a9404ab69dc6e4a78533aa8a0" Jun 09 08:50:44.407357 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:50:44.407154 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a81e32250cc10da2dee6a9cc3055ee48b768a1a9404ab69dc6e4a78533aa8a0\": container with ID starting with 1a81e32250cc10da2dee6a9cc3055ee48b768a1a9404ab69dc6e4a78533aa8a0 not found: ID does not exist" containerID="1a81e32250cc10da2dee6a9cc3055ee48b768a1a9404ab69dc6e4a78533aa8a0" Jun 09 08:50:44.407357 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.407179 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a81e32250cc10da2dee6a9cc3055ee48b768a1a9404ab69dc6e4a78533aa8a0"} err="failed to get container status \"1a81e32250cc10da2dee6a9cc3055ee48b768a1a9404ab69dc6e4a78533aa8a0\": rpc error: code = NotFound desc = could not find container \"1a81e32250cc10da2dee6a9cc3055ee48b768a1a9404ab69dc6e4a78533aa8a0\": container with ID starting with 1a81e32250cc10da2dee6a9cc3055ee48b768a1a9404ab69dc6e4a78533aa8a0 not found: ID does not exist" Jun 09 08:50:44.407357 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.407199 2567 scope.go:117] "RemoveContainer" containerID="a610c97f04a55f044d24c41e86aebce7e212dec4c63940e5777df2ff39017558" Jun 09 08:50:44.407507 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.407422 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a610c97f04a55f044d24c41e86aebce7e212dec4c63940e5777df2ff39017558"} err="failed to get container status \"a610c97f04a55f044d24c41e86aebce7e212dec4c63940e5777df2ff39017558\": rpc error: code = NotFound desc = could not find container \"a610c97f04a55f044d24c41e86aebce7e212dec4c63940e5777df2ff39017558\": container with ID starting with a610c97f04a55f044d24c41e86aebce7e212dec4c63940e5777df2ff39017558 not found: ID does not exist" Jun 09 08:50:44.407507 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.407445 2567 scope.go:117] "RemoveContainer" containerID="de7586291ba5e982ba169be45551691c8bc4d8a9efc8662ceeaa256802fe8c28" Jun 09 08:50:44.407704 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.407679 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de7586291ba5e982ba169be45551691c8bc4d8a9efc8662ceeaa256802fe8c28"} err="failed to get container status \"de7586291ba5e982ba169be45551691c8bc4d8a9efc8662ceeaa256802fe8c28\": rpc error: code = NotFound desc = could not find container \"de7586291ba5e982ba169be45551691c8bc4d8a9efc8662ceeaa256802fe8c28\": container with ID starting with de7586291ba5e982ba169be45551691c8bc4d8a9efc8662ceeaa256802fe8c28 not found: ID does not exist" Jun 09 08:50:44.407805 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.407706 2567 scope.go:117] "RemoveContainer" containerID="1b36a047cb293c78e86db77e55af73a39b63138f2cf86179d734baa5bcae299d" Jun 09 08:50:44.408017 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.407980 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b36a047cb293c78e86db77e55af73a39b63138f2cf86179d734baa5bcae299d"} err="failed to get container status \"1b36a047cb293c78e86db77e55af73a39b63138f2cf86179d734baa5bcae299d\": rpc error: code = NotFound desc = could not find container \"1b36a047cb293c78e86db77e55af73a39b63138f2cf86179d734baa5bcae299d\": container with ID starting with 1b36a047cb293c78e86db77e55af73a39b63138f2cf86179d734baa5bcae299d not found: ID does not exist" Jun 09 08:50:44.408017 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.408017 2567 scope.go:117] "RemoveContainer" containerID="5356f19249aa38a4b8c9dff260de4d55cd8fec39b2957350a937844ce331f40e" Jun 09 08:50:44.408279 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.408257 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5356f19249aa38a4b8c9dff260de4d55cd8fec39b2957350a937844ce331f40e"} err="failed to get container status \"5356f19249aa38a4b8c9dff260de4d55cd8fec39b2957350a937844ce331f40e\": rpc error: code = NotFound desc = could not find container \"5356f19249aa38a4b8c9dff260de4d55cd8fec39b2957350a937844ce331f40e\": container with ID starting with 5356f19249aa38a4b8c9dff260de4d55cd8fec39b2957350a937844ce331f40e not found: ID does not exist" Jun 09 08:50:44.408279 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.408278 2567 scope.go:117] "RemoveContainer" containerID="8cb2f2fe6f2b6ed30c39c15a19c12b10b8cb942d4fa5da163cd7e51c0908af7d" Jun 09 08:50:44.408541 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.408520 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8cb2f2fe6f2b6ed30c39c15a19c12b10b8cb942d4fa5da163cd7e51c0908af7d"} err="failed to get container status \"8cb2f2fe6f2b6ed30c39c15a19c12b10b8cb942d4fa5da163cd7e51c0908af7d\": rpc error: code = NotFound desc = could not find container \"8cb2f2fe6f2b6ed30c39c15a19c12b10b8cb942d4fa5da163cd7e51c0908af7d\": container with ID starting with 8cb2f2fe6f2b6ed30c39c15a19c12b10b8cb942d4fa5da163cd7e51c0908af7d not found: ID does not exist" Jun 09 08:50:44.408622 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.408542 2567 scope.go:117] "RemoveContainer" containerID="cb1fd687b8a4eeea8d3234ee836f934b575db01139bed2124c2ca7295ff78b97" Jun 09 08:50:44.408815 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.408797 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb1fd687b8a4eeea8d3234ee836f934b575db01139bed2124c2ca7295ff78b97"} err="failed to get container status \"cb1fd687b8a4eeea8d3234ee836f934b575db01139bed2124c2ca7295ff78b97\": rpc error: code = NotFound desc = could not find container \"cb1fd687b8a4eeea8d3234ee836f934b575db01139bed2124c2ca7295ff78b97\": container with ID starting with cb1fd687b8a4eeea8d3234ee836f934b575db01139bed2124c2ca7295ff78b97 not found: ID does not exist" Jun 09 08:50:44.408873 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.408816 2567 scope.go:117] "RemoveContainer" containerID="1a81e32250cc10da2dee6a9cc3055ee48b768a1a9404ab69dc6e4a78533aa8a0" Jun 09 08:50:44.409066 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.409045 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a81e32250cc10da2dee6a9cc3055ee48b768a1a9404ab69dc6e4a78533aa8a0"} err="failed to get container status \"1a81e32250cc10da2dee6a9cc3055ee48b768a1a9404ab69dc6e4a78533aa8a0\": rpc error: code = NotFound desc = could not find container \"1a81e32250cc10da2dee6a9cc3055ee48b768a1a9404ab69dc6e4a78533aa8a0\": container with ID starting with 1a81e32250cc10da2dee6a9cc3055ee48b768a1a9404ab69dc6e4a78533aa8a0 not found: ID does not exist" Jun 09 08:50:44.409120 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.409066 2567 scope.go:117] "RemoveContainer" containerID="a610c97f04a55f044d24c41e86aebce7e212dec4c63940e5777df2ff39017558" Jun 09 08:50:44.409289 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.409274 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a610c97f04a55f044d24c41e86aebce7e212dec4c63940e5777df2ff39017558"} err="failed to get container status \"a610c97f04a55f044d24c41e86aebce7e212dec4c63940e5777df2ff39017558\": rpc error: code = NotFound desc = could not find container \"a610c97f04a55f044d24c41e86aebce7e212dec4c63940e5777df2ff39017558\": container with ID starting with a610c97f04a55f044d24c41e86aebce7e212dec4c63940e5777df2ff39017558 not found: ID does not exist" Jun 09 08:50:44.409330 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.409290 2567 scope.go:117] "RemoveContainer" containerID="de7586291ba5e982ba169be45551691c8bc4d8a9efc8662ceeaa256802fe8c28" Jun 09 08:50:44.409506 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.409485 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de7586291ba5e982ba169be45551691c8bc4d8a9efc8662ceeaa256802fe8c28"} err="failed to get container status \"de7586291ba5e982ba169be45551691c8bc4d8a9efc8662ceeaa256802fe8c28\": rpc error: code = NotFound desc = could not find container \"de7586291ba5e982ba169be45551691c8bc4d8a9efc8662ceeaa256802fe8c28\": container with ID starting with de7586291ba5e982ba169be45551691c8bc4d8a9efc8662ceeaa256802fe8c28 not found: ID does not exist" Jun 09 08:50:44.409556 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.409508 2567 scope.go:117] "RemoveContainer" containerID="1b36a047cb293c78e86db77e55af73a39b63138f2cf86179d734baa5bcae299d" Jun 09 08:50:44.409800 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.409780 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b36a047cb293c78e86db77e55af73a39b63138f2cf86179d734baa5bcae299d"} err="failed to get container status \"1b36a047cb293c78e86db77e55af73a39b63138f2cf86179d734baa5bcae299d\": rpc error: code = NotFound desc = could not find container \"1b36a047cb293c78e86db77e55af73a39b63138f2cf86179d734baa5bcae299d\": container with ID starting with 1b36a047cb293c78e86db77e55af73a39b63138f2cf86179d734baa5bcae299d not found: ID does not exist" Jun 09 08:50:44.409800 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.409798 2567 scope.go:117] "RemoveContainer" containerID="5356f19249aa38a4b8c9dff260de4d55cd8fec39b2957350a937844ce331f40e" Jun 09 08:50:44.410042 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.410021 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5356f19249aa38a4b8c9dff260de4d55cd8fec39b2957350a937844ce331f40e"} err="failed to get container status \"5356f19249aa38a4b8c9dff260de4d55cd8fec39b2957350a937844ce331f40e\": rpc error: code = NotFound desc = could not find container \"5356f19249aa38a4b8c9dff260de4d55cd8fec39b2957350a937844ce331f40e\": container with ID starting with 5356f19249aa38a4b8c9dff260de4d55cd8fec39b2957350a937844ce331f40e not found: ID does not exist" Jun 09 08:50:44.410098 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.410043 2567 scope.go:117] "RemoveContainer" containerID="8cb2f2fe6f2b6ed30c39c15a19c12b10b8cb942d4fa5da163cd7e51c0908af7d" Jun 09 08:50:44.410251 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.410236 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8cb2f2fe6f2b6ed30c39c15a19c12b10b8cb942d4fa5da163cd7e51c0908af7d"} err="failed to get container status \"8cb2f2fe6f2b6ed30c39c15a19c12b10b8cb942d4fa5da163cd7e51c0908af7d\": rpc error: code = NotFound desc = could not find container \"8cb2f2fe6f2b6ed30c39c15a19c12b10b8cb942d4fa5da163cd7e51c0908af7d\": container with ID starting with 8cb2f2fe6f2b6ed30c39c15a19c12b10b8cb942d4fa5da163cd7e51c0908af7d not found: ID does not exist" Jun 09 08:50:44.410287 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.410252 2567 scope.go:117] "RemoveContainer" containerID="cb1fd687b8a4eeea8d3234ee836f934b575db01139bed2124c2ca7295ff78b97" Jun 09 08:50:44.410571 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.410451 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb1fd687b8a4eeea8d3234ee836f934b575db01139bed2124c2ca7295ff78b97"} err="failed to get container status \"cb1fd687b8a4eeea8d3234ee836f934b575db01139bed2124c2ca7295ff78b97\": rpc error: code = NotFound desc = could not find container \"cb1fd687b8a4eeea8d3234ee836f934b575db01139bed2124c2ca7295ff78b97\": container with ID starting with cb1fd687b8a4eeea8d3234ee836f934b575db01139bed2124c2ca7295ff78b97 not found: ID does not exist" Jun 09 08:50:44.410571 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.410467 2567 scope.go:117] "RemoveContainer" containerID="1a81e32250cc10da2dee6a9cc3055ee48b768a1a9404ab69dc6e4a78533aa8a0" Jun 09 08:50:44.410713 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.410664 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a81e32250cc10da2dee6a9cc3055ee48b768a1a9404ab69dc6e4a78533aa8a0"} err="failed to get container status \"1a81e32250cc10da2dee6a9cc3055ee48b768a1a9404ab69dc6e4a78533aa8a0\": rpc error: code = NotFound desc = could not find container \"1a81e32250cc10da2dee6a9cc3055ee48b768a1a9404ab69dc6e4a78533aa8a0\": container with ID starting with 1a81e32250cc10da2dee6a9cc3055ee48b768a1a9404ab69dc6e4a78533aa8a0 not found: ID does not exist" Jun 09 08:50:44.410713 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.410681 2567 scope.go:117] "RemoveContainer" containerID="a610c97f04a55f044d24c41e86aebce7e212dec4c63940e5777df2ff39017558" Jun 09 08:50:44.410890 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.410874 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a610c97f04a55f044d24c41e86aebce7e212dec4c63940e5777df2ff39017558"} err="failed to get container status \"a610c97f04a55f044d24c41e86aebce7e212dec4c63940e5777df2ff39017558\": rpc error: code = NotFound desc = could not find container \"a610c97f04a55f044d24c41e86aebce7e212dec4c63940e5777df2ff39017558\": container with ID starting with a610c97f04a55f044d24c41e86aebce7e212dec4c63940e5777df2ff39017558 not found: ID does not exist" Jun 09 08:50:44.410890 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.410889 2567 scope.go:117] "RemoveContainer" containerID="de7586291ba5e982ba169be45551691c8bc4d8a9efc8662ceeaa256802fe8c28" Jun 09 08:50:44.411162 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.411143 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de7586291ba5e982ba169be45551691c8bc4d8a9efc8662ceeaa256802fe8c28"} err="failed to get container status \"de7586291ba5e982ba169be45551691c8bc4d8a9efc8662ceeaa256802fe8c28\": rpc error: code = NotFound desc = could not find container \"de7586291ba5e982ba169be45551691c8bc4d8a9efc8662ceeaa256802fe8c28\": container with ID starting with de7586291ba5e982ba169be45551691c8bc4d8a9efc8662ceeaa256802fe8c28 not found: ID does not exist" Jun 09 08:50:44.411295 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.411165 2567 scope.go:117] "RemoveContainer" containerID="1b36a047cb293c78e86db77e55af73a39b63138f2cf86179d734baa5bcae299d" Jun 09 08:50:44.411295 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.411279 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:50:44.411724 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.411506 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b36a047cb293c78e86db77e55af73a39b63138f2cf86179d734baa5bcae299d"} err="failed to get container status \"1b36a047cb293c78e86db77e55af73a39b63138f2cf86179d734baa5bcae299d\": rpc error: code = NotFound desc = could not find container \"1b36a047cb293c78e86db77e55af73a39b63138f2cf86179d734baa5bcae299d\": container with ID starting with 1b36a047cb293c78e86db77e55af73a39b63138f2cf86179d734baa5bcae299d not found: ID does not exist" Jun 09 08:50:44.411724 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.411530 2567 scope.go:117] "RemoveContainer" containerID="5356f19249aa38a4b8c9dff260de4d55cd8fec39b2957350a937844ce331f40e" Jun 09 08:50:44.412051 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.412028 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5356f19249aa38a4b8c9dff260de4d55cd8fec39b2957350a937844ce331f40e"} err="failed to get container status \"5356f19249aa38a4b8c9dff260de4d55cd8fec39b2957350a937844ce331f40e\": rpc error: code = NotFound desc = could not find container \"5356f19249aa38a4b8c9dff260de4d55cd8fec39b2957350a937844ce331f40e\": container with ID starting with 5356f19249aa38a4b8c9dff260de4d55cd8fec39b2957350a937844ce331f40e not found: ID does not exist" Jun 09 08:50:44.412137 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.412055 2567 scope.go:117] "RemoveContainer" containerID="8cb2f2fe6f2b6ed30c39c15a19c12b10b8cb942d4fa5da163cd7e51c0908af7d" Jun 09 08:50:44.412306 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.412285 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8cb2f2fe6f2b6ed30c39c15a19c12b10b8cb942d4fa5da163cd7e51c0908af7d"} err="failed to get container status \"8cb2f2fe6f2b6ed30c39c15a19c12b10b8cb942d4fa5da163cd7e51c0908af7d\": rpc error: code = NotFound desc = could not find container \"8cb2f2fe6f2b6ed30c39c15a19c12b10b8cb942d4fa5da163cd7e51c0908af7d\": container with ID starting with 8cb2f2fe6f2b6ed30c39c15a19c12b10b8cb942d4fa5da163cd7e51c0908af7d not found: ID does not exist" Jun 09 08:50:44.412306 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.412304 2567 scope.go:117] "RemoveContainer" containerID="cb1fd687b8a4eeea8d3234ee836f934b575db01139bed2124c2ca7295ff78b97" Jun 09 08:50:44.412534 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.412517 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb1fd687b8a4eeea8d3234ee836f934b575db01139bed2124c2ca7295ff78b97"} err="failed to get container status \"cb1fd687b8a4eeea8d3234ee836f934b575db01139bed2124c2ca7295ff78b97\": rpc error: code = NotFound desc = could not find container \"cb1fd687b8a4eeea8d3234ee836f934b575db01139bed2124c2ca7295ff78b97\": container with ID starting with cb1fd687b8a4eeea8d3234ee836f934b575db01139bed2124c2ca7295ff78b97 not found: ID does not exist" Jun 09 08:50:44.412578 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.412535 2567 scope.go:117] "RemoveContainer" containerID="1a81e32250cc10da2dee6a9cc3055ee48b768a1a9404ab69dc6e4a78533aa8a0" Jun 09 08:50:44.412809 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.412790 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a81e32250cc10da2dee6a9cc3055ee48b768a1a9404ab69dc6e4a78533aa8a0"} err="failed to get container status \"1a81e32250cc10da2dee6a9cc3055ee48b768a1a9404ab69dc6e4a78533aa8a0\": rpc error: code = NotFound desc = could not find container \"1a81e32250cc10da2dee6a9cc3055ee48b768a1a9404ab69dc6e4a78533aa8a0\": container with ID starting with 1a81e32250cc10da2dee6a9cc3055ee48b768a1a9404ab69dc6e4a78533aa8a0 not found: ID does not exist" Jun 09 08:50:44.412809 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.412809 2567 scope.go:117] "RemoveContainer" containerID="a610c97f04a55f044d24c41e86aebce7e212dec4c63940e5777df2ff39017558" Jun 09 08:50:44.413050 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.413029 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a610c97f04a55f044d24c41e86aebce7e212dec4c63940e5777df2ff39017558"} err="failed to get container status \"a610c97f04a55f044d24c41e86aebce7e212dec4c63940e5777df2ff39017558\": rpc error: code = NotFound desc = could not find container \"a610c97f04a55f044d24c41e86aebce7e212dec4c63940e5777df2ff39017558\": container with ID starting with a610c97f04a55f044d24c41e86aebce7e212dec4c63940e5777df2ff39017558 not found: ID does not exist" Jun 09 08:50:44.413089 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.413051 2567 scope.go:117] "RemoveContainer" containerID="de7586291ba5e982ba169be45551691c8bc4d8a9efc8662ceeaa256802fe8c28" Jun 09 08:50:44.413279 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.413259 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de7586291ba5e982ba169be45551691c8bc4d8a9efc8662ceeaa256802fe8c28"} err="failed to get container status \"de7586291ba5e982ba169be45551691c8bc4d8a9efc8662ceeaa256802fe8c28\": rpc error: code = NotFound desc = could not find container \"de7586291ba5e982ba169be45551691c8bc4d8a9efc8662ceeaa256802fe8c28\": container with ID starting with de7586291ba5e982ba169be45551691c8bc4d8a9efc8662ceeaa256802fe8c28 not found: ID does not exist" Jun 09 08:50:44.413279 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.413278 2567 scope.go:117] "RemoveContainer" containerID="1b36a047cb293c78e86db77e55af73a39b63138f2cf86179d734baa5bcae299d" Jun 09 08:50:44.413486 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.413468 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b36a047cb293c78e86db77e55af73a39b63138f2cf86179d734baa5bcae299d"} err="failed to get container status \"1b36a047cb293c78e86db77e55af73a39b63138f2cf86179d734baa5bcae299d\": rpc error: code = NotFound desc = could not find container \"1b36a047cb293c78e86db77e55af73a39b63138f2cf86179d734baa5bcae299d\": container with ID starting with 1b36a047cb293c78e86db77e55af73a39b63138f2cf86179d734baa5bcae299d not found: ID does not exist" Jun 09 08:50:44.413486 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.413484 2567 scope.go:117] "RemoveContainer" containerID="5356f19249aa38a4b8c9dff260de4d55cd8fec39b2957350a937844ce331f40e" Jun 09 08:50:44.413763 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.413740 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 09 08:50:44.413860 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.413791 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 09 08:50:44.413860 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.413740 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 09 08:50:44.413971 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.413865 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5356f19249aa38a4b8c9dff260de4d55cd8fec39b2957350a937844ce331f40e"} err="failed to get container status \"5356f19249aa38a4b8c9dff260de4d55cd8fec39b2957350a937844ce331f40e\": rpc error: code = NotFound desc = could not find container \"5356f19249aa38a4b8c9dff260de4d55cd8fec39b2957350a937844ce331f40e\": container with ID starting with 5356f19249aa38a4b8c9dff260de4d55cd8fec39b2957350a937844ce331f40e not found: ID does not exist" Jun 09 08:50:44.413971 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.413890 2567 scope.go:117] "RemoveContainer" containerID="8cb2f2fe6f2b6ed30c39c15a19c12b10b8cb942d4fa5da163cd7e51c0908af7d" Jun 09 08:50:44.413971 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.413926 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 09 08:50:44.413971 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.413967 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 09 08:50:44.414158 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.413963 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 09 08:50:44.414158 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.413996 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 09 08:50:44.414158 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.414008 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-br5z9\"" Jun 09 08:50:44.414158 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.414019 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 09 08:50:44.414158 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.414133 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 09 08:50:44.414377 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.414182 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 09 08:50:44.414377 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.414191 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 09 08:50:44.414377 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.414264 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 09 08:50:44.414524 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.414431 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8cb2f2fe6f2b6ed30c39c15a19c12b10b8cb942d4fa5da163cd7e51c0908af7d"} err="failed to get container status \"8cb2f2fe6f2b6ed30c39c15a19c12b10b8cb942d4fa5da163cd7e51c0908af7d\": rpc error: code = NotFound desc = could not find container \"8cb2f2fe6f2b6ed30c39c15a19c12b10b8cb942d4fa5da163cd7e51c0908af7d\": container with ID starting with 8cb2f2fe6f2b6ed30c39c15a19c12b10b8cb942d4fa5da163cd7e51c0908af7d not found: ID does not exist" Jun 09 08:50:44.414524 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.414455 2567 scope.go:117] "RemoveContainer" containerID="cb1fd687b8a4eeea8d3234ee836f934b575db01139bed2124c2ca7295ff78b97" Jun 09 08:50:44.414765 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.414738 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb1fd687b8a4eeea8d3234ee836f934b575db01139bed2124c2ca7295ff78b97"} err="failed to get container status \"cb1fd687b8a4eeea8d3234ee836f934b575db01139bed2124c2ca7295ff78b97\": rpc error: code = NotFound desc = could not find container \"cb1fd687b8a4eeea8d3234ee836f934b575db01139bed2124c2ca7295ff78b97\": container with ID starting with cb1fd687b8a4eeea8d3234ee836f934b575db01139bed2124c2ca7295ff78b97 not found: ID does not exist" Jun 09 08:50:44.414839 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.414768 2567 scope.go:117] "RemoveContainer" containerID="1a81e32250cc10da2dee6a9cc3055ee48b768a1a9404ab69dc6e4a78533aa8a0" Jun 09 08:50:44.414972 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.414956 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4igulr3rts5g7\"" Jun 09 08:50:44.415068 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.415007 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a81e32250cc10da2dee6a9cc3055ee48b768a1a9404ab69dc6e4a78533aa8a0"} err="failed to get container status \"1a81e32250cc10da2dee6a9cc3055ee48b768a1a9404ab69dc6e4a78533aa8a0\": rpc error: code = NotFound desc = could not find container \"1a81e32250cc10da2dee6a9cc3055ee48b768a1a9404ab69dc6e4a78533aa8a0\": container with ID starting with 1a81e32250cc10da2dee6a9cc3055ee48b768a1a9404ab69dc6e4a78533aa8a0 not found: ID does not exist" Jun 09 08:50:44.415068 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.415033 2567 scope.go:117] "RemoveContainer" containerID="a610c97f04a55f044d24c41e86aebce7e212dec4c63940e5777df2ff39017558" Jun 09 08:50:44.415289 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.415269 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a610c97f04a55f044d24c41e86aebce7e212dec4c63940e5777df2ff39017558"} err="failed to get container status \"a610c97f04a55f044d24c41e86aebce7e212dec4c63940e5777df2ff39017558\": rpc error: code = NotFound desc = could not find container \"a610c97f04a55f044d24c41e86aebce7e212dec4c63940e5777df2ff39017558\": container with ID starting with a610c97f04a55f044d24c41e86aebce7e212dec4c63940e5777df2ff39017558 not found: ID does not exist" Jun 09 08:50:44.415373 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.415290 2567 scope.go:117] "RemoveContainer" containerID="de7586291ba5e982ba169be45551691c8bc4d8a9efc8662ceeaa256802fe8c28" Jun 09 08:50:44.415560 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.415541 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de7586291ba5e982ba169be45551691c8bc4d8a9efc8662ceeaa256802fe8c28"} err="failed to get container status \"de7586291ba5e982ba169be45551691c8bc4d8a9efc8662ceeaa256802fe8c28\": rpc error: code = NotFound desc = could not find container \"de7586291ba5e982ba169be45551691c8bc4d8a9efc8662ceeaa256802fe8c28\": container with ID starting with de7586291ba5e982ba169be45551691c8bc4d8a9efc8662ceeaa256802fe8c28 not found: ID does not exist" Jun 09 08:50:44.415635 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.415561 2567 scope.go:117] "RemoveContainer" containerID="1b36a047cb293c78e86db77e55af73a39b63138f2cf86179d734baa5bcae299d" Jun 09 08:50:44.415712 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.415662 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 09 08:50:44.416023 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.416002 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b36a047cb293c78e86db77e55af73a39b63138f2cf86179d734baa5bcae299d"} err="failed to get container status \"1b36a047cb293c78e86db77e55af73a39b63138f2cf86179d734baa5bcae299d\": rpc error: code = NotFound desc = could not find container \"1b36a047cb293c78e86db77e55af73a39b63138f2cf86179d734baa5bcae299d\": container with ID starting with 1b36a047cb293c78e86db77e55af73a39b63138f2cf86179d734baa5bcae299d not found: ID does not exist" Jun 09 08:50:44.416177 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.416025 2567 scope.go:117] "RemoveContainer" containerID="5356f19249aa38a4b8c9dff260de4d55cd8fec39b2957350a937844ce331f40e" Jun 09 08:50:44.416409 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.416366 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5356f19249aa38a4b8c9dff260de4d55cd8fec39b2957350a937844ce331f40e"} err="failed to get container status \"5356f19249aa38a4b8c9dff260de4d55cd8fec39b2957350a937844ce331f40e\": rpc error: code = NotFound desc = could not find container \"5356f19249aa38a4b8c9dff260de4d55cd8fec39b2957350a937844ce331f40e\": container with ID starting with 5356f19249aa38a4b8c9dff260de4d55cd8fec39b2957350a937844ce331f40e not found: ID does not exist" Jun 09 08:50:44.416409 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.416389 2567 scope.go:117] "RemoveContainer" containerID="8cb2f2fe6f2b6ed30c39c15a19c12b10b8cb942d4fa5da163cd7e51c0908af7d" Jun 09 08:50:44.416736 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.416690 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8cb2f2fe6f2b6ed30c39c15a19c12b10b8cb942d4fa5da163cd7e51c0908af7d"} err="failed to get container status \"8cb2f2fe6f2b6ed30c39c15a19c12b10b8cb942d4fa5da163cd7e51c0908af7d\": rpc error: code = NotFound desc = could not find container \"8cb2f2fe6f2b6ed30c39c15a19c12b10b8cb942d4fa5da163cd7e51c0908af7d\": container with ID starting with 8cb2f2fe6f2b6ed30c39c15a19c12b10b8cb942d4fa5da163cd7e51c0908af7d not found: ID does not exist" Jun 09 08:50:44.416736 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.416710 2567 scope.go:117] "RemoveContainer" containerID="cb1fd687b8a4eeea8d3234ee836f934b575db01139bed2124c2ca7295ff78b97" Jun 09 08:50:44.416984 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.416934 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb1fd687b8a4eeea8d3234ee836f934b575db01139bed2124c2ca7295ff78b97"} err="failed to get container status \"cb1fd687b8a4eeea8d3234ee836f934b575db01139bed2124c2ca7295ff78b97\": rpc error: code = NotFound desc = could not find container \"cb1fd687b8a4eeea8d3234ee836f934b575db01139bed2124c2ca7295ff78b97\": container with ID starting with cb1fd687b8a4eeea8d3234ee836f934b575db01139bed2124c2ca7295ff78b97 not found: ID does not exist" Jun 09 08:50:44.416984 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.416959 2567 scope.go:117] "RemoveContainer" containerID="1a81e32250cc10da2dee6a9cc3055ee48b768a1a9404ab69dc6e4a78533aa8a0" Jun 09 08:50:44.416984 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.416979 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 09 08:50:44.417314 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.417289 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a81e32250cc10da2dee6a9cc3055ee48b768a1a9404ab69dc6e4a78533aa8a0"} err="failed to get container status \"1a81e32250cc10da2dee6a9cc3055ee48b768a1a9404ab69dc6e4a78533aa8a0\": rpc error: code = NotFound desc = could not find container \"1a81e32250cc10da2dee6a9cc3055ee48b768a1a9404ab69dc6e4a78533aa8a0\": container with ID starting with 1a81e32250cc10da2dee6a9cc3055ee48b768a1a9404ab69dc6e4a78533aa8a0 not found: ID does not exist" Jun 09 08:50:44.426239 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.426208 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 09 08:50:44.427357 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.427329 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 08:50:44.556528 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.556492 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtzcb\" (UniqueName: \"kubernetes.io/projected/e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8-kube-api-access-wtzcb\") pod \"prometheus-k8s-0\" (UID: \"e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:50:44.556729 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.556535 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8-config-out\") pod \"prometheus-k8s-0\" (UID: \"e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:50:44.556729 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.556556 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:50:44.556729 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.556579 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:50:44.556729 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.556600 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:50:44.556729 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.556641 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:50:44.556729 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.556699 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:50:44.556729 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.556719 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:50:44.556980 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.556742 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:50:44.556980 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.556758 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:50:44.556980 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.556832 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:50:44.556980 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.556872 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:50:44.556980 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.556903 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:50:44.556980 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.556922 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:50:44.556980 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.556939 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8-web-config\") pod \"prometheus-k8s-0\" (UID: \"e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:50:44.556980 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.556959 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:50:44.556980 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.556980 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:50:44.557256 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.557006 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:50:44.557256 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.557026 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8-config\") pod \"prometheus-k8s-0\" (UID: \"e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:50:44.557256 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.557039 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:50:44.658017 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.657936 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:50:44.658017 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.657971 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:50:44.658017 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.657992 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:50:44.658017 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.658008 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:50:44.658300 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.658026 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8-web-config\") pod \"prometheus-k8s-0\" (UID: \"e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:50:44.658300 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.658046 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:50:44.658300 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.658067 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:50:44.658300 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.658095 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:50:44.658300 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.658116 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8-config\") pod \"prometheus-k8s-0\" (UID: \"e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:50:44.658300 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.658129 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:50:44.658300 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.658155 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtzcb\" (UniqueName: \"kubernetes.io/projected/e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8-kube-api-access-wtzcb\") pod \"prometheus-k8s-0\" (UID: \"e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:50:44.658300 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.658179 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8-config-out\") pod \"prometheus-k8s-0\" (UID: \"e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:50:44.658892 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.658861 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:50:44.659063 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.659026 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:50:44.659387 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.659361 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:50:44.661476 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.661424 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:50:44.661476 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.661432 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8-config\") pod \"prometheus-k8s-0\" (UID: \"e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:50:44.661476 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.661431 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8-config-out\") pod \"prometheus-k8s-0\" (UID: \"e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:50:44.661728 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.661477 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8-web-config\") pod \"prometheus-k8s-0\" (UID: \"e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:50:44.661728 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.661459 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:50:44.661728 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.661538 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:50:44.661728 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.661564 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:50:44.661728 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.661595 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:50:44.661728 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.661617 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:50:44.662829 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.662086 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:50:44.662829 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.662130 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:50:44.662829 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.662175 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:50:44.662829 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.662203 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:50:44.662829 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.662248 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:50:44.662829 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.662262 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:50:44.662829 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.662509 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:50:44.662829 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.662551 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:50:44.663280 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.662830 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:50:44.663280 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.662879 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:50:44.663280 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.663151 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:50:44.663979 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.663954 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:50:44.664101 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.664084 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:50:44.664165 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.664135 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:50:44.664973 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.664952 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:50:44.667045 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.667024 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtzcb\" (UniqueName: \"kubernetes.io/projected/e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8-kube-api-access-wtzcb\") pod \"prometheus-k8s-0\" (UID: \"e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:50:44.725230 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.725208 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:50:44.864588 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:44.864555 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 08:50:44.867794 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:50:44.867765 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7207b8d_4ea5_4ecd_a14e_d4ba6e1716c8.slice/crio-225d71d29fab768647a6ce4adab21d3eee3ab30884f6316aa4ad1307bfe7c696 WatchSource:0}: Error finding container 225d71d29fab768647a6ce4adab21d3eee3ab30884f6316aa4ad1307bfe7c696: Status 404 returned error can't find the container with id 225d71d29fab768647a6ce4adab21d3eee3ab30884f6316aa4ad1307bfe7c696 Jun 09 08:50:45.073988 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:45.073952 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9bc08187-f796-411d-8c53-a92d0cac4d6f" path="/var/lib/kubelet/pods/9bc08187-f796-411d-8c53-a92d0cac4d6f/volumes" Jun 09 08:50:45.343898 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:45.343866 2567 generic.go:356] "Generic (PLEG): container finished" podID="e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8" containerID="511f79ce46e64a1f7421d3f727e4da18ce2cd7a74f3a03946f2c972a4a589137" exitCode=0 Jun 09 08:50:45.344374 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:45.343955 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8","Type":"ContainerDied","Data":"511f79ce46e64a1f7421d3f727e4da18ce2cd7a74f3a03946f2c972a4a589137"} Jun 09 08:50:45.344374 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:45.344042 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8","Type":"ContainerStarted","Data":"225d71d29fab768647a6ce4adab21d3eee3ab30884f6316aa4ad1307bfe7c696"} Jun 09 08:50:46.353642 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:46.353605 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8","Type":"ContainerStarted","Data":"5a9b993673d8f4df457c0d1a9602f9065475df183c3ea7241d18e1115c3c172b"} Jun 09 08:50:46.354098 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:46.353705 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8","Type":"ContainerStarted","Data":"f240ab3f9781268672eec4e4195c47c6a1a1c6fae491db6c8efc150aaa16703e"} Jun 09 08:50:46.354098 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:46.353749 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8","Type":"ContainerStarted","Data":"42fb574e10bd2192b7c40d991f9d0857042fa2736d107dfd44a4be5b8c5fd5a7"} Jun 09 08:50:46.354098 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:46.353789 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8","Type":"ContainerStarted","Data":"3b246287295a7acea6c77ab11194c826344a7d7f4cf02baca9707c1db5fc71a9"} Jun 09 08:50:46.354098 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:46.353831 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8","Type":"ContainerStarted","Data":"36f45bc24aeea778a6c82e46da858b8c769bfd1ee9ea9b8b6a03227401c5804f"} Jun 09 08:50:46.354098 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:46.353869 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8","Type":"ContainerStarted","Data":"0977beb802124324d12d4a489c907d0514397f8f77e119ccaaa31fde83e89b73"} Jun 09 08:50:46.383015 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:46.382956 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.367378937 podStartE2EDuration="2.382936204s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.557267ms" isStatefulPod=false podCreationTimestamp="2026-06-09 08:50:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:50:46.381974611 +0000 UTC m=+323.826922005" watchObservedRunningTime="2026-06-09 08:50:46.382936204 +0000 UTC m=+323.827883556" Jun 09 08:50:49.725325 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:50:49.725274 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:51:03.676778 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:51:03.676734 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-c97c5c49c-fn4jw" podUID="e28b9904-750f-489c-b660-e6b1f6a5848b" containerName="registry" containerID="cri-o://7a40be77e081f1605755f71b12626bdc40de1aa31045df71daa9ed5ec2bffb3c" gracePeriod=30 Jun 09 08:51:03.924807 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:51:03.924776 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c97c5c49c-fn4jw" Jun 09 08:51:03.929949 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:51:03.929890 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e28b9904-750f-489c-b660-e6b1f6a5848b-image-registry-private-configuration\") pod \"e28b9904-750f-489c-b660-e6b1f6a5848b\" (UID: \"e28b9904-750f-489c-b660-e6b1f6a5848b\") " Jun 09 08:51:03.929949 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:51:03.929918 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e28b9904-750f-489c-b660-e6b1f6a5848b-registry-certificates\") pod \"e28b9904-750f-489c-b660-e6b1f6a5848b\" (UID: \"e28b9904-750f-489c-b660-e6b1f6a5848b\") " Jun 09 08:51:03.930125 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:51:03.929952 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e28b9904-750f-489c-b660-e6b1f6a5848b-ca-trust-extracted\") pod \"e28b9904-750f-489c-b660-e6b1f6a5848b\" (UID: \"e28b9904-750f-489c-b660-e6b1f6a5848b\") " Jun 09 08:51:03.930125 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:51:03.929969 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e28b9904-750f-489c-b660-e6b1f6a5848b-bound-sa-token\") pod \"e28b9904-750f-489c-b660-e6b1f6a5848b\" (UID: \"e28b9904-750f-489c-b660-e6b1f6a5848b\") " Jun 09 08:51:03.930125 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:51:03.930014 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jhhdq\" (UniqueName: \"kubernetes.io/projected/e28b9904-750f-489c-b660-e6b1f6a5848b-kube-api-access-jhhdq\") pod \"e28b9904-750f-489c-b660-e6b1f6a5848b\" (UID: \"e28b9904-750f-489c-b660-e6b1f6a5848b\") " Jun 09 08:51:03.930125 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:51:03.930037 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e28b9904-750f-489c-b660-e6b1f6a5848b-installation-pull-secrets\") pod \"e28b9904-750f-489c-b660-e6b1f6a5848b\" (UID: \"e28b9904-750f-489c-b660-e6b1f6a5848b\") " Jun 09 08:51:03.930125 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:51:03.930084 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e28b9904-750f-489c-b660-e6b1f6a5848b-registry-tls\") pod \"e28b9904-750f-489c-b660-e6b1f6a5848b\" (UID: \"e28b9904-750f-489c-b660-e6b1f6a5848b\") " Jun 09 08:51:03.930125 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:51:03.930116 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e28b9904-750f-489c-b660-e6b1f6a5848b-trusted-ca\") pod \"e28b9904-750f-489c-b660-e6b1f6a5848b\" (UID: \"e28b9904-750f-489c-b660-e6b1f6a5848b\") " Jun 09 08:51:03.930421 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:51:03.930307 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e28b9904-750f-489c-b660-e6b1f6a5848b-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "e28b9904-750f-489c-b660-e6b1f6a5848b" (UID: "e28b9904-750f-489c-b660-e6b1f6a5848b"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 08:51:03.930756 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:51:03.930727 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e28b9904-750f-489c-b660-e6b1f6a5848b-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "e28b9904-750f-489c-b660-e6b1f6a5848b" (UID: "e28b9904-750f-489c-b660-e6b1f6a5848b"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 08:51:03.932992 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:51:03.932956 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e28b9904-750f-489c-b660-e6b1f6a5848b-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e28b9904-750f-489c-b660-e6b1f6a5848b" (UID: "e28b9904-750f-489c-b660-e6b1f6a5848b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 08:51:03.933106 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:51:03.933085 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e28b9904-750f-489c-b660-e6b1f6a5848b-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "e28b9904-750f-489c-b660-e6b1f6a5848b" (UID: "e28b9904-750f-489c-b660-e6b1f6a5848b"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 08:51:03.933188 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:51:03.933173 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e28b9904-750f-489c-b660-e6b1f6a5848b-kube-api-access-jhhdq" (OuterVolumeSpecName: "kube-api-access-jhhdq") pod "e28b9904-750f-489c-b660-e6b1f6a5848b" (UID: "e28b9904-750f-489c-b660-e6b1f6a5848b"). InnerVolumeSpecName "kube-api-access-jhhdq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 08:51:03.933242 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:51:03.933203 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e28b9904-750f-489c-b660-e6b1f6a5848b-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "e28b9904-750f-489c-b660-e6b1f6a5848b" (UID: "e28b9904-750f-489c-b660-e6b1f6a5848b"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 08:51:03.933301 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:51:03.933245 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e28b9904-750f-489c-b660-e6b1f6a5848b-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "e28b9904-750f-489c-b660-e6b1f6a5848b" (UID: "e28b9904-750f-489c-b660-e6b1f6a5848b"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 08:51:03.938408 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:51:03.938381 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e28b9904-750f-489c-b660-e6b1f6a5848b-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "e28b9904-750f-489c-b660-e6b1f6a5848b" (UID: "e28b9904-750f-489c-b660-e6b1f6a5848b"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 08:51:04.030836 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:51:04.030787 2567 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e28b9904-750f-489c-b660-e6b1f6a5848b-ca-trust-extracted\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\"" Jun 09 08:51:04.030836 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:51:04.030831 2567 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e28b9904-750f-489c-b660-e6b1f6a5848b-bound-sa-token\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\"" Jun 09 08:51:04.030836 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:51:04.030841 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jhhdq\" (UniqueName: \"kubernetes.io/projected/e28b9904-750f-489c-b660-e6b1f6a5848b-kube-api-access-jhhdq\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\"" Jun 09 08:51:04.030836 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:51:04.030850 2567 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e28b9904-750f-489c-b660-e6b1f6a5848b-installation-pull-secrets\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\"" Jun 09 08:51:04.031098 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:51:04.030860 2567 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e28b9904-750f-489c-b660-e6b1f6a5848b-registry-tls\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\"" Jun 09 08:51:04.031098 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:51:04.030870 2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e28b9904-750f-489c-b660-e6b1f6a5848b-trusted-ca\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\"" Jun 09 08:51:04.031098 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:51:04.030879 2567 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e28b9904-750f-489c-b660-e6b1f6a5848b-image-registry-private-configuration\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\"" Jun 09 08:51:04.031098 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:51:04.030887 2567 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e28b9904-750f-489c-b660-e6b1f6a5848b-registry-certificates\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\"" Jun 09 08:51:04.435448 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:51:04.435413 2567 generic.go:356] "Generic (PLEG): container finished" podID="e28b9904-750f-489c-b660-e6b1f6a5848b" containerID="7a40be77e081f1605755f71b12626bdc40de1aa31045df71daa9ed5ec2bffb3c" exitCode=0 Jun 09 08:51:04.435603 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:51:04.435460 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c97c5c49c-fn4jw" Jun 09 08:51:04.435603 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:51:04.435493 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c97c5c49c-fn4jw" event={"ID":"e28b9904-750f-489c-b660-e6b1f6a5848b","Type":"ContainerDied","Data":"7a40be77e081f1605755f71b12626bdc40de1aa31045df71daa9ed5ec2bffb3c"} Jun 09 08:51:04.435603 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:51:04.435542 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c97c5c49c-fn4jw" event={"ID":"e28b9904-750f-489c-b660-e6b1f6a5848b","Type":"ContainerDied","Data":"6b8e1b76386d2c0deaa961b32cf859b1d3a1db2a4548fb5ecd27ad4fe918e5ab"} Jun 09 08:51:04.435603 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:51:04.435562 2567 scope.go:117] "RemoveContainer" containerID="7a40be77e081f1605755f71b12626bdc40de1aa31045df71daa9ed5ec2bffb3c" Jun 09 08:51:04.444672 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:51:04.444633 2567 scope.go:117] "RemoveContainer" containerID="7a40be77e081f1605755f71b12626bdc40de1aa31045df71daa9ed5ec2bffb3c" Jun 09 08:51:04.444938 ip-10-0-140-114 kubenswrapper[2567]: E0609 08:51:04.444919 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a40be77e081f1605755f71b12626bdc40de1aa31045df71daa9ed5ec2bffb3c\": container with ID starting with 7a40be77e081f1605755f71b12626bdc40de1aa31045df71daa9ed5ec2bffb3c not found: ID does not exist" containerID="7a40be77e081f1605755f71b12626bdc40de1aa31045df71daa9ed5ec2bffb3c" Jun 09 08:51:04.444994 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:51:04.444946 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a40be77e081f1605755f71b12626bdc40de1aa31045df71daa9ed5ec2bffb3c"} err="failed to get container status \"7a40be77e081f1605755f71b12626bdc40de1aa31045df71daa9ed5ec2bffb3c\": rpc error: code = NotFound desc = could not find container \"7a40be77e081f1605755f71b12626bdc40de1aa31045df71daa9ed5ec2bffb3c\": container with ID starting with 7a40be77e081f1605755f71b12626bdc40de1aa31045df71daa9ed5ec2bffb3c not found: ID does not exist" Jun 09 08:51:04.456448 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:51:04.456424 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-c97c5c49c-fn4jw"] Jun 09 08:51:04.460028 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:51:04.460006 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-c97c5c49c-fn4jw"] Jun 09 08:51:05.074134 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:51:05.074103 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e28b9904-750f-489c-b660-e6b1f6a5848b" path="/var/lib/kubelet/pods/e28b9904-750f-489c-b660-e6b1f6a5848b/volumes" Jun 09 08:51:44.725536 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:51:44.725496 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:51:44.741170 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:51:44.741141 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:51:45.618901 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:51:45.618874 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 08:52:47.676559 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:52:47.676475 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-grvqt_ae90f658-436b-42fc-b170-318cd82d55b1/global-pull-secret-syncer/0.log" Jun 09 08:52:47.826886 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:52:47.826857 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-cct9r_849de24e-c8a4-4afd-a40b-45f1f35290b5/konnectivity-agent/0.log" Jun 09 08:52:47.917621 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:52:47.917591 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-114.ec2.internal_2b5ea2489658268516287fa452cb2cb5/haproxy/0.log" Jun 09 08:52:51.503218 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:52:51.503141 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-x2fqm_a6855c96-c4f2-4650-bda3-95ce7db1d9da/cluster-monitoring-operator/0.log" Jun 09 08:52:51.529405 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:52:51.529377 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-tz7sc_a33e2374-26ae-4bee-890f-b8fe15b36547/kube-state-metrics/0.log" Jun 09 08:52:51.549932 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:52:51.549909 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-tz7sc_a33e2374-26ae-4bee-890f-b8fe15b36547/kube-rbac-proxy-main/0.log" Jun 09 08:52:51.571876 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:52:51.571853 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-tz7sc_a33e2374-26ae-4bee-890f-b8fe15b36547/kube-rbac-proxy-self/0.log" Jun 09 08:52:51.654170 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:52:51.654149 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-rls65_32722df9-425b-407a-bbf7-e15e1abb9252/monitoring-plugin/0.log" Jun 09 08:52:51.770796 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:52:51.770723 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nfgmq_55c367b2-677c-43bd-b3c2-78a08c0276bd/node-exporter/0.log" Jun 09 08:52:51.790595 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:52:51.790575 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nfgmq_55c367b2-677c-43bd-b3c2-78a08c0276bd/kube-rbac-proxy/0.log" Jun 09 08:52:51.815845 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:52:51.815819 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nfgmq_55c367b2-677c-43bd-b3c2-78a08c0276bd/init-textfile/0.log" Jun 09 08:52:51.954521 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:52:51.954494 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-zq2zq_a69dbc83-8dbf-41fb-8089-cc84b3d14f3c/kube-rbac-proxy-main/0.log" Jun 09 08:52:51.975857 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:52:51.975824 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-zq2zq_a69dbc83-8dbf-41fb-8089-cc84b3d14f3c/kube-rbac-proxy-self/0.log" Jun 09 08:52:51.999934 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:52:51.999908 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-zq2zq_a69dbc83-8dbf-41fb-8089-cc84b3d14f3c/openshift-state-metrics/0.log" Jun 09 08:52:52.035029 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:52:52.034959 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8/prometheus/0.log" Jun 09 08:52:52.056712 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:52:52.056688 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8/config-reloader/0.log" Jun 09 08:52:52.077489 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:52:52.077467 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8/thanos-sidecar/0.log" Jun 09 08:52:52.097565 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:52:52.097542 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8/kube-rbac-proxy-web/0.log" Jun 09 08:52:52.117133 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:52:52.117107 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8/kube-rbac-proxy/0.log" Jun 09 08:52:52.137139 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:52:52.137116 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8/kube-rbac-proxy-thanos/0.log" Jun 09 08:52:52.158695 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:52:52.158644 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e7207b8d-4ea5-4ecd-a14e-d4ba6e1716c8/init-config-reloader/0.log" Jun 09 08:52:52.184326 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:52:52.184298 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-6zxrs_ef91a01e-4bac-4f0e-abd0-b6e19b454dcc/prometheus-operator/0.log" Jun 09 08:52:52.206828 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:52:52.206798 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-6zxrs_ef91a01e-4bac-4f0e-abd0-b6e19b454dcc/kube-rbac-proxy/0.log" Jun 09 08:52:52.230539 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:52:52.230512 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-85png_9a484e5e-e35f-49e5-917d-14725c068d43/prometheus-operator-admission-webhook/0.log" Jun 09 08:52:52.341679 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:52:52.341622 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-db779c74f-bkk6m_d83de3c6-c5e2-4e91-a8e2-0e347568ea69/thanos-query/0.log" Jun 09 08:52:52.364709 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:52:52.364684 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-db779c74f-bkk6m_d83de3c6-c5e2-4e91-a8e2-0e347568ea69/kube-rbac-proxy-web/0.log" Jun 09 08:52:52.387072 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:52:52.387049 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-db779c74f-bkk6m_d83de3c6-c5e2-4e91-a8e2-0e347568ea69/kube-rbac-proxy/0.log" Jun 09 08:52:52.409746 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:52:52.409718 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-db779c74f-bkk6m_d83de3c6-c5e2-4e91-a8e2-0e347568ea69/prom-label-proxy/0.log" Jun 09 08:52:52.429771 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:52:52.429753 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-db779c74f-bkk6m_d83de3c6-c5e2-4e91-a8e2-0e347568ea69/kube-rbac-proxy-rules/0.log" Jun 09 08:52:52.450437 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:52:52.450411 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-db779c74f-bkk6m_d83de3c6-c5e2-4e91-a8e2-0e347568ea69/kube-rbac-proxy-metrics/0.log" Jun 09 08:52:54.486909 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:52:54.486872 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-qxtw7_64cc3732-bece-4942-a855-126c460e9d38/download-server/0.log" Jun 09 08:52:54.923708 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:52:54.923682 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-tr52t_bc7c68b8-62b9-47b5-a562-f9baf876d223/volume-data-source-validator/0.log" Jun 09 08:52:55.048994 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:52:55.048957 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-p7tv7/perf-node-gather-daemonset-gmgx7"] Jun 09 08:52:55.049341 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:52:55.049328 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e28b9904-750f-489c-b660-e6b1f6a5848b" containerName="registry" Jun 09 08:52:55.049391 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:52:55.049343 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e28b9904-750f-489c-b660-e6b1f6a5848b" containerName="registry" Jun 09 08:52:55.049430 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:52:55.049403 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="e28b9904-750f-489c-b660-e6b1f6a5848b" containerName="registry" Jun 09 08:52:55.052411 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:52:55.052389 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p7tv7/perf-node-gather-daemonset-gmgx7" Jun 09 08:52:55.054627 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:52:55.054608 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-p7tv7\"/\"kube-root-ca.crt\"" Jun 09 08:52:55.055309 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:52:55.055291 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-p7tv7\"/\"default-dockercfg-rvg4q\"" Jun 09 08:52:55.055309 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:52:55.055306 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-p7tv7\"/\"openshift-service-ca.crt\"" Jun 09 08:52:55.063308 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:52:55.063271 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p7tv7/perf-node-gather-daemonset-gmgx7"] Jun 09 08:52:55.077432 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:52:55.077395 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6a325ebc-e299-43f6-ac03-b9d7526823c7-proc\") pod \"perf-node-gather-daemonset-gmgx7\" (UID: \"6a325ebc-e299-43f6-ac03-b9d7526823c7\") " pod="openshift-must-gather-p7tv7/perf-node-gather-daemonset-gmgx7" Jun 09 08:52:55.077597 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:52:55.077508 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6a325ebc-e299-43f6-ac03-b9d7526823c7-sys\") pod \"perf-node-gather-daemonset-gmgx7\" (UID: \"6a325ebc-e299-43f6-ac03-b9d7526823c7\") " pod="openshift-must-gather-p7tv7/perf-node-gather-daemonset-gmgx7" Jun 09 08:52:55.077597 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:52:55.077582 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6a325ebc-e299-43f6-ac03-b9d7526823c7-podres\") pod \"perf-node-gather-daemonset-gmgx7\" (UID: \"6a325ebc-e299-43f6-ac03-b9d7526823c7\") " pod="openshift-must-gather-p7tv7/perf-node-gather-daemonset-gmgx7" Jun 09 08:52:55.077750 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:52:55.077608 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6a325ebc-e299-43f6-ac03-b9d7526823c7-lib-modules\") pod \"perf-node-gather-daemonset-gmgx7\" (UID: \"6a325ebc-e299-43f6-ac03-b9d7526823c7\") " pod="openshift-must-gather-p7tv7/perf-node-gather-daemonset-gmgx7" Jun 09 08:52:55.077750 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:52:55.077677 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzbhf\" (UniqueName: \"kubernetes.io/projected/6a325ebc-e299-43f6-ac03-b9d7526823c7-kube-api-access-nzbhf\") pod \"perf-node-gather-daemonset-gmgx7\" (UID: \"6a325ebc-e299-43f6-ac03-b9d7526823c7\") " pod="openshift-must-gather-p7tv7/perf-node-gather-daemonset-gmgx7" Jun 09 08:52:55.178209 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:52:55.178113 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6a325ebc-e299-43f6-ac03-b9d7526823c7-podres\") pod \"perf-node-gather-daemonset-gmgx7\" (UID: \"6a325ebc-e299-43f6-ac03-b9d7526823c7\") " pod="openshift-must-gather-p7tv7/perf-node-gather-daemonset-gmgx7" Jun 09 08:52:55.178209 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:52:55.178158 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6a325ebc-e299-43f6-ac03-b9d7526823c7-lib-modules\") pod \"perf-node-gather-daemonset-gmgx7\" (UID: \"6a325ebc-e299-43f6-ac03-b9d7526823c7\") " pod="openshift-must-gather-p7tv7/perf-node-gather-daemonset-gmgx7" Jun 09 08:52:55.178209 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:52:55.178192 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzbhf\" (UniqueName: \"kubernetes.io/projected/6a325ebc-e299-43f6-ac03-b9d7526823c7-kube-api-access-nzbhf\") pod \"perf-node-gather-daemonset-gmgx7\" (UID: \"6a325ebc-e299-43f6-ac03-b9d7526823c7\") " pod="openshift-must-gather-p7tv7/perf-node-gather-daemonset-gmgx7" Jun 09 08:52:55.178488 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:52:55.178233 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6a325ebc-e299-43f6-ac03-b9d7526823c7-proc\") pod \"perf-node-gather-daemonset-gmgx7\" (UID: \"6a325ebc-e299-43f6-ac03-b9d7526823c7\") " pod="openshift-must-gather-p7tv7/perf-node-gather-daemonset-gmgx7" Jun 09 08:52:55.178488 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:52:55.178283 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6a325ebc-e299-43f6-ac03-b9d7526823c7-podres\") pod \"perf-node-gather-daemonset-gmgx7\" (UID: \"6a325ebc-e299-43f6-ac03-b9d7526823c7\") " pod="openshift-must-gather-p7tv7/perf-node-gather-daemonset-gmgx7" Jun 09 08:52:55.178488 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:52:55.178301 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6a325ebc-e299-43f6-ac03-b9d7526823c7-sys\") pod \"perf-node-gather-daemonset-gmgx7\" (UID: \"6a325ebc-e299-43f6-ac03-b9d7526823c7\") " pod="openshift-must-gather-p7tv7/perf-node-gather-daemonset-gmgx7" Jun 09 08:52:55.178488 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:52:55.178339 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6a325ebc-e299-43f6-ac03-b9d7526823c7-proc\") pod \"perf-node-gather-daemonset-gmgx7\" (UID: \"6a325ebc-e299-43f6-ac03-b9d7526823c7\") " pod="openshift-must-gather-p7tv7/perf-node-gather-daemonset-gmgx7" Jun 09 08:52:55.178488 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:52:55.178358 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6a325ebc-e299-43f6-ac03-b9d7526823c7-lib-modules\") pod \"perf-node-gather-daemonset-gmgx7\" (UID: \"6a325ebc-e299-43f6-ac03-b9d7526823c7\") " pod="openshift-must-gather-p7tv7/perf-node-gather-daemonset-gmgx7" Jun 09 08:52:55.178488 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:52:55.178420 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6a325ebc-e299-43f6-ac03-b9d7526823c7-sys\") pod \"perf-node-gather-daemonset-gmgx7\" (UID: \"6a325ebc-e299-43f6-ac03-b9d7526823c7\") " pod="openshift-must-gather-p7tv7/perf-node-gather-daemonset-gmgx7" Jun 09 08:52:55.188021 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:52:55.187998 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzbhf\" (UniqueName: \"kubernetes.io/projected/6a325ebc-e299-43f6-ac03-b9d7526823c7-kube-api-access-nzbhf\") pod \"perf-node-gather-daemonset-gmgx7\" (UID: \"6a325ebc-e299-43f6-ac03-b9d7526823c7\") " pod="openshift-must-gather-p7tv7/perf-node-gather-daemonset-gmgx7" Jun 09 08:52:55.362258 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:52:55.362212 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p7tv7/perf-node-gather-daemonset-gmgx7" Jun 09 08:52:55.496850 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:52:55.496822 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p7tv7/perf-node-gather-daemonset-gmgx7"] Jun 09 08:52:55.499388 ip-10-0-140-114 kubenswrapper[2567]: W0609 08:52:55.499359 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6a325ebc_e299_43f6_ac03_b9d7526823c7.slice/crio-874ad72d19d9e951dd6735eb412a28677b80c9a45c01a181ca42b3f6f57bfe90 WatchSource:0}: Error finding container 874ad72d19d9e951dd6735eb412a28677b80c9a45c01a181ca42b3f6f57bfe90: Status 404 returned error can't find the container with id 874ad72d19d9e951dd6735eb412a28677b80c9a45c01a181ca42b3f6f57bfe90 Jun 09 08:52:55.803718 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:52:55.803601 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nsxkc_16df8afb-8164-41fd-9d0d-005830dda96c/dns/0.log" Jun 09 08:52:55.824674 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:52:55.824629 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nsxkc_16df8afb-8164-41fd-9d0d-005830dda96c/kube-rbac-proxy/0.log" Jun 09 08:52:55.845465 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:52:55.845438 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6l4gp_5c8cf271-8ccb-42a2-abe4-fe6565f5346b/dns-node-resolver/0.log" Jun 09 08:52:55.892982 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:52:55.892950 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p7tv7/perf-node-gather-daemonset-gmgx7" event={"ID":"6a325ebc-e299-43f6-ac03-b9d7526823c7","Type":"ContainerStarted","Data":"ed6e9b55203cd760cdf4f1efa6e50a8004104e47bb5689ee77b6fb6cb05a90fb"} Jun 09 08:52:55.893130 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:52:55.893002 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p7tv7/perf-node-gather-daemonset-gmgx7" event={"ID":"6a325ebc-e299-43f6-ac03-b9d7526823c7","Type":"ContainerStarted","Data":"874ad72d19d9e951dd6735eb412a28677b80c9a45c01a181ca42b3f6f57bfe90"} Jun 09 08:52:55.893130 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:52:55.893077 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-p7tv7/perf-node-gather-daemonset-gmgx7" Jun 09 08:52:55.907826 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:52:55.907782 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-p7tv7/perf-node-gather-daemonset-gmgx7" podStartSLOduration=0.907767251 podStartE2EDuration="907.767251ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 08:52:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:52:55.906185479 +0000 UTC m=+453.351132838" watchObservedRunningTime="2026-06-09 08:52:55.907767251 +0000 UTC m=+453.352714600" Jun 09 08:52:56.284810 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:52:56.284781 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ghb2d_c1eca8fd-ed14-4a3b-a17b-bf84f42f7302/node-ca/0.log" Jun 09 08:52:57.273988 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:52:57.273961 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zmgdk_434a609b-dd30-4747-96b8-ce766267866d/serve-healthcheck-canary/0.log" Jun 09 08:52:57.583819 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:52:57.583794 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-pdvps_f3bf0a1a-491b-4abe-bb6f-7064fe8ac166/insights-operator/1.log" Jun 09 08:52:57.589322 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:52:57.589293 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-pdvps_f3bf0a1a-491b-4abe-bb6f-7064fe8ac166/insights-operator/0.log" Jun 09 08:52:57.607878 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:52:57.607848 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6mxzw_1067dd40-c47a-489f-b027-34b793b71c40/kube-rbac-proxy/0.log" Jun 09 08:52:57.626723 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:52:57.626699 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6mxzw_1067dd40-c47a-489f-b027-34b793b71c40/exporter/0.log" Jun 09 08:52:57.647359 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:52:57.647333 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6mxzw_1067dd40-c47a-489f-b027-34b793b71c40/extractor/0.log" Jun 09 08:53:01.905796 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:53:01.905769 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-p7tv7/perf-node-gather-daemonset-gmgx7" Jun 09 08:53:02.492544 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:53:02.492514 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jf7vr_2505c746-7f3b-4dcc-a6a1-956885ca7fc3/kube-multus-additional-cni-plugins/0.log" Jun 09 08:53:02.517227 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:53:02.517199 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jf7vr_2505c746-7f3b-4dcc-a6a1-956885ca7fc3/egress-router-binary-copy/0.log" Jun 09 08:53:02.542304 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:53:02.542278 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jf7vr_2505c746-7f3b-4dcc-a6a1-956885ca7fc3/cni-plugins/0.log" Jun 09 08:53:02.566623 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:53:02.566600 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jf7vr_2505c746-7f3b-4dcc-a6a1-956885ca7fc3/bond-cni-plugin/0.log" Jun 09 08:53:02.587863 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:53:02.587833 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jf7vr_2505c746-7f3b-4dcc-a6a1-956885ca7fc3/routeoverride-cni/0.log" Jun 09 08:53:02.609821 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:53:02.609793 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jf7vr_2505c746-7f3b-4dcc-a6a1-956885ca7fc3/whereabouts-cni-bincopy/0.log" Jun 09 08:53:02.630411 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:53:02.630380 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jf7vr_2505c746-7f3b-4dcc-a6a1-956885ca7fc3/whereabouts-cni/0.log" Jun 09 08:53:02.991057 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:53:02.991029 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-fc2mh_08a58dd1-4ebb-4a3f-a35a-24c6a035ca2e/kube-multus/0.log" Jun 09 08:53:03.124017 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:53:03.123988 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qchhg_955c937e-7a98-4e3a-b4bb-52e78c5ac289/network-metrics-daemon/0.log" Jun 09 08:53:03.144235 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:53:03.144194 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qchhg_955c937e-7a98-4e3a-b4bb-52e78c5ac289/kube-rbac-proxy/0.log" Jun 09 08:53:04.136606 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:53:04.136575 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rldts_ac21d247-409c-489e-8d3a-396c01dee935/ovn-controller/0.log" Jun 09 08:53:04.155790 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:53:04.155760 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rldts_ac21d247-409c-489e-8d3a-396c01dee935/ovn-acl-logging/0.log" Jun 09 08:53:04.179010 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:53:04.178985 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rldts_ac21d247-409c-489e-8d3a-396c01dee935/kube-rbac-proxy-node/0.log" Jun 09 08:53:04.200878 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:53:04.200853 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rldts_ac21d247-409c-489e-8d3a-396c01dee935/kube-rbac-proxy-ovn-metrics/0.log" Jun 09 08:53:04.221479 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:53:04.221456 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rldts_ac21d247-409c-489e-8d3a-396c01dee935/northd/0.log" Jun 09 08:53:04.241549 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:53:04.241528 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rldts_ac21d247-409c-489e-8d3a-396c01dee935/nbdb/0.log" Jun 09 08:53:04.264470 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:53:04.264444 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rldts_ac21d247-409c-489e-8d3a-396c01dee935/sbdb/0.log" Jun 09 08:53:04.307545 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:53:04.307525 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rldts_ac21d247-409c-489e-8d3a-396c01dee935/ovnkube-controller/0.log" Jun 09 08:53:05.415380 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:53:05.415352 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-dbd9cf844-bdkvt_07afa869-7b21-4f9d-a861-2ff5757149f3/check-endpoints/0.log" Jun 09 08:53:05.438682 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:53:05.438643 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-4jvm8_8593ba17-a4fb-4caf-a018-e1e93147ffca/network-check-target-container/0.log" Jun 09 08:53:06.285703 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:53:06.285673 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-v6bhs_c9696892-a39d-47db-9799-69ad596e65b8/iptables-alerter/0.log" Jun 09 08:53:06.934120 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:53:06.934065 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-7f5qb_ac799a26-bfc2-45ee-806d-771558fabc2a/tuned/0.log" Jun 09 08:53:08.512169 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:53:08.512140 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-854f8b96b6-vzzjj_f0b23720-7d48-4020-a608-c0348551c543/cluster-samples-operator/0.log" Jun 09 08:53:08.528542 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:53:08.528508 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-854f8b96b6-vzzjj_f0b23720-7d48-4020-a608-c0348551c543/cluster-samples-operator-watch/0.log" Jun 09 08:53:09.392260 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:53:09.392220 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-6bc5ff68f5-pbsns_28bee076-40fc-40d5-a80c-1b9867359d6c/service-ca-operator/1.log" Jun 09 08:53:09.393021 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:53:09.393003 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-6bc5ff68f5-pbsns_28bee076-40fc-40d5-a80c-1b9867359d6c/service-ca-operator/0.log" Jun 09 08:53:09.663605 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:53:09.663518 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca_service-ca-7d74d578b8-kszsj_ce9c041a-8702-4ea3-b5b8-48dced93bbd4/service-ca-controller/0.log" Jun 09 08:53:10.065914 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:53:10.065887 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-p6x82_0ad0de63-3d32-4927-9f79-8f848b6f52f4/csi-driver/0.log" Jun 09 08:53:10.086350 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:53:10.086324 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-p6x82_0ad0de63-3d32-4927-9f79-8f848b6f52f4/csi-node-driver-registrar/0.log" Jun 09 08:53:10.106486 ip-10-0-140-114 kubenswrapper[2567]: I0609 08:53:10.106453 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-p6x82_0ad0de63-3d32-4927-9f79-8f848b6f52f4/csi-liveness-probe/0.log"